Oh... hey there ElasticSearchers :)
Ok, so I'm thinking about using ES for looking up geo info about IP
addresses. And I'm just wondering if someone has had some experience
they would like to share.
Or, if you have some insights on how this would be achieved, that
would be cool too.
The way I see it, there are three broad dimensions:
1) Converting CSV to JSON
- most of the GeoIP databases provide the data in csv
- how to bulk convert
2) Massive amount of documents
- some of these databases can contain 6Million+ files/documents
- include all in one index or spread across several indices for
better performance
3) Query Formulation
- many of the IP addresses in these documents are expressed in ranges
- e.g. 182.242.522.100/99
- how to formulate query/filter so that it interprets this as a range
and returns true if IP address within that range
Suggestions on any of these aspects are all welcome.
Cheers,
Ted
(74 lines) Oct 26, 2010 11:36
(98 lines) Oct 26, 2010 12:03
(117 lines) Oct 26, 2010 14:36
(151 lines) Oct 26, 2010 17:46
(187 lines) Oct 26, 2010 18:42