Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

ElasticSearch and GeoIpSearch

Background merge hit exception
(123 lines)
test post
(4 lines)
Oct 26, 2010
Ted Karmel
Ted Karmel
Oh... hey there ElasticSearchers :)

Ok, so I'm thinking about using ES for looking up geo info about IP
addresses.  And I'm just wondering if someone has had some experience
they would like to share.

Or, if you have some insights on how this would be achieved, that
would be cool too.

The way I see it, there are three broad dimensions:

1)  Converting CSV to JSON
-  most of the GeoIP databases provide the data in csv
-  how to bulk convert

2)  Massive amount of documents
-  some of these databases can contain 6Million+ files/documents
-  include all in one index or spread across several indices for
better performance

3)  Query Formulation
-  many of the IP addresses in these documents are expressed in ranges
-  e.g. 182.242.522.100/99
-  how to formulate query/filter so that it interprets this as a range
and returns true if IP address within that range


Suggestions on any of these aspects are all welcome.


Cheers,
Ted


Reply
Tags: geo infoip addressesinsights
Messages in this thread
ElasticSearch and GeoIpSearch
reply Re: ElasticSearch and GeoIpSearch
(74 lines) Oct 26, 2010 11:36
reply Re: ElasticSearch and GeoIpSearch
(98 lines) Oct 26, 2010 12:03
reply Re: ElasticSearch and GeoIpSearch
(117 lines) Oct 26, 2010 14:36
reply Re: ElasticSearch and GeoIpSearch
(151 lines) Oct 26, 2010 17:46
reply Re: ElasticSearch and GeoIpSearch
(187 lines) Oct 26, 2010 18:42
Similar Threads
CouchDB ElasticSearch Integration Howto
Hi, ElasticSearch has added a feature which directly indexes couchdb documents. ElasticSearch listens on the CouchDB _changes interface and indexes the docs. This feature has undergone some changes in the current development series. So,…