Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

Search the http://elasticsearch.org website with elasticsearch itself

¿Expected results?
(18 lines)
Feb 11, 2011
Karel Minařík
Karel Minařík
Hi,

I've spent couple of hours during the last days with implementing an
ElasticSearch-backed search for the ES website (so it could be
“self-hosted”, so to speak), as we have been talking about it on IRC
the other day.

First, you can try the functionality here:

--> http://elasticsearch.karmi.cz/

The query is passed directly as a query string parameter to ES, so you can
try any Lucene-compatible query.

The code for the demo is available here:
https://github.com/karmi/elasticsearc...:master...search.
The autocomplete + results display is done with heavily stylized jQuery-UI
Autocomplete. It's kinda invasive, but works. Would be nice to rewrite it,
though.

The content was insterted into ES with this Ruby library:
https://github.com/karmi/hide, it leverages the Jekyll gem to gather info
about the pages, so the usage is trivial. It uses the
https://github.com/karmi/slingshot gem to insert docs into ES (see
https://github.com/karmi/hide/blob/master/lib/hide/indexer.rb).

For the real use, I think the following would need to be done:

* Get hold of some VPS or other server to run the ES server. This is the
least of a problem, either me or @clintongormley can provide one.
* A redesign of the results window, color-differentiate the different
categories (blog, guide)
* Displaying a highlight of term instead of URL
* Creating an HTTP endpoint for Github post-receive hook, which pulls new
content from Github whenever there's a push into the repo, and re-indexes
accordingly.

For the optimal case, it would be nice to have checkboxes to allow search
in "guides" etc only, @lukasvlcek suggested indexing also Github issues, it
would be nice to have prettier GUI, etc etc etc.

What does everybody think, is it worthwile to continue with this? Any
ideas, suggestions?

Karel



Reply
Tags: last days
Messages in this thread
Search the http://elasticsearch.org website with elasticsearch itself
geo search not working for current version of ElasticSearch (< 0.11.0)
February 4, 2011 07:03:17 PM
I am very new to ElasticSearch, and trying to test the geo functionality. I've looked at the documentation and other posts and cobbled together a test that fails on 0.14.4. Going back through the older versions, the following test does work with…
opposite links in http://www.elasticsearch.org/guide/appendix/building-from-source.html
February 9, 2011 10:39:35 AM
Shay, a small fyi, the links for the zip and tar.gz are opposite ( "...code in either zip or tar.gz." ), not sure if this is the right place to say that, though. :-)
ElasticSearch and GeoIpSearch
October 26, 2010 11:03:07 AM
Oh... hey there ElasticSearchers :) Ok, so I'm thinking about using ES for looking up geo info about IP addresses. And I'm just wondering if someone has had some experience they would like to share. Or, if you have some insights on how this…
Anyone using ElasticSearch with Mongodb?
November 28, 2010 04:49:53 AM
I would be very interested to hear the paths that you guys have chosen for full text search on Mongodb documents. Anyone using ElasticSearch for the same? If yes can you throw some light on your experience as well as how you have done it. Would…
From Compass to ElasticSearch
January 11, 2011 09:19:18 AM
(I hope this post didn't sent twice..) Hello, I would like to migrate an app I wrote using Compass to work with ElasticSearch (the Java API). I did some searches and experiments, but failed to find the answers, so can you point me to relevant…
ElasticSearch 0.11.0 Released
September 28, 2010 03:44:32 PM
Hi, 0.11 is out, more details here: http://www.elasticsearch.com/blog/2010/09/29/0.11.0-released.html. -shay.banon
ElasticSearch 0.14.1 Released
December 29, 2010 06:12:05 AM
Hi, Just released a bug fix for 0.14.0 version that was just released. It fixed a major regression in the REST create index API. Details of the regression are here: https://github.com/elasticsearch/elasticsearch/issues/closed#issue/578 . sorry…
ElasticSearch Geo and rabbitMQ
December 30, 2010 08:47:03 AM
hi all, i'm new to elasticsearch and i'm looking for some directions. i would like to integrate geo searches into rabbitmq and since elasticsearch has integration for both i thought it could be the solution i am looking for. although there are some…
ElasticSearch 0.14 Released
December 28, 2010 04:00:15 AM
Hi, ElasticSearch 0.14 released, see more here: http://www.elasticsearch.com/blog/2010/12/27/0.14.0-released.html. cheers, -shay.banon
ElasticSearch 0.14.2 Released
January 5, 2011 03:51:05 PM
Hi, 0.14.2 is out, fixing a major bug in highlighting: https://github.com/elasticsearch/elasticsearch/issues/closed#issue/600 . There are also bug fixes and minor features added to this release, all found here:…
ElasticSearch 0.13.1 Released
December 3, 2010 01:46:16 PM
Hi, ElasticSearch 0.13.1 released with one major change, upgrading the Lucene version from 3.0.2 to 3.0.3. The new Lucene version fixes two important bugs, the first is a memory leak that happens when running a long indexing session, and the…
elasticsearch-head – new GUI up on GitHub
January 16, 2011 10:03:42 PM
Hi, just thought I'd pass on some info, one our our intrepid UI engineers at Aconex is building for us a useful in house tool to combine with our upcoming use of Flume->ElasticSearch, and we've licensed it under ASL 2. …
org.elasticsearch.action.UnavailableShardsException
January 7, 2011 12:59:43 AM
Hi, Before doing any configuration my example was eorking well. I configured my elasticsearch.yml as follows: node: data: true index : number_of_shards : 3 number_of_replicas : 2 I am getting the following error: Exception in thread…
ElasticSearch.pm v 0.23 is out - big performance boost
October 19, 2010 05:12:17 PM
Hi all ElasticSearch.pm (the Perl API to ElasticSearch) is out here: http://search.cpan.org/~drtech/ElasticSearch-0.23/lib/ElasticSearch.p m It comes with a large performance boost, from bulk() indexing, and a different backend. You can read…
Elastica - PHP client for elasticsearch
October 20, 2010 06:49:41 AM
Hi I published my PHP client for elasticsearch named Elastica to github. The client is still in development but it I'm already using it in two installations. The difference to the PHP client from nervetattoo is that it integrates easily with Zend…
Few Querys related to ElasticSearch
November 29, 2010 05:08:48 AM
Hi Would appreciate if any of you can share your experience / thoughts on below questions: 1. REST Api vs Java api - Have read that Java api is much faster as it works at a lower level protocol. Do you guys have any comparison? 2. What approach do…
Hosting and securing ElasticSearch.
January 31, 2011 11:59:04 AM
This is a multi-part message in MIME format. I've been looking at ElasticSearch and I'm a huge fan of what I'm seeing so far. I'm currently using Lucene.NET on my site (sf4answers.com) to perform searching, but I feel that I'd…
pyes - Python ElasticSearch 0.12.1 Released
October 20, 2010 03:03:39 AM
Hi, The new release target elasticsearch 0.12 or above. pyes is a connector to use elasticsearch from python. Web: http://pypi.python.org/pypi/pyes/ Source: http://github.com/aparo/pyes/ Features: - Thrift/HTTP protocols - Bulk…
Prototype use of ElasticSearch Twitter River
November 10, 2010 08:59:49 AM
Mozilla Metrics has created a five node ElasticSearch cluster on some test machines that is using the Twitter River functionality to automatically retrieve a filtered set of documents from Twitter's streaming API and index them. I've just created…
Problem with insert data to elasticsearch
October 25, 2010 05:18:39 AM
Hi, I'm using latest elasticsearch release 0.12.0 I have problem with insert data to elasticsearch. I'm using "elasticsearch" PHP client to insert data. Insert data is done in loop. PHP script insert 0 - 10000 entries and reload itself. Next it…
Advice and preferences for PHP based search engines for highly dynamic social website?
February 10, 2011
Okay so I am building this website which has functionality similar to facebook and twitter and it has highly dynamic content. All the questions etc,…
Ruby: HTTP.get_response from a website that does not exist
January 16, 2011
Hi, I have this code to check if the site is up or down: require 'net/http' require 'uri' res =…
Php http authentication: ask for password every time website is loaded!
January 2, 2011
hey guys, my question is: how can i do in php, that EVERY TIME a website is loaded it asks for the http authentification and not just the first…
What problems can I have by pinging or making a HTTP request to a website every minute?
January 19, 2011
What problems do I have to think before creating a monitoring system like pingdom, etc?
Securing HTTP traffic between data-logger and website, options
February 9, 2011
Hi, Got some IP data-loggers (that measure temp., humidity, light-level) sitting inside bunch of warehouses / stores with each warehouse / store…
Is it possible to host a website with Apache HTTP through a ZyXEL EQ-660R modem and a Netgear WGT624v3 wireless router?
December 21, 2010
Essentially, I have a spare desktop computer I'd like to turn into a web server, but my modem and wireless router are very difficult to work with. I…
Modifying simple search in rails to search linked data?
January 13, 2011
I followed: http://railscasts.com/episodes/37-simple-search-form (albeit the updated version) to implement searching on my app. Right now when you…
Convert vim / search to search and replace without retyping regular expression
January 11, 2011
When I perform a search and replace in Vim, I like to use the search function ( /regex ) first to visually test my regex. Is there a simple way to…
MySQL: Best way to search in files' content (fulltext search)
February 9, 2011
Hi! I'm currently developing a website which allows the users to upload presentations, documents and e-books (something like scribd and slideshare)…
How to restrict Search page numbers on bottom of search result page-php?
January 25, 2011
Hi, I am having problem in restricting search result page number in php page. I am using 3 fields to select user input and displaying search results…
Http connection with google results in: java.io.IOException: 4-Error in HTTP operation
January 5, 2011
I get the following error when trying to connect to Google's Client Login. Sometimes I get a fast result, other times a really slow one en sometimes…
Why do users get an HTTP 404 error when attempting to clone a Mercurial repository over HTTP?
February 2, 2011
The repository is hosted on my PC. I use Apache with WAMP and TortoiseHG. I have setup users and passwords and they are able to browse the…
Http push - http streaming method with ssl - do proxies interfere whith https traffic?
January 16, 2011
My Question is related to the HTTP Streaming Method for realizing HTTP Server Push: The "HTTP streaming" mechanism keeps a request open…
Simulate HTTP responses to test a node.js HTTP client
January 21, 2011
Hi, How can I simulate HTTP responses to test an app? Thanks! Edit: I know there's an open-source app that fakes HTTP responses. I don't remember if…
How to make "domain.com/search/q=query" from "domain.com/search/query" without breaking $_GET
January 26, 2011
Hello! I've got: RewriteRule ^catalog/search/([a-zA-Z-_0-9]+)/(.*)/?$ index.php?page=catalog&type=search&category=$1&q=$2 [L]…
Http://localhost does not work, http://127.0.0.1 works
February 5, 2011
Iam running Zend with Apache and got to see a strange behaviour.... If i type http://127.0.0.1 in my browser url, it works fine, but after typing:…
Why is my website being redirected?
January 1, 2011
i have this .htaccess code mod_rewrite problem RewriteEngine On RewriteCond %{REQUEST_FILENAME} !-f RewriteRule ^([^/]*)$ /user.php?user=$1 [L] but…
Website thumnails
January 2, 2011
I want to create website thumbnails using php. I have a dedicated server running centos 5.5 so I can install software on it. I need a free solution…
Localizing a website
January 18, 2011
Which should you rather use for a medium-sized web site (I don't know the exact number of pages, words, and so on yet): A) PHP files with static…
SQL vulnerability on a website
January 23, 2011
A website I use, which I think is rather popular generated a SQL syntax error being the geek I am I investigated it. Before I could stop myself I…