Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

ElasticSearch crashes OS?

cluster sizing + speed
(207 lines)
Apr 18, 2011
Karussell
Karussell
Hi there,

our server crashed every two weeks or so and I thought it was a
hardware failure or something similar. Now it gets even worse: the
servers crashes nearly every two days - I think this gets worse after
I'm triggering a query every 20 seconds to get the index "warmed".

There were no specific messages in ES logs or elsewhere. Also memory
consumption of ES was always within the limit. I also cannot imagine
that a Java program can kill the OS ...

We've investigated a lot. RAM check (no errors found), no hard-disc
error logs found, enough RAM (7.5 available but crashed with 4.5g),
updated to latest master of ES from April, 17th and it keeps still
crashing. I didn't found a hs err pid log. This would be in the folder
where I started ES, right?

Now I have created every minute a node stats snapshot (see
https://gist.github.com/926242) and the server crashed today at ~
19.16 It was 10 minutes before the next optimize (I marked the first
optimize with optimize at 07:29)

Can someone see a problem with ES there? Or point me into a direction
where I can try to fix the problem? Should I try a complete reindex?
I'm kind of stuck now.

Regards,
Peter.


Reply
Tags: hardware failureservers
Messages in this thread
ElasticSearch crashes OS?
reply Re: ElasticSearch crashes OS?
(40 lines) Apr 18, 2011 18:29
Search the http://elasticsearch.org website with elasticsearch itself
February 11, 2011 08:53:09 AM
Hi, I've spent couple of hours during the last days with implementing an ElasticSearch-backed search for the ES website (so it could be “self-hosted”, so to speak), as we have been talking about it on IRC the other day. First, you can try the…
new to ElasticSearch
March 1, 2011 10:04:51 AM
Hello Group, Hello Shay, i'm currently looking for an alternative to SOLR, as SOLRs java api SOLRJ is more a mess than useful. As a typical newbie, I got a few questions that I couldn't answer myself by looking at the doc's. 1. Does ElasticSearch…
ElasticSearch and doc type
April 5, 2011 11:34:15 PM
I read ElasticSearch online guide but found no information on why index name and doc type both exist. I wonder if doc type is a way to separate different indexes but all of them share the same logical name. I think that I am wrong because…
ElasticSearch 0.14.2 Released
January 5, 2011 03:51:05 PM
Hi, 0.14.2 is out, fixing a major bug in highlighting: https://github.com/elasticsearch/elasticsearch/issues/closed#issue/600 . There are also bug fixes and minor features added to this release, all found here:…
ElasticSearch + Cassandra
April 4, 2011 12:13:06 PM
Hi Everyone, Has anyone done/attempted to integrate ElasticSearch with Cassandra like was described at http://www.elasticsearch.org/blog/2010/02/25/nosql_yessearch.html ? I don't mean using Cassandra as a Gateway for ES, but using ES to query the…
From Compass to ElasticSearch
January 11, 2011 09:19:18 AM
(I hope this post didn't sent twice..) Hello, I would like to migrate an app I wrote using Compass to work with ElasticSearch (the Java API). I did some searches and experiments, but failed to find the answers, so can you point me to relevant…
Re: From Compass to ElasticSearch
February 23, 2011 08:03:56 AM
I've finished a working POC, took some times because I did it on my free time... Gonna fork ES and add new code before this week-end. I let you know when code is ready ! See you guys, Alois Cochard http://aloiscochard.blogspot.com…
What is the storage used in Elasticsearch?
March 17, 2011 04:19:05 AM
Hi all, First, thanks for this great tool, Elasticsearch :o) I was wondering: what is the underlying JSON document database used in ES? Terrastore? I am digging into the code, looking for Java classes in charge of the persistance. Can you point…
ElasticSearch 0.14 Released
December 28, 2010 04:00:15 AM
Hi, ElasticSearch 0.14 released, see more here: http://www.elasticsearch.com/blog/2010/12/27/0.14.0-released.html. cheers, -shay.banon
ElasticSearch 0.11.0 Released
September 28, 2010 03:44:32 PM
Hi, 0.11 is out, more details here: http://www.elasticsearch.com/blog/2010/09/29/0.11.0-released.html. -shay.banon
ElasticSearch 0.13.1 Released
December 3, 2010 01:46:16 PM
Hi, ElasticSearch 0.13.1 released with one major change, upgrading the Lucene version from 3.0.2 to 3.0.3. The new Lucene version fixes two important bugs, the first is a memory leak that happens when running a long indexing session, and the…
ElasticSearch Geo and rabbitMQ
December 30, 2010 08:47:03 AM
hi all, i'm new to elasticsearch and i'm looking for some directions. i would like to integrate geo searches into rabbitmq and since elasticsearch has integration for both i thought it could be the solution i am looking for. although there are some…
Re: ElasticSearch vs NoSQL
March 18, 2011 04:30:24 PM
I just started playing with ES and had to comment this subject. imo, this question in subject (discussion is great!) is plain wrong. What I would like to see somewhere is rather search and "nosql db". Keeping these two topics apart is like…
ElasticSearch 0.14.1 Released
December 29, 2010 06:12:05 AM
Hi, Just released a bug fix for 0.14.0 version that was just released. It fixed a major regression in the REST create index API. Details of the regression are here: https://github.com/elasticsearch/elasticsearch/issues/closed#issue/578 . sorry…
Re: ElasticSearch + Cassandra
April 6, 2011 03:41:24 PM
On 6 Apr., 14:21, Shay Banon <shay.b### @elasticsearch.com> wrote: > Yes, agreed, Solandra and Lucandra are pretty cool in terms of concepts, but I think they lack when it comes to how they use Lucene (putting the solr aspect aside).…
Anyone using ElasticSearch with Mongodb?
November 28, 2010 04:49:53 AM
I would be very interested to hear the paths that you guys have chosen for full text search on Mongodb documents. Anyone using ElasticSearch for the same? If yes can you throw some light on your experience as well as how you have done it. Would…
ElasticSearch and GeoIpSearch
October 26, 2010 11:03:07 AM
Oh... hey there ElasticSearchers :) Ok, so I'm thinking about using ES for looking up geo info about IP addresses. And I'm just wondering if someone has had some experience they would like to share. Or, if you have some insights on how this…
ElasticSearch and CouchDB
April 17, 2011 01:51:00 PM
If I have multiple instances of couch in a cluster with the same db should I register a river against each for the same db? Is it safe to do this? Thanks
elasticsearch thoughts; also, a bug.
March 20, 2011 09:51:36 PM
Hey all. I just wanted to share my experiences with elasticsearch on a 10 node cluster and my thoughts. I've had a lot of fun using it, and will make heavy use of it in the future, :) http://blog.jinked.com/posts/30 I wanted to take the time to…
elasticsearch sharding
February 14, 2011 08:04:46 AM
Hi, for my application i've tested Lucene, but quickly had problems with >10 million documents in one index on one server. Query latency growed up to several seconds and for some keywords result sets had been very large - up to out of memory.…
Playframework + Morphia + MongoDb + ElasticSearch = Disater?
March 26, 2011
Guys I have a couple of questions: Q1. I am using Play 1.1.1 with the Morphia-MongoDB module and ElasticSearch for Indexing. Has any one tried this?…
Imagick constructor crashes PHP/CGI
December 18, 2010
When I call the Imagick constructor PHP/CGI crashes. The imagick .dll is loaded in the php.ini file (extension) and I've got imagick installed. I am…
App Crashes due to Db creation on every launch
December 23, 2010
I have an application in which i am trying to create a Database. On the first run the application works properly. Subsequent launch of the…
App Crashes On Startup Due To ClassCastException
February 6, 2011
When I start my app, I get a ClassCastException at Cursor c = (Cursor) DataHelper.selectAll(); . Here is my main .java: package…
MongoDB crashes the server after I run it
January 26, 2011
I've been using Rails/Passenger/nginx/MongoDB for a while on my OpenVZ VPS. But today MongoDB crashes the whole server. This is what I get: Cannot…
Mysql table locked after php crashes
March 2, 2011
I have a MySQL DB and an innoDB table in it. I have a php page that connects, locks the table, does some updates, then unlocks the table. The PHP…
Mysql table crashes after kill -9
March 28, 2011
After MySQL lags, I must kill it with -9. Since I have killed the MySQL process, there is one static MyISAM table with 40k rows that has problems.…
Apache crashes a few seconds after the start.
January 30, 2011
Hi, i've got a problem with apache. When i try to start it (/etc/init.d/apache2 start) it dies after a few seconds. It shows up on "ps aux"…
Vsftpd crashes if I add anon_root directive
April 11, 2011
Here is a full config : anonymous_enable=YES local_enable=YES write_enable=YES local_umask=022 anon_upload_enable=YES anon_mkdir_write_enable=YES…
How to Prevent Big MyISAM Table from crashes
December 31, 2010
i have a table 30 GB MySQL MYISAM with 29 millions rows Multiple crawlers are running all the time so that multiple programs keep inserting into…
Mysql crashes by some strange queries
April 16, 2011
Hi, I have some strange log entry in my debug where I see that the mysql crashes: Apr 13 08:51:16 cronjob1 mysqld[22953]: Attempting backtrace. You…
OS X: Is there a way to automatically restart Apache if it crashes?
February 23, 2011
I've installed Apache using Macports. It crashes every once in a while and I need to manually restart it. Is there a way to get Apache to…
Server Crashes Every 14 Days On The Exact Same Time
March 21, 2011
A few months ago our server started to crash every 14 days, at the exact same time. We're pretty sure this isn't some kind of hardware failure, as…
Apache crashes in a loop of string concatenation
April 17, 2011
I have a script that opens a huge XLSX file and reads 3000 rows of data, saving it to a two dimensional array. Of all places for Apache to crash, it…
IE 8 Crashes when displaying PDF in IFrame served from Django
February 7, 2011
I have a web application which displays pdf's in an IFrame. I recently made a change to start serving up the PDF using Django instead of allowing…
Sqlite3 c library over jni crashes after 1003 queries
February 3, 2011
Hey I'm writing a Sqlite library for java which uses C Sqlite3 code over JNI. I think I'm having a problem with memory leaks. Can anyone help me…
How to restart Tomcat on a remote server if the application crashes?
February 2, 2011
Suppose I put a java app on Tomcat on a remote server, say Amazon AWS. What's do you recommend to restart tomcat if the application fails in a…
Tool to monitor MySQL even when a request crashes the server
April 7, 2011
Hi! It happens quite often that my server goes down (from a few minutes to always). I think I managed to found the problem, located to mysql that…
Django admin crashes when trying to update record but not when inserting a new one...
April 12, 2011
Hello, I'm having a weird problem: technical info for developemnt (production will be on linux/apache/Mysql) macosx 2.6.6 python 2.6.1 django 1.3…
App Crashes On Startup Due To java.lang.IllegalArgumentException: column '_id' does not exist
February 11, 2011
Whenever I start my app, I get a java.lang.IllegalArgumentException: column '_id' does not exist error in my LogCat. I have created the column '_id'…