Best unofficial Apache Server developers community |
| |||||
| Jul 30, 2011 | |||||
|
Seven Garfee |
|
||||
| Tags: | |||||
|
improving random read performance August 19, 2010 07:53:57 PM I am currently running under Hbasev0.20.3. I increased the block cache to .4 from .2. The heap size is 2GB. The default regionserver handler count is 25 in hbase-default.xml. Will try LZO compression. What are other performance tunings I can do ?… The hfile.block.cache.size = 0 performance is better than default(0.2) in random read? Is it possibl October 20, 2010 10:19:49 PM Hi all, I run my performance testing in random read, but I got the hfile.block.cache.size = 0 performance is better than default, Is it possible? My cluster (4 nodes): Hadoop 0.20.2, HBase 0.20.6 1 * namenode & hmaster & zookeeper 3… The hfile.block.cache.size = 0 performance is better than default(0.2) in random read? Is it possibl October 20, 2010 10:19:49 PM Hi all, I run my performance testing in random read, but I got the hfile.block.cache.size = 0 performance is better than default, Is it possible? My cluster (4 nodes): Hadoop 0.20.2, HBase 0.20.6 1 * namenode & hmaster & zookeeper 3… Resolved] (HDFS-380) support for persistent connections to improve random read performance. June 5, 2011 11:14:40 PM [ https://issues.apache.org/jira/browse/HDFS-380?page=com.atlassian.jira .plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-380. How to improve random read latency? May 29, 2011 03:24:42 PM Are there any configurations that I need to set to improve read latency? I'm running HBase on 10 ec2 m1.large instances (7.5GB RAM). Also, as the size of the data gets bigger is it normal to get higher latency for reads? I'm testing out the YCSB… Read performance vs. vmstat + your experience with read optimizations June 20, 2011 02:40:27 PM Hi all, I am having trouble reconciling various metrics regarding reads so I'm hoping someone here can help me understand what's going on. I am running tests on a single node cluster with 16GB of RAM. I'm testing on the following column family: … Random Access & Performance. July 18, 2011 09:09:16 AM A generic question regarding ElasticSearch / Lucene. I have a lot of indexes, and they are very large. I believe we have about 3 Billion documents that need to be searched very quickly. The data has a lot of fields (10-20) per document, and can… Re: improve read performance for read-only store February 21, 2011 12:24:43 AM Hi Anani, >>> I have deployed 2 application in production using Voldemort and am >>> concentrating on performance and monitoring now. I have been going >>> through the discussions on this group looking for fine-tuning… improve read performance for read-only store February 10, 2011 07:19:37 PM Hi, I have deployed 2 application in production using Voldemort and am concentrating on performance and monitoring now. I have been going through the discussions on this group looking for fine-tuning server/ client configuration or any other tips… Sharding performance decrease when using a random key November 16, 2010 10:05:39 AM Serial sharding key appears to be much better than random sharding key in my write-only test. MongoDB 1.6.4. Two sharding nodes, one mongos and one config server. Is it possible? Random Reads throughput/performance June 23, 2011 08:08:44 PM We have been testing random reads and from a 6 node cluster (1NN, 5DN, 1HM, 5RS each with 48G, 5 disks) right now seeing a throughput of 1100 per sec per node. Most of the configs are default, except 4G for RS, *handler.count and gc (… Re: Read/Write Performance December 30, 2010 11:01:16 AM Keep going. Let it run longer. Get the servers as loaded as you think they'll be in production. Make sure the perf numbers are not because cluster is 'fresh'. St.Ack On Thu, Dec 30, 2010 at 5:51 AM, Wayne <wav1### @gmail.com> wrote: > We… Re: Read/Write Performance January 2, 2011 08:05:45 PM The LZO did not seem to work with the 1GB region size. It was causing several minute pauses followed by 5 seconds of requests being processed and then again 30+ second pauses (is this GC, compaction, or splits??...all regions go to 0 requests but… Re: Read/Write Performance January 3, 2011 11:48:17 AM On Sun, Jan 2, 2011 at 6:04 PM, Wayne <wav1### @gmail.com> wrote: > The LZO did not seem to work with the 1GB region size. It was causing > several minute pauses followed by 5 seconds of requests being processed and > then again 30+… Re: Read/Write Performance December 30, 2010 08:58:19 AM That's great to hear, thanks for sharing your results and configuration. How many concurrent writer processes are you running? Thanks, Michael On Thu, Dec 30, 2010 at 8:51 AM, Wayne <wav1### @gmail.com> wrote: > We finally got our… Re: Read/Write Performance December 30, 2010 07:52:21 AM We finally got our cluster up and running and write performance looks very good. We are getting sustained 8-10k writes/sec/node on a 10 node cluster from Python through thrift. These are values written to 3 CFs so actual hbase performance is 25-30k… Re: Read/Write Performance January 2, 2011 07:12:17 PM Has this cured the GC pause at all? I do not see why turning on LZO is relavent at all (I read your email, and it sounds that you saw pause after the LZO is turned on). BTW, are you using CMS on a 8GB Heapsize JVM and experiencing a 4 mins pause?… Re: Read/Write Performance December 30, 2010 11:01:34 AM Oh, what versions are you using? St.Ack On Thu, Dec 30, 2010 at 9:00 AM, Stack <sta### @duboce.net> wrote: > Keep going. Let it run longer. Get the servers as loaded as you think > they'll be in production. Make sure the perf numbers… Riak read performance February 14, 2011 05:48:45 AM Hi, I have just read the benchmark for Riak against several other NoSQL databases here: http://www.slideshare.net/ThibaultDory/comparing-nosql-databases-bench mark It seems that the performance is not as good. Is this justifiable? I am keen to… How many bytes of the random input are actually read by Openssl for the genrsa command? June 24, 2011 If random.rnd is 5 megabytes of data, how much of that file does the command openssl genrsa -rand random.rnd -out privkey.pem 2048 actually read and… High performance MySQL random non-sequential row June 19, 2011 I'm trying to grab a random row from a table where the data doesn't change. I've read that people try ORDER BY RAND() which is terrible for large… What to use for a benchmark (read performance) test between FileStream, Embedded SQL, and NoSQl? February 25, 2011 Hi, I am trying to write a small program that searches a key-value type structure. My search is to find the FASTEST approach possible for searching… Which of these MySQL database designs (attached) is best for mostly read high performance? June 15, 2011 I am a data base admin and developer in MySQL. I have a couple of years working with MySQL. I recently adquire and study O'Reilly High Performance… High read performance database solution for storing simple data on Windows. February 25, 2011 Dear All, I though that I have a simple problem but I am struggling with it for the last few days. To make a long story short, here is a description… MySQL: How to retrieve a random row or multiple random rows? January 3, 2011 I have a MySQL database table that stores the URLs of photos. I need to pull 5 random records from the database of a particular type. I can pull 5… MySql : how can I implement a sort of "read/not read yet" topics? January 28, 2011 Hi. I'm about to implement a list of topic/argument in my forum, and I'd like to insert a sort of flag like "read/not read yet" for each message,… Qt ftp->list() - how to read how many bytes read January 8, 2011 when i do ftp->list() i'm expecting to get the bytes read and show it. problem is i dont see any option for this (only to ftp->get() using… MySQL 5.5 performance schema is to monitor performance not to improve right? April 26, 2011 Hi Guys, According to my perception Mysql5.5 performance schema feature is to monitor the performance but not to improve. Am i right? Requires yours… MongoDB performance, is my performance expected? April 13, 2011 My MongoDB server that I've just setup can handle about 2,500 writes per second, is this an acceptable rate? If not what is? What are your systems… Mysql 1 Random Row February 8, 2011 Is this the correct way to do this? $query = 'SELECT * FROM gameids ORDER BY timestamp RAND LIMIT 1'; Mysql random least used February 11, 2011 I need to select a record at random but not one already selected before unless all records have been selected. Table Setup: _word (id, nam) _word_tm… How to Use SQlite Random() March 7, 2011 I'm aware that to select a random row in SQlite I need the command "SELECT * FROM table ORDER BY RANDOM() LIMIT X", but how do I use this within… Fastest way to get random row from mySQL May 26, 2011 I have InnoDB table with millions of records. I need to find the way to get random row as fast as i can. My solution #1 was: SELECT * FROM keywords… How do I get 20 random records in Django? January 11, 2011 Random 20 rows. I don't care how. What's the easiest way? MySql Help? Caching, random? January 12, 2011 Hello, I was told to do the following. Just a Generalized Approach Running The selectRandom() procedure every 5seconds will be too messy. instead… SQL: Could abs(random()) % someNumberGreaterThanZero return zero? March 7, 2011 SELECT foo FROM bar WHERE id >= (abs(random()) % (SELECT max(id) FROM bar)) LIMIT 1; I saw this in another answer as an alternative to ORDER BY… Best way to get a reasonably random key for MYSQL records January 5, 2011 Hi there, I need to generate a reasonably random unique key for a table. It should be something like a GUID for MYSQL. I've tried UUID, but it looks… Get random text between two regexen April 8, 2011 Hello. I have a file of scraped posts that looks like this: 1 Name: foo Hello, my name is foo. 2 Name: bar Hello. Multi line post. 3 Name: foo… Random Data From Cassandra DB April 7, 2011 I'm using the Random Partitioner, and I'm wondering if there's a way to do the equivalent of a range scan to get a batch of random rows. I assume… | |||||
(42 lines) Jul 30, 2011 05:22
(53 lines) Jul 30, 2011 06:30
(84 lines) Jul 30, 2011 08:32