Best unofficial Apache Server developers community

Answers

Php mysql shuffle output speed

⇧

⇩

45 views

Hello,

I have a mysql query that returns 20 results from a table of 110,000,000. I would like to shuffle these before echoing them out using php.

Is it faster to use

ORDER RAND()

shuffle the array in php somehow?

php mysql

asked April 11, 2011 11:30 am CDT

David19801

posted via StackOverflow

1 Answer

⇧

⇩

Depending on the amount of results you're pulling back from MySQL, ORDER BY RAND() will be faster.

If you're only returning 20 like you say, the performance differences will be negligible.

You could always test it out and see which is better for you, to shuffle an array in PHP you would use shuffle().

answered April 11, 2011 12:24 pm CDT

rudi_visser

Your answer

Similar discussion threads

Roundcube Apache mysql set-up - Speed enhancments sought
January 8, 2011 03:01:02 PM
Hi chaps and chapettes, I have just set-up my first RC system: (relevent versions notes at end of this Email) RC Apache mysql postfix dovecot spamassassin php The Roundcube is a little slow with one test…

Problems with connections pool in Tomcat 6.0.18 6.0.20 + MySQL 5.1 + mysql-connector 5.1.x
January 27, 2011 01:47:26 AM
Hi all, I have a problem with: Tomcat 6.0.x + MySQL 5.1 + mysql-connector.5.1.x And I test with Ubuntu 10.04, Windows 2003 and Mac OSX 10.6.6 I configured the connection in tomcat like this: <Resource driverClassName="com.mysql.jdbc.Driver" …

MySql overload: auth mysql + cache?
March 24, 2011 07:42:41 AM
Hello all, I'm facing a major issue on one of my DB after an application upgrade that switch to AuthMysql for a subversion server authentication My DB server is overloaded by tons of: > SELECT user.unix_pw, length(user.unix_pw) FROM user,…

Populating mySql DataStore from Mysql table
April 8, 2011 01:37:19 AM
I am trying to populate a datastore that uses Mysql persistence with a Mysql table. For that I have done the following: 1. Changed server.properties 2. Created a data store and named its persistence as mysql 3. included a mysql connector in…

Get Shuffle and sort time
April 4, 2011 01:16:27 PM
Hi, Where can I get the shuffle and sort time of a reduce task?

Shuffle tasks getting killed
September 22, 2010 11:53:49 PM
Hi, I continuously run a series of batch job using Hadoop Map Reduce. I also have a managing daemon that moves data around on the hdfs making way for more jobs to be run. I use capacity scheduler to schedule many jobs in parallel. I see an issue…

How does Hadoop do sort(shuffle) after map exactly?
November 22, 2010 09:33:29 PM
Hi, I'm new to Hadoop and I want to know its implementation better. I was always wondering after mapping, how each reduce task get its input. It is said in google's paper and hadoop's documentation that a sort is done to aggregate the same key of…

why does puppet shuffle its ‘phases’ and how can I stop this?
September 27, 2010 10:10:54 AM
Hi all, class zabbix { file { "/etc/zabbix/": ensure => directory, recurse => true, purge => false, force => false, owner => "root", group => "root", mode …

Re: why does puppet shuffle its ‘phases’ and how can I stop this?
September 27, 2010 10:15:11 AM
On 09/27/2010 03:08 PM, D.N. van der Meijden wrote: > Hi all, > > ... > Sorry for the lengthy e-mail, but I was hoping someone could perhaps > shed a light on this issue :-) Hi, it's expected behaviour. If you want Puppet to do…

questions about the order of the map and reduce and the shuffle error
August 27, 2010 04:44:12 AM
hello guys: I'm doing some experiences on my 3 node virtual machine cluster, one for namenode and jobtracker while the other tow for datanode and tasktracker.with a 0.21.0 hadoop and when I 'm running a job ,I got such message 10/08/27…

Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
December 1, 2010 11:25:01 PM
Hi all, I have installed Hadoop 0.20.2 on a cluster of 6 computers. Everything runs fine when I run an application on Hadoop with one system in the cluster. But as soon as I include more than one system and then run a job, I get the following…

Created: (MAPREDUCE-2354) Shuffle should be optimized
March 4, 2011 05:02:02 AM
Shuffle should be optimized

Re: Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.
December 2, 2010 05:44:37 AM
On 02/12/10 05:24, prashant sethia wrote: > Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES I don't know about other people's causes of this message, but searching for it throws up the only time I've seen it …

Non-deterministic execution: Shuffle Error, Exceeded MAX_FAILED_UNIQUE_FETCHES
November 27, 2010 08:46:04 AM
Hi, I'm trying to split a single file throug a mep-reduce job. My input is a sequence file where each entry represent a graph node together with its neighbors and i would like to split it in more files. A typical execution is, for example hadoop…

Created: (MAPREDUCE-2168) We should implement limits on shuffle connections to TaskTracker per job
November 1, 2010 07:57:54 AM
We should implement limits on shuffle connections to TaskTracker per job

Created: (PIG-1704) Output Compression is not at work if the output path is absolute and there is a
October 29, 2010 02:06:09 PM
Output Compression is not at work if the output path is absolute and there is a trailing / afte the compression suffix

Text output separator for Hive Output
April 7, 2011 07:39:08 AM
Hi, How would I set the field separator for Hive output to files? I see that the default is a space (or tab, don't know exactly) but I would like to use another character to facilitate loading of the output in another system. I already tried …

svn commit: r950583 - in /httpd/httpd/trunk/docs/manual/developer: output-filters.html.en output-fil
June 2, 2010 09:53:07 AM
Author: jorton Date: Wed Jun 2 14:53:07 2010 New Revision: 950583 URL: http://svn.apache.org/viewvc?rev=950583&view=rev Log: - clarify wording on handling of empty brigades, see dev@ thread from msgid…

Better speed for M/R
October 6, 2010 03:23:04 AM
Right now we have two "big collections" on a Master / Slave scenario. We can't keep the indexes on RAM, as they are already big, and they grow day by day. On those two tables we need to get averages, aggregations, etc... that we get launching M/R…

Where is the speed?
January 27, 2011 11:49:40 AM
Hi, Just opening the MongoDB and simple samples, I try to insert 300000 rows in LocalHost, in the "Category" document class. I find that about 5000 records are added each second. Doesn't seem THAT fast, does it? Then I did the very same job…

Questions and Answers are licensed under cc-wiki license.

Php mysql shuffle output speed

1 Answer

Your answer

Join with account you already have