Best unofficial Apache Server developers community
Username
Forgot password?
Sign in with Twitter account
Sign in with Facebook account
List archives

Rebalance cluster

multiple datastax opscenter?
(14 lines)
Installing C* on EC2
(11 lines)
Jan 11, 2012
Daning Wang
Daning Wang
Hi All,

We have 5 nodes cluster(on 0.8.6), but two machines are slower and have
less memory, so the performance was not good  on those two machines for
large volume traffic.I want to move some data from slower machine to faster
machine to ease some load, the token ring will not be equally balanced.

I am thinking the following steps,

1. modify cassandra.yaml to change the initial token.
2. restart cassandra(don't need to auto-bootstrap, right?)
3. then run nodetool repair,(or nodetool move?, not sure which one to use)


Is there any doc that has detailed steps about how to do this?

Thanks in advance,

Daning


Reply
Tags: volume trafficmemory
Messages in this thread
Rebalance cluster
reply Re: Rebalance cluster
(53 lines) Jan 11, 2012 13:42
reply Re: Rebalance cluster
(45 lines) Jan 11, 2012 14:01
reply Re: Rebalance cluster
(70 lines) Jan 11, 2012 15:34
reply Re: Rebalance cluster
(101 lines) Jan 12, 2012 10:43
reply Re: Rebalance cluster
(9 lines) Jan 15, 2012 11:53
Cluster is in inconsistent state got conflicting clocks version when doing a rebalance
May 5, 2011 02:18:40 AM
All, I'm attempting to shrink my cluster from 8 to 4 nodes (we replaced the first four nodes with new hardware which are much faster). However when I ran voldemort-rebalance.sh I got the following error: $ ./bin/voldemort-rebalance.sh --url…
Neo Rebalance!
September 19, 2010 01:58:50 AM
Yo, I've finally uploaded a working version of the rebalance implementation I've been thinking about for forever. It's inteface is very raw, and I'd like to hear feedback about ways to make it easier to use. I'll be filling in a wiki page with…
Re: mogile rebalance
December 19, 2011 07:56:21 AM
Hi , after adding the new device into the cluster i believe mogile completed replicating the files to the new device dev5 and now I wanted to run rebalance in order to distribute the file system load equally .. this is how the devices look now…
Rebalance hangs
August 31, 2011 07:11:29 PM
I'm using 2.53 and rebalance is hanging. I'm not exactly sure where to poke to figure out why. Nothing indicitave of a problem is showing up in !watch or syslog. Any suggestions? To reproduce the problem I run the following commands: mogadm…
Re: Rebalance error
June 16, 2011 01:43:20 AM
No. Just a few per minute... On 06/16/2011 08:39 AM, dormando wrote: > > On Thu, 16 Jun 2011, Arkadi Colson wrote: > >> Can this be the reason that rebalance does not cleanup the over-replicated >> files? > How many of…
mogilefs rebalance
May 9, 2011 03:58:35 AM
Dear Listmembers, I have a question about mogilefs rebalance. We're using mogilefs in a virtual machine, and we have to migrate it. The question is, that if the rebalance is too slow for us, can we use rsyncing instead? After rsync, we simply…
Rebalance.pm patch
October 28, 2010 05:39:20 AM
Hi, I'm finally trying the new Rebalance stuff and stubbled upon an error when using a global limit. When the JobMaster tries to load the saved rebal_state, Rebalance.pm croaks because it doesn't recognize the saved setting 'limit'. bye, Martijn.…
Rebalance error
June 15, 2011 10:04:39 AM
Hi, !watch is reporting this while running rebalance: :: [replicate(11617)] Rebalance for DevFID[d=133;f=7675034] (http://10.0.1.103:7500/dev133/0/007/675/0007675034.fid) failed: HTTP delete (due to 'did_rebalance;ret=1') failed: can't connect…
t/30-rebalance.t failure with IO::AIO 4.11
November 29, 2011 02:51:45 PM
t/30-rebalance.t fails on my Debian testing laptop, which has libio-aio-perl 4.11-2+b1. Towards the end of the test, I get a lot of 404 errors from DELETE. The 404 errors shuffle the "ok 48" message into the middle of the line and hides it from…
Re: Does anyone actively use rebalance?
July 31, 2010 03:33:06 AM
Rebalance has been immensely useful to us. When adding new storage nodes, we are able to mitigate the damage from HD failures, are able to add nodes more sparingly, and just generally balances out load across storage nodes. ( 12 storage nodes, 6…
Rebalance does not work well
October 17, 2011 09:54:37 PM
Hi all,I have raised a issue ,see https://issues.apache.org/jira/browse/AMQ-3544.
Re: mogile rebalance
December 19, 2011 10:49:41 AM
> this is the policy I ran ..to test > > mogadm rebalance policy --options="from_devices=dev3,dev4 to_devices=dev2,dev5 limit_type=device limit_by=size limit=10g" > > mogadm rebalance test > Tested rebalance policy... >…
Rebalance stuck?
September 8, 2010 05:46:17 AM
Hi, I have a problem with enable_rebalance. It seems that after a while it stopped working. Now i read in Store.pm about List::Util::shuffle() not being really random, is this still true? I've also setup a test environment to analyse the…
Rebalance Stuck
May 23, 2011 01:33:56 PM
We have a mogilefs cluster with a stuck rebalance. It won't stop, I can't change settings, and because of this I can't do a fsck. kel### @mogtracker1prod:~$ mogadm rebalance settings rebal_host = mogtracker2prod …
Rebalance docs, Roadmap, etc
September 19, 2010 07:51:34 PM
First off, I have posted initial documentation for the unreleased rebalance overhaul: http://code.google.com/p/mogilefs/wiki/Rebalance Next, I have posted a quick Roadmap of all the major features I've been planning on working on: …
Failure Detector and Rebalance
November 7, 2011 03:01:34 PM
Does failure-detector (any implementation) is rebalance-aware? If a node is added to the cluster, Is this node part of the nodes being checked in any of the failure detector implementations? thanks, --john
Reproductive for issue of rebalance
October 15, 2011 03:00:03 AM
Hi all,assuming there are two networked brokers A and B in both direction . Now setting up a client to connect to Broker A and making sure that the client has connected to Broker A via log information. Then shutdown Broker A and we expect for…
Re: source socket, rebalance issues
August 23, 2010 06:28:41 PM
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 8/23/10 12:24 PM, dormando wrote: >> It looks like the maxconns default is 10K and I don't set it explicitly. >> I assume that is connections that would show up in netstat? I'm seeing…
source socket, rebalance issues
August 19, 2010 02:18:34 PM
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I'm running mogilefs 2.30 with 14 hosts with 4 devices each. When I !watch on one of my trackers, I see lots (several to many a minute) of messages like these: :: [replicate(9979)] Unable to create…
riak_core data handoff/rebalance
June 30, 2011 04:04:53 PM
I'm trying to understand when and how data handoff between nodes is triggered in riak_core. I was under the impression that data would be shuffled when a new node joined the cluster or an existing node left the cluster, but maybe that's not the…
How can I get Cassandra to automatically rebalance?
April 24, 2010
I am looking at a cassandra cluster, but the administration effort seems to be quite high. Is there any way I can configure Cassandra to rebalance…
Mysql cluster Vs basic Mysql db setup(not cluster)
December 22, 2010
Why mysql cluster requires more ram as compared to basic mysql db setup (no cluster)? What is the ideal ram requirement for a mysql cluster with 2…
Managing a Cassandra Cluster ?
April 14, 2011
Suppose that one has set up a cassandra cluster. You've got a 10[TB] database that is distributed evenly between 10 nodes, everything runs smoothly…
Cluster points in PostGIS
June 24, 2011
I'm building an application that pulls lat/long values from a database and plots them on a Google Map. There could be thousands of data points so I…
Cassandra cluster not ring
April 18, 2011
Hi all, I'm setting up cassandra cluster.I made the configuration changes(adding seeds). When I ring that cluster, its showing only one node. bit…
Firing up a cluster using whirr
January 15, 2011
I'm new to whirr and AWS so apologies in advance if I'm asking something silly. I'm following the directions here to set up whirr and bin/whirr…
Ubuntu cluster management
April 5, 2011
Hello, I am trying to figure out a solution for managing a set of linux machines(OS:Ubuntu,~40 nodes. same hardware). These machines are supposed to…
Named Cluster DNS breaking ssh
February 17, 2011
This problem occurs on fedora core 12. So I was trying to setup a named dns server on a central node and on the surface it looks like it works (ping…
Setting up mysql cluster
February 15, 2011
In our development environment we have used either MyISAM or InnoDB storage engine. Now in our deployment environment we need to go for MySQL…
Schedule job executes twice on cluster
May 10, 2011
We are using Cron4j java scheduler for scheduling jobs which execute every night. Now, when this same web application is deployed(Tomcat) on…
Hadoop install cluster
March 2, 2011
Is it possible to run hadoop on multi-node and these nodes install hadoop on different paths? I noticed the tutorial, such as Michael Noll's,…
Hadoop install cluster
March 2, 2011
Is it possible to run hadoop on multi-node and these nodes install hadoop on different paths? I noticed the tutorial, such as Michael Noll's,…
MSFC "the Cluster name is not online"
March 11, 2011
Hi all, i have a microsoft 2008 failovercluster in my lab with, also, an unproductive dns server. Unfortunately i had a hdd-crash and recover my…
MySQL Cluster + Manager and NDB/J
June 2, 2011
I've been trying to setup a MySQL Cluster for a few days using the MySQL Cluster Manager on 3 Ubuntu nodes (3 identical VM instances with 1GB RAM…
Mysql cluster problem in ubuntu
February 26, 2011
I have a problem while installing and configuring mysql cluster runnign on ubuntu 10.10 This is configuration for Cluster management [NDBD DEFAULT]…
PostgreSQL: VACUUM FULL or CLUSTER?
February 7, 2011
I'm nearly out of disk space because of a query that tried to update every row in a huge table. I don't have enough space for CLUSTER (though it…
Running a mapreduce jar on Hadoop cluster.
April 8, 2011
Hello all, I'm trying to run the map reduce implementation of quadratic sieve algorithm on Hadoop. For this purpose I'm using karmasphere Hadoop…
How to setup the cassandra cluster in cloud
March 10, 2011
Hi All, I new to cassandra. i installed cassandra in my machine ec2 but how can i configure cassandra in cluster mode. Is there any link that will…
Run Nutch on existing Hadoop cluster
March 14, 2011
Hello, We have a Hadoop cluster (Hadoop 0.20) and I want to use Nutch 1.2 to import some files over HTTP into HDFS, but I couldn't get Nutch running…
Installing Hbase / Hadoop on EC2 cluster
February 24, 2011
I know that I can spin off a EC2 cluster with Hadoop installed (unless I am wrong about that). How about Hbase ? Can I have the Hadoop and Hbase…