Hi Thx for your help. I finaly could add the last brick . I now have a Distributed-replicated volume > gluster volume info > > Volume Name: dccbackup > Type: Distributed-Replicate > Status: Started > Number of Bricks: 2 x 2 = 4 > Transport-type: tcp > Bricks: > Brick1: mysqldccbackup:/export > Brick2: mysqldccbackupmirror:/export > Brick3: gfsbrick1:/brick1 > Brick4: gfsbrick2:/brick2 On the client side though I don't see any increasing in storage size. I tried to rebalance gluster volume rebalance dccbackup fix-layout start and got . > starting rebalance on volume dccbackup has been unsuccessful I'm kind of stuck here. Thank you KL > What is the output of: > > # ls /etc/glusterd/peers > 39bd607b-b355-4e0d-80ae-ef507e0dbabe 4583d8b7-f724-4017-b549-9aa9e27dd50f a70858c6-cac3-43fa-b743-4d2226f8a433 > > Above output is mine. > > If you cat each of these files, there should be one for each peer OTHER than the host that your are logged into), and hostnames each files, like this: > # cat /etc/glusterd/peers/* > uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe > state=3 > hostname1=jc1letgfs15-pfs1 > uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f > state=3 > hostname1=jc1letgfs18-pfs1 > uuid=a70858c6-cac3-43fa-b743-4d2226f8a433 > state=3 > hostname1=jc1letgfs14-pfs1 > > Here is a listing of all the peer files on all four nodes of my GlusterFS servers - I created this configuration in the same way you did - two servers, then add two servers: > > jc1letgfs14 > /etc/glusterd/peers/39bd607b-b355-4e0d-80ae-ef507e0dbabe > uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe > state=3 > hostname1=jc1letgfs15-pfs1 > /etc/glusterd/peers/4583d8b7-f724-4017-b549-9aa9e27dd50f > uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f > state=3 > hostname1=jc1letgfs18-pfs1 > /etc/glusterd/peers/94f28f8c-8958-435b-80e4-3bd6d4fc5156 > uuid=94f28f8c-8958-435b-80e4-3bd6d4fc5156 > state=3 > hostname1=10.20.72.191 > > jc1letgfs15 > /etc/glusterd/peers/4583d8b7-f724-4017-b549-9aa9e27dd50f > uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f > state=3 > hostname1=jc1letgfs18-pfs1 > /etc/glusterd/peers/94f28f8c-8958-435b-80e4-3bd6d4fc5156 > uuid=94f28f8c-8958-435b-80e4-3bd6d4fc5156 > state=3 > hostname1=10.20.72.191 > /etc/glusterd/peers/a70858c6-cac3-43fa-b743-4d2226f8a433 > uuid=a70858c6-cac3-43fa-b743-4d2226f8a433 > state=3 > hostname1=jc1letgfs14-pfs1 > > jc1letgfs17 > /etc/glusterd/peers/39bd607b-b355-4e0d-80ae-ef507e0dbabe > uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe > state=3 > hostname1=jc1letgfs15-pfs1 > /etc/glusterd/peers/4583d8b7-f724-4017-b549-9aa9e27dd50f > uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f > state=3 > hostname1=jc1letgfs18-pfs1 > /etc/glusterd/peers/a70858c6-cac3-43fa-b743-4d2226f8a433 > uuid=a70858c6-cac3-43fa-b743-4d2226f8a433 > state=3 > hostname1=jc1letgfs14-pfs1 > > jc1letgfs18 > /etc/glusterd/peers/39bd607b-b355-4e0d-80ae-ef507e0dbabe > uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe > state=3 > hostname1=jc1letgfs15-pfs1 > /etc/glusterd/peers/94f28f8c-8958-435b-80e4-3bd6d4fc5156 > uuid=94f28f8c-8958-435b-80e4-3bd6d4fc5156 > state=3 > hostname1=10.20.72.191 > /etc/glusterd/peers/a70858c6-cac3-43fa-b743-4d2226f8a433 > uuid=a70858c6-cac3-43fa-b743-4d2226f8a433 > state=3 > hostname1=jc1letgfs14-pfs1 > > I hope this is of some help. > > James Burnash > Unix Engineer > > > -----Original Message----- > From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of Karim Latouche > Sent: Monday, May 23, 2011 1:02 PM > To: Mohit Anchlia > Cc: gluster-users at gluster.org > Subject: Re: Trouble to add brick > > hi > > Here is the output of gluster peer status command of the four nodes > > mysqldccbackup mysqldccbackupmirror are the two first nodes > > I got issues when I tried to add gfsbrick1 and two to the already working cluster > > > >> [root at gfsbrick1 ~]# gluster peer status >> Number of Peers: 1 >> >> Hostname: 10.0.4.225 >> Uuid: 00000000-0000-0000-0000-000000000000 >> State: Establishing Connection (Connected) > >> [root at gfsbrick2 ~]# gluster peer status >> Number of Peers: 2 >> >> Hostname: 10.0.4.225 >> Uuid: 2f4a1869-8c7e-49ea-a7b1-d9b2d364e5d6 >> State: Peer in Cluster (Connected) >> >> Hostname: mysqldccbackupmirror >> Uuid: 0961e0d2-e2e8-497d-9c51-4b96c061f939 >> State: Peer Rejected (Connected) >> [root at mysqldccbackup ~]# gluster peer status >> Number of Peers: 3 >> >> Hostname: mysqldccbackupmirror >> Uuid: 0961e0d2-e2e8-497d-9c51-4b96c061f939 >> State: Peer in Cluster (Connected) >> >> Hostname: gfsbrick2 >> Uuid: 14f07412-b2e5-4b34-8980-d180a64b720f >> State: Peer in Cluster (Connected) >> >> Hostname: gfsbrick1 >> Uuid: 00000000-0000-0000-0000-000000000000 >> State: Establishing Connection (Connected) > > >> root at mysqldccbackupmirror ~]# gluster peer status >> Number of Peers: 1 >> >> Hostname: 10.0.4.225 >> Uuid: 2f4a1869-8c7e-49ea-a7b1-d9b2d364e5d6 >> State: Peer in Cluster (Connected) >> [root at mysqldccbackupmirror ~]# gluster peer status >> Number of Peers: 1 >> >> Hostname: 10.0.4.225 >> Uuid: 2f4a1869-8c7e-49ea-a7b1-d9b2d364e5d6 >> State: Peer in Cluster (Connected) > Thx a lot > > KL > > > > > > > > > >> Please send the complete output of gluster peer status from both the nodes. >> >> On Mon, May 23, 2011 at 9:44 AM, Karim Latouche >> <klatouche at digitalchocolate.com> wrote: >>> hi >>> >>> Thx for your answer. >>> >>> I should have mention that I already set up a proper hosts file to avoid DNS >>> resolution issue but I still have same issue. >>> >>> The last brick is allways the one having issues to be added . I tried adding >>> gfsbrick2 first then gfsbrick1 and the result is the same >>> >>> I get >>> >>>> Hostname: gfsbrick2 >>>> Uuid: 14f07412-b2e5-4b34-8980-d180a64b720f >>>> State: Peer in Cluster (Connected) >>>> >>>> Hostname: gfsbrick1 >>>> Uuid: 00000000-0000-0000-0000-000000000000 >>>> State: Establishing Connection (Connected) >>> instead of >>> >>> >>>> Hostname: gfsbrick2 >>>> Uuid: 00000000-0000-0000-0000-000000000000 >>>> State: Establishing Connection (Connected) >>> It 's really strange. >>> >>> >>> Thx >>> >>> KL >>> >>> >>> >>> >>>> Karim, >>>> gfsbrick1 is not able to contact gfsbrick2 yet. Generally happens if >>>> the DNS resolutions dont happen as expected. You can map them manually in >>>> /etc/hosts for both the machines?. >>>> >>>> something like: >>>> on gfsbrick1 >>>> <ip-of-brick2> gfsbrick2 >>>> on gfsbrick2 >>>> <ip-of-brick1> gfsbrick1 >>>> >>>> Pranith. >>>> >>>> ----- Original Message ----- >>>> From: "Karim Latouche"<klatouche at digitalchocolate.com> >>>> To: gluster-users at gluster.org >>>> Sent: Monday, May 23, 2011 7:56:22 PM >>>> Subject: Trouble to add brick >>>> >>>> Hi >>>> >>>> I got a strange problems >>>> >>>> I run a two bricks replicated volume and I tried to add 2 more bricks >>>> >>>> The first one went ok >>>> >>>>> gluster peer probe gfsbrick1 >>>>> Probe successful >>>> It seems I can't add the second one >>>> >>>> I get a >>>> >>>>> Hostname: gfsbrick2 >>>>> Uuid: 00000000-0000-0000-0000-000000000000 >>>>> State: Establishing Connection (Connected) >>>> Did anyone encounter this issue ? >>>> >>>> Thx >>>> >>>> KL >>>> >>>> >>>> _______________________________________________ >>>> Gluster-users mailing list >>>> Gluster-users at gluster.org >>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>> _______________________________________________ >>> Gluster-users mailing list >>> Gluster-users at gluster.org >>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>> > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > > DISCLAIMER: > This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this in error, please immediately notify me and permanently delete the original and any copy of any e-mail and any printout thereof. E-mail transmission cannot be guaranteed to be secure or error-free. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. > NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its discretion, monitor and review the content of all e-mail communications. http://www.knight.com
