Vijaykumar, Thanks! Joe in IRC helped get me going, basically, stopping all glusterd procs, killing a bunch of huge gysncd procs, cleanig up, and starting everything back up. I was just asking in IRC...whats the interval for geo-replication? can it be configured? On Mon, Jan 7, 2013 at 12:37 AM, Vijaykumar Koppad <vkoppad at redhat.com> wrote: > hi Matthew , > > This is weird. There might be some inconsistency between gsyncd and glusterd communication. > Just try restarting glusterd once. If it doesn't work, I guess we need some more info > on what all you did before this happened. > > Thanks, > Vijaykumar > > > ----- Original Message ----- >> From: "Matthew Nicholson" <matthew_nicholson at harvard.edu> >> To: "Matthew Nicholson" <matthew_nicholson at harvard.edu> >> Cc: gluster-users at gluster.org >> Sent: Saturday, January 5, 2013 12:48:33 AM >> Subject: Re: geo-replication issues/questions >> >> just to point out more weirdness: >> >> root at sum1-gstore02 nichols2]# gluster volume geo-replication gstore >> status >> MASTER SLAVE >> STATUS >> -------------------------------------------------------------------------------- >> gstore gluster://ox60-gstore01:gstore-rep >> OK >> >> [root at sum1-gstore02 nichols2]# gluster volume geo-replication gstore >> gluster://ox60-gstore01:gstore-rep stop >> geo-replication session between gstore & >> gluster://ox60-gstore01:gstore-rep not active >> geo-replication command failed >> >> [root at sum1-gstore02 nichols2]# gluster volume geo-replication gstore >> gluster://ox60-gstore01:gstore-rep config >> gluster_log_file: >> /var/log/glusterfs/geo-replication/gstore/gluster%3A%2F%2F10.242.64.121%3Agstore-rep.gluster.log >> ssh_command: ssh -oPasswordAuthentication=no >> -oStrictHostKeyChecking=no -i >> /var/lib/glusterd/geo-replication/secret.pem >> remote_gsyncd: /usr/libexec/glusterfs/gsyncd >> state_file: >> /var/lib/glusterd/geo-replication/gstore/gluster%3A%2F%2F10.242.64.121%3Agstore-rep.status >> gluster_command_dir: /usr/sbin/ >> pid_file: >> /var/lib/glusterd/geo-replication/gstore/gluster%3A%2F%2F10.242.64.121%3Agstore-rep.pid >> log_file: >> /var/log/glusterfs/geo-replication/gstore/gluster%3A%2F%2F10.242.64.121%3Agstore-rep.log >> gluster_params: xlator-option=*-dht.assert-no-child-down=true >> >> is there really no simple way to turn this off and start fresh? >> >> On Fri, Jan 4, 2013 at 10:39 AM, Matthew Nicholson >> <matthew_nicholson at harvard.edu> wrote: >> > Oh further more, the slave as listed in the info file are things >> > like: >> > >> > slave2=6456206b-fe19-4b65-b7ab-0c9e7ce6221e:ssh://gstore-rep:/gstore-rep >> > >> > but: >> > >> > gluster volume geo-replication gstore gstore-rep:/gstore-rep stop >> > geo-replication session between gstore & gstore-rep:/gstore-rep not >> > active >> > geo-replication command failed >> > >> > and >> > >> > gluster volume geo-replication gstore >> > gluster://gstore-rep:/gstore-rep stop >> > geo-replication session between gstore & gstore-rep:/gstore-rep not >> > active >> > geo-replication command failed >> > >> > BUT: >> > >> > gluster volume geo-replication gstore >> > gluster://gstore-rep:/gstore-rep stop >> > geo-replication session between gstore & >> > gluster://gstore-rep:/gstore-rep not active >> > geo-replication command failed >> > [root at sum1-gstore01 ~]# gluster volume geo-replication gstore >> > gluster://gstore-rep:/gstore-rep config >> > gluster_log_file: >> > /var/log/glusterfs/geo-replication/gstore/gluster%3A%2F%2F10.242.64.125%3A%2Fgstore-rep.gluster.log >> > ssh_command: ssh -oPasswordAuthentication=no >> > -oStrictHostKeyChecking=no -i >> > /var/lib/glusterd/geo-replication/secret.pem >> > session_owner: b5532175-bf49-413b-b0d7-b834ee9ec619 >> > remote_gsyncd: /usr/libexec/glusterfs/gsyncd >> > state_file: >> > /var/lib/glusterd/geo-replication/gstore/gluster%3A%2F%2F10.242.64.125%3A%2Fgstore-rep.status >> > gluster_command_dir: /usr/sbin/ >> > pid_file: >> > /var/lib/glusterd/geo-replication/gstore/gluster%3A%2F%2F10.242.64.125%3A%2Fgstore-rep.pid >> > log_file: >> > /var/log/glusterfs/geo-replication/gstore/gluster%3A%2F%2F10.242.64.125%3A%2Fgstore-rep.log >> > gluster_params: xlator-option=*-dht.assert-no-child-down=true >> > >> > so, its got a config! >> > >> > I know much of this coem form the gsync.conf file, but i'm not >> > clear >> > on how safe this is to edit, or how to get that sync'd properly >> > among >> > the nodes that make up this volume... >> > >> > >> > >> > On Fri, Jan 4, 2013 at 10:26 AM, Matthew Nicholson >> > <matthew_nicholson at harvard.edu> wrote: >> >> I've got a bunch, but I'll start with my current one: >> >> >> >> [root at sum1-gstore01 ~]# gluster volume geo-replication gstore >> >> status >> >> MASTER SLAVE >> >> STATUS >> >> -------------------------------------------------------------------------------- >> >> >> >> >> >> but ps axf |grep gsync shows lots of procs, and >> >> /var/lib/glusterd/vols/gstore/info >> >> >> >> shows a couple slave entires. >> >> >> >> >> >> trying to turn off geo indexing yeilds: >> >> >> >> [root at sum1-gstore01 ~]# gluster volume set gstore >> >> geo-replication.indexing off >> >> geo-replication.indexing cannot be disabled while geo-replication >> >> sessions exist >> >> Set volume unsuccessful >> >> >> >> so, my question is, how to do i stop these outright? >> >> >> >> I'm been pinging IRC, but its pretty dead in there, and attempts >> >> to >> >> subscribe to this list have been failing too.... >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> Matthew Nicholson >> >> matthew_nicholson at harvard.edu >> >> Research Computing Specialist >> >> FAS Research Computing >> >> Harvard University >> > >> > >> > >> > -- >> > Matthew Nicholson >> > matthew_nicholson at harvard.edu >> > Research Computing Specialist >> > FAS Research Computing >> > Harvard University >> >> >> >> -- >> Matthew Nicholson >> matthew_nicholson at harvard.edu >> Research Computing Specialist >> FAS Research Computing >> Harvard University >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://supercolony.gluster.org/mailman/listinfo/gluster-users >> -- Matthew Nicholson matthew_nicholson at harvard.edu Research Computing Specialist FAS Research Computing Harvard University