On Tuesday, March 22, 2016 18:27:46 Atin Mukherjee wrote:
> This is the problem, peer handshaking hasn't finished yet. To get to
> know the reason I'd need to get the glusterd log file from 192.168.122.10.
Here's the log from the other machine (.10).
> As a workaround can you do the following?
>
> 1. From node 1 open /var/lib/glusterd/peers/<uuid file>, modify state=3
> 2. Repeat step 1 for node 2 as well if state is different
> 3. restart both the glusterd instances.
Hmm, just realized this:
This is "Box A"
[root@vmserver-a peers]# ls -l
total 4
-rw------- 1 root root 74 Mar 22 17:15 fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
[root@vmserver-a peers]# cat fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
uuid=fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
state=3
hostname1=192.168.122.1
This is "Box B" (from where I'm running the gluster create command:
[root@vmserver-b peers]# ls -l
total 4
-rw------- 1 root root 75 Mar 22 17:15 d8e1d7a0-077a-4a50-93f6-d3922e3b96b9
[root@vmserver-b peers]# cat d8e1d7a0-077a-4a50-93f6-d3922e3b96b9
uuid=d8e1d7a0-077a-4a50-93f6-d3922e3b96b9
state=3
hostname1=192.168.122.10
Why is the gateway in the peer list? To my knowledge, that's not getting
added anywhere. This is weird.
Also odd:
[root@vmserver-a peers]# gluster peer status
Number of Peers: 1
Hostname: 192.168.122.1
Uuid: fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
State: Peer in Cluster (Disconnected)
[root@vmserver-b peers]# gluster peer status
Number of Peers: 1
Hostname: 192.168.122.10
Uuid: d8e1d7a0-077a-4a50-93f6-d3922e3b96b9
State: Peer in Cluster (Connected)
So, somehow, on vmserver-a is getting 192.168.122.1 in its peer list instead
of 192.168.122.11
Very strange.
j
> ~Atin
>
> >> Also send the glusterd log of the node where the commands have failed.
> >
> > The two logs are attached. The peer status says connected. The log file
> > says "FAILED : Host 192.168.122.10 is not in 'Peer in Cluster' state"
> > I'm confused. :)
> >
> > Thanks for your help on this!
> >
> > j
> >
> >
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users@xxxxxxxxxxx
> > http://www.gluster.org/mailman/listinfo/gluster-users
--
Joshua J. Kugler - Fairbanks, Alaska
Azariah Enterprises - Programming and Website Design
joshua@xxxxxxxxxxx - Jabber: pedahzur@xxxxxxxxx
PGP Key: http://pgp.mit.edu/ ID 0x73B13B6A
[2016-03-22 05:23:28.500587] I [MSGID: 100030] [glusterfsd.c:2035:main] 0-glusterd: Started running glusterd version 3.6.9 (args: glusterd --xlator-option *.upgrade=on -N)
[2016-03-22 05:23:28.505311] I [graph.c:269:gf_add_cmdline_options] 0-management: adding option 'upgrade' for volume 'management' with value 'on'
[2016-03-22 05:23:28.505375] I [glusterd.c:1214:init] 0-management: Maximum allowed open file descriptors set to 65536
[2016-03-22 05:23:28.505390] I [glusterd.c:1259:init] 0-management: Using /var/lib/glusterd as working directory
[2016-03-22 05:23:28.508992] E [rpc-transport.c:266:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.6.9/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
[2016-03-22 05:23:28.509015] W [rpc-transport.c:270:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
[2016-03-22 05:23:28.509022] W [rpcsvc.c:1524:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
[2016-03-22 05:23:28.509652] I [glusterd.c:413:glusterd_check_gsync_present] 0-glusterd: geo-replication module not installed in the system
[2016-03-22 05:23:28.509954] E [store.c:432:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/glusterd.info, returned error: (No such file or directory)
[2016-03-22 05:23:28.509969] E [store.c:432:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/glusterd.info, returned error: (No such file or directory)
[2016-03-22 05:23:28.509975] I [glusterd-store.c:2068:glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 30603
[2016-03-22 05:23:28.510038] I [glusterd-store.c:3502:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
[2016-03-22 05:23:28.510091] E [store.c:432:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/options, returned error: (No such file or directory)
Final graph:
+------------------------------------------------------------------------------+
1: volume management
2: type mgmt/glusterd
3: option rpc-auth.auth-glusterfs on
4: option rpc-auth.auth-unix on
5: option rpc-auth.auth-null on
6: option transport.socket.listen-backlog 128
7: option upgrade on
8: option ping-timeout 30
9: option transport.socket.read-fail-log off
10: option transport.socket.keepalive-interval 2
11: option transport.socket.keepalive-time 10
12: option transport-type rdma
13: option working-directory /var/lib/glusterd
14: end-volume
15:
+------------------------------------------------------------------------------+
[2016-03-22 05:23:28.548842] W [glusterfsd.c:1211:cleanup_and_exit] (--> 0-: received signum (15), shutting down
[2016-03-22 05:23:29.137920] I [MSGID: 100030] [glusterfsd.c:2035:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.6.9 (args: /usr/sbin/glusterd --pid-file=/var/run/glusterd.pid)
[2016-03-22 05:23:29.141413] I [glusterd.c:1214:init] 0-management: Maximum allowed open file descriptors set to 65536
[2016-03-22 05:23:29.141441] I [glusterd.c:1259:init] 0-management: Using /var/lib/glusterd as working directory
[2016-03-22 05:23:29.144506] E [rpc-transport.c:266:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.6.9/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
[2016-03-22 05:23:29.144520] W [rpc-transport.c:270:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
[2016-03-22 05:23:29.144527] W [rpcsvc.c:1524:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
[2016-03-22 05:23:29.145711] I [glusterd.c:413:glusterd_check_gsync_present] 0-glusterd: geo-replication module not installed in the system
[2016-03-22 05:23:29.145828] E [store.c:432:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/glusterd.info, returned error: (No such file or directory)
[2016-03-22 05:23:29.145847] E [store.c:432:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/glusterd.info, returned error: (No such file or directory)
[2016-03-22 05:23:29.145853] I [glusterd-store.c:2068:glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 30603
[2016-03-22 05:23:29.145926] I [glusterd-store.c:3502:glusterd_store_retrieve_missed_snaps_list] 0-management: No missed snaps list.
Final graph:
+------------------------------------------------------------------------------+
1: volume management
2: type mgmt/glusterd
3: option rpc-auth.auth-glusterfs on
4: option rpc-auth.auth-unix on
5: option rpc-auth.auth-null on
6: option transport.socket.listen-backlog 128
7: option ping-timeout 30
8: option transport.socket.read-fail-log off
9: option transport.socket.keepalive-interval 2
10: option transport.socket.keepalive-time 10
11: option transport-type rdma
12: option working-directory /var/lib/glusterd
13: end-volume
14:
+------------------------------------------------------------------------------+
[2016-03-22 05:26:39.277674] I [glusterd-handshake.c:1119:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30603
[2016-03-22 05:26:39.277734] E [store.c:432:gf_store_handle_retrieve] 0-: Path corresponding to /var/lib/glusterd/glusterd.info, returned error: (No such file or directory)
[2016-03-22 05:26:39.277797] I [glusterd.c:176:glusterd_uuid_generate_save] 0-management: generated UUID: d8e1d7a0-077a-4a50-93f6-d3922e3b96b9
[2016-03-22 05:26:39.378230] I [glusterd-handler.c:2543:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
[2016-03-22 05:26:39.382409] I [glusterd-handler.c:2571:__glusterd_handle_probe_query] 0-glusterd: Unable to find peerinfo for host: 192.168.122.1 (24007)
[2016-03-22 05:26:39.426110] I [rpc-clnt.c:969:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
[2016-03-22 05:26:39.430904] I [glusterd-handler.c:3131:glusterd_friend_add] 0-management: connect returned 0
[2016-03-22 05:26:39.430951] I [glusterd-handler.c:2595:__glusterd_handle_probe_query] 0-glusterd: Responded to 192.168.122.1, op_ret: 0, op_errno: 0, ret: 0
[2016-03-22 05:26:39.431292] I [glusterd-handler.c:2232:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
[2016-03-22 05:27:42.430208] E [socket.c:2276:socket_connect_finish] 0-management: connection to 192.168.122.1:24007 failed (Connection timed out)
[2016-03-22 05:27:42.430297] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer 00000000-0000-0000-0000-000000000000, in Probe Received from peer state, has disconnected from glusterd.
[2016-03-22 05:27:42.547206] I [glusterd-handler.c:3367:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 192.168.122.1 (0), ret: 0
[2016-03-22 05:28:46.172190] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:29:49.182179] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:30:52.191315] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:31:55.202283] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:32:58.212233] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:34:01.223197] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:35:04.235459] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:36:07.251197] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:37:10.265260] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:38:13.280271] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:39:16.295281] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:40:19.314224] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:41:22.326185] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:42:25.341434] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:43:28.363441] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:44:31.384431] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:45:34.405262] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:46:37.422292] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:47:40.438345] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:48:43.455476] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:49:46.476270] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:50:49.499488] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:51:52.517249] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:52:55.530198] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:53:58.548203] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:55:01.561214] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:56:04.574469] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:57:07.590351] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:58:10.609212] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 05:59:13.623405] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:00:16.643396] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:01:19.659222] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:02:22.680261] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:03:25.696402] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:04:28.717496] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:05:31.737470] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:06:34.760348] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:07:37.779496] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:08:40.802530] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:09:43.824283] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:10:46.843259] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:11:49.858456] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:12:52.878289] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:13:55.896370] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:14:58.916243] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:16:01.933275] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:17:04.951404] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:18:07.973473] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:19:10.994531] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:20:14.013358] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:21:17.028227] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:22:20.042446] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:23:23.060233] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:24:26.074253] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:25:29.088202] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:26:32.101634] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:27:35.119223] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:28:38.134200] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:29:41.146413] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:30:44.164291] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:31:47.181419] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:32:50.197276] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:33:53.211194] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:34:56.229497] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:35:59.248395] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:37:02.269316] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:38:05.284302] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:39:08.300576] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:40:11.320251] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:41:14.336215] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:42:17.350482] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:43:20.369277] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:44:23.391245] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:45:26.407255] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:46:29.423260] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:47:32.440239] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:48:35.456461] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:49:38.479270] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:50:41.496253] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:51:44.509432] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:52:47.528222] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:53:50.546232] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:54:53.561235] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:55:56.574210] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:56:59.589269] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:58:02.603220] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 06:59:05.616269] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:00:08.637476] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:01:11.654219] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:02:14.674205] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:03:17.690421] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:04:20.709413] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:05:23.729297] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:06:26.745489] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:07:29.762251] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:08:32.784452] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:09:35.806295] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:10:38.825259] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:11:41.841245] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:12:44.858261] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:13:47.874319] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:14:50.896563] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:15:53.917314] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:16:56.936334] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:17:59.954470] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:19:02.977333] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:20:05.996382] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:21:09.012385] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:22:12.026226] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:23:15.039462] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:24:18.053205] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:25:21.066295] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:26:24.082426] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:27:27.097362] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:28:30.110381] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:29:33.128228] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:30:36.141432] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:31:39.160343] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:32:42.180277] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:33:45.199256] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:34:48.216198] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:35:51.230278] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:36:54.246425] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:37:57.265455] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:39:00.280247] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:40:03.295217] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:41:06.309261] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:42:09.323195] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:43:12.336374] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:44:15.354377] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:45:18.374347] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:46:21.389332] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:47:24.404433] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-22 07:47:49.023140] W [glusterfsd.c:1211:cleanup_and_exit] (--> 0-: received signum (15), shutting down
[2016-03-23 01:14:11.002649] I [MSGID: 100030] [glusterfsd.c:2035:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.6.9 (args: /usr/sbin/glusterd --pid-file=/var/run/glusterd.pid)
[2016-03-23 01:14:11.023162] I [glusterd.c:1214:init] 0-management: Maximum allowed open file descriptors set to 65536
[2016-03-23 01:14:11.023232] I [glusterd.c:1259:init] 0-management: Using /var/lib/glusterd as working directory
[2016-03-23 01:14:11.045377] E [rpc-transport.c:266:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.6.9/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
[2016-03-23 01:14:11.045409] W [rpc-transport.c:270:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
[2016-03-23 01:14:11.045417] W [rpcsvc.c:1524:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
[2016-03-23 01:14:11.047819] I [glusterd.c:413:glusterd_check_gsync_present] 0-glusterd: geo-replication module not installed in the system
[2016-03-23 01:14:11.059829] I [glusterd-store.c:2048:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 30603
[2016-03-23 01:14:11.072770] I [glusterd-handler.c:3179:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
[2016-03-23 01:14:11.072868] I [rpc-clnt.c:969:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
Final graph:
+------------------------------------------------------------------------------+
1: volume management
2: type mgmt/glusterd
3: option rpc-auth.auth-glusterfs on
4: option rpc-auth.auth-unix on
5: option rpc-auth.auth-null on
6: option transport.socket.listen-backlog 128
7: option ping-timeout 30
8: option transport.socket.read-fail-log off
9: option transport.socket.keepalive-interval 2
10: option transport.socket.keepalive-time 10
11: option transport-type rdma
12: option working-directory /var/lib/glusterd
13: end-volume
14:
+------------------------------------------------------------------------------+
[2016-03-23 01:14:11.601806] I [glusterd-handshake.c:1119:__glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 30603
[2016-03-23 01:14:11.601938] I [glusterd.c:146:glusterd_uuid_init] 0-management: retrieved UUID: d8e1d7a0-077a-4a50-93f6-d3922e3b96b9
[2016-03-23 01:14:11.658345] I [glusterd-handler.c:2543:__glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
[2016-03-23 01:14:11.660094] I [glusterd-handler.c:2595:__glusterd_handle_probe_query] 0-glusterd: Responded to 192.168.122.1, op_ret: 0, op_errno: 0, ret: 0
[2016-03-23 01:14:11.680421] I [glusterd-handler.c:2232:__glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
[2016-03-23 01:15:14.076974] E [socket.c:2276:socket_connect_finish] 0-management: connection to 192.168.122.1:24007 failed (Connection timed out)
[2016-03-23 01:15:14.077058] I [MSGID: 106004] [glusterd-handler.c:4398:__glusterd_peer_rpc_notify] 0-management: Peer fe722085-ac0f-4449-a43f-2dc9dd1fd8fb, in Accepted peer request state, has disconnected from glusterd.
[2016-03-23 01:15:14.113727] I [glusterd-handler.c:3367:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 192.168.122.1 (0), ret: 0
[2016-03-23 01:15:14.234058] I [glusterd-handler.c:2389:__glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: fe722085-ac0f-4449-a43f-2dc9dd1fd8fb
[2016-03-23 01:15:14.234101] I [glusterd-handler.c:2432:__glusterd_handle_friend_update] 0-management: Received my uuid as Friend
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
