Re: Upgraded to 3.7.1, now glusterd core dumps on 1 server

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 

Atin,
When will 3.7.2 be out? I really need it functional by Monday.
Is it safe for me to uninstall 3.7.1, then reinstall 3.7.0?
Regards,
Eva
From: Atin Mukherjee <atin.mukherjee83@xxxxxxxxx>
Date: Saturday, June 6, 2015 1:08 AM
To: Eva Freer <freereb@xxxxxxxx>
Subject: Re: Upgraded to 3.7.1, now glusterd core dumps on 1 server

3.7.1 has issues in rebalance and the core is known. The same will be fixed in 3.7.2.

Regards,
Atin

Sent from Samsung Galaxy S4

On 6 Jun 2015 10:27, "Freer, Eva B." <freereb@xxxxxxxx> wrote:
We have a distributed, replicated configuration with 2 servers. Both servers are running RHEL 6.6 and were fully patched on 5/27/2015. At that time I upgraded to Gluster 3.7.0. 

One server uses Infiniband to supply data to 6 clients. I also updated the Mellanox OFED drivers, which removed rdma and glusterfs-rdma saying they are no longer needed, on all the clients last week. All seemed to be well. 

This configuration serves 2 volumes: home and data. The home volume is small and has plenty of space. The data volume consisted of 5 x 33TB bricks on each server which are replicated via Ethernet. We were at 95% capacity and the long awaited storage expansion was put into service this week with the addition of 2 x 50TB bricks on each server.

After adding the bricks, I did: 'gluster volume rebalance data fix-layout start'
This failed due to no longer having the rdma, so I removed the rdma transport type using: 'gluster volume set data config.transport tcp'
I was then able to successfully run the rebalance fix-layout.

After this completed, I attempted to do a full rebalance with: 'gluster volume rebalance data start'
This did not seem to be going well with the following or similar line repeatedly in the data-rebalance.log:
[2015-06-05 23:06:14.306519] E [socket.c:2913:socket_connect] (--> /usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x3beb224fb0] (--> /usr/lib64/glusterfs/3.7.0/rpc-transport/socket.so(+0x7821)[0x7f4f5fbed821] (--> /usr/lib64/libgfrpc.so.0(rpc_clnt_reconnect+0xd9)[0x3beb60e729] (--> /usr/lib64/libglusterfs.so.0(gf_timer_proc+0x113)[0x3beb245573] (--> /lib64/libpthread.so.0[0x3be9e079d1] ))))) 0-socket: invalid argument: this->private

I stopped the rebalance with: 'gluster volume rebalance data stop'
It appeared to stop, and 'gluster volume rebalance data status' reported that no rebalance was running. Subsequent attempts to restart it failed, reporting that rebalance was already running. 

Hoping to solve the problem, I unmounted the volumes on all clients, stopped both volumes, then stopped glusterfsd and glusterd using the init.d scripts. There were still a few gluster processes hanging around on one server, so I killed them with a SIGTERM. Hoping that the problem would be fixed by the 3.7.1 update, I updated all the gluster packages on both servers.

After the update, glusterd starts on one server (svr2 below), but core dumps every time on the other (svr1 below). I attempted to downgrade back to 3.7.0, but yum tells me that the packages aren't downgradable. Both servers have also been rebooted.

The node-state.info file on svr1 which is failing has:
rebalance_status=1
status=1
rebalance_op=19
rebalance-id=fac3a496-34b4-42e8-889c-60ad0c4d6fd1

On svr2, which is working, it has:
rebalance_status=1
status=4
rebalance_op=0
rebalance-id=00000000-0000-0000-0000-000000000000

I believe that the problem is related to the failed rebalance, but could really use some help in resolving it.

TIA,
Eva

 I ran 'glusterd —debug' and got the following output below:

[root@svr1 ~]# glusterd --debug
[2015-06-06 04:23:53.382235] I [MSGID: 100030] [glusterfsd.c:2294:main] 0-glusterd: Started running glusterd version 3.7.1 (args: glusterd --debug)
[2015-06-06 04:23:53.382286] D [logging.c:1788:__gf_log_inject_timer_event] 0-logging-infra: Starting timer now. Timeout = 120, current buf size = 5
[2015-06-06 04:23:53.382471] D [MSGID: 0] [glusterfsd.c:626:get_volfp] 0-glusterfsd: loading volume file /etc/glusterfs/glusterd.vol
[2015-06-06 04:23:53.385879] I [glusterd.c:1282:init] 0-management: Maximum allowed open file descriptors set to 65536
[2015-06-06 04:23:53.385909] I [glusterd.c:1327:init] 0-management: Using /var/lib/glusterd as working directory
[2015-06-06 04:23:53.385965] D [glusterd.c:391:glusterd_rpcsvc_options_build] 0-: listen-backlog value: 128
[2015-06-06 04:23:53.386118] D [rpcsvc.c:2315:rpcsvc_init] 0-rpc-service: RPC service inited.
[2015-06-06 04:23:53.386134] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2015-06-06 04:23:53.386170] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:53.391242] D [socket.c:3867:socket_init] 0-socket.management: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:53.391266] D [socket.c:3938:socket_init] 0-socket.management: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:53.391274] D [socket.c:3941:socket_init] 0-socket.management: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:53.391282] D [socket.c:3958:socket_init] 0-socket.management: using system polling thread
[2015-06-06 04:23:53.391294] D [name.c:550:server_fill_address_family] 0-socket.management: option address-family not specified, defaulting to inet
[2015-06-06 04:23:53.391388] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/rdma.so
[2015-06-06 04:23:53.391421] E [rpc-transport.c:291:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.7.1/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
[2015-06-06 04:23:53.391436] W [rpc-transport.c:295:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
[2015-06-06 04:23:53.391445] W [rpcsvc.c:1595:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
[2015-06-06 04:23:53.391453] E [glusterd.c:1515:init] 0-management: creation of 1 listeners failed, continuing with succeeded transport
[2015-06-06 04:23:53.391462] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc peer, Num: 1238437, Ver: 2, Port: 0
[2015-06-06 04:23:53.391471] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc cli read-only, Num: 1238463, Ver: 2, Port: 0
[2015-06-06 04:23:53.391479] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc mgmt, Num: 1238433, Ver: 2, Port: 0
[2015-06-06 04:23:53.391487] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc mgmt v3, Num: 1238433, Ver: 3, Port: 0
[2015-06-06 04:23:53.391496] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster Portmap, Num: 34123456, Ver: 1, Port: 0
[2015-06-06 04:23:53.391504] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster Handshake, Num: 14398633, Ver: 2, Port: 0
[2015-06-06 04:23:53.391512] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster MGMT Handshake, Num: 1239873, Ver: 1, Port: 0
[2015-06-06 04:23:53.391548] D [rpcsvc.c:2315:rpcsvc_init] 0-rpc-service: RPC service inited.
[2015-06-06 04:23:53.391558] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2015-06-06 04:23:53.391574] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:53.391649] D [socket.c:3816:socket_init] 0-socket.management: disabling nodelay
[2015-06-06 04:23:53.391660] D [socket.c:3867:socket_init] 0-socket.management: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:53.391670] D [socket.c:3938:socket_init] 0-socket.management: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:53.391677] D [socket.c:3941:socket_init] 0-socket.management: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:53.391685] D [socket.c:3958:socket_init] 0-socket.management: using system polling thread
[2015-06-06 04:23:53.391764] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: GlusterD svc cli, Num: 1238463, Ver: 2, Port: 0
[2015-06-06 04:23:53.391779] D [rpcsvc.c:1872:rpcsvc_program_register] 0-rpc-service: New program registered: Gluster Handshake (CLI Getspec), Num: 14398633, Ver: 2, Port: 0
[2015-06-06 04:23:53.391814] D [glusterd-utils.c:5763:glusterd_sm_tr_log_init] 0-: returning 0
[2015-06-06 04:23:53.391827] D [glusterd.c:1582:init] 0-management: cannot get run-with-valgrind value
[2015-06-06 04:23:53.540315] D [glusterd.c:446:glusterd_check_gsync_present] 0-glusterd: Returning 0
[2015-06-06 04:23:53.540446] D [glusterd.c:572:glusterd_crt_georep_folders] 0-: Returning 0
[2015-06-06 04:23:57.900056] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:57.900106] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:57.900179] D [store.c:304:gf_store_retrieve_value] 0-: key operating-version found
[2015-06-06 04:23:57.900222] I [glusterd-store.c:1986:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 30600
[2015-06-06 04:23:57.900306] D [store.c:304:gf_store_retrieve_value] 0-: key UUID found
[2015-06-06 04:23:57.900355] D [glusterd-store.c:2055:glusterd_retrieve_uuid] 0-: Returning 0
[2015-06-06 04:23:57.900386] I [glusterd.c:154:glusterd_uuid_init] 0-management: retrieved UUID: 0512eb62-b9d1-4f28-9e61-52bc4c50902b
[2015-06-06 04:23:57.900502] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-glustershd: setting frame-timeout to 600
[2015-06-06 04:23:57.900520] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-glustershd: disable ping-timeout
[2015-06-06 04:23:57.900539] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:57.900696] D [socket.c:3816:socket_init] 0-glustershd: disabling nodelay
[2015-06-06 04:23:57.900715] D [socket.c:3867:socket_init] 0-glustershd: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:57.900733] D [socket.c:3938:socket_init] 0-glustershd: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:57.900746] D [socket.c:3941:socket_init] 0-glustershd: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:57.900759] D [socket.c:3958:socket_init] 0-glustershd: using system polling thread
[2015-06-06 04:23:57.900817] D [MSGID: 0] [glusterd-svc-mgmt.c:116:glusterd_svc_init_common] 0-management: Returning 0
[2015-06-06 04:23:57.900843] D [glusterd.c:1204:glusterd_svc_init_all] 0-management: shd service initialized
[2015-06-06 04:23:57.900914] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-nfs: setting frame-timeout to 600
[2015-06-06 04:23:57.900930] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-nfs: disable ping-timeout
[2015-06-06 04:23:57.900997] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:57.901120] D [socket.c:3816:socket_init] 0-nfs: disabling nodelay
[2015-06-06 04:23:57.901137] D [socket.c:3867:socket_init] 0-nfs: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:57.901153] D [socket.c:3938:socket_init] 0-nfs: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:57.901165] D [socket.c:3941:socket_init] 0-nfs: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:57.901177] D [socket.c:3958:socket_init] 0-nfs: using system polling thread
[2015-06-06 04:23:57.901220] D [glusterd.c:1212:glusterd_svc_init_all] 0-management: nfs service initialized
[2015-06-06 04:23:57.901291] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-quotad: setting frame-timeout to 600
[2015-06-06 04:23:57.901307] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-quotad: disable ping-timeout
[2015-06-06 04:23:57.901324] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:57.901449] D [socket.c:3816:socket_init] 0-quotad: disabling nodelay
[2015-06-06 04:23:57.901466] D [socket.c:3867:socket_init] 0-quotad: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:57.901482] D [socket.c:3938:socket_init] 0-quotad: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:57.901494] D [socket.c:3941:socket_init] 0-quotad: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:57.901506] D [socket.c:3958:socket_init] 0-quotad: using system polling thread
[2015-06-06 04:23:57.901553] D [glusterd.c:1221:glusterd_svc_init_all] 0-management: quotad service initialized
[2015-06-06 04:23:57.901620] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-bitd: setting frame-timeout to 600
[2015-06-06 04:23:57.901636] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-bitd: disable ping-timeout
[2015-06-06 04:23:57.901656] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:57.901775] D [socket.c:3816:socket_init] 0-bitd: disabling nodelay
[2015-06-06 04:23:57.901792] D [socket.c:3867:socket_init] 0-bitd: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:57.901807] D [socket.c:3938:socket_init] 0-bitd: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:57.901819] D [socket.c:3941:socket_init] 0-bitd: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:57.901832] D [socket.c:3958:socket_init] 0-bitd: using system polling thread
[2015-06-06 04:23:57.901873] D [glusterd.c:1230:glusterd_svc_init_all] 0-management: BitD service initialized
[2015-06-06 04:23:57.901955] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-scrub: setting frame-timeout to 600
[2015-06-06 04:23:57.901974] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-scrub: disable ping-timeout
[2015-06-06 04:23:57.901995] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:57.902115] D [socket.c:3816:socket_init] 0-scrub: disabling nodelay
[2015-06-06 04:23:57.902132] D [socket.c:3867:socket_init] 0-scrub: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:57.902147] D [socket.c:3938:socket_init] 0-scrub: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:57.902166] D [socket.c:3941:socket_init] 0-scrub: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:57.902179] D [socket.c:3958:socket_init] 0-scrub: using system polling thread
[2015-06-06 04:23:57.902221] D [glusterd.c:1238:glusterd_svc_init_all] 0-management: scrub service initialized
[2015-06-06 04:23:57.902310] D [glusterd-utils.c:519:glusterd_volinfo_new] 0-management: Returning 0
[2015-06-06 04:23:57.902388] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
[2015-06-06 04:23:57.902405] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-snapd: disable ping-timeout
[2015-06-06 04:23:57.902425] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:57.902546] D [socket.c:3816:socket_init] 0-snapd: disabling nodelay
[2015-06-06 04:23:57.902563] D [socket.c:3867:socket_init] 0-snapd: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:57.902579] D [socket.c:3938:socket_init] 0-snapd: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:57.902591] D [socket.c:3941:socket_init] 0-snapd: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:57.902604] D [socket.c:3958:socket_init] 0-snapd: using system polling thread
[2015-06-06 04:23:57.902651] D [glusterd-snapd-svc.c:112:glusterd_snapdsvc_init] 0-management: Returning 0
[2015-06-06 04:23:57.908407] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:57.908438] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:57.908476] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:57.908517] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908533] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = type value = 2
[2015-06-06 04:23:57.908554] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908567] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = count value = 2
[2015-06-06 04:23:57.908591] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908604] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = status value = 1
[2015-06-06 04:23:57.908622] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908635] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = sub_count value = 2
[2015-06-06 04:23:57.908654] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908666] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = stripe_count value = 1
[2015-06-06 04:23:57.908685] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908697] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = replica_count value = 2
[2015-06-06 04:23:57.908716] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908728] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = disperse_count value = 0
[2015-06-06 04:23:57.908748] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908760] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = redundancy_count value = 0
[2015-06-06 04:23:57.908779] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908792] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = version value = 25
[2015-06-06 04:23:57.908810] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908823] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = transport-type value = 0
[2015-06-06 04:23:57.908842] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908854] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = volume-id value = 7f7f5445-2622-4681-b2dd-2325f93c2549
[2015-06-06 04:23:57.908877] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908890] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = username value = 297a4286-b7c7-4377-a9c5-df7e928c5231
[2015-06-06 04:23:57.908915] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.908928] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = password value = c72abad3-b7d6-45b0-b171-7c69e8d6ee1f
[2015-06-06 04:23:57.909003] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909018] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = op-version value = 30600
[2015-06-06 04:23:57.909043] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909056] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = client-op-version value = 2
[2015-06-06 04:23:57.909076] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909089] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = parent_volname value = N/A
[2015-06-06 04:23:57.909113] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909125] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = restored_from_snap value = 00000000-0000-0000-0000-000000000000
[2015-06-06 04:23:57.909149] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909162] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = snap-max-hard-limit value = 256
[2015-06-06 04:23:57.909183] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909195] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = auth.ssl-allow value = *
[2015-06-06 04:23:57.909225] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=auth.ssl-allow,value:*
[2015-06-06 04:23:57.909249] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909262] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = client.ssl value = on
[2015-06-06 04:23:57.909282] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=client.ssl,value:on
[2015-06-06 04:23:57.909303] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909316] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = server.ssl value = on
[2015-06-06 04:23:57.909337] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=server.ssl,value:on
[2015-06-06 04:23:57.909357] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909370] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = config.transport value = tcp
[2015-06-06 04:23:57.909400] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=config.transport,value:tcp
[2015-06-06 04:23:57.909422] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909435] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-0 value = svr1:-home1
[2015-06-06 04:23:57.909457] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909470] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-1 value = svr2:-home1
[2015-06-06 04:23:57.909493] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:57.909542] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:57.909573] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:57.909609] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909634] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909651] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909669] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909686] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909703] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909720] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909737] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909754] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909771] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909789] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909806] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909823] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909840] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909856] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909873] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909891] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909908] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909926] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909965] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.909983] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.910000] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.910018] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.916756] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:57.916786] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:57.916827] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:57.916866] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.916887] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:57.916906] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.138315] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.138336] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.138346] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.138360] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.138372] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.138398] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.138413] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146754] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.146785] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.146823] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.146861] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146885] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146898] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146912] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146925] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146957] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146972] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146985] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.146999] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.147024] D [glusterd-store.c:2325:glusterd_store_retrieve_bricks] 0-: Returning with 0
[2015-06-06 04:23:58.147300] D [glusterd-utils.c:1964:glusterd_volume_compute_cksum] 0-management: Returning with 0
[2015-06-06 04:23:58.172095] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.172169] D [store.c:304:gf_store_retrieve_value] 0-: key version found
[2015-06-06 04:23:58.172207] D [store.c:458:gf_store_handle_destroy] 0-: Returning 0
[2015-06-06 04:23:58.188751] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.188866] D [glusterd-utils.c:1964:glusterd_volume_compute_cksum] 0-management: Returning with 0
[2015-06-06 04:23:58.205659] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.205780] D [store.c:372:gf_store_save_value] 0-: returning: 0
[2015-06-06 04:23:58.205829] D [store.c:372:gf_store_save_value] 0-: returning: 0
[2015-06-06 04:23:58.251394] D [store.c:458:gf_store_handle_destroy] 0-: Returning 0
[2015-06-06 04:23:58.259736] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.259766] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.259799] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.259836] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.259858] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.259876] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.259894] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.259915] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.259999] D [glusterd-utils.c:519:glusterd_volinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.260082] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-snapd: setting frame-timeout to 600
[2015-06-06 04:23:58.260100] D [rpc-clnt.c:989:rpc_clnt_connection_init] 0-snapd: disable ping-timeout
[2015-06-06 04:23:58.260122] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:58.260252] D [socket.c:3816:socket_init] 0-snapd: disabling nodelay
[2015-06-06 04:23:58.260270] D [socket.c:3867:socket_init] 0-snapd: Configued transport.tcp-user-timeout=0
[2015-06-06 04:23:58.260287] D [socket.c:3938:socket_init] 0-snapd: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:58.260300] D [socket.c:3941:socket_init] 0-snapd: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:58.260313] D [socket.c:3958:socket_init] 0-snapd: using system polling thread
[2015-06-06 04:23:58.260358] D [glusterd-snapd-svc.c:112:glusterd_snapdsvc_init] 0-management: Returning 0
[2015-06-06 04:23:58.268158] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.268189] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.268226] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.268264] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268279] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = type value = 2
[2015-06-06 04:23:58.268300] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268314] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = count value = 14
[2015-06-06 04:23:58.268333] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268346] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = status value = 1
[2015-06-06 04:23:58.268364] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268377] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = sub_count value = 2
[2015-06-06 04:23:58.268396] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268409] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = stripe_count value = 1
[2015-06-06 04:23:58.268428] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268441] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = replica_count value = 2
[2015-06-06 04:23:58.268460] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268473] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = disperse_count value = 0
[2015-06-06 04:23:58.268492] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268505] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = redundancy_count value = 0
[2015-06-06 04:23:58.268524] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268537] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = version value = 52
[2015-06-06 04:23:58.268555] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268568] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = transport-type value = 0
[2015-06-06 04:23:58.268588] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268601] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = volume-id value = 6cbe45f3-361c-42a7-9f02-a7bb7e717cca
[2015-06-06 04:23:58.268624] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268637] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = username value = ee88b27e-ac6e-4109-8426-0027d9292ac9
[2015-06-06 04:23:58.268658] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268670] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = password value = 266e545f-ad38-47b2-9659-0acfd38c6a57
[2015-06-06 04:23:58.268692] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268705] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = op-version value = 30600
[2015-06-06 04:23:58.268726] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268739] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = client-op-version value = 2
[2015-06-06 04:23:58.268759] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268772] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = parent_volname value = N/A
[2015-06-06 04:23:58.268793] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268807] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = restored_from_snap value = 00000000-0000-0000-0000-000000000000
[2015-06-06 04:23:58.268830] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268843] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = snap-max-hard-limit value = 256
[2015-06-06 04:23:58.268864] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268877] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = config.transport value = tcp
[2015-06-06 04:23:58.268905] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=config.transport,value:tcp
[2015-06-06 04:23:58.268928] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.268979] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = client.ssl value = on
[2015-06-06 04:23:58.269002] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=client.ssl,value:on
[2015-06-06 04:23:58.269025] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269038] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = server.ssl value = on
[2015-06-06 04:23:58.269058] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=server.ssl,value:on
[2015-06-06 04:23:58.269078] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269091] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = auth.ssl-allow value = *
[2015-06-06 04:23:58.269111] D [glusterd-store.c:2634:glusterd_store_update_volinfo] 0-: Parsed as Volume-set:key=auth.ssl-allow,value:*
[2015-06-06 04:23:58.269131] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269144] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-0 value = svr1:-data2
[2015-06-06 04:23:58.269165] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269178] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-1 value = svr2:-data2
[2015-06-06 04:23:58.269199] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269211] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-2 value = svr1:-data3
[2015-06-06 04:23:58.269232] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269244] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-3 value = svr2:-data3
[2015-06-06 04:23:58.269266] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269279] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-4 value = svr1:-data4
[2015-06-06 04:23:58.269300] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269313] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-5 value = svr2:-data4
[2015-06-06 04:23:58.269334] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269346] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-6 value = svr1:-data5
[2015-06-06 04:23:58.269367] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269379] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-7 value = svr2:-data5
[2015-06-06 04:23:58.269400] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269413] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-8 value = svr1:-data1
[2015-06-06 04:23:58.269433] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269446] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-9 value = svr2:-data1
[2015-06-06 04:23:58.269466] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269479] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-10 value = svr1:-data6
[2015-06-06 04:23:58.269499] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269513] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-11 value = svr2:-data6
[2015-06-06 04:23:58.269533] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269546] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-12 value = svr1:-data7
[2015-06-06 04:23:58.269567] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269580] D [glusterd-store.c:2485:glusterd_store_update_volinfo] 0-: key = brick-13 value = svr2:-data7
[2015-06-06 04:23:58.269602] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.269647] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.269683] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.269716] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269736] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269753] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269771] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269789] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269806] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269823] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269840] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269858] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269877] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269895] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269913] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269930] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269972] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.269990] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270007] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270025] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270043] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270061] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270078] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270096] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270114] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.270131] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276498] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.276529] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.276567] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.276604] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276626] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276645] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276665] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276684] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276703] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276722] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.276741] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.276783] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.276809] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.284836] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.284867] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.284906] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.284966] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.284992] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285012] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285032] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285051] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285071] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285090] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285108] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.285129] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.285169] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.285197] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293252] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.293283] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.293321] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.293357] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293378] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293397] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293416] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293435] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293453] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293471] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.293489] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.293529] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.293557] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301526] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.301556] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.301597] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.301636] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301658] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301677] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301696] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301715] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301733] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301751] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301769] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.301788] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.301828] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.301857] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.309975] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.310005] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.310044] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.310081] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310102] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310121] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310141] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310159] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310177] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310196] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.310214] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.310255] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.310280] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318319] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.318349] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.318391] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.318431] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318453] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318472] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318492] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318511] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318530] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318549] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318568] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.318587] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.318634] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.318661] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326720] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.326751] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.326789] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.326826] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326848] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326867] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326888] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326911] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326931] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.326981] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.327001] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.327042] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.327069] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335084] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.335115] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.335153] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.335190] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335212] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335231] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335251] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335270] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335289] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335308] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335327] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.335346] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.335388] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.335414] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343459] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.343490] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.343529] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.343565] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343587] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343607] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343627] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343646] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343665] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343684] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.343704] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.343746] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.343771] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.351836] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.351867] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.351905] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.351972] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.351998] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352017] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352037] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352056] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352075] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352093] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352112] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.352131] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.352175] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.352201] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360201] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.360232] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.360270] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.360306] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360328] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360347] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360367] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360386] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360404] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360422] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360440] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.360459] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.360501] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.360527] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368562] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.368592] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.368630] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.368667] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368689] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368708] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368727] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368745] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368763] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368781] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368800] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.368818] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.368863] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.368889] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.376950] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.376981] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.377023] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.377060] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377082] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377101] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377121] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377140] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377159] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377178] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377197] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.377216] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.377258] D [glusterd-utils.c:811:glusterd_brickinfo_new] 0-management: Returning 0
[2015-06-06 04:23:58.377284] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385334] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.385365] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.385404] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.385440] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385462] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385482] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385502] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385521] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385540] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385559] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385577] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.385597] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.385632] D [glusterd-store.c:2325:glusterd_store_retrieve_bricks] 0-: Returning with 0
[2015-06-06 04:23:58.386052] D [glusterd-utils.c:1964:glusterd_volume_compute_cksum] 0-management: Returning with 0
[2015-06-06 04:23:58.407228] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.407292] D [store.c:304:gf_store_retrieve_value] 0-: key version found
[2015-06-06 04:23:58.407329] D [store.c:458:gf_store_handle_destroy] 0-: Returning 0
[2015-06-06 04:23:58.415605] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.415720] D [glusterd-utils.c:1964:glusterd_volume_compute_cksum] 0-management: Returning with 0
[2015-06-06 04:23:58.432504] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.432624] D [store.c:372:gf_store_save_value] 0-: returning: 0
[2015-06-06 04:23:58.432673] D [store.c:372:gf_store_save_value] 0-: returning: 0
[2015-06-06 04:23:58.478139] D [store.c:458:gf_store_handle_destroy] 0-: Returning 0
[2015-06-06 04:23:58.486471] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.486501] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.486537] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.486577] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.486598] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.486616] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.486635] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.486656] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.486689] D [glusterd-store.c:2968:glusterd_store_retrieve_volumes] 0-: Returning with 0
[2015-06-06 04:23:58.503287] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-06 04:23:58.503317] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-06 04:23:58.503349] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-06 04:23:58.503397] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.503419] D [glusterd-utils.c:5763:glusterd_sm_tr_log_init] 0-: returning 0
[2015-06-06 04:23:58.503444] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.503463] D [store.c:608:gf_store_iter_get_next] 0-: Returning with 0
[2015-06-06 04:23:58.503480] D [glusterd-peer-utils.c:454:glusterd_peer_hostname_new] 0-glusterd: Returning 0
[2015-06-06 04:23:58.503501] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-06 04:23:58.503537] I [glusterd-handler.c:3387:glusterd_friend_add_from_peerinfo] 0-management: connect returned 0
[2015-06-06 04:23:58.503611] D [glusterd-handler.c:3220:glusterd_transport_inet_options_build] 0-glusterd: Returning 0
[2015-06-06 04:23:58.503645] I [rpc-clnt.c:972:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
[2015-06-06 04:23:58.503660] D [rpc-clnt.c:984:rpc_clnt_connection_init] 0-management: setting ping-timeout to 30
[2015-06-06 04:23:58.503678] D [rpc-transport.c:287:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.7.1/rpc-transport/socket.so
[2015-06-06 04:23:58.503832] D [socket.c:3867:socket_init] 0-management: Configued transport.tcp-user-timeout=-1
[2015-06-06 04:23:58.503852] D [socket.c:3938:socket_init] 0-management: SSL support on the I/O path is NOT enabled
[2015-06-06 04:23:58.503865] D [socket.c:3941:socket_init] 0-management: SSL support for glusterd is NOT enabled
[2015-06-06 04:23:58.503878] D [socket.c:3958:socket_init] 0-management: using system polling thread
[2015-06-06 04:23:58.510217] D [common-utils.c:334:gf_resolve_ip6] 0-resolver: returning ip-160.91.108.93 (port-24007) for hostname: svr2 and port: 24007
[2015-06-06 04:23:58.510246] D [socket.c:2883:socket_fix_ssl_opts] 0-management: disabling SSL for portmapper connection
[2015-06-06 04:23:58.510360] D [glusterd-handler.c:3153:glusterd_rpc_create] 0-management: returning 0
[2015-06-06 04:23:58.510387] D [glusterd-store.c:3986:glusterd_store_retrieve_peers] 0-: Returning with 0
[2015-06-06 04:23:58.510441] D [glusterd-store.c:3386:glusterd_store_retrieve_missed_snaps_list] 0-management: EOF for missed_snap_list
[2015-06-06 04:23:58.510462] D [glusterd-store.c:3487:glusterd_store_retrieve_snaps] 0-: Returning with 0
[2015-06-06 04:23:58.510758] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.510857] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.511276] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.511304] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.511312] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.511321] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.511330] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.511337] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.511498] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.511555] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.511790] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.511803] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.511811] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.511820] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.511828] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.511835] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.512020] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.512079] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.512313] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.512327] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.512334] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.512343] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.512351] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.512358] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.512514] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.512570] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.512810] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.512824] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.512832] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.512840] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.512848] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.512855] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.513037] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.513095] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.513329] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.513342] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.513350] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.513358] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.513366] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.513373] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.513529] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.513585] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.513818] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.513831] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.513839] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.513847] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.513855] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.513862] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.514044] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find friend: svr1
[2015-06-06 04:23:58.514102] D [common-utils.c:3116:gf_is_local_addr] 0-management: 160.91.55.61 
[2015-06-06 04:23:58.514337] D [common-utils.c:3013:gf_interface_search] 0-management: 160.91.55.61 is local address at interface eth0
[2015-06-06 04:23:58.514351] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.514359] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.514368] D [glusterd-peer-utils.c:636:gd_peerinfo_find_from_hostname] 0-management: Friend svr2 found.. state: 3
[2015-06-06 04:23:58.514375] D [glusterd-peer-utils.c:164:glusterd_hostname_to_uuid] 0-management: returning 0
[2015-06-06 04:23:58.514383] D [glusterd-utils.c:851:glusterd_resolve_brick] 0-management: Returning 0
[2015-06-06 04:23:58.514540] D [glusterd-peer-utils.c:129:glusterd_peerinfo_find_by_hostname] 0-management: Unable to find

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
...
 
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux