Re: Gluster 3.8.10 rebalance VMs corruption

[Mahdi Adnan <mahdi.adnan@xxxxxxxxxxx>]

Hello Krutika,

Kindly, check the attached logs.

--

Respectfully
Mahdi A. Mahdi

---

From: Krutika Dhananjay <kdhananj@xxxxxxxxxx>
Sent: Saturday, March 18, 2017 3:29:03 PM
To: Mahdi Adnan
Cc: gluster-users@xxxxxxxxxxx
Subject: Re: Gluster 3.8.10 rebalance VMs corruption

 

Hi Mahdi,

Could you attach mount, brick and rebalance logs?

-Krutika

On Sat, Mar 18, 2017 at 12:14 AM, Mahdi Adnan <mahdi.adnan@xxxxxxxxxxx> wrote:

Hi,

I have upgraded to Gluster 3.8.10 today and ran the add-brick procedure in a volume contains few VMs.

After the completion of rebalance, i have rebooted the VMs, some of ran just fine, and others just crashed.

Windows boot to recovery mode and Linux throw xfs errors and does not boot.

I ran the test again and it happened just as the first one, but i have noticed only VMs doing disk IOs are affected by this bug.

The VMs in power off mode started fine and even md5 of the disk file did not change after the rebalance.

anyone else can confirm this ?

Volume info:

 

Volume Name: vmware2

Type: Distributed-Replicate

Volume ID: 02328d46-a285-4533-aa3a-fb9bfeb688bf

Status: Started

Snapshot Count: 0

Number of Bricks: 22 x 2 = 44

Transport-type: tcp

Bricks:

Brick1: gluster01:/mnt/disk1/vmware2

Brick2: gluster03:/mnt/disk1/vmware2

Brick3: gluster02:/mnt/disk1/vmware2

Brick4: gluster04:/mnt/disk1/vmware2

Brick5: gluster01:/mnt/disk2/vmware2

Brick6: gluster03:/mnt/disk2/vmware2

Brick7: gluster02:/mnt/disk2/vmware2

Brick8: gluster04:/mnt/disk2/vmware2

Brick9: gluster01:/mnt/disk3/vmware2

Brick10: gluster03:/mnt/disk3/vmware2

Brick11: gluster02:/mnt/disk3/vmware2

Brick12: gluster04:/mnt/disk3/vmware2

Brick13: gluster01:/mnt/disk4/vmware2

Brick14: gluster03:/mnt/disk4/vmware2

Brick15: gluster02:/mnt/disk4/vmware2

Brick16: gluster04:/mnt/disk4/vmware2

Brick17: gluster01:/mnt/disk5/vmware2

Brick18: gluster03:/mnt/disk5/vmware2

Brick19: gluster02:/mnt/disk5/vmware2

Brick20: gluster04:/mnt/disk5/vmware2

Brick21: gluster01:/mnt/disk6/vmware2

Brick22: gluster03:/mnt/disk6/vmware2

Brick23: gluster02:/mnt/disk6/vmware2

Brick24: gluster04:/mnt/disk6/vmware2

Brick25: gluster01:/mnt/disk7/vmware2

Brick26: gluster03:/mnt/disk7/vmware2

Brick27: gluster02:/mnt/disk7/vmware2

Brick28: gluster04:/mnt/disk7/vmware2

Brick29: gluster01:/mnt/disk8/vmware2

Brick30: gluster03:/mnt/disk8/vmware2

Brick31: gluster02:/mnt/disk8/vmware2

Brick32: gluster04:/mnt/disk8/vmware2

Brick33: gluster01:/mnt/disk9/vmware2

Brick34: gluster03:/mnt/disk9/vmware2

Brick35: gluster02:/mnt/disk9/vmware2

Brick36: gluster04:/mnt/disk9/vmware2

Brick37: gluster01:/mnt/disk10/vmware2

Brick38: gluster03:/mnt/disk10/vmware2

Brick39: gluster02:/mnt/disk10/vmware2

Brick40: gluster04:/mnt/disk10/vmware2

Brick41: gluster01:/mnt/disk11/vmware2

Brick42: gluster03:/mnt/disk11/vmware2

Brick43: gluster02:/mnt/disk11/vmware2

Brick44: gluster04:/mnt/disk11/vmware2

Options Reconfigured:

cluster.server-quorum-type: server

nfs.disable: on

performance.readdir-ahead: on

transport.address-family: inet

performance.quick-read: off

performance.read-ahead: off

performance.io-cache: off

performance.stat-prefetch: off

cluster.eager-lock: enable

network.remote-dio: enable

features.shard: on

cluster.data-self-heal-algorithm: full

features.cache-invalidation: on

ganesha.enable: on

features.shard-block-size: 256MB

client.event-threads: 2

server.event-threads: 2

cluster.favorite-child-policy: size

storage.build-pgfid: off

network.ping-timeout: 5

cluster.enable-shared-storage: enable

nfs-ganesha: enable

cluster.server-quorum-ratio: 51%

Adding bricks:

gluster volume add-brick vmware2 replica 2 gluster01:/mnt/disk11/vmware2 gluster03:/mnt/disk11/vmware2 gluster02:/mnt/disk11/vmware2 gluster04:/mnt/disk11/vmware2

starting fix layout:

gluster volume rebalance vmware2 fix-layout start

Starting rebalance:

gluster volume rebalance vmware2  start

--

Respectfully
Mahdi A. Mahdi

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users

[2017-03-17 11:27:07.780421] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.8.10 (args: /usr/sbin/glusterfsd -s gluster01 --volfile-id vmware2.gluster01.mnt-disk11-vmware2 -p /var/lib/glusterd/vols/vmware2/run/gluster01-mnt-disk11-vmware2.pid -S /var/run/gluster/2353d462bcc2e466bc3631878947aad4.socket --brick-name /mnt/disk11/vmware2 -l /var/log/glusterfs/bricks/mnt-disk11-vmware2.log --xlator-option *-posix.glusterd-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --brick-port 49523 --xlator-option vmware2-server.listen-port=49523)
[2017-03-17 11:27:07.795279] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:27:07.803686] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-server: adding option 'listen-port' for volume 'vmware2-server' with value '49523'
[2017-03-17 11:27:07.803741] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-posix: adding option 'glusterd-uuid' for volume 'vmware2-posix' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:27:07.804192] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login./mnt/disk11/vmware2.allow
[2017-03-17 11:27:07.804222] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password
[2017-03-17 11:27:07.804230] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:27:07.805894] I [rpcsvc.c:2214:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
[2017-03-17 11:27:07.806027] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-vmware2-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
[2017-03-17 11:27:07.813099] I [MSGID: 121050] [ctr-helper.c:259:extract_ctr_options] 0-gfdbdatastore: CTR Xlator is disabled.
[2017-03-17 11:27:07.813141] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-pagesize from params.Assigning default value: 4096
[2017-03-17 11:27:07.813158] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-journalmode from params.Assigning default value: wal
[2017-03-17 11:27:07.813171] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-sync from params.Assigning default value: off
[2017-03-17 11:27:07.813183] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-autovacuum from params.Assigning default value: none
[2017-03-17 11:27:07.817268] I [trash.c:2408:init] 0-vmware2-trash: no option specified for 'eliminate', using NULL
[2017-03-17 11:27:07.818133] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2017-03-17 11:27:07.818195] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-unix' is not recognized
[2017-03-17 11:27:07.818233] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-null' is not recognized
[2017-03-17 11:27:07.818301] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'auth-path' is not recognized
[2017-03-17 11:27:07.818349] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-quota: option 'timeout' is not recognized
[2017-03-17 11:27:07.818441] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-trash: option 'brick-path' is not recognized
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-posix
  2:     type storage/posix
  3:     option glusterd-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
  4:     option directory /mnt/disk11/vmware2
  5:     option volume-id 02328d46-a285-4533-aa3a-fb9bfeb688bf
  6:     option update-link-count-parent off
  7: end-volume
  8:  
  9: volume vmware2-trash
 10:     type features/trash
 11:     option trash-dir .trashcan
 12:     option brick-path /mnt/disk11/vmware2
 13:     option trash-internal-op off
 14:     subvolumes vmware2-posix
 15: end-volume
 16:  
 17: volume vmware2-changetimerecorder
 18:     type features/changetimerecorder
 19:     option db-type sqlite3
 20:     option hot-brick off
 21:     option db-name vmware2.db
 22:     option db-path /mnt/disk11/vmware2/.glusterfs/
 23:     option record-exit off
 24:     option ctr_link_consistency off
 25:     option ctr_lookupheal_link_timeout 300
 26:     option ctr_lookupheal_inode_timeout 300
 27:     option record-entry on
 28:     option ctr-enabled off
 29:     option record-counters off
 30:     option ctr-record-metadata-heat off
 31:     option sql-db-cachesize 1000
 32:     option sql-db-wal-autocheckpoint 1000
 33:     subvolumes vmware2-trash
 34: end-volume
 35:  
 36: volume vmware2-changelog
 37:     type features/changelog
 38:     option changelog-brick /mnt/disk11/vmware2
 39:     option changelog-dir /mnt/disk11/vmware2/.glusterfs/changelogs
 40:     option changelog-barrier-timeout 120
 41:     subvolumes vmware2-changetimerecorder
 42: end-volume
 43:  
 44: volume vmware2-bitrot-stub
 45:     type features/bitrot-stub
 46:     option export /mnt/disk11/vmware2
 47:     subvolumes vmware2-changelog
 48: end-volume
 49:  
 50: volume vmware2-access-control
 51:     type features/access-control
 52:     subvolumes vmware2-bitrot-stub
 53: end-volume
 54:  
 55: volume vmware2-locks
 56:     type features/locks
 57:     subvolumes vmware2-access-control
 58: end-volume
 59:  
 60: volume vmware2-worm
 61:     type features/worm
 62:     option worm off
 63:     option worm-file-level off
 64:     subvolumes vmware2-locks
 65: end-volume
 66:  
 67: volume vmware2-read-only
 68:     type features/read-only
 69:     option read-only off
 70:     subvolumes vmware2-worm
 71: end-volume
 72:  
 73: volume vmware2-leases
 74:     type features/leases
 75:     option leases off
 76:     subvolumes vmware2-read-only
 77: end-volume
 78:  
 79: volume vmware2-upcall
 80:     type features/upcall
 81:     option cache-invalidation on
 82:     subvolumes vmware2-leases
 83: end-volume
 84:  
 85: volume vmware2-io-threads
 86:     type performance/io-threads
 87:     subvolumes vmware2-upcall
 88: end-volume
 89:  
 90: volume vmware2-marker
 91:     type features/marker
 92:     option volume-uuid 02328d46-a285-4533-aa3a-fb9bfeb688bf
 93:     option timestamp-file /var/lib/glusterd/vols/vmware2/marker.tstamp
 94:     option quota-version 0
 95:     option xtime off
 96:     option gsync-force-xtime off
 97:     option quota off
 98:     option inode-quota off
 99:     subvolumes vmware2-io-threads
100: end-volume
101:  
102: volume vmware2-barrier
103:     type features/barrier
104:     option barrier disable
105:     option barrier-timeout 120
106:     subvolumes vmware2-marker
107: end-volume
108:  
109: volume vmware2-index
110:     type features/index
111:     option index-base /mnt/disk11/vmware2/.glusterfs/indices
112:     option xattrop-dirty-watchlist trusted.afr.dirty
113:     option xattrop-pending-watchlist trusted.afr.vmware2-
114:     subvolumes vmware2-barrier
115: end-volume
116:  
117: volume vmware2-quota
118:     type features/quota
119:     option volume-uuid vmware2
120:     option server-quota off
121:     option timeout 0
122:     option deem-statfs off
123:     subvolumes vmware2-index
124: end-volume
125:  
126: volume /mnt/disk11/vmware2
127:     type debug/io-stats
128:     option log-level INFO
129:     option latency-measurement off
130:     option count-fop-hits off
131:     subvolumes vmware2-quota
132: end-volume
133:  
134: volume vmware2-decompounder
135:     type performance/decompounder
136:     subvolumes /mnt/disk11/vmware2
137: end-volume
138:  
139: volume vmware2-server
140:     type protocol/server
141:     option transport.socket.listen-port 49523
142:     option rpc-auth.auth-glusterfs on
143:     option rpc-auth.auth-unix on
144:     option rpc-auth.auth-null on
145:     option rpc-auth-allow-insecure on
146:     option transport-type tcp
147:     option transport.address-family inet
148:     option auth.login./mnt/disk11/vmware2.allow 3a215959-1d65-4907-bf78-c3ac81a3e744
149:     option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password e2a2a9b6-b3fc-4783-9540-facce887713a
150:     option auth-path /mnt/disk11/vmware2
151:     option auth.addr./mnt/disk11/vmware2.allow *
152:     option transport.tcp-user-timeout 5
153:     option event-threads 2
154:     subvolumes vmware2-decompounder
155: end-volume
156:  
+------------------------------------------------------------------------------+
[2017-03-17 11:27:10.123760] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 11:27:10.189528] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 11:27:10.474043] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:10.474084] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-1989-2017/03/17-11:19:58:622913-vmware2-client-40-2-0 (version: 3.8.10)
[2017-03-17 11:27:10.664653] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:10.664688] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-2022-2017/03/17-10:27:01:902189-vmware2-client-40-2-0 (version: 3.8.10)
[2017-03-17 11:27:10.702663] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:10.702696] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-2002-2017/03/17-11:04:19:695379-vmware2-client-40-2-0 (version: 3.8.10)
[2017-03-17 11:27:10.746471] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:10.746508] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-2008-2017/03/17-11:13:04:716498-vmware2-client-40-2-0 (version: 3.8.10)
[2017-03-17 11:27:13.482994] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:13.483025] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-14928-2017/03/17-11:27:08:843204-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:27:14.658813] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:14.658855] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-17760-2017/03/17-11:27:10:15114-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:27:14.663342] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:14.663383] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-35059-2017/03/17-11:27:10:18116-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:27:14.740326] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:27:14.740363] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-20631-2017/03/17-11:27:10:30030-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:30:29.895407] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:30:29.895448] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:30:34.980509] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:30:34.980562] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-19055-2017/03/17-11:30:29:676726-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:30:35.036011] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:30:35.036051] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-36325-2017/03/17-11:30:29:682419-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:30:35.062878] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:30:35.062914] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-21911-2017/03/17-11:30:29:675417-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:30:35.253609] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-40-0-0
[2017-03-17 11:30:35.253643] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-40-0-0
[2017-03-17 11:30:35.330381] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-19055-2017/03/17-11:30:29:676726-vmware2-client-40-0-0
[2017-03-17 11:30:35.330423] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-19055-2017/03/17-11:30:29:676726-vmware2-client-40-0-0
[2017-03-17 11:30:35.356270] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-36325-2017/03/17-11:30:29:682419-vmware2-client-40-0-0
[2017-03-17 11:30:35.356336] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-36325-2017/03/17-11:30:29:682419-vmware2-client-40-0-0
[2017-03-17 11:30:35.372137] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-21911-2017/03/17-11:30:29:675417-vmware2-client-40-0-0
[2017-03-17 11:30:35.372182] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-21911-2017/03/17-11:30:29:675417-vmware2-client-40-0-0
[2017-03-17 11:35:15.987314] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:35:15.987342] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:35:21.114247] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:35:21.114282] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-23659-2017/03/17-11:35:15:764152-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:35:21.133090] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:35:21.133121] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-20801-2017/03/17-11:35:15:758316-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:35:21.133822] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:35:21.133852] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-38083-2017/03/17-11:35:15:772180-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:35:21.438865] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-23659-2017/03/17-11:35:15:764152-vmware2-client-40-0-0
[2017-03-17 11:35:21.438896] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-23659-2017/03/17-11:35:15:764152-vmware2-client-40-0-0
[2017-03-17 11:35:21.451550] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-38083-2017/03/17-11:35:15:772180-vmware2-client-40-0-0
[2017-03-17 11:35:21.451596] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-38083-2017/03/17-11:35:15:772180-vmware2-client-40-0-0
[2017-03-17 11:36:29.388291] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-40-0-0
[2017-03-17 11:36:29.388376] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-40-0-0
[2017-03-17 11:36:42.372156] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-20801-2017/03/17-11:35:15:758316-vmware2-client-40-0-0
[2017-03-17 11:36:42.372229] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-20801-2017/03/17-11:35:15:758316-vmware2-client-40-0-0
[2017-03-17 11:40:51.730220] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 11:40:51.804426] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 11:40:56.847579] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 11:40:56.885248] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 11:40:57.184932] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:40:57.184960] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:41:02.459603] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:41:02.459637] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-40209-2017/03/17-11:40:57:32432-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:41:02.522562] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:41:02.522597] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-22942-2017/03/17-11:40:57:8774-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:41:02.535003] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:41:02.535028] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-25797-2017/03/17-11:40:57:50966-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:41:02.769586] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-40209-2017/03/17-11:40:57:32432-vmware2-client-40-0-0
[2017-03-17 11:41:02.769632] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-40209-2017/03/17-11:40:57:32432-vmware2-client-40-0-0
[2017-03-17 11:41:48.259047] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-25797-2017/03/17-11:40:57:50966-vmware2-client-40-0-0
[2017-03-17 11:41:48.259091] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-25797-2017/03/17-11:40:57:50966-vmware2-client-40-0-0
[2017-03-17 11:42:55.486701] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-22942-2017/03/17-11:40:57:8774-vmware2-client-40-0-0
[2017-03-17 11:42:55.486760] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-22942-2017/03/17-11:40:57:8774-vmware2-client-40-0-0
[2017-03-17 11:42:57.176684] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-40-0-0
[2017-03-17 11:42:57.176758] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-40-0-0
[2017-03-17 11:44:07.123327] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f1dae9cbdc5] -->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xe5) [0x7f1db005dcd5] -->/usr/sbin/glusterfsd(cleanup_and_exit+0x6b) [0x7f1db005db4b] ) 0-: received signum (15), shutting down
[2017-03-17 11:50:17.303033] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.8.10 (args: /usr/sbin/glusterfsd -s gluster01 --volfile-id vmware2.gluster01.mnt-disk11-vmware2 -p /var/lib/glusterd/vols/vmware2/run/gluster01-mnt-disk11-vmware2.pid -S /var/run/gluster/2353d462bcc2e466bc3631878947aad4.socket --brick-name /mnt/disk11/vmware2 -l /var/log/glusterfs/bricks/mnt-disk11-vmware2.log --xlator-option *-posix.glusterd-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --brick-port 49523 --xlator-option vmware2-server.listen-port=49523)
[2017-03-17 11:50:17.317848] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:50:17.332717] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-server: adding option 'listen-port' for volume 'vmware2-server' with value '49523'
[2017-03-17 11:50:17.332796] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-posix: adding option 'glusterd-uuid' for volume 'vmware2-posix' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:50:17.333216] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login./mnt/disk11/vmware2.allow
[2017-03-17 11:50:17.333236] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password
[2017-03-17 11:50:17.333301] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:50:17.335199] I [rpcsvc.c:2214:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
[2017-03-17 11:50:17.335321] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-vmware2-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
[2017-03-17 11:50:17.338513] I [MSGID: 121050] [ctr-helper.c:259:extract_ctr_options] 0-gfdbdatastore: CTR Xlator is disabled.
[2017-03-17 11:50:17.338554] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-pagesize from params.Assigning default value: 4096
[2017-03-17 11:50:17.338570] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-journalmode from params.Assigning default value: wal
[2017-03-17 11:50:17.338584] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-sync from params.Assigning default value: off
[2017-03-17 11:50:17.338596] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-autovacuum from params.Assigning default value: none
[2017-03-17 11:50:17.342088] I [trash.c:2408:init] 0-vmware2-trash: no option specified for 'eliminate', using NULL
[2017-03-17 11:50:17.347654] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2017-03-17 11:50:17.347714] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-unix' is not recognized
[2017-03-17 11:50:17.347750] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-null' is not recognized
[2017-03-17 11:50:17.347835] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'auth-path' is not recognized
[2017-03-17 11:50:17.347886] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-quota: option 'timeout' is not recognized
[2017-03-17 11:50:17.347976] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-trash: option 'brick-path' is not recognized
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-posix
  2:     type storage/posix
  3:     option glusterd-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
  4:     option directory /mnt/disk11/vmware2
  5:     option volume-id 02328d46-a285-4533-aa3a-fb9bfeb688bf
  6:     option update-link-count-parent off
  7: end-volume
  8:  
  9: volume vmware2-trash
 10:     type features/trash
 11:     option trash-dir .trashcan
 12:     option brick-path /mnt/disk11/vmware2
 13:     option trash-internal-op off
 14:     subvolumes vmware2-posix
 15: end-volume
 16:  
 17: volume vmware2-changetimerecorder
 18:     type features/changetimerecorder
 19:     option db-type sqlite3
 20:     option hot-brick off
 21:     option db-name vmware2.db
 22:     option db-path /mnt/disk11/vmware2/.glusterfs/
 23:     option record-exit off
 24:     option ctr_link_consistency off
 25:     option ctr_lookupheal_link_timeout 300
 26:     option ctr_lookupheal_inode_timeout 300
 27:     option record-entry on
 28:     option ctr-enabled off
 29:     option record-counters off
 30:     option ctr-record-metadata-heat off
 31:     option sql-db-cachesize 1000
 32:     option sql-db-wal-autocheckpoint 1000
 33:     subvolumes vmware2-trash
 34: end-volume
 35:  
 36: volume vmware2-changelog
 37:     type features/changelog
 38:     option changelog-brick /mnt/disk11/vmware2
 39:     option changelog-dir /mnt/disk11/vmware2/.glusterfs/changelogs
 40:     option changelog-barrier-timeout 120
 41:     subvolumes vmware2-changetimerecorder
 42: end-volume
 43:  
 44: volume vmware2-bitrot-stub
 45:     type features/bitrot-stub
 46:     option export /mnt/disk11/vmware2
 47:     subvolumes vmware2-changelog
 48: end-volume
 49:  
 50: volume vmware2-access-control
 51:     type features/access-control
 52:     subvolumes vmware2-bitrot-stub
 53: end-volume
 54:  
 55: volume vmware2-locks
 56:     type features/locks
 57:     subvolumes vmware2-access-control
 58: end-volume
 59:  
 60: volume vmware2-worm
 61:     type features/worm
 62:     option worm off
 63:     option worm-file-level off
 64:     subvolumes vmware2-locks
 65: end-volume
 66:  
 67: volume vmware2-read-only
 68:     type features/read-only
 69:     option read-only off
 70:     subvolumes vmware2-worm
 71: end-volume
 72:  
 73: volume vmware2-leases
 74:     type features/leases
 75:     option leases off
 76:     subvolumes vmware2-read-only
 77: end-volume
 78:  
 79: volume vmware2-upcall
 80:     type features/upcall
 81:     option cache-invalidation on
 82:     subvolumes vmware2-leases
 83: end-volume
 84:  
 85: volume vmware2-io-threads
 86:     type performance/io-threads
 87:     subvolumes vmware2-upcall
 88: end-volume
 89:  
 90: volume vmware2-marker
 91:     type features/marker
 92:     option volume-uuid 02328d46-a285-4533-aa3a-fb9bfeb688bf
 93:     option timestamp-file /var/lib/glusterd/vols/vmware2/marker.tstamp
 94:     option quota-version 0
 95:     option xtime off
 96:     option gsync-force-xtime off
 97:     option quota off
 98:     option inode-quota off
 99:     subvolumes vmware2-io-threads
100: end-volume
101:  
102: volume vmware2-barrier
103:     type features/barrier
104:     option barrier disable
105:     option barrier-timeout 120
106:     subvolumes vmware2-marker
107: end-volume
108:  
109: volume vmware2-index
110:     type features/index
111:     option index-base /mnt/disk11/vmware2/.glusterfs/indices
112:     option xattrop-dirty-watchlist trusted.afr.dirty
113:     option xattrop-pending-watchlist trusted.afr.vmware2-
114:     subvolumes vmware2-barrier
115: end-volume
116:  
117: volume vmware2-quota
118:     type features/quota
119:     option volume-uuid vmware2
120:     option server-quota off
121:     option timeout 0
122:     option deem-statfs off
123:     subvolumes vmware2-index
124: end-volume
125:  
126: volume /mnt/disk11/vmware2
127:     type debug/io-stats
128:     option log-level INFO
129:     option latency-measurement off
130:     option count-fop-hits off
131:     subvolumes vmware2-quota
132: end-volume
133:  
134: volume vmware2-decompounder
135:     type performance/decompounder
136:     subvolumes /mnt/disk11/vmware2
137: end-volume
138:  
139: volume vmware2-server
140:     type protocol/server
141:     option transport.socket.listen-port 49523
142:     option rpc-auth.auth-glusterfs on
143:     option rpc-auth.auth-unix on
144:     option rpc-auth.auth-null on
145:     option rpc-auth-allow-insecure on
146:     option transport-type tcp
147:     option transport.address-family inet
148:     option auth.login./mnt/disk11/vmware2.allow 3a215959-1d65-4907-bf78-c3ac81a3e744
149:     option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password e2a2a9b6-b3fc-4783-9540-facce887713a
150:     option auth-path /mnt/disk11/vmware2
151:     option auth.addr./mnt/disk11/vmware2.allow *
152:     option transport.tcp-user-timeout 5
153:     option event-threads 2
154:     subvolumes vmware2-decompounder
155: end-volume
156:  
+------------------------------------------------------------------------------+
[2017-03-17 11:50:19.749463] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 11:50:19.822237] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 11:50:20.178890] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:20.178930] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-1989-2017/03/17-11:19:58:622913-vmware2-client-40-7-0 (version: 3.8.10)
[2017-03-17 11:50:20.352080] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:20.352121] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-2002-2017/03/17-11:04:19:695379-vmware2-client-40-7-0 (version: 3.8.10)
[2017-03-17 11:50:20.363843] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:20.363873] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-2022-2017/03/17-10:27:01:902189-vmware2-client-40-7-0 (version: 3.8.10)
[2017-03-17 11:50:20.364482] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:20.364503] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-2008-2017/03/17-11:13:04:716498-vmware2-client-40-7-0 (version: 3.8.10)
[2017-03-17 11:50:23.074224] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:23.074262] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-24405-2017/03/17-11:50:18:374929-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:24.293323] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:24.293364] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-26571-2017/03/17-11:50:19:495274-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:24.319468] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:24.319504] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-29401-2017/03/17-11:50:19:610631-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:24.539169] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:24.539208] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-43787-2017/03/17-11:50:19:517134-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:32.585935] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:32.585974] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:37.662279] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:37.662311] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-43960-2017/03/17-11:50:32:252145-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:37.685728] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:37.685780] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-26750-2017/03/17-11:50:32:232986-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:37.714140] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:50:37.714170] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-29573-2017/03/17-11:50:32:245124-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:50:37.798516] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-40-0-0
[2017-03-17 11:50:37.798556] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-40-0-0
[2017-03-17 11:50:37.954220] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-43960-2017/03/17-11:50:32:252145-vmware2-client-40-0-0
[2017-03-17 11:50:37.954257] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-43960-2017/03/17-11:50:32:252145-vmware2-client-40-0-0
[2017-03-17 11:50:37.984067] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-26750-2017/03/17-11:50:32:232986-vmware2-client-40-0-0
[2017-03-17 11:50:37.984118] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-26750-2017/03/17-11:50:32:232986-vmware2-client-40-0-0
[2017-03-17 11:50:38.029665] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-29573-2017/03/17-11:50:32:245124-vmware2-client-40-0-0
[2017-03-17 11:50:38.029707] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-29573-2017/03/17-11:50:32:245124-vmware2-client-40-0-0
[2017-03-17 11:51:03.828323] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:51:03.828360] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:51:08.936696] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:51:08.936726] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-26933-2017/03/17-11:51:03:537845-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:51:08.956123] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:51:08.956164] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-44143-2017/03/17-11:51:03:556519-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:51:09.015279] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 11:51:09.015308] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-29767-2017/03/17-11:51:03:549427-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 11:51:09.286534] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-44143-2017/03/17-11:51:03:556519-vmware2-client-40-0-0
[2017-03-17 11:51:09.286562] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-44143-2017/03/17-11:51:03:556519-vmware2-client-40-0-0
[2017-03-17 11:51:09.330399] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-29767-2017/03/17-11:51:03:549427-vmware2-client-40-0-0
[2017-03-17 11:51:09.330449] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-29767-2017/03/17-11:51:03:549427-vmware2-client-40-0-0
[2017-03-17 11:52:13.170788] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-26933-2017/03/17-11:51:03:537845-vmware2-client-40-0-0
[2017-03-17 11:52:13.170837] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-26933-2017/03/17-11:51:03:537845-vmware2-client-40-0-0
[2017-03-17 11:52:22.932887] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-40-0-0
[2017-03-17 11:52:22.933007] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-40-0-0
[2017-03-17 12:50:34.978340] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 12:50:35.034098] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 12:50:40.050414] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 12:50:40.092370] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 12:50:40.532687] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 12:50:40.532726] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 12:50:45.670999] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 12:50:45.671027] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-3462-2017/03/17-12:50:40:250962-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 12:50:45.738409] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 12:50:45.738439] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-48796-2017/03/17-12:50:40:239648-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 12:50:45.864275] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 12:50:45.864307] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-17893-2017/03/17-12:50:40:256458-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 12:50:46.282861] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-3462-2017/03/17-12:50:40:250962-vmware2-client-40-0-0
[2017-03-17 12:50:46.282893] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-3462-2017/03/17-12:50:40:250962-vmware2-client-40-0-0
[2017-03-17 12:50:46.415231] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-17893-2017/03/17-12:50:40:256458-vmware2-client-40-0-0
[2017-03-17 12:50:46.415254] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-17893-2017/03/17-12:50:40:256458-vmware2-client-40-0-0
[2017-03-17 12:51:02.023079] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-48796-2017/03/17-12:50:40:239648-vmware2-client-40-0-0
[2017-03-17 12:51:02.023113] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-48796-2017/03/17-12:50:40:239648-vmware2-client-40-0-0
[2017-03-17 12:52:33.387697] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-40-0-0
[2017-03-17 12:52:33.387837] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-40-0-0
[2017-03-17 12:52:58.930655] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f18d1ee1dc5] -->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xe5) [0x7f18d3573cd5] -->/usr/sbin/glusterfsd(cleanup_and_exit+0x6b) [0x7f18d3573b4b] ) 0-: received signum (15), shutting down
[2017-03-17 13:11:36.963835] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.8.10 (args: /usr/sbin/glusterfsd -s gluster01 --volfile-id vmware2.gluster01.mnt-disk11-vmware2 -p /var/lib/glusterd/vols/vmware2/run/gluster01-mnt-disk11-vmware2.pid -S /var/run/gluster/2353d462bcc2e466bc3631878947aad4.socket --brick-name /mnt/disk11/vmware2 -l /var/log/glusterfs/bricks/mnt-disk11-vmware2.log --xlator-option *-posix.glusterd-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --brick-port 49523 --xlator-option vmware2-server.listen-port=49523)
[2017-03-17 13:11:36.978054] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 13:11:36.991237] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-server: adding option 'listen-port' for volume 'vmware2-server' with value '49523'
[2017-03-17 13:11:36.991288] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-posix: adding option 'glusterd-uuid' for volume 'vmware2-posix' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 13:11:36.991703] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login./mnt/disk11/vmware2.allow
[2017-03-17 13:11:36.991722] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password
[2017-03-17 13:11:36.991748] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 13:11:36.993786] I [rpcsvc.c:2214:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
[2017-03-17 13:11:36.993911] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-vmware2-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
[2017-03-17 13:11:36.997088] I [MSGID: 121050] [ctr-helper.c:259:extract_ctr_options] 0-gfdbdatastore: CTR Xlator is disabled.
[2017-03-17 13:11:36.997128] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-pagesize from params.Assigning default value: 4096
[2017-03-17 13:11:36.997145] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-journalmode from params.Assigning default value: wal
[2017-03-17 13:11:36.997158] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-sync from params.Assigning default value: off
[2017-03-17 13:11:36.997182] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-autovacuum from params.Assigning default value: none
[2017-03-17 13:11:37.003572] I [trash.c:2408:init] 0-vmware2-trash: no option specified for 'eliminate', using NULL
[2017-03-17 13:11:37.004479] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2017-03-17 13:11:37.004542] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-unix' is not recognized
[2017-03-17 13:11:37.004580] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-null' is not recognized
[2017-03-17 13:11:37.004648] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'auth-path' is not recognized
[2017-03-17 13:11:37.004694] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-quota: option 'timeout' is not recognized
[2017-03-17 13:11:37.004797] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-trash: option 'brick-path' is not recognized
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-posix
  2:     type storage/posix
  3:     option glusterd-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
  4:     option directory /mnt/disk11/vmware2
  5:     option volume-id 02328d46-a285-4533-aa3a-fb9bfeb688bf
  6:     option update-link-count-parent off
  7: end-volume
  8:  
  9: volume vmware2-trash
 10:     type features/trash
 11:     option trash-dir .trashcan
 12:     option brick-path /mnt/disk11/vmware2
 13:     option trash-internal-op off
 14:     subvolumes vmware2-posix
 15: end-volume
 16:  
 17: volume vmware2-changetimerecorder
 18:     type features/changetimerecorder
 19:     option db-type sqlite3
 20:     option hot-brick off
 21:     option db-name vmware2.db
 22:     option db-path /mnt/disk11/vmware2/.glusterfs/
 23:     option record-exit off
 24:     option ctr_link_consistency off
 25:     option ctr_lookupheal_link_timeout 300
 26:     option ctr_lookupheal_inode_timeout 300
 27:     option record-entry on
 28:     option ctr-enabled off
 29:     option record-counters off
 30:     option ctr-record-metadata-heat off
 31:     option sql-db-cachesize 1000
 32:     option sql-db-wal-autocheckpoint 1000
 33:     subvolumes vmware2-trash
 34: end-volume
 35:  
 36: volume vmware2-changelog
 37:     type features/changelog
 38:     option changelog-brick /mnt/disk11/vmware2
 39:     option changelog-dir /mnt/disk11/vmware2/.glusterfs/changelogs
 40:     option changelog-barrier-timeout 120
 41:     subvolumes vmware2-changetimerecorder
 42: end-volume
 43:  
 44: volume vmware2-bitrot-stub
 45:     type features/bitrot-stub
 46:     option export /mnt/disk11/vmware2
 47:     subvolumes vmware2-changelog
 48: end-volume
 49:  
 50: volume vmware2-access-control
 51:     type features/access-control
 52:     subvolumes vmware2-bitrot-stub
 53: end-volume
 54:  
 55: volume vmware2-locks
 56:     type features/locks
 57:     subvolumes vmware2-access-control
 58: end-volume
 59:  
 60: volume vmware2-worm
 61:     type features/worm
 62:     option worm off
 63:     option worm-file-level off
 64:     subvolumes vmware2-locks
 65: end-volume
 66:  
 67: volume vmware2-read-only
 68:     type features/read-only
 69:     option read-only off
 70:     subvolumes vmware2-worm
 71: end-volume
 72:  
 73: volume vmware2-leases
 74:     type features/leases
 75:     option leases off
 76:     subvolumes vmware2-read-only
 77: end-volume
 78:  
 79: volume vmware2-upcall
 80:     type features/upcall
 81:     option cache-invalidation on
 82:     subvolumes vmware2-leases
 83: end-volume
 84:  
 85: volume vmware2-io-threads
 86:     type performance/io-threads
 87:     subvolumes vmware2-upcall
 88: end-volume
 89:  
 90: volume vmware2-marker
 91:     type features/marker
 92:     option volume-uuid 02328d46-a285-4533-aa3a-fb9bfeb688bf
 93:     option timestamp-file /var/lib/glusterd/vols/vmware2/marker.tstamp
 94:     option quota-version 0
 95:     option xtime off
 96:     option gsync-force-xtime off
 97:     option quota off
 98:     option inode-quota off
 99:     subvolumes vmware2-io-threads
100: end-volume
101:  
102: volume vmware2-barrier
103:     type features/barrier
104:     option barrier disable
105:     option barrier-timeout 120
106:     subvolumes vmware2-marker
107: end-volume
108:  
109: volume vmware2-index
110:     type features/index
111:     option index-base /mnt/disk11/vmware2/.glusterfs/indices
112:     option xattrop-dirty-watchlist trusted.afr.dirty
113:     option xattrop-pending-watchlist trusted.afr.vmware2-
114:     subvolumes vmware2-barrier
115: end-volume
116:  
117: volume vmware2-quota
118:     type features/quota
119:     option volume-uuid vmware2
120:     option server-quota off
121:     option timeout 0
122:     option deem-statfs off
123:     subvolumes vmware2-index
124: end-volume
125:  
126: volume /mnt/disk11/vmware2
127:     type debug/io-stats
128:     option log-level INFO
129:     option latency-measurement off
130:     option count-fop-hits off
131:     subvolumes vmware2-quota
132: end-volume
133:  
134: volume vmware2-decompounder
135:     type performance/decompounder
136:     subvolumes /mnt/disk11/vmware2
137: end-volume
138:  
139: volume vmware2-server
140:     type protocol/server
141:     option transport.socket.listen-port 49523
142:     option rpc-auth.auth-glusterfs on
143:     option rpc-auth.auth-unix on
144:     option rpc-auth.auth-null on
145:     option rpc-auth-allow-insecure on
146:     option transport-type tcp
147:     option transport.address-family inet
148:     option auth.login./mnt/disk11/vmware2.allow 3a215959-1d65-4907-bf78-c3ac81a3e744
149:     option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password e2a2a9b6-b3fc-4783-9540-facce887713a
150:     option auth-path /mnt/disk11/vmware2
151:     option auth.addr./mnt/disk11/vmware2.allow *
152:     option transport.tcp-user-timeout 5
153:     option event-threads 2
154:     subvolumes vmware2-decompounder
155: end-volume
156:  
+------------------------------------------------------------------------------+
[2017-03-17 13:11:39.327598] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 13:11:39.396572] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 13:11:39.735394] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:39.735433] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-1989-2017/03/17-11:19:58:622913-vmware2-client-40-12-0 (version: 3.8.10)
[2017-03-17 13:11:39.888596] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:39.888632] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-2002-2017/03/17-11:04:19:695379-vmware2-client-40-12-0 (version: 3.8.10)
[2017-03-17 13:11:39.940193] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:39.940237] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-2008-2017/03/17-11:13:04:716498-vmware2-client-40-12-0 (version: 3.8.10)
[2017-03-17 13:11:39.963741] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:39.963794] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-2022-2017/03/17-10:27:01:902189-vmware2-client-40-12-0 (version: 3.8.10)
[2017-03-17 13:11:42.769021] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:42.769051] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-6684-2017/03/17-13:11:38:36394-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:11:43.784565] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:43.784608] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-8523-2017/03/17-13:11:39:178256-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:11:43.870384] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:43.870409] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-25739-2017/03/17-13:11:39:195736-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:11:43.893925] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:11:43.893951] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-11341-2017/03/17-13:11:39:179773-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:14:07.373087] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:14:07.373130] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:14:12.466780] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:14:12.466805] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-26731-2017/03/17-13:14:07:87406-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:14:12.500177] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:14:12.500203] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-9523-2017/03/17-13:14:07:72241-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:14:12.504718] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:14:12.504748] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-12338-2017/03/17-13:14:07:78854-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:14:12.555303] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-40-0-0
[2017-03-17 13:14:12.555345] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-40-0-0
[2017-03-17 13:14:12.745627] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-26731-2017/03/17-13:14:07:87406-vmware2-client-40-0-0
[2017-03-17 13:14:12.745657] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-26731-2017/03/17-13:14:07:87406-vmware2-client-40-0-0
[2017-03-17 13:14:12.782027] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-9523-2017/03/17-13:14:07:72241-vmware2-client-40-0-0
[2017-03-17 13:14:12.782089] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-9523-2017/03/17-13:14:07:72241-vmware2-client-40-0-0
[2017-03-17 13:14:12.791790] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-12338-2017/03/17-13:14:07:78854-vmware2-client-40-0-0
[2017-03-17 13:14:12.791837] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-12338-2017/03/17-13:14:07:78854-vmware2-client-40-0-0
[2017-03-17 13:16:37.509445] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:16:37.509498] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:16:42.609761] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:16:42.609793] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-10440-2017/03/17-13:16:37:236816-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:16:42.629106] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:16:42.629147] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-27639-2017/03/17-13:16:37:252455-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:16:42.632920] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:16:42.632949] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-13299-2017/03/17-13:16:37:243907-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:16:42.916289] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-27639-2017/03/17-13:16:37:252455-vmware2-client-40-0-0
[2017-03-17 13:16:42.916351] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-27639-2017/03/17-13:16:37:252455-vmware2-client-40-0-0
[2017-03-17 13:16:42.934640] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-13299-2017/03/17-13:16:37:243907-vmware2-client-40-0-0
[2017-03-17 13:16:42.934671] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-13299-2017/03/17-13:16:37:243907-vmware2-client-40-0-0
[2017-03-17 13:16:53.901017] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-10440-2017/03/17-13:16:37:236816-vmware2-client-40-0-0
[2017-03-17 13:16:53.901078] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-10440-2017/03/17-13:16:37:236816-vmware2-client-40-0-0
[2017-03-17 13:17:02.411233] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-40-0-0
[2017-03-17 13:17:02.411285] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-40-0-0
[2017-03-17 13:27:19.528259] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 13:27:19.576202] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 13:27:24.620401] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 13:27:24.657924] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 13:27:24.966203] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:27:24.966248] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:27:30.226848] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:27:30.226873] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-31635-2017/03/17-13:27:24:779669-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:27:30.231944] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:27:30.231966] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-14467-2017/03/17-13:27:24:766209-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:27:30.275584] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:27:30.275608] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-17281-2017/03/17-13:27:24:764880-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:27:30.497258] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-31635-2017/03/17-13:27:24:779669-vmware2-client-40-0-0
[2017-03-17 13:27:30.497318] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-31635-2017/03/17-13:27:24:779669-vmware2-client-40-0-0
[2017-03-17 13:27:30.556635] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-17281-2017/03/17-13:27:24:764880-vmware2-client-40-0-0
[2017-03-17 13:27:30.556668] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-17281-2017/03/17-13:27:24:764880-vmware2-client-40-0-0
[2017-03-17 13:27:42.126634] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-40-0-0
[2017-03-17 13:27:42.126696] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-40-0-0
[2017-03-17 13:27:47.172645] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-14467-2017/03/17-13:27:24:766209-vmware2-client-40-0-0
[2017-03-17 13:27:47.172751] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-14467-2017/03/17-13:27:24:766209-vmware2-client-40-0-0
[2017-03-17 13:28:02.020888] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f8e9f87adc5] -->/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xe5) [0x7f8ea0f0ccd5] -->/usr/sbin/glusterfsd(cleanup_and_exit+0x6b) [0x7f8ea0f0cb4b] ) 0-: received signum (15), shutting down
[2017-03-17 13:57:41.162714] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.8.10 (args: /usr/sbin/glusterfsd -s gluster01 --volfile-id vmware2.gluster01.mnt-disk11-vmware2 -p /var/lib/glusterd/vols/vmware2/run/gluster01-mnt-disk11-vmware2.pid -S /var/run/gluster/2353d462bcc2e466bc3631878947aad4.socket --brick-name /mnt/disk11/vmware2 -l /var/log/glusterfs/bricks/mnt-disk11-vmware2.log --xlator-option *-posix.glusterd-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --brick-port 49523 --xlator-option vmware2-server.listen-port=49523)
[2017-03-17 13:57:41.176823] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 13:57:41.184414] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-server: adding option 'listen-port' for volume 'vmware2-server' with value '49523'
[2017-03-17 13:57:41.184463] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-posix: adding option 'glusterd-uuid' for volume 'vmware2-posix' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 13:57:41.184959] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 13:57:41.184964] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login./mnt/disk11/vmware2.allow
[2017-03-17 13:57:41.185021] I [MSGID: 115034] [server.c:398:_check_for_auth_option] 0-vmware2-decompounder: skip format check for non-addr auth option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password
[2017-03-17 13:57:41.186583] I [rpcsvc.c:2214:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
[2017-03-17 13:57:41.186705] W [MSGID: 101002] [options.c:954:xl_opt_validate] 0-vmware2-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
[2017-03-17 13:57:41.189954] I [MSGID: 121050] [ctr-helper.c:259:extract_ctr_options] 0-gfdbdatastore: CTR Xlator is disabled.
[2017-03-17 13:57:41.189992] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-pagesize from params.Assigning default value: 4096
[2017-03-17 13:57:41.190007] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-journalmode from params.Assigning default value: wal
[2017-03-17 13:57:41.190020] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-sync from params.Assigning default value: off
[2017-03-17 13:57:41.190030] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-vmware2-changetimerecorder: Failed to retrieve sql-db-autovacuum from params.Assigning default value: none
[2017-03-17 13:57:41.193471] I [trash.c:2408:init] 0-vmware2-trash: no option specified for 'eliminate', using NULL
[2017-03-17 13:57:41.195160] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2017-03-17 13:57:41.195223] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-unix' is not recognized
[2017-03-17 13:57:41.195261] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'rpc-auth.auth-null' is not recognized
[2017-03-17 13:57:41.195329] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-server: option 'auth-path' is not recognized
[2017-03-17 13:57:41.195376] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-quota: option 'timeout' is not recognized
[2017-03-17 13:57:41.195467] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-vmware2-trash: option 'brick-path' is not recognized
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-posix
  2:     type storage/posix
  3:     option glusterd-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
  4:     option directory /mnt/disk11/vmware2
  5:     option volume-id 02328d46-a285-4533-aa3a-fb9bfeb688bf
  6:     option update-link-count-parent off
  7: end-volume
  8:  
  9: volume vmware2-trash
 10:     type features/trash
 11:     option trash-dir .trashcan
 12:     option brick-path /mnt/disk11/vmware2
 13:     option trash-internal-op off
 14:     subvolumes vmware2-posix
 15: end-volume
 16:  
 17: volume vmware2-changetimerecorder
 18:     type features/changetimerecorder
 19:     option db-type sqlite3
 20:     option hot-brick off
 21:     option db-name vmware2.db
 22:     option db-path /mnt/disk11/vmware2/.glusterfs/
 23:     option record-exit off
 24:     option ctr_link_consistency off
 25:     option ctr_lookupheal_link_timeout 300
 26:     option ctr_lookupheal_inode_timeout 300
 27:     option record-entry on
 28:     option ctr-enabled off
 29:     option record-counters off
 30:     option ctr-record-metadata-heat off
 31:     option sql-db-cachesize 1000
 32:     option sql-db-wal-autocheckpoint 1000
 33:     subvolumes vmware2-trash
 34: end-volume
 35:  
 36: volume vmware2-changelog
 37:     type features/changelog
 38:     option changelog-brick /mnt/disk11/vmware2
 39:     option changelog-dir /mnt/disk11/vmware2/.glusterfs/changelogs
 40:     option changelog-barrier-timeout 120
 41:     subvolumes vmware2-changetimerecorder
 42: end-volume
 43:  
 44: volume vmware2-bitrot-stub
 45:     type features/bitrot-stub
 46:     option export /mnt/disk11/vmware2
 47:     subvolumes vmware2-changelog
 48: end-volume
 49:  
 50: volume vmware2-access-control
 51:     type features/access-control
 52:     subvolumes vmware2-bitrot-stub
 53: end-volume
 54:  
 55: volume vmware2-locks
 56:     type features/locks
 57:     subvolumes vmware2-access-control
 58: end-volume
 59:  
 60: volume vmware2-worm
 61:     type features/worm
 62:     option worm off
 63:     option worm-file-level off
 64:     subvolumes vmware2-locks
 65: end-volume
 66:  
 67: volume vmware2-read-only
 68:     type features/read-only
 69:     option read-only off
 70:     subvolumes vmware2-worm
 71: end-volume
 72:  
 73: volume vmware2-leases
 74:     type features/leases
 75:     option leases off
 76:     subvolumes vmware2-read-only
 77: end-volume
 78:  
 79: volume vmware2-upcall
 80:     type features/upcall
 81:     option cache-invalidation on
 82:     subvolumes vmware2-leases
 83: end-volume
 84:  
 85: volume vmware2-io-threads
 86:     type performance/io-threads
 87:     subvolumes vmware2-upcall
 88: end-volume
 89:  
 90: volume vmware2-marker
 91:     type features/marker
 92:     option volume-uuid 02328d46-a285-4533-aa3a-fb9bfeb688bf
 93:     option timestamp-file /var/lib/glusterd/vols/vmware2/marker.tstamp
 94:     option quota-version 0
 95:     option xtime off
 96:     option gsync-force-xtime off
 97:     option quota off
 98:     option inode-quota off
 99:     subvolumes vmware2-io-threads
100: end-volume
101:  
102: volume vmware2-barrier
103:     type features/barrier
104:     option barrier disable
105:     option barrier-timeout 120
106:     subvolumes vmware2-marker
107: end-volume
108:  
109: volume vmware2-index
110:     type features/index
111:     option index-base /mnt/disk11/vmware2/.glusterfs/indices
112:     option xattrop-dirty-watchlist trusted.afr.dirty
113:     option xattrop-pending-watchlist trusted.afr.vmware2-
114:     subvolumes vmware2-barrier
115: end-volume
116:  
117: volume vmware2-quota
118:     type features/quota
119:     option volume-uuid vmware2
120:     option server-quota off
121:     option timeout 0
122:     option deem-statfs off
123:     subvolumes vmware2-index
124: end-volume
125:  
126: volume /mnt/disk11/vmware2
127:     type debug/io-stats
128:     option log-level INFO
129:     option latency-measurement off
130:     option count-fop-hits off
131:     subvolumes vmware2-quota
132: end-volume
133:  
134: volume vmware2-decompounder
135:     type performance/decompounder
136:     subvolumes /mnt/disk11/vmware2
137: end-volume
138:  
139: volume vmware2-server
140:     type protocol/server
141:     option transport.socket.listen-port 49523
142:     option rpc-auth.auth-glusterfs on
143:     option rpc-auth.auth-unix on
144:     option rpc-auth.auth-null on
145:     option rpc-auth-allow-insecure on
146:     option transport-type tcp
147:     option transport.address-family inet
148:     option auth.login./mnt/disk11/vmware2.allow 3a215959-1d65-4907-bf78-c3ac81a3e744
149:     option auth.login.3a215959-1d65-4907-bf78-c3ac81a3e744.password e2a2a9b6-b3fc-4783-9540-facce887713a
150:     option auth-path /mnt/disk11/vmware2
151:     option auth.addr./mnt/disk11/vmware2.allow *
152:     option transport.tcp-user-timeout 5
153:     option event-threads 2
154:     subvolumes vmware2-decompounder
155: end-volume
156:  
+------------------------------------------------------------------------------+
[2017-03-17 13:57:43.507233] I [glusterfsd-mgmt.c:54:mgmt_cbk_spec] 0-mgmt: Volume file changed
[2017-03-17 13:57:43.574114] I [glusterfsd-mgmt.c:1600:mgmt_getspec_cbk] 0-glusterfs: No change in volfile, continuing
[2017-03-17 13:57:43.961363] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:43.961407] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-1989-2017/03/17-11:19:58:622913-vmware2-client-40-17-0 (version: 3.8.10)
[2017-03-17 13:57:44.075659] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:44.075698] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-2022-2017/03/17-10:27:01:902189-vmware2-client-40-17-0 (version: 3.8.10)
[2017-03-17 13:57:44.095988] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:44.096018] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-2008-2017/03/17-11:13:04:716498-vmware2-client-40-17-0 (version: 3.8.10)
[2017-03-17 13:57:44.123919] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:44.123950] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-2002-2017/03/17-11:04:19:695379-vmware2-client-40-17-0 (version: 3.8.10)
[2017-03-17 13:57:46.904327] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:46.904362] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-23987-2017/03/17-13:57:42:225019-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:57:47.974567] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:47.974604] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-28474-2017/03/17-13:57:43:363632-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:57:48.003440] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:48.003478] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-25662-2017/03/17-13:57:43:358817-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:57:48.017003] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:57:48.017040] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-42823-2017/03/17-13:57:43:374232-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:59:32.819298] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:59:32.819332] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:59:37.882862] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:59:37.882899] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-26408-2017/03/17-13:59:32:533251-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:59:37.906515] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:59:37.906539] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-29213-2017/03/17-13:59:32:538788-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:59:37.937066] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 13:59:37.937090] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-43557-2017/03/17-13:59:32:547912-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 13:59:38.028621] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-40-0-0
[2017-03-17 13:59:38.028668] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-40-0-0
[2017-03-17 13:59:38.170999] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-26408-2017/03/17-13:59:32:533251-vmware2-client-40-0-0
[2017-03-17 13:59:38.171031] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-26408-2017/03/17-13:59:32:533251-vmware2-client-40-0-0
[2017-03-17 13:59:38.199954] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-29213-2017/03/17-13:59:32:538788-vmware2-client-40-0-0
[2017-03-17 13:59:38.200005] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-29213-2017/03/17-13:59:32:538788-vmware2-client-40-0-0
[2017-03-17 13:59:38.263729] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-43557-2017/03/17-13:59:32:547912-vmware2-client-40-0-0
[2017-03-17 13:59:38.263779] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-43557-2017/03/17-13:59:32:547912-vmware2-client-40-0-0
[2017-03-17 14:00:52.406852] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 14:00:52.406900] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 14:00:57.485702] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 14:00:57.485727] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster03-29690-2017/03/17-14:00:52:104006-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 14:00:57.493573] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 14:00:57.493602] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster02-26875-2017/03/17-14:00:52:98696-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 14:00:57.496864] I [login.c:76:gf_auth] 0-auth/login: allowed user names: 3a215959-1d65-4907-bf78-c3ac81a3e744
[2017-03-17 14:00:57.496890] I [MSGID: 115029] [server-handshake.c:692:server_setvolume] 0-vmware2-server: accepted client from gluster04-44025-2017/03/17-14:00:52:114074-vmware2-client-40-0-0 (version: 3.8.10)
[2017-03-17 14:00:57.799914] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster03-29690-2017/03/17-14:00:52:104006-vmware2-client-40-0-0
[2017-03-17 14:00:57.799940] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster03-29690-2017/03/17-14:00:52:104006-vmware2-client-40-0-0
[2017-03-17 14:00:57.832367] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster04-44025-2017/03/17-14:00:52:114074-vmware2-client-40-0-0
[2017-03-17 14:00:57.832388] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster04-44025-2017/03/17-14:00:52:114074-vmware2-client-40-0-0
[2017-03-17 14:01:18.481666] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-40-0-0
[2017-03-17 14:01:18.481742] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-40-0-0
[2017-03-17 14:01:24.916329] I [MSGID: 115036] [server.c:548:server_rpc_notify] 0-vmware2-server: disconnecting connection from gluster02-26875-2017/03/17-14:00:52:98696-vmware2-client-40-0-0
[2017-03-17 14:01:24.916378] I [MSGID: 101055] [client_t.c:415:gf_client_unref] 0-vmware2-server: Shutting down connection gluster02-26875-2017/03/17-14:00:52:98696-vmware2-client-40-0-0

[2017-03-17 11:30:24.643870] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=4 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328067202 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 11:30:24.661103] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:30:24.661201] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 11:30:24.661257] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 11:30:29.642696] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328067202'
[2017-03-17 11:30:29.642723] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:30:29.642736] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '4'
[2017-03-17 11:30:29.642747] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 11:30:29.642774] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:30:29.642786] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:30:29.642800] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:30:29.642813] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:30:29.642831] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:30:29.642842] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:30:29.642855] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:30:29.642870] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:30:29.642881] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:30:29.642897] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:30:29.642908] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:30:29.642927] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:30:29.642941] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:30:29.642952] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:30:29.642962] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:30:29.642975] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:30:29.642985] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:30:29.642995] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:30:29.643008] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:30:29.643019] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:30:29.643029] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:30:29.643042] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:30:29.643052] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:30:29.643063] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:30:29.643075] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:30:29.643086] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:30:29.643096] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:30:29.643109] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:30:29.643119] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:30:29.643130] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:30:29.643143] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:30:29.643153] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:30:29.643163] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:30:29.643180] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:30:29.643191] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:30:29.643201] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:30:29.643214] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:30:29.643224] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:30:29.643235] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:30:29.643248] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:30:29.643259] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:30:29.643269] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:30:29.643282] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:30:29.643292] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:30:29.643303] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:30:29.643316] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:30:29.643327] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:30:29.643338] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:30:29.643357] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:30:29.643368] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:30:29.643378] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:30:29.643391] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:30:29.643406] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:30:29.643416] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:30:29.643434] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:30:29.643445] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:30:29.643455] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:30:29.643468] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:30:29.643478] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:30:29.643488] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:30:29.643501] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:30:29.643511] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:30:29.643522] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:30:29.643534] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:30:29.643544] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:30:29.643555] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:30:29.643567] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:30:29.643577] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:30:29.643588] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:30:29.645962] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328067202
[2017-03-17 11:30:29.727148] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:30:29.745562] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.748249] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.748644] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 11:30:29.750603] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.756322] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.756848] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:30:29.756891] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.756995] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 11:30:29.757059] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 11:30:29.758381] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.760705] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.763018] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.763266] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 11:30:29.765323] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.770402] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.770971] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:30:29.771006] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.771073] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 11:30:29.771163] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 11:30:29.772451] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.774745] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.777073] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.777358] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 11:30:29.779379] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.784460] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.784946] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:30:29.784975] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.785040] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 11:30:29.785077] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 11:30:29.786635] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.788960] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.791287] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.791558] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 11:30:29.793608] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.798340] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.798855] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:30:29.798888] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.798968] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 11:30:29.799046] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 11:30:29.800282] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.802606] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.804947] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.805243] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 11:30:29.807261] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.812219] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.812711] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:30:29.812733] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.812816] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 11:30:29.812869] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 11:30:29.814162] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.816468] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.818828] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.819084] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 11:30:29.821132] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.825847] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.826342] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:30:29.826370] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.826462] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 11:30:29.826527] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 11:30:29.827808] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.830125] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.832449] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.832678] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 11:30:29.834761] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.839463] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.839949] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:30:29.839974] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.840051] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 11:30:29.840134] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 11:30:29.841428] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.843742] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.846078] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.846350] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 11:30:29.848396] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.853179] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.853651] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:30:29.853672] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.853729] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 11:30:29.853798] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 11:30:29.855125] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.857445] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.859781] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.860078] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 11:30:29.862103] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.867253] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.867735] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:30:29.867762] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.867861] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 11:30:29.867924] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 11:30:29.869397] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.871714] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.874051] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.874339] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 11:30:29.876379] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.881140] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.881630] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:30:29.881652] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.881712] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 11:30:29.881801] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 11:30:29.883093] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.885425] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.887782] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.888056] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 11:30:29.890108] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 11:30:29.895207] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:29.895675] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:30:29.895703] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:29.895776] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 11:30:29.895832] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 11:30:29.897118] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-16460-2017/03/17-11:30:24:635392-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster02
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster03
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 4
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328067202
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 11:30:34.642417] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 11:30:34.642639] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 11:30:34.647782] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 11:30:34.647846] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 11:30:34.648025] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 11:30:34.648061] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 11:30:34.648160] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 11:30:34.657189] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 11:30:34.657255] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 11:30:34.657287] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 11:30:34.661658] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 11:30:34.666157] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 11:30:34.670608] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 11:30:34.670672] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 11:30:34.670705] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 11:30:34.670740] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 11:30:34.670805] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 11:30:34.670846] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 11:30:34.670892] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 11:30:34.670921] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 11:30:34.670946] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 11:30:34.670973] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 11:30:34.671001] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 11:30:34.671040] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 11:30:34.671083] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 11:30:34.671111] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49425 (from 0)
[2017-03-17 11:30:34.671154] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 11:30:34.671183] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 11:30:34.671208] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 11:30:34.671234] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 11:30:34.671260] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49500 (from 0)
[2017-03-17 11:30:34.671286] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 11:30:34.671310] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 11:30:34.671344] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.773967] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.774085] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:30:34.774103] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.774148] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-2' came back up; going online.
[2017-03-17 11:30:34.774210] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.774371] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.774465] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.774555] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775026] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 11:30:34.775073] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775138] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:30:34.775150] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.775309] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775367] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775419] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775466] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775533] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775579] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775627] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775682] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:30:34.775698] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.775808] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:30:34.775828] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.775880] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-6' came back up; going online.
[2017-03-17 11:30:34.775909] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.775960] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776031] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776081] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776128] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776173] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776224] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776268] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776312] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776365] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776424] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776473] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776531] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776597] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:30:34.776631] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.776673] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-14' came back up; going online.
[2017-03-17 11:30:34.776701] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776750] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776810] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776882] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776933] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.776989] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:30:34.777000] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777104] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 11:30:34.777161] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:30:34.777172] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777208] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-10' came back up; going online.
[2017-03-17 11:30:34.777239] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:30:34.777248] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777288] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-22' came back up; going online.
[2017-03-17 11:30:34.777311] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 11:30:34.777340] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:30:34.777352] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777465] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:30:34.777479] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777514] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-18' came back up; going online.
[2017-03-17 11:30:34.777537] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 11:30:34.777571] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:30:34.777581] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777679] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:30:34.777708] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777725] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:30:34.777746] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777912] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:30:34.777941] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.777986] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:30:34.778005] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778078] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:30:34.778119] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778139] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:30:34.778157] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778174] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-26' came back up; going online.
[2017-03-17 11:30:34.778204] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-30' came back up; going online.
[2017-03-17 11:30:34.778245] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:30:34.778262] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778275] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:30:34.778290] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778399] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:30:34.778419] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778475] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:30:34.778495] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778556] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-34' came back up; going online.
[2017-03-17 11:30:34.778560] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:30:34.778581] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778592] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 11:30:34.778627] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:30:34.778638] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778698] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-38' came back up; going online.
[2017-03-17 11:30:34.778726] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:30:34.778745] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778755] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:30:34.778791] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778890] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:30:34.778907] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.778974] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:30:34.778995] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.779034] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 11:30:34.779079] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:30:34.779090] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.779154] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:30:34.779173] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.779202] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:30:34.779219] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.779334] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:30:34.779353] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.779378] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:30:34.779398] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.779466] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-42' came back up; going online.
[2017-03-17 11:30:34.779487] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 11:30:34.779513] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 11:30:34.779521] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 11:30:34.779551] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 11:30:34.779579] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 11:30:34.779608] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 11:30:34.779610] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 11:30:34.779641] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 11:30:34.779669] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 11:30:34.779672] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 11:30:34.779689] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 11:30:34.779699] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 11:30:34.779714] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 11:30:34.779733] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 11:30:34.779753] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 11:30:34.779785] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 11:30:34.779817] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 11:30:34.779826] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 11:30:34.779849] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 11:30:34.779894] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 11:30:34.779928] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 11:30:34.779938] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 11:30:34.779976] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 11:30:34.780002] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 11:30:34.780040] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 11:30:34.780073] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 11:30:34.780133] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:30:34.780685] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:30:34.780719] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:30:34.780996] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 11:30:34.790152] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 11:30:34.792622] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 11:30:34.793178] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 11:30:34.793410] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 11:30:34.793876] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 11:30:34.794148] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 11:30:34.794339] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 11:30:34.794404] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 11:30:34.794438] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 11:30:34.794474] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 11:30:34.794497] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328067202
[2017-03-17 11:30:34.794563] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 11:30:34.797625] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 11:30:34.824255] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 11:30:34.849744] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 11:30:34.891364] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 11:30:35.061728] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 11:30:35.123416] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /mahdi-test-2012
[2017-03-17 11:30:35.173123] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /IT-Mahdi4
[2017-03-17 11:30:35.234561] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 11:30:35.234632] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 1.00 secs
[2017-03-17 11:30:35.234658] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 0, size: 0, lookups: 0, failures: 0, skipped: 0
[2017-03-17 11:30:35.234890] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7fa2e442edc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7fa2e5ac0cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7fa2e5ac0b4b] ) 0-: received signum (15), shutting down
[2017-03-17 11:35:10.733160] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=1 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328069492 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 11:35:10.751334] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:35:10.751414] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 11:35:10.751465] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 11:35:15.733064] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328069492'
[2017-03-17 11:35:15.733096] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:35:15.733110] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '1'
[2017-03-17 11:35:15.733122] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 11:35:15.733147] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:35:15.733159] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:35:15.733171] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:35:15.733185] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:35:15.733206] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:35:15.733218] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:35:15.733246] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:35:15.733265] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:35:15.733279] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:35:15.733297] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:35:15.733309] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:35:15.733320] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:35:15.733334] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:35:15.733345] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:35:15.733356] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:35:15.733370] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:35:15.733381] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:35:15.733392] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:35:15.733406] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:35:15.733417] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:35:15.733428] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:35:15.733442] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:35:15.733453] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:35:15.733464] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:35:15.733478] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:35:15.733489] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:35:15.733500] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:35:15.733519] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:35:15.733531] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:35:15.733542] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:35:15.733556] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:35:15.733567] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:35:15.733578] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:35:15.733592] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:35:15.733603] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:35:15.733614] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:35:15.733628] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:35:15.733639] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:35:15.733650] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:35:15.733664] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:35:15.733676] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:35:15.733687] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:35:15.733701] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:35:15.733712] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:35:15.733723] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:35:15.733738] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:35:15.733749] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:35:15.733761] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:35:15.733807] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:35:15.733826] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:35:15.733839] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:35:15.733852] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:35:15.733872] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:35:15.733886] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:35:15.733899] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:35:15.733910] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:35:15.733921] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:35:15.733935] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:35:15.733946] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:35:15.733957] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:35:15.733970] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:35:15.733981] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:35:15.733992] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:35:15.734006] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:35:15.734017] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:35:15.734028] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:35:15.734041] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:35:15.734052] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:35:15.734063] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:35:15.736609] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328069492
[2017-03-17 11:35:15.819915] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:35:15.839135] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.842779] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.843113] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 11:35:15.845560] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.849350] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.849891] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:35:15.849914] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.849992] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 11:35:15.850065] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 11:35:15.851592] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.854235] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.856861] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.857107] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 11:35:15.859486] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.864301] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.864782] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:35:15.864818] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.864889] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 11:35:15.864977] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 11:35:15.866437] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.868964] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.871492] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.871752] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 11:35:15.874261] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.879013] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.879491] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:35:15.879524] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.879587] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 11:35:15.879668] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 11:35:15.881280] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.883707] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.886137] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.886408] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 11:35:15.888563] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.892968] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.893473] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:35:15.893500] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.893577] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 11:35:15.893611] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 11:35:15.895125] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.897459] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.899806] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.900089] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 11:35:15.902161] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.907075] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.907613] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:35:15.907638] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.907719] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 11:35:15.907790] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 11:35:15.909005] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.911345] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.913719] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.913991] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 11:35:15.916089] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.920550] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.921095] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:35:15.921126] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.921210] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 11:35:15.921247] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 11:35:15.922555] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.924888] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.927222] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.927440] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 11:35:15.929550] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.932706] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.933228] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:35:15.933248] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.933311] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 11:35:15.933381] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 11:35:15.934722] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.937063] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.939410] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.939618] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 11:35:15.941753] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.944722] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.945185] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:35:15.945205] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.945259] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 11:35:15.945315] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 11:35:15.946872] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.949208] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.951560] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.951859] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 11:35:15.953912] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.959095] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.959578] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:35:15.959606] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.959687] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 11:35:15.959778] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 11:35:15.960998] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.963353] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.966124] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.966393] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 11:35:15.968482] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.972710] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.973262] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:35:15.973292] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.973361] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 11:35:15.973445] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 11:35:15.974853] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.977203] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.979574] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.979854] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 11:35:15.981933] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 11:35:15.987133] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:15.987575] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:35:15.987604] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:15.987669] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 11:35:15.987728] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 11:35:15.989108] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-18224-2017/03/17-11:35:10:725243-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster02
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster03
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 1
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328069492
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 11:35:20.732680] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 11:35:20.732729] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 11:35:20.738303] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 11:35:20.738431] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 11:35:20.743069] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 11:35:20.747572] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 11:35:20.747632] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 11:35:20.747662] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 11:35:20.747687] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 11:35:20.747711] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 11:35:20.747735] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 11:35:20.747759] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 11:35:20.747806] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 11:35:20.747834] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 11:35:20.747859] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 11:35:20.747896] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 11:35:20.747923] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 11:35:20.747986] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 11:35:20.748015] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 11:35:20.748038] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 11:35:20.748061] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 11:35:20.748084] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 11:35:20.748107] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 11:35:20.748131] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 11:35:20.748153] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 11:35:20.748176] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 11:35:20.748199] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 11:35:20.748223] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 11:35:20.748246] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 11:35:20.748269] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 11:35:20.748292] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49425 (from 0)
[2017-03-17 11:35:20.748314] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49500 (from 0)
[2017-03-17 11:35:20.748338] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 11:35:20.748369] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.848481] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:35:20.848506] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.848557] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-3' came back up; going online.
[2017-03-17 11:35:20.848609] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.848675] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849154] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 11:35:20.849185] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849230] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849272] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849315] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849364] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849403] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849442] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849484] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849521] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849557] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849600] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849637] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849673] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849712] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849776] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849824] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849863] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849904] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849943] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.849980] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850019] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850069] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:35:20.850079] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.850221] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850267] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850312] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850361] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850417] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:35:20.850427] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.850503] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850544] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850583] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850627] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.850674] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:35:20.850695] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.850728] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-11' came back up; going online.
[2017-03-17 11:35:20.850756] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:35:20.850771] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.850810] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-7' came back up; going online.
[2017-03-17 11:35:20.850838] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:35:20.850846] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.850941] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:35:20.850952] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.850993] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-15' came back up; going online.
[2017-03-17 11:35:20.851021] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:35:20.851029] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851121] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:35:20.851137] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851241] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:35:20.851252] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851281] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-19' came back up; going online.
[2017-03-17 11:35:20.851305] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:35:20.851313] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851339] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-23' came back up; going online.
[2017-03-17 11:35:20.851360] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:35:20.851365] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:35:20.851398] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851380] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851501] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:35:20.851513] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851550] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:35:20.851564] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851598] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:35:20.851609] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851664] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-27' came back up; going online.
[2017-03-17 11:35:20.851680] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:35:20.851689] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 11:35:20.851694] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851712] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:35:20.851722] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851833] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:35:20.851867] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851896] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:35:20.851905] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-35' came back up; going online.
[2017-03-17 11:35:20.851924] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851970] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-31' came back up; going online.
[2017-03-17 11:35:20.851976] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:35:20.851987] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.851999] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:35:20.852009] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852076] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:35:20.852087] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852128] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:35:20.852141] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852177] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-39' came back up; going online.
[2017-03-17 11:35:20.852188] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 11:35:20.852205] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:35:20.852215] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852217] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:35:20.852231] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852331] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:35:20.852343] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852376] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:35:20.852396] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852398] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-43' came back up; going online.
[2017-03-17 11:35:20.852422] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 11:35:20.852437] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 11:35:20.852460] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:35:20.852468] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852479] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:35:20.852491] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852554] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 11:35:20.852581] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:35:20.852589] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852608] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:35:20.852621] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.852690] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 11:35:20.852710] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 11:35:20.852719] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 11:35:20.852738] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 11:35:20.852748] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 11:35:20.852753] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 11:35:20.852794] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 11:35:20.852798] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 11:35:20.852821] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 11:35:20.852836] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 11:35:20.852837] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 11:35:20.852860] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 11:35:20.852868] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 11:35:20.852889] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 11:35:20.852895] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 11:35:20.852906] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 11:35:20.852920] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 11:35:20.852923] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 11:35:20.852943] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 11:35:20.852955] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 11:35:20.852976] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 11:35:20.852977] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 11:35:20.853001] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 11:35:20.853006] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 11:35:20.853024] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 11:35:20.853039] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 11:35:20.853076] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:35:20.853754] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:35:20.853780] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:35:20.853941] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 11:35:20.865026] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 11:35:20.865641] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 11:35:20.865825] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 11:35:20.866251] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 11:35:20.866412] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 11:35:20.866619] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 11:35:20.866786] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 11:35:20.866812] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328069492
[2017-03-17 11:35:20.866830] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 11:35:20.866904] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 11:35:20.866968] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 11:35:20.866972] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 11:35:20.869349] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 11:35:20.886029] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 11:35:20.886057] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 11:35:20.886069] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 11:35:20.886078] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 11:35:20.886086] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 11:35:20.886094] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 11:35:20.886103] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 11:35:20.886111] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 11:35:20.886118] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 11:35:20.886126] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 11:35:20.886134] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 11:35:20.886209] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 11:35:20.886254] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 11:35:20.886289] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 11:35:20.886327] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 11:35:20.886342] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 11:35:20.886397] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 11:35:20.886433] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 11:35:20.886448] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 11:35:20.886513] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 11:35:20.886528] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 11:35:20.887314] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 11:35:20.887369] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 11:35:20.887386] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 11:35:20.887456] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 11:35:20.887476] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 11:35:20.887502] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 11:35:20.887542] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 11:35:20.887575] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 11:35:20.887591] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 11:35:20.887648] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 11:35:20.887656] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 11:35:20.888468] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 11:35:20.888540] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 11:35:20.888519] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 11:35:20.888576] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 11:35:20.888615] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 11:35:20.888634] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 11:35:20.888673] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 11:35:20.888694] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 11:35:20.888735] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 11:35:20.888750] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 11:35:20.888848] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 11:35:20.888850] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 11:35:20.889654] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 11:35:20.889740] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 11:35:20.889749] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 11:35:20.889779] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 11:35:20.889871] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 11:35:20.889869] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 11:35:20.889906] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 11:35:20.889919] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 11:35:20.889957] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 11:35:20.889961] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 11:35:20.889991] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 11:35:20.889994] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 11:35:20.890805] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 11:35:20.890883] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 11:35:20.890893] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 11:35:20.890917] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 11:35:20.890963] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 11:35:20.890988] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 11:35:20.891013] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 11:35:20.891029] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 11:35:20.891073] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 11:35:20.891095] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 11:35:20.891128] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 11:35:20.891146] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 11:35:20.891969] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 11:35:20.892006] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 11:35:20.892036] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 11:35:20.892069] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 11:35:20.892110] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 11:35:20.892142] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 11:35:20.892172] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 11:35:20.892203] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 11:35:20.892233] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 11:35:20.893058] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-6; inode layout - 1561806288 - 1757032073 - 1; disk layout - 0 - 195225785 - 1
[2017-03-17 11:35:20.893098] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893145] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 1757032074 - 1952257859 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 11:35:20.893191] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893217] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 1952257860 - 2147483645 - 1; disk layout - 390451572 - 585677357 - 1
[2017-03-17 11:35:20.893234] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893254] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 2147483646 - 2342709431 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 11:35:20.893272] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893441] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-11; inode layout - 0 - 195225785 - 1; disk layout - 1561806288 - 1757032073 - 1
[2017-03-17 11:35:20.893456] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893588] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 195225786 - 390451571 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 11:35:20.893612] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893633] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-13; inode layout - 390451572 - 585677357 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 11:35:20.893678] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.893746] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 585677358 - 780903143 - 1; disk layout - 2147483646 - 2342709431 - 1
[2017-03-17 11:35:20.893789] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:35:20.896674] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 11:35:20.909638] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.lck-2c739d20965fb485: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:35:20.912861] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.02 secs
[2017-03-17 11:35:20.916629] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/.lck-2c739d20965fb485) } would result in dst node (vmware2-replicate-19:1841365904) having lower disk space then the source node (vmware2-replicate-18:1852380248).Skipping file.
[2017-03-17 11:35:20.917324] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 11:35:20.932693] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-1; inode layout - 1952257860 - 2147483645 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 11:35:20.932727] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.932803] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 3318838362 - 3514064147 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 11:35:20.932840] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.932857] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-3; inode layout - 3709289934 - 3904515719 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 11:35:20.932874] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.932928] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-4; inode layout - 3904515720 - 4099741505 - 1; disk layout - 2147483646 - 2342709431 - 1
[2017-03-17 11:35:20.932945] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.933040] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-6; inode layout - 0 - 195225785 - 1; disk layout - 2537935218 - 2733161003 - 1
[2017-03-17 11:35:20.933053] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.933146] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 195225786 - 390451571 - 1; disk layout - 2733161004 - 2928386789 - 1
[2017-03-17 11:35:20.933178] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.933282] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-10; inode layout - 2147483646 - 2342709431 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 11:35:20.933318] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.933341] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 585677358 - 780903143 - 1; disk layout - 3318838362 - 3514064147 - 1
[2017-03-17 11:35:20.933359] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.933454] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 2537935218 - 2733161003 - 1; disk layout - 0 - 195225785 - 1
[2017-03-17 11:35:20.933469] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.933548] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-13; inode layout - 2733161004 - 2928386789 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 11:35:20.933560] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:35:20.935938] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 11:35:20.946228] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 11:35:20.950719] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 11:35:20.968343] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 11:35:20.977531] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 11:35:20.998656] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 11:35:21.014438] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 2733161004 - 2928386789 - 1; disk layout - 390451572 - 585677357 - 1
[2017-03-17 11:35:21.014477] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:35:21.015084] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-11; inode layout - 390451572 - 585677357 - 1; disk layout - 2733161004 - 2928386789 - 1
[2017-03-17 11:35:21.015115] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:35:21.017967] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 11:35:21.033939] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:21.040315] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.19: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:21.050136] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.1: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:21.050505] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.19) } would result in dst node (vmware2-replicate-3:1847913120) having lower disk space then the source node (vmware2-replicate-2:1852339760).Skipping file.
[2017-03-17 11:35:21.057720] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:2176 name:(/.shard/994e99c6-80c4-4128-851e-fdd18f848090.1) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848708176).Skipping file.
[2017-03-17 11:35:21.060973] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.16: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.066802] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:21.074005] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1853952792).Skipping file.
[2017-03-17 11:35:21.078983] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.33: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:21.085900] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.33) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1848184520).Skipping file.
[2017-03-17 11:35:21.089386] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.32: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.092123] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.16 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.096819] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.4: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:21.103459] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:21.110954] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.9: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:21.120787] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.9) } would result in dst node (vmware2-replicate-15:1847639368) having lower disk space then the source node (vmware2-replicate-18:1852378928).Skipping file.
[2017-03-17 11:35:21.121162] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.108: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:21.134634] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.92: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:21.141457] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.22: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:21.143901] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.92) } would result in dst node (vmware2-replicate-3:1847913120) having lower disk space then the source node (vmware2-replicate-2:1852339760).Skipping file.
[2017-03-17 11:35:21.151695] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.22) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848708176).Skipping file.
[2017-03-17 11:35:21.153566] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.167656] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.189: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:21.177147] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.189) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1853952792).Skipping file.
[2017-03-17 11:35:21.179873] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.62: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:21.186360] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.37: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.189915] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.62) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1848184520).Skipping file.
[2017-03-17 11:35:21.191441] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:21.195733] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.38: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:21.200187] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.82: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:21.201620] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63) } would result in dst node (vmware2-replicate-19:1841365904) having lower disk space then the source node (vmware2-replicate-14:1841370072).Skipping file.
[2017-03-17 11:35:21.206359] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.38) } would result in dst node (vmware2-replicate-13:1840840560) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:21.210463] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.82) } would result in dst node (vmware2-replicate-15:1847639368) having lower disk space then the source node (vmware2-replicate-18:1852366848).Skipping file.
[2017-03-17 11:35:21.215871] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.222: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:21.228244] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.132: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:21.241071] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.161: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:21.241484] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.132) } would result in dst node (vmware2-replicate-3:1847913056) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:21.247757] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.74: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.253915] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.161) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848708176).Skipping file.
[2017-03-17 11:35:21.256213] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.232: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:21.267282] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.232) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1853952792).Skipping file.
[2017-03-17 11:35:21.275201] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.284: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:21.281866] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.48: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.286885] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.284) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1848184520).Skipping file.
[2017-03-17 11:35:21.287460] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:21.294273] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:21.300123] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:256 name:(/.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841370072).Skipping file.
[2017-03-17 11:35:21.301094] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.143: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:21.313335] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.295: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:21.314017] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.143) } would result in dst node (vmware2-replicate-15:1847639368) having lower disk space then the source node (vmware2-replicate-18:1852355024).Skipping file.
[2017-03-17 11:35:21.323569] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.162: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:21.333114] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.180: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:21.339403] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.162) } would result in dst node (vmware2-replicate-3:1847913056) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:21.341407] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.85: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.350091] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.180) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848708176).Skipping file.
[2017-03-17 11:35:21.351225] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.257: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:21.352493] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.48 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.365226] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.308: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:21.365538] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.257) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1853952792).Skipping file.
[2017-03-17 11:35:21.377743] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.382641] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.308) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1848178312).Skipping file.
[2017-03-17 11:35:21.385600] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:21.393449] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.35: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:21.402334] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.181: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:21.402582] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:0 name:(/.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841370072).Skipping file.
[2017-03-17 11:35:21.407481] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:506368 name:(/.shard/994e99c6-80c4-4128-851e-fdd18f848090.35) } would result in dst node (vmware2-replicate-13:1840840560) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:21.419866] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.181) } would result in dst node (vmware2-replicate-15:1847639368) having lower disk space then the source node (vmware2-replicate-18:1852346032).Skipping file.
[2017-03-17 11:35:21.430079] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.403: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:21.434520] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.164: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:21.442123] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.207: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:21.451109] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.164) } would result in dst node (vmware2-replicate-3:1847913056) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:21.460181] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.207) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848708176).Skipping file.
[2017-03-17 11:35:21.472715] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.175: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.511505] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.595: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:21.533476] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.595) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1853933696).Skipping file.
[2017-03-17 11:35:21.535252] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.499: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:21.551497] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.121: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.553999] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.499) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1848148728).Skipping file.
[2017-03-17 11:35:21.561195] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.1: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:21.572929] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.34: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:21.585197] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.192: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:21.608169] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.192) } would result in dst node (vmware2-replicate-15:1847639368) having lower disk space then the source node (vmware2-replicate-18:1852323336).Skipping file.
[2017-03-17 11:35:21.622007] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.544: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:21.649233] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.318: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:21.660113] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.237: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:21.668204] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.318) } would result in dst node (vmware2-replicate-3:1847912992) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:21.676857] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.235: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:21.683229] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.237) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848708176).Skipping file.
[2017-03-17 11:35:21.688736] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.604: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:21.698531] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.507: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:21.713721] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.604) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1853896920).Skipping file.
[2017-03-17 11:35:21.720572] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.122: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:21.723344] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.507) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1848108296).Skipping file.
[2017-03-17 11:35:21.731992] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.8: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:25.621167] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 4.60 secs
[2017-03-17 11:35:25.753138] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 11:35:25.825885] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 11:35:25.838478] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.01 secs
[2017-03-17 11:35:25.884716] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /mahdi-test-2012
[2017-03-17 11:35:25.955540] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-0; inode layout - 3904515720 - 4099741505 - 1; disk layout - 390451572 - 585677357 - 1
[2017-03-17 11:35:25.955567] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /mahdi-test-2012, gfid = f32801ab-a6e1-4707-b03e-28ced6d3d5eb
[2017-03-17 11:35:25.956260] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-6; inode layout - 390451572 - 585677357 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 11:35:25.956280] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /mahdi-test-2012, gfid = f32801ab-a6e1-4707-b03e-28ced6d3d5eb
[2017-03-17 11:35:25.965446] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /mahdi-test-2012
[2017-03-17 11:35:26.108589] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /mahdi-test-2012 took 0.14 secs
[2017-03-17 11:35:26.163871] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /IT-Mahdi4
[2017-03-17 11:35:26.237703] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-0; inode layout - 2537935218 - 2733161003 - 1; disk layout - 0 - 195225785 - 1
[2017-03-17 11:35:26.237732] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.237978] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 0 - 195225785 - 1; disk layout - 2537935218 - 2733161003 - 1
[2017-03-17 11:35:26.237993] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.238417] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 1561806288 - 1757032073 - 1; disk layout - 976128930 - 1171354715 - 1
[2017-03-17 11:35:26.238429] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.238487] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 3709289934 - 3904515719 - 1; disk layout - 1366580502 - 1561806287 - 1
[2017-03-17 11:35:26.238497] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.238592] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-16; inode layout - 1171354716 - 1366580501 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 11:35:26.238602] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.239352] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 1757032074 - 1952257859 - 1; disk layout - 1171354716 - 1366580501 - 1
[2017-03-17 11:35:26.239372] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.239399] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 976128930 - 1171354715 - 1; disk layout - 1561806288 - 1757032073 - 1
[2017-03-17 11:35:26.239423] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.239569] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 1366580502 - 1561806287 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 11:35:26.239579] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:35:26.247095] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /IT-Mahdi4
[2017-03-17 11:35:26.343580] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /IT-Mahdi4 took 0.10 secs
[2017-03-17 11:35:26.416399] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 11:35:26.416516] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 11:35:26.416581] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 11:35:26.416660] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 11:35:26.416692] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 11:35:26.416742] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 11:35:26.416773] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 11:35:26.416835] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 11:35:26.417368] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 11:35:26.417434] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 11:35:26.417492] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 11:35:26.417547] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 11:35:26.417608] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 11:35:26.417651] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 11:35:26.417676] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 11:35:26.418295] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 11:35:26.418366] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 11:35:26.418416] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 11:35:26.418441] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 11:35:26.418496] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 11:35:26.418518] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 11:35:26.418583] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 11:35:26.419192] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 11:35:26.421092] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.854: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:35:26.424894] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.740: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:26.424917] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.267: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.424945] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.661: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:26.425125] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.266: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.425396] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.10: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.425490] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.199: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.425576] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.212: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.425639] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.789: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:26.425647] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.136: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.426046] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:26.426201] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.32: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.426204] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.721: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:26.426179] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:26.426219] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.88: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.426225] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.188: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.426249] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.630: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:26.426718] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.346: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.426740] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.239: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.426807] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.286: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.426931] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.684: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:26.428608] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.764: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:26.463111] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.854) } would result in dst node (vmware2-replicate-7:1847142424) having lower disk space then the source node (vmware2-replicate-8:1852457752).Skipping file.
[2017-03-17 11:35:26.467649] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.267) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848646232).Skipping file.
[2017-03-17 11:35:26.467722] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.789) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1846871296).Skipping file.
[2017-03-17 11:35:26.469490] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.661) } would result in dst node (vmware2-replicate-3:1847912992) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:26.469945] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.740) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1846870272).Skipping file.
[2017-03-17 11:35:26.470425] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.199) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1850014616).Skipping file.
[2017-03-17 11:35:26.472300] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.212) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1850014104).Skipping file.
[2017-03-17 11:35:26.472421] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841369944).Skipping file.
[2017-03-17 11:35:26.473172] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.32) } would result in dst node (vmware2-replicate-13:1840777968) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.473423] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.239) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1850014104).Skipping file.
[2017-03-17 11:35:26.475163] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.10) } would result in dst node (vmware2-replicate-13:1840777944) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.475646] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.286) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848646168).Skipping file.
[2017-03-17 11:35:26.476413] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.721) } would result in dst node (vmware2-replicate-3:1847912992) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:26.476435] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841369944).Skipping file.
[2017-03-17 11:35:26.476989] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.630) } would result in dst node (vmware2-replicate-1:1844536328) having lower disk space then the source node (vmware2-replicate-0:1844259928).Skipping file.
[2017-03-17 11:35:26.477340] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.88) } would result in dst node (vmware2-replicate-13:1840777944) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.477665] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.793: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:26.479163] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.684) } would result in dst node (vmware2-replicate-1:1844535560) having lower disk space then the source node (vmware2-replicate-0:1844259928).Skipping file.
[2017-03-17 11:35:26.480299] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.764) } would result in dst node (vmware2-replicate-1:1844535304) having lower disk space then the source node (vmware2-replicate-0:1844259928).Skipping file.
[2017-03-17 11:35:26.481951] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.324: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.483510] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.384: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.484028] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.797: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:26.485087] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.197: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.485330] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.66: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:26.487178] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.89: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.488427] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.256: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.489624] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.890: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:35:26.490204] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.379: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.490508] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.125: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:26.491254] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.262: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.491917] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.819: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:26.492136] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.394: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.493292] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.93: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.494195] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.289: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.494473] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.392: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.500036] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.606: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.517535] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.793) } would result in dst node (vmware2-replicate-3:1847912992) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:26.524026] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.324) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848645768).Skipping file.
[2017-03-17 11:35:26.525265] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.797) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1846855272).Skipping file.
[2017-03-17 11:35:26.532467] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.976: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:26.534412] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.256) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849992272).Skipping file.
[2017-03-17 11:35:26.536245] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.89) } would result in dst node (vmware2-replicate-13:1840777736) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.537995] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.890) } would result in dst node (vmware2-replicate-3:1847912992) having lower disk space then the source node (vmware2-replicate-2:1852339720).Skipping file.
[2017-03-17 11:35:26.539111] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.379) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848645680).Skipping file.
[2017-03-17 11:35:26.541040] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.291: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.542107] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:26.542186] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.392) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848645632).Skipping file.
[2017-03-17 11:35:26.542197] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.93) } would result in dst node (vmware2-replicate-13:1840777712) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.542631] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.819) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1846851432).Skipping file.
[2017-03-17 11:35:26.544108] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.289) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849989120).Skipping file.
[2017-03-17 11:35:26.549233] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.298: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.549774] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.117: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.550451] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.429: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.553786] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.725: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.556555] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.149: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:26.556866] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.389: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.557812] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.991: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:35:26.559529] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.131: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.577042] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.976) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1846841920).Skipping file.
[2017-03-17 11:35:26.581850] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841369944).Skipping file.
[2017-03-17 11:35:26.592674] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.429) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848645208).Skipping file.
[2017-03-17 11:35:26.594079] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.298) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849965440).Skipping file.
[2017-03-17 11:35:26.595347] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.300: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.595814] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.444: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.595990] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.117) } would result in dst node (vmware2-replicate-13:1840777520) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.605267] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.991) } would result in dst node (vmware2-replicate-11:1842938008) having lower disk space then the source node (vmware2-replicate-10:1846834200).Skipping file.
[2017-03-17 11:35:26.611269] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.441: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.611369] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.733: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.611613] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.166: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:26.617392] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.131) } would result in dst node (vmware2-replicate-13:1840777400) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.621173] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.154: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.633553] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.305: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.633892] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.444) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848645016).Skipping file.
[2017-03-17 11:35:26.640516] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.300) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849943568).Skipping file.
[2017-03-17 11:35:26.649142] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.557: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.660014] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.840: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.669276] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.154) } would result in dst node (vmware2-replicate-13:1840777184) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.681336] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.305) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849920392).Skipping file.
[2017-03-17 11:35:26.686918] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.468: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:26.687629] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.557) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848644736).Skipping file.
[2017-03-17 11:35:26.696852] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:26.700743] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.167: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:26.731598] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841369944).Skipping file.
[2017-03-17 11:35:26.748193] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.333: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:26.758916] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.167) } would result in dst node (vmware2-replicate-13:1840773800) having lower disk space then the source node (vmware2-replicate-16:1839900384).Skipping file.
[2017-03-17 11:35:26.775085] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.561: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:26.790197] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.333) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849863600).Skipping file.
[2017-03-17 11:35:26.806819] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.561) } would result in dst node (vmware2-replicate-17:1848179384) having lower disk space then the source node (vmware2-replicate-4:1848643480).Skipping file.
[2017-03-17 11:35:26.816304] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.846: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:26.826187] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.497: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:28.365448] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.4 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:28.376053] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:28.403347] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1841894232).Skipping file.
[2017-03-17 11:35:28.412817] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.173: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:29.269578] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:29.272929] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.368: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:29.288247] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.368) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1849076128).Skipping file.
[2017-03-17 11:35:29.292698] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.570: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:29.304581] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.570) } would result in dst node (vmware2-replicate-17:1848169584) having lower disk space then the source node (vmware2-replicate-4:1848603768).Skipping file.
[2017-03-17 11:35:29.311985] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.855: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:29.585193] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.1 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:29.596675] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.605: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:30.023595] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:30.036705] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:30.079560] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190) } would result in dst node (vmware2-replicate-19:1841365944) having lower disk space then the source node (vmware2-replicate-14:1842942808).Skipping file.
[2017-03-17 11:35:30.092003] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.224: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:30.104032] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.8 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:30.113145] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.377: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:30.129207] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.224) } would result in dst node (vmware2-replicate-13:1841545680) having lower disk space then the source node (vmware2-replicate-16:1840948960).Skipping file.
[2017-03-17 11:35:30.143684] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.601: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:30.146604] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.377) } would result in dst node (vmware2-replicate-15:1847657288) having lower disk space then the source node (vmware2-replicate-18:1848902184).Skipping file.
[2017-03-17 11:35:30.171183] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.954: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:30.171713] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.601) } would result in dst node (vmware2-replicate-17:1848152360) having lower disk space then the source node (vmware2-replicate-4:1848589304).Skipping file.
[2017-03-17 11:35:30.185881] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.607: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:33.397565] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 13.00 secs
[2017-03-17 11:35:33.397595] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 7, size: 1343553536, lookups: 568, failures: 0, skipped: 87
[2017-03-17 11:35:33.755296] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:33.763116] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.206: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:34.036061] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.108 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:34.036216] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.32 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:34.036520] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.222 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:34.044464] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.225: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:34.044982] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.381: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:34.045049] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.622: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:34.068119] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.622) } would result in dst node (vmware2-replicate-17:1847614160) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:34.085539] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.965: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:34.707289] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.295 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:34.711286] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.613: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:34.772269] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.403 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:34.802382] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:34.825997] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.544 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:35:34.838030] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.252: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:34.840845] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227) } would result in dst node (vmware2-replicate-19:1841890232) having lower disk space then the source node (vmware2-replicate-14:1842942808).Skipping file.
[2017-03-17 11:35:34.855978] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.438: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:35.049800] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 15.00 secs
[2017-03-17 11:35:35.049816] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 14, size: 3222601728, lookups: 568, failures: 0, skipped: 89
[2017-03-17 11:35:35.154277] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:35.155165] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.173 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:35.161778] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.649: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:35.170337] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.636: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:35.191008] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.649) } would result in dst node (vmware2-replicate-17:1847304264) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:35.196469] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.280: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:35.251704] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:35.260694] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.287: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:35.383256] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.121 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:35.394059] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.486: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:35.741074] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.122 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:35.748514] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.657: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:35.777922] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.657) } would result in dst node (vmware2-replicate-17:1847235904) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:35.794993] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.644: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:35.843775] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.74 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:35.854404] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.293: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:36.301964] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 16.00 secs
[2017-03-17 11:35:36.301983] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 20, size: 4833214464, lookups: 568, failures: 0, skipped: 91
[2017-03-17 11:35:36.896681] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.85 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:36.906054] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.313: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:36.972446] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.175 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:36.984031] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.493: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:38.143466] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.235 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:38.152059] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.744: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:38.189526] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.744) } would result in dst node (vmware2-replicate-17:1846725720) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:38.206260] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.750: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:39.114576] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.66 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:39.119614] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:39.144306] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336) } would result in dst node (vmware2-replicate-19:1841890232) having lower disk space then the source node (vmware2-replicate-14:1843991384).Skipping file.
[2017-03-17 11:35:39.153723] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.342: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:39.306115] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.125 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:39.314930] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.505: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:39.947667] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.34 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:39.947950] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.149 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:39.959360] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.813: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:39.985848] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.813) } would result in dst node (vmware2-replicate-17:1846230304) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:39.994888] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.756: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:39.998047] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.340: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:40.002439] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.166 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:40.011495] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.345: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:40.025508] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.340) } would result in dst node (vmware2-replicate-18:1844791000) having lower disk space then the source node (vmware2-replicate-14:1845039960).Skipping file.
[2017-03-17 11:35:40.040224] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.535: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:40.061329] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.345) } would result in dst node (vmware2-replicate-13:1842305616) having lower disk space then the source node (vmware2-replicate-16:1841912416).Skipping file.
[2017-03-17 11:35:40.080299] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.953: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:40.113943] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.953) } would result in dst node (vmware2-replicate-17:1846203568) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:40.139232] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.815: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:44.054304] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.225 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:44.057775] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:44.064410] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348) } would result in dst node (vmware2-replicate-19:1842414520) having lower disk space then the source node (vmware2-replicate-14:1845039960).Skipping file.
[2017-03-17 11:35:44.066739] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.366: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:44.482662] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.206 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:44.490581] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.554: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:44.569118] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.366) } would result in dst node (vmware2-replicate-13:1842443720) having lower disk space then the source node (vmware2-replicate-16:1842436704).Skipping file.
[2017-03-17 11:35:44.625598] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.978: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:44.635612] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.978) } would result in dst node (vmware2-replicate-17:1846082232) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:44.638623] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.947: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:46.367750] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.252 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:46.368044] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.287 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:46.370061] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:46.370163] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.376: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:46.374064] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:46.375692] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.566: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:46.949569] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.346 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.950014] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.266 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.950503] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.606 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.950857] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.394 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.951290] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.384 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.951509] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.725 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.951850] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.733 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.952251] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.840 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:46.956314] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.987: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:46.959165] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:46.961714] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.569: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:46.965189] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:46.965227] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.376) } would result in dst node (vmware2-replicate-13:1842644032) having lower disk space then the source node (vmware2-replicate-16:1843485280).Skipping file.
[2017-03-17 11:35:46.965234] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.385: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:46.966510] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.988: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:35:46.966711] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.949: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:46.969193] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.987) } would result in dst node (vmware2-replicate-17:1846082232) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:46.970123] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.977: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:46.970701] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:46.974270] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.391: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:46.976411] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.577: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:46.979105] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:46.981458] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.988) } would result in dst node (vmware2-replicate-17:1846082232) having lower disk space then the source node (vmware2-replicate-4:1848525856).Skipping file.
[2017-03-17 11:35:46.983599] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:46.986020] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.431: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:46.992077] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:46.998324] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.591: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:47.002284] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:47.016123] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.846 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:47.019149] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:47.020567] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.313 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:47.020903] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.435: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:47.024188] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.609: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:47.024890] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:47.026712] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.385) } would result in dst node (vmware2-replicate-13:1843166008) having lower disk space then the source node (vmware2-replicate-16:1844009272).Skipping file.
[2017-03-17 11:35:47.027296] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.391) } would result in dst node (vmware2-replicate-13:1843165752) having lower disk space then the source node (vmware2-replicate-16:1844009272).Skipping file.
[2017-03-17 11:35:47.028807] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.431) } would result in dst node (vmware2-replicate-13:1843165752) having lower disk space then the source node (vmware2-replicate-16:1844009272).Skipping file.
[2017-03-17 11:35:47.034376] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.449: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:47.034871] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.617: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:47.035095] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:47.044049] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:47.051188] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.452: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:47.055428] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:47.057214] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.449) } would result in dst node (vmware2-replicate-13:1843163440) having lower disk space then the source node (vmware2-replicate-16:1844009272).Skipping file.
[2017-03-17 11:35:47.062588] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.646: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:47.064733] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.446: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:47.073188] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.452) } would result in dst node (vmware2-replicate-13:1843161896) having lower disk space then the source node (vmware2-replicate-16:1844009272).Skipping file.
[2017-03-17 11:35:47.082471] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.453: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:47.103915] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.453) } would result in dst node (vmware2-replicate-13:1843159072) having lower disk space then the source node (vmware2-replicate-16:1844008248).Skipping file.
[2017-03-17 11:35:47.109877] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.663: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:47.337090] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.446) } would result in dst node (vmware2-replicate-18:1842571768) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:48.087651] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:48.106472] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1845564248).Skipping file.
[2017-03-17 11:35:48.113661] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.459: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:48.141131] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.459) } would result in dst node (vmware2-replicate-13:1843059344) having lower disk space then the source node (vmware2-replicate-16:1843663768).Skipping file.
[2017-03-17 11:35:48.151804] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.666: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:49.102806] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.855 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:49.103559] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.954 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:49.103920] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.280 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:49.109832] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:49.110302] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.460: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:49.115004] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.796: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:49.136046] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.460) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1843838512).Skipping file.
[2017-03-17 11:35:49.136542] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1846088536).Skipping file.
[2017-03-17 11:35:49.144707] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.467: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:49.145786] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.463: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:49.166610] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.463) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1843829256).Skipping file.
[2017-03-17 11:35:49.181832] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.806: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:49.351612] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.342 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:49.356341] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.479: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:49.358599] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.467) } would result in dst node (vmware2-replicate-18:1842458560) having lower disk space then the source node (vmware2-replicate-14:1846088536).Skipping file.
[2017-03-17 11:35:49.402924] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.479) } would result in dst node (vmware2-replicate-18:1842443152) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:49.404921] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.470: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:49.419959] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.823: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:49.436530] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.470) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1843756000).Skipping file.
[2017-03-17 11:35:49.446627] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:49.476325] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495) } would result in dst node (vmware2-replicate-19:1842938808) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:49.485210] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.524: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:49.515500] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.524) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1843736216).Skipping file.
[2017-03-17 11:35:49.529800] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.844: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:49.676302] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.293 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:49.681058] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.520: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:49.690029] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.520) } would result in dst node (vmware2-replicate-18:1842364504) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:49.694352] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.540: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:49.717238] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.540) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1843688664).Skipping file.
[2017-03-17 11:35:49.727438] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.882: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:35:49.739111] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.965 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:35:49.745202] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.532: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:49.763494] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.532) } would result in dst node (vmware2-replicate-18:1842344168) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:49.774215] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.547: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:55.390614] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.381 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:55.390839] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.438 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:55.391116] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.486 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:55.399921] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:55.400326] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.568: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:55.405434] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.907: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:55.409123] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534) } would result in dst node (vmware2-replicate-19:1846084536) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:55.413455] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.912: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:35:56.109352] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.188 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:56.112163] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:56.118219] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541) } would result in dst node (vmware2-replicate-19:1846084536) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:56.120424] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.579: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:56.124617] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.579) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1842417648).Skipping file.
[2017-03-17 11:35:56.126580] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.926: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:56.544187] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.882 from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:35:56.550643] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.564: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:56.561067] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.564) } would result in dst node (vmware2-replicate-18:1841006216) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:56.567716] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.600: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:56.576165] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.600) } would result in dst node (vmware2-replicate-13:1843037312) having lower disk space then the source node (vmware2-replicate-16:1842339512).Skipping file.
[2017-03-17 11:35:56.585989] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.930: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:56.973447] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.136 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:56.973542] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.262 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:56.973593] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.197 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:56.975607] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.934: attempting to move from vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:35:56.976196] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.578: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:56.978776] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.619: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:57.169782] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.435 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:57.171928] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.580: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:57.716066] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.291 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:57.728007] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.389 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:57.745976] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.643: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:57.745981] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.625: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:35:58.287536] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.441 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:58.287579] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.547 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:58.290919] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.690: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:58.291159] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.296253] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.297967] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.698: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:58.302215] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.698) } would result in dst node (vmware2-replicate-13:1843561600) having lower disk space then the source node (vmware2-replicate-16:1843382440).Skipping file.
[2017-03-17 11:35:58.303824] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.307526] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.310020] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.704: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:35:58.594332] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.578) } would result in dst node (vmware2-replicate-18:1840954400) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.596734] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.580) } would result in dst node (vmware2-replicate-18:1840954392) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.599398] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.468 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:58.600294] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.625) } would result in dst node (vmware2-replicate-18:1840954392) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.601446] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.604405] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.738: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:58.609610] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.610396] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.766: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:58.615302] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.617239] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.620903] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.623571] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.780: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:58.625112] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.627919] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.633172] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.635858] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.792: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:35:58.842984] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.497 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:35:58.848607] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:35:58.864798] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:35:58.871284] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.827: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:00.335298] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.605 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:00.342945] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:00.364123] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:00.374703] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.838: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:01.433465] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.607 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:01.440851] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:01.458464] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:01.465364] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.848: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:04.115459] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.568 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:04.123815] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.785: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:36:04.158281] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.785) } would result in dst node (vmware2-replicate-18:1839817544) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:04.166055] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.869: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:06.077956] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.613 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:06.078034] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.636 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:06.084967] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:06.091420] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.872: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:06.106247] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:06.112126] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.834: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:36:06.127298] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.834) } would result in dst node (vmware2-replicate-18:1839797336) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:06.134852] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.875: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:06.161731] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.619 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:06.168822] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:06.191903] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:06.201459] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.893: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:07.023907] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.644 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:07.029967] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:07.044771] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:07.049788] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.894: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:07.216360] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.493 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:07.222980] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:07.235271] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:07.243676] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.905: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:07.337748] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.643 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:07.337992] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.912 from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:36:07.346319] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:07.350710] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.923: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:07.368199] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:07.376528] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:07.396751] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:07.408483] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.935: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:07.420057] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.750 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:07.428363] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:07.454523] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:07.470573] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.942: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:08.972172] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.37 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:08.972985] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.505 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:08.977154] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.901: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:36:08.978572] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.959: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:08.991023] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.901) } would result in dst node (vmware2-replicate-18:1841894488) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:08.997281] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:09.007127] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:09.010291] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.960: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:09.433467] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.535 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:09.434210] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.756 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:09.438258] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929: attempting to move from vmware2-replicate-14 to vmware2-replicate-19
[2017-03-17 11:36:09.445396] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929) } would result in dst node (vmware2-replicate-19:1847133112) having lower disk space then the source node (vmware2-replicate-14:1846612824).Skipping file.
[2017-03-17 11:36:09.447937] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.975: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:09.455723] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.990: attempting to move from vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:09.931773] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.815 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:09.932253] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.690 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:09.938329] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/vmx-mahdi-test-2012-3740751067-1.vswp: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:36:09.939811] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/vmware-1.log: attempting to move from vmware2-replicate-10 to vmware2-replicate-4
[2017-03-17 11:36:10.397671] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/vmx-mahdi-test-2012-3740751067-1.vswp from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:36:10.397820] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/vmware-1.log from subvolume vmware2-replicate-10 to vmware2-replicate-4
[2017-03-17 11:36:10.398006] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.766 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:10.398172] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.738 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:10.398279] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.792 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:10.398383] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.780 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:10.401990] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-b8552f5aea9554a5: attempting to move from vmware2-replicate-14 to vmware2-replicate-13
[2017-03-17 11:36:10.402272] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012-flat.vmdk: attempting to move from vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:10.403333] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012-def754db.vswp: attempting to move from vmware2-replicate-16 to vmware2-replicate-10
[2017-03-17 11:36:10.404808] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012.vmx.lck: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:36:10.405429] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-df3375149a8439a4: attempting to move from vmware2-replicate-10 to vmware2-replicate-9
[2017-03-17 11:36:10.405598] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012.vmx: attempting to move from vmware2-replicate-18 to vmware2-replicate-0
[2017-03-17 11:36:10.417721] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/mahdi-test-2012/mahdi-test-2012-flat.vmdk) } would result in dst node (vmware2-replicate-21:1852268904) having lower disk space then the source node (vmware2-replicate-12:1852972704).Skipping file.
[2017-03-17 11:36:10.423261] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012.vmsd: attempting to move from vmware2-replicate-18 to vmware2-replicate-12
[2017-03-17 11:36:10.451672] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:0 name:(/mahdi-test-2012/mahdi-test-2012-def754db.vswp) } would result in dst node (vmware2-replicate-10:1842744920) having lower disk space then the source node (vmware2-replicate-16:1847679584).Skipping file.
[2017-03-17 11:36:10.459649] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_3.vmdk: attempting to move from vmware2-replicate-4 to vmware2-replicate-0
[2017-03-17 11:36:10.470049] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:2 name:(/IT-Mahdi4/IT-Mahdi4_3.vmdk) } would result in dst node (vmware2-replicate-0:1847405648) having lower disk space then the source node (vmware2-replicate-4:1848524888).Skipping file.
[2017-03-17 11:36:10.474453] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_1.vmdk: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:36:10.484527] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:2 name:(/IT-Mahdi4/IT-Mahdi4_1.vmdk) } would result in dst node (vmware2-replicate-16:1847679584) having lower disk space then the source node (vmware2-replicate-8:1850282768).Skipping file.
[2017-03-17 11:36:10.488374] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_5-flat.vmdk: attempting to move from vmware2-replicate-10 to vmware2-replicate-21
[2017-03-17 11:36:11.094037] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.947 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:11.094720] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012.vmx.lck from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:36:11.094887] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/.lck-df3375149a8439a4 from subvolume vmware2-replicate-10 to vmware2-replicate-9
[2017-03-17 11:36:11.095167] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012.vmx from subvolume vmware2-replicate-18 to vmware2-replicate-0
[2017-03-17 11:36:11.095390] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.704 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:11.095749] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012.vmsd from subvolume vmware2-replicate-18 to vmware2-replicate-12
[2017-03-17 11:36:11.101180] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-23bc2d7a82c27a9b: attempting to move from vmware2-replicate-10 to vmware2-replicate-21
[2017-03-17 11:36:11.101422] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-f9e8afd09b84b3aa: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:36:11.103849] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp: attempting to move from vmware2-replicate-12 to vmware2-replicate-13
[2017-03-17 11:36:11.116365] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/IT-Mahdi4/.lck-f9e8afd09b84b3aa) } would result in dst node (vmware2-replicate-17:1846082240) having lower disk space then the source node (vmware2-replicate-4:1848524888).Skipping file.
[2017-03-17 11:36:11.176860] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:0 name:(/IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp) } would result in dst node (vmware2-replicate-13:1848153808) having lower disk space then the source node (vmware2-replicate-12:1853496992).Skipping file.
[2017-03-17 11:36:14.001924] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/.lck-b8552f5aea9554a5 from subvolume vmware2-replicate-14 to vmware2-replicate-13
[2017-03-17 11:36:14.002027] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.827 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:14.002101] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.949 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:14.002299] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_5-flat.vmdk from subvolume vmware2-replicate-10 to vmware2-replicate-21
[2017-03-17 11:36:14.002372] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/.lck-23bc2d7a82c27a9b from subvolume vmware2-replicate-10 to vmware2-replicate-21
[2017-03-17 11:36:14.002578] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.977 from subvolume vmware2-replicate-12 to vmware2-replicate-21
[2017-03-17 11:36:14.002875] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.554 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:14.092274] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 54.00 secs
[2017-03-17 11:36:14.092291] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 99, size: 23564229720, lookups: 568, failures: 0, skipped: 166
[2017-03-17 11:36:14.304064] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.566 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:14.689877] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.838 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:15.243914] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 55.00 secs
[2017-03-17 11:36:15.243930] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 101, size: 24101100632, lookups: 568, failures: 0, skipped: 166
[2017-03-17 11:36:16.815531] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 56.00 secs
[2017-03-17 11:36:16.815547] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 101, size: 24101100632, lookups: 568, failures: 0, skipped: 166
[2017-03-17 11:36:16.882041] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.848 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:16.882153] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.893 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:18.051825] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 58.00 secs
[2017-03-17 11:36:18.051843] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 103, size: 24637971544, lookups: 568, failures: 0, skipped: 166
[2017-03-17 11:36:18.624686] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.894 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:36:18.707561] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.609 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:18.745088] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.569 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:18.980587] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.663 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:19.035823] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.577 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:19.037910] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.617 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:19.039044] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.591 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:19.111571] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.646 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:21.039182] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.666 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:21.039536] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.796 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:21.040038] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.806 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:21.040583] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.869 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:21.041026] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.823 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:21.041306] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.844 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:23.356192] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 63.00 secs
[2017-03-17 11:36:23.356247] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 117, size: 28396067928, lookups: 568, failures: 0, skipped: 166
[2017-03-17 11:36:23.548990] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.907 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:23.549038] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.926 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:23.549094] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.930 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:23.549139] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.934 from subvolume vmware2-replicate-18 to vmware2-replicate-15
[2017-03-17 11:36:25.107266] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.875 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:25.107340] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.872 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:25.469667] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.905 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:26.005100] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.923 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:27.422772] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.942 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:27.422887] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.935 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:29.273326] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.959 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:29.275535] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.975 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:29.313377] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.960 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:29.354316] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.990 from subvolume vmware2-replicate-16 to vmware2-replicate-13
[2017-03-17 11:36:29.356046] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 69.00 secs
[2017-03-17 11:36:29.356096] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 131, size: 32154164312, lookups: 568, failures: 0, skipped: 166
[2017-03-17 11:36:29.356311] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7fedc2057dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7fedc36e9cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7fedc36e9b4b] ) 0-: received signum (15), shutting down
[2017-03-17 11:40:51.822431] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=5 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328072220 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 11:40:51.841149] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:40:51.841242] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 11:40:51.841308] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 11:40:56.896297] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328072220'
[2017-03-17 11:40:56.896327] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:40:56.896340] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '5'
[2017-03-17 11:40:56.896351] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 11:40:56.896373] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:40:56.896385] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:40:56.896396] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:40:56.896410] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:40:56.896429] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:40:56.896441] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:40:56.896459] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:40:56.896471] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:40:56.896486] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:40:56.896500] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:40:56.896510] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:40:56.896533] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:40:56.896546] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:40:56.896557] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:40:56.896567] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:40:56.896580] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:40:56.896591] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:40:56.896601] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:40:56.896614] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:40:56.896624] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:40:56.896635] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:40:56.896647] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:40:56.896658] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:40:56.896668] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:40:56.896680] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:40:56.896691] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:40:56.896701] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:40:56.896714] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:40:56.896724] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:40:56.896734] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:40:56.896747] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:40:56.896757] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:40:56.896782] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:40:56.896800] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:40:56.896811] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:40:56.896821] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:40:56.896834] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:40:56.896845] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:40:56.896855] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:40:56.896868] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:40:56.896879] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:40:56.896890] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:40:56.896903] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:40:56.896913] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:40:56.896931] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:40:56.896944] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:40:56.896955] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:40:56.896965] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:40:56.896978] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:40:56.896989] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:40:56.896999] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:40:56.897017] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:40:56.897028] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:40:56.897038] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:40:56.897057] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:40:56.897067] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:40:56.897078] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:40:56.897091] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:40:56.897101] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:40:56.897112] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:40:56.897124] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:40:56.897135] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:40:56.897145] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:40:56.897158] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:40:56.897168] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:40:56.897179] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:40:56.897191] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:40:56.897202] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:40:56.897217] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:40:56.899578] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328072220
[2017-03-17 11:40:56.899695] I [MSGID: 109086] [dht-shared.c:297:dht_parse_decommissioned_bricks] 0-vmware2-dht: decommissioning subvolume vmware2-replicate-20
[2017-03-17 11:40:56.899710] I [MSGID: 109086] [dht-shared.c:297:dht_parse_decommissioned_bricks] 0-vmware2-dht: decommissioning subvolume vmware2-replicate-21
[2017-03-17 11:40:56.983231] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:40:57.003171] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.006401] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.006814] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 11:40:57.009433] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.014640] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.015243] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:40:57.015281] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.015396] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 11:40:57.015452] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 11:40:57.017026] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.019669] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.022285] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.022542] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 11:40:57.024885] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.029575] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.030206] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:40:57.030249] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.030331] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 11:40:57.030416] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 11:40:57.031860] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.034503] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.037122] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.037393] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 11:40:57.039719] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.044778] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.045316] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:40:57.045340] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.045406] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 11:40:57.045498] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 11:40:57.046896] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.049403] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.051856] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.052066] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 11:40:57.054261] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.058953] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.059471] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:40:57.059496] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.059564] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 11:40:57.059641] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 11:40:57.060949] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.063312] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.065639] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.065874] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 11:40:57.067963] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.073006] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.073473] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:40:57.073492] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.073554] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 11:40:57.073603] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 11:40:57.074954] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.077271] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.079617] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.079888] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 11:40:57.081949] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.086627] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.087191] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:40:57.087241] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.087345] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 11:40:57.087392] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 11:40:57.090393] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.094986] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.099281] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.099531] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 11:40:57.103558] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.108285] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.108803] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:40:57.108829] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.108917] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 11:40:57.108990] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 11:40:57.112128] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.116339] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.120353] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.120619] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 11:40:57.124369] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.129447] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.129958] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:40:57.129990] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.130064] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 11:40:57.130144] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 11:40:57.132756] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.136477] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.140049] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.140323] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 11:40:57.143616] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.148731] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.149299] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:40:57.149324] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.149387] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 11:40:57.149471] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 11:40:57.151836] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.155357] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.158708] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.158994] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 11:40:57.162069] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.167189] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.167827] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:40:57.167858] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.167933] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 11:40:57.168026] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 11:40:57.169979] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.173168] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.176371] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.176643] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 11:40:57.179558] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 11:40:57.184681] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:40:57.185245] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:40:57.185284] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:40:57.185373] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 11:40:57.185429] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 11:40:57.187428] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-20490-2017/03/17-11:40:51:812826-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster02
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster03
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 5
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328072220
890:     option decommissioned-bricks vmware2-replicate-20,vmware2-replicate-21
891:     option lock-migration off
892:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
893: end-volume
894:  
895: volume vmware2
896:     type debug/io-stats
897:     option log-level INFO
898:     option latency-measurement off
899:     option count-fop-hits off
900:     subvolumes vmware2-dht
901: end-volume
902:  
+------------------------------------------------------------------------------+
[2017-03-17 11:41:02.067673] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 11:41:02.067986] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 11:41:02.068090] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 11:41:02.068172] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 11:41:02.068204] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 11:41:02.068229] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 11:41:02.068253] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 11:41:02.086895] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 11:41:02.095991] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 11:41:02.096076] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 11:41:02.096131] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 11:41:02.104568] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.112876] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.112974] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.113036] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.113420] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.113512] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.113620] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:41:02.113636] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.113680] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-3' came back up; going online.
[2017-03-17 11:41:02.113748] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 11:41:02.113786] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 11:41:02.113816] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 11:41:02.113836] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 11:41:02.113856] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 11:41:02.113876] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 11:41:02.113896] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 11:41:02.113915] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 11:41:02.113934] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 11:41:02.113966] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:41:02.113978] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.114015] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-11' came back up; going online.
[2017-03-17 11:41:02.114040] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 11:41:02.114072] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:41:02.114084] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.114147] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-7' came back up; going online.
[2017-03-17 11:41:02.114176] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49500 (from 0)
[2017-03-17 11:41:02.114222] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:41:02.114242] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.114280] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-19' came back up; going online.
[2017-03-17 11:41:02.114310] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.114362] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.114410] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 11:41:02.128725] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.132973] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.144191] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:41:02.144220] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.144271] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-15' came back up; going online.
[2017-03-17 11:41:02.148370] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:41:02.148403] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.148470] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-23' came back up; going online.
[2017-03-17 11:41:02.151737] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 11:41:02.155977] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 11:41:02.156026] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 11:41:02.156077] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:41:02.156091] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.156143] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-27' came back up; going online.
[2017-03-17 11:41:02.156185] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:41:02.156197] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.156235] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-31' came back up; going online.
[2017-03-17 11:41:02.156778] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:41:02.156807] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.156850] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-35' came back up; going online.
[2017-03-17 11:41:02.156914] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:41:02.156928] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.156964] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-39' came back up; going online.
[2017-03-17 11:41:02.157082] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 11:41:02.157148] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 11:41:02.157244] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 11:41:02.157267] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 11:41:02.157290] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.157347] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.157414] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.157466] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 11:41:02.157497] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 11:41:02.157520] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 11:41:02.157541] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 11:41:02.157563] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 11:41:02.157585] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 11:41:02.157607] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 11:41:02.157628] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 11:41:02.157650] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 11:41:02.157671] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 11:41:02.157693] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49425 (from 0)
[2017-03-17 11:41:02.157718] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.157818] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 11:41:02.157854] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.157907] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 11:41:02.157956] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.158020] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.158074] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.158126] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.158194] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.158253] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.195907] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:41:02.195934] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.195980] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-43' came back up; going online.
[2017-03-17 11:41:02.196024] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:41:02.196033] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196179] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:41:02.196193] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196306] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:41:02.196319] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196409] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:41:02.196422] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196508] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:41:02.196520] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196612] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:41:02.196624] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196714] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:41:02.196726] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196831] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:41:02.196849] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.196939] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:41:02.196951] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.197039] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:41:02.197061] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.197333] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 11:41:02.197355] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 11:41:02.197393] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 11:41:02.197415] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 11:41:02.197429] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 11:41:02.197449] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 11:41:02.197469] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 11:41:02.197490] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 11:41:02.197518] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 11:41:02.197531] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 11:41:02.197552] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 11:41:02.197576] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197637] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197690] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197734] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197796] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197864] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197907] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197948] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.197986] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.198038] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.198088] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.198212] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:41:02.198224] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198421] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:41:02.198435] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198514] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:41:02.198525] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198593] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:41:02.198603] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198673] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:41:02.198684] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198747] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 11:41:02.198809] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:41:02.198818] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198903] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:41:02.198916] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.198986] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:41:02.198997] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.199066] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:41:02.199077] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.199147] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:41:02.199158] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.199262] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:41:02.199277] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.199349] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 11:41:02.199376] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 11:41:02.199399] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 11:41:02.199427] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 11:41:02.199454] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 11:41:02.199473] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 11:41:02.199486] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 11:41:02.199505] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 11:41:02.199531] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 11:41:02.199563] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 11:41:02.200296] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:41:02.200909] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:41:02.200932] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:41:02.201111] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 11:41:02.210263] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 11:41:02.214479] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 11:41:02.214694] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 11:41:02.214895] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 11:41:02.215449] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 11:41:02.215706] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 11:41:02.215967] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 11:41:02.216065] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328072220
[2017-03-17 11:41:02.216067] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 11:41:02.216224] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 11:41:02.216245] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 11:41:02.216275] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 11:41:02.218928] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 11:41:02.239923] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 11:41:02.239957] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 11:41:02.239969] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 11:41:02.239977] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 11:41:02.239985] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 11:41:02.239993] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 11:41:02.240001] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 11:41:02.240008] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 11:41:02.240016] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 11:41:02.240024] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 11:41:02.240031] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 11:41:02.240112] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 11:41:02.240154] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 11:41:02.240191] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 11:41:02.240215] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 11:41:02.240279] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 11:41:02.240304] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 11:41:02.241152] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 11:41:02.241220] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 11:41:02.241241] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 11:41:02.241322] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 11:41:02.241340] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 11:41:02.241371] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 11:41:02.241444] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 11:41:02.241436] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 11:41:02.241480] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 11:41:02.241533] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 11:41:02.241555] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 11:41:02.241601] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 11:41:02.242413] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 11:41:02.242491] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 11:41:02.242508] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 11:41:02.242599] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 11:41:02.242608] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 11:41:02.242641] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 11:41:02.242688] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 11:41:02.242697] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 11:41:02.242723] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 11:41:02.242807] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 11:41:02.242809] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 11:41:02.243626] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 11:41:02.243634] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 11:41:02.243666] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 11:41:02.243687] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 11:41:02.243725] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 11:41:02.243747] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 11:41:02.243798] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 11:41:02.243865] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 11:41:02.243881] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 11:41:02.243913] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 11:41:02.243964] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 11:41:02.243984] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 11:41:02.244031] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 11:41:02.244826] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 11:41:02.244835] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 11:41:02.244872] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 11:41:02.244951] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 11:41:02.244967] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 11:41:02.245002] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 11:41:02.245022] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 11:41:02.245079] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 11:41:02.245091] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 11:41:02.245133] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 11:41:02.245155] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 11:41:02.245189] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 11:41:02.246009] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 11:41:02.246048] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 11:41:02.246079] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 11:41:02.246118] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 11:41:02.246149] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 11:41:02.246183] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 11:41:02.246216] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 11:41:02.246255] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 11:41:02.246295] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 11:41:02.246326] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 11:41:02.246357] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 11:41:02.246389] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 11:41:02.248772] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 11:41:02.260813] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.lck-2c739d20965fb485 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-8)
[2017-03-17 11:41:02.261794] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.lck-2c739d20965fb485
[2017-03-17 11:41:02.264126] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.lck-2c739d20965fb485: attempting to move from vmware2-replicate-18 to vmware2-replicate-8
[2017-03-17 11:41:02.266912] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.02 secs
[2017-03-17 11:41:02.271867] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 11:41:02.285397] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.lck-2c739d20965fb485 from subvolume vmware2-replicate-18 to vmware2-replicate-8
[2017-03-17 11:41:02.292197] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 11:41:02.301456] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 11:41:02.305594] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 11:41:02.323495] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 11:41:02.331990] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 11:41:02.351584] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 11:41:02.370258] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 11:41:02.476113] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.36: attempting to move from vmware2-replicate-4 to vmware2-replicate-3
[2017-03-17 11:41:02.483632] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.30: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:02.495610] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.45: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:02.510806] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.32: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:02.519182] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.2: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:02.525301] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:02.526069] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63
[2017-03-17 11:41:02.528463] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:02.535512] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.38 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:02.536640] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.38
[2017-03-17 11:41:02.539272] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.38: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:02.546003] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:41:02.557434] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.51: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:02.689400] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.585: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:02.694990] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.247: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:02.700653] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.68: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:02.705334] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.49: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:02.706659] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:02.707415] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48
[2017-03-17 11:41:02.711397] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:02.712776] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/994e99c6-80c4-4128-851e-fdd18f848090.35 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:02.714354] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/994e99c6-80c4-4128-851e-fdd18f848090.35
[2017-03-17 11:41:02.718726] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.35: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:02.724138] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:41:02.737029] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.56: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:02.747564] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.677: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:02.754785] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.312: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:02.762709] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.182: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:02.769256] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:02.773423] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.61: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:02.776532] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:02.779136] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63
[2017-03-17 11:41:02.783428] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:02.786123] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.32 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:02.787254] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.32
[2017-03-17 11:41:02.793412] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.32: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:02.811326] W [MSGID: 109009] [dht-common.c:1887:dht_lookup_everywhere_cbk] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.25: gfid differs on subvolume vmware2-replicate-18, gfid local = 88cfc315-7cbd-4b8a-8980-a88ff2c66890, gfid node = 089d6930-9f83-4e8e-9eb4-fa9ba1906102
[2017-03-17 11:41:02.811358] W [MSGID: 109007] [dht-common.c:1947:dht_lookup_everywhere_cbk] 0-vmware2-dht: multiple subvolumes (vmware2-replicate-13 and vmware2-replicate-18) have file /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.25 (preferably rename the file in the backend,and do a fresh lookup)
[2017-03-17 11:41:02.853578] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:02.864109] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.20: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:02.962850] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:02.964708] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24
[2017-03-17 11:41:02.968737] E [MSGID: 109023] [dht-rebalance.c:2463:gf_defrag_get_entry] 0-vmware2-dht: Migrate file failed:/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.1 lookup failed
[2017-03-17 11:41:03.156869] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:03.159327] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31
[2017-03-17 11:41:03.268984] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:03.272257] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145
[2017-03-17 11:41:03.379880] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:03.384261] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186
[2017-03-17 11:41:03.612225] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:03.618310] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187
[2017-03-17 11:41:03.819616] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:03.824330] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190
[2017-03-17 11:41:03.882700] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.10 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:03.885751] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.10
[2017-03-17 11:41:03.966860] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:03.974229] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227
[2017-03-17 11:41:03.988823] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.88 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:03.992872] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.88
[2017-03-17 11:41:04.073694] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:04.082653] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336
[2017-03-17 11:41:04.094505] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.89 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.098839] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.89
[2017-03-17 11:41:04.286026] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.93 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.288929] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.93
[2017-03-17 11:41:04.357355] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:04.364622] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348
[2017-03-17 11:41:04.373618] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.117 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.377651] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.117
[2017-03-17 11:41:04.440093] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:04.447385] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365
[2017-03-17 11:41:04.458777] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.131 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.462781] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.131
[2017-03-17 11:41:04.529174] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:04.537562] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372
[2017-03-17 11:41:04.559337] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.154 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.562811] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.154
[2017-03-17 11:41:04.624366] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:04.628768] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375
[2017-03-17 11:41:04.641751] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.167 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.645618] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.167
[2017-03-17 11:41:04.712837] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:04.716121] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378
[2017-03-17 11:41:04.727940] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.224 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:04.731792] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.224
[2017-03-17 11:41:05.003281] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:05.007278] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395
[2017-03-17 11:41:05.020820] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.345 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:05.024843] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.345
[2017-03-17 11:41:05.095291] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:05.101501] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407
[2017-03-17 11:41:05.111717] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.366 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:05.115537] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.366
[2017-03-17 11:41:05.191029] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.9 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:05.196009] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.9
[2017-03-17 11:41:05.221065] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:05.225720] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433
[2017-03-17 11:41:05.269092] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.376 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:05.272667] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.376
[2017-03-17 11:41:05.348525] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.82 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:05.353872] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.82
[2017-03-17 11:41:05.446867] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.385 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:05.450093] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.385
[2017-03-17 11:41:05.491228] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.143 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:05.497919] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.143
[2017-03-17 11:41:05.589706] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:05.597407] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448
[2017-03-17 11:41:05.629639] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.391 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:05.633127] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.391
[2017-03-17 11:41:05.671841] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.181 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:05.679567] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.181
[2017-03-17 11:41:05.932006] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:05.933664] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457
[2017-03-17 11:41:05.942707] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.431 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:05.946482] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.431
[2017-03-17 11:41:05.973692] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.32 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:05.982929] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.25: attempting to move from vmware2-replicate-13 to vmware2-replicate-17
[2017-03-17 11:41:05.983544] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.192 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:05.985584] W [MSGID: 109023] [dht-rebalance.c:1277:dht_migrate_file] 0-vmware2-dht: migrate file failed: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.25: failed to lock file on vmware2-replicate-13 (Stale file handle)
[2017-03-17 11:41:05.988396] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.192
[2017-03-17 11:41:05.989475] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.711: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:06.016273] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.449 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.020360] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.449
[2017-03-17 11:41:06.046809] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.199 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.053186] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.199
[2017-03-17 11:41:06.088875] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.452 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.092352] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.452
[2017-03-17 11:41:06.394398] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.212 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.400311] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.212
[2017-03-17 11:41:06.496524] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:06.526511] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495
[2017-03-17 11:41:06.538851] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.453 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.542330] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.453
[2017-03-17 11:41:06.574306] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.239 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.581314] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.239
[2017-03-17 11:41:06.614018] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.459 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.617799] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.459
[2017-03-17 11:41:06.650332] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.256 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.653875] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.256
[2017-03-17 11:41:06.683680] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.460 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.687777] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.460
[2017-03-17 11:41:06.714023] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.289 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.721328] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.289
[2017-03-17 11:41:06.745847] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:06.749395] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534
[2017-03-17 11:41:06.764214] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.463 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.767558] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.463
[2017-03-17 11:41:06.795791] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.298 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.803348] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.298
[2017-03-17 11:41:06.829379] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:06.837352] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541
[2017-03-17 11:41:06.849659] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.470 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.853316] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.470
[2017-03-17 11:41:06.879027] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.300 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.884530] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.300
[2017-03-17 11:41:06.915502] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.524 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.919369] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.524
[2017-03-17 11:41:06.945513] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.305 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:06.951664] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.305
[2017-03-17 11:41:06.983731] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.540 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:06.986828] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.540
[2017-03-17 11:41:07.016844] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.333 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:07.023167] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.333
[2017-03-17 11:41:07.050772] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.579 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:07.054966] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.579
[2017-03-17 11:41:07.081123] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.368 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:07.087721] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.368
[2017-03-17 11:41:07.115176] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.600 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:07.118981] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.600
[2017-03-17 11:41:07.201158] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.377 on vmware2-replicate-15 (hashed subvol is vmware2-replicate-14)
[2017-03-17 11:41:07.205654] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.377
[2017-03-17 11:41:07.238611] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.242184] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632
[2017-03-17 11:41:07.253427] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.698 on vmware2-replicate-13 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:07.257494] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.698
[2017-03-17 11:41:07.301604] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.308142] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664
[2017-03-17 11:41:07.345616] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.351403] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670
[2017-03-17 11:41:07.396490] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.402715] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676
[2017-03-17 11:41:07.430655] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.437690] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710
[2017-03-17 11:41:07.467881] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.475701] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716
[2017-03-17 11:41:07.507897] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.515137] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729
[2017-03-17 11:41:07.545990] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.553814] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732
[2017-03-17 11:41:07.593644] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.598770] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737
[2017-03-17 11:41:07.688818] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.694025] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831
[2017-03-17 11:41:07.716189] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.720308] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841
[2017-03-17 11:41:07.738835] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.744744] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851
[2017-03-17 11:41:07.767134] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.772675] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852
[2017-03-17 11:41:07.794678] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.801151] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881
[2017-03-17 11:41:07.817704] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.823251] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883
[2017-03-17 11:41:07.843938] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.848857] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898
[2017-03-17 11:41:07.872048] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.877548] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916
[2017-03-17 11:41:07.901017] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929 on vmware2-replicate-19 (hashed subvol is vmware2-replicate-18)
[2017-03-17 11:41:07.904842] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929
[2017-03-17 11:41:07.920713] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 5.55 secs
[2017-03-17 11:41:08.057878] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 11:41:08.149817] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 11:41:08.169104] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.02 secs
[2017-03-17 11:41:08.226293] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /mahdi-test-2012
[2017-03-17 11:41:08.325403] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /mahdi-test-2012
[2017-03-17 11:41:08.368029] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /mahdi-test-2012/mahdi-test-2012-flat.vmdk on vmware2-replicate-21 (hashed subvol is vmware2-replicate-7)
[2017-03-17 11:41:08.382084] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /mahdi-test-2012/mahdi-test-2012-flat.vmdk
[2017-03-17 11:41:08.384876] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 6.00 secs
[2017-03-17 11:41:08.384897] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 4, size: 101318740, lookups: 713, failures: 0, skipped: 1
[2017-03-17 11:41:08.452500] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /mahdi-test-2012 took 0.13 secs
[2017-03-17 11:41:08.498161] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /IT-Mahdi4
[2017-03-17 11:41:08.587495] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /IT-Mahdi4
[2017-03-17 11:41:08.620168] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /IT-Mahdi4/IT-Mahdi4_3.vmdk on vmware2-replicate-0 (hashed subvol is vmware2-replicate-2)
[2017-03-17 11:41:08.622821] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /IT-Mahdi4/IT-Mahdi4_3.vmdk
[2017-03-17 11:41:08.638869] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /IT-Mahdi4/IT-Mahdi4_1.vmdk on vmware2-replicate-16 (hashed subvol is vmware2-replicate-12)
[2017-03-17 11:41:08.642097] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /IT-Mahdi4/IT-Mahdi4_1.vmdk
[2017-03-17 11:41:08.669354] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp on vmware2-replicate-13 (hashed subvol is vmware2-replicate-16)
[2017-03-17 11:41:08.672918] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp
[2017-03-17 11:41:09.417544] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:09.426020] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.399: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:09.788347] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 7.00 secs
[2017-03-17 11:41:09.788364] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 5, size: 369754196, lookups: 731, failures: 0, skipped: 1
[2017-03-17 11:41:09.848199] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:41:09.853288] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.526: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:10.384075] E [MSGID: 109023] [dht-rebalance.c:2463:gf_defrag_get_entry] 0-vmware2-dht: Migrate file failed:/IT-Mahdi4/IT-Mahdi4_3.vmdk lookup failed
[2017-03-17 11:41:10.842619] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 8.00 secs
[2017-03-17 11:41:10.842635] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 6, size: 638189652, lookups: 734, failures: 0, skipped: 1
[2017-03-17 11:41:10.926050] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:41:10.928374] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.34: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:11.367607] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.20 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:11.367646] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.68 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:11.370090] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:11.370762] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.882: attempting to move from vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 11:41:11.435367] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.30 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:11.463244] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.21: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:11.760266] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 9.00 secs
[2017-03-17 11:41:11.760282] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 10, size: 1711931476, lookups: 738, failures: 0, skipped: 1
[2017-03-17 11:41:11.790546] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.36 from subvolume vmware2-replicate-4 to vmware2-replicate-3
[2017-03-17 11:41:11.793728] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.104: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:11.962140] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.585 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:11.962201] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.182 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:11.962250] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.677 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:11.962295] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.51 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:11.962500] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.56 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:11.967571] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.529: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:11.967939] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.871: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:11.968138] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.400: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:11.968501] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.919: attempting to move from vmware2-replicate-12 to vmware2-replicate-11
[2017-03-17 11:41:11.969637] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:12.043515] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.45 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:12.047565] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.912: attempting to move from vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 11:41:12.048461] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /IT-Mahdi4 took 3.46 secs
[2017-03-17 11:41:12.673609] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 11:41:12.673668] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 11:41:12.673721] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 11:41:12.673773] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 11:41:12.673817] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 11:41:12.673885] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 11:41:12.673928] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 11:41:12.673977] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 11:41:12.674570] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 11:41:12.674732] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 11:41:12.674772] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 11:41:12.674829] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 11:41:12.674852] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 11:41:12.675741] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 11:41:12.675844] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 11:41:12.675910] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 11:41:12.675990] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 11:41:12.676072] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 11:41:12.676537] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 11:41:12.676645] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 11:41:12.676684] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 11:41:12.676701] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:12.676736] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 11:41:12.676770] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 11:41:12.677066] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.436: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:12.677200] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.989: attempting to move from vmware2-replicate-12 to vmware2-replicate-11
[2017-03-17 11:41:12.677704] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.958: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:12.677792] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.55: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:12.677930] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.6: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:12.678040] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.706: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:12.678477] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.36: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:12.678611] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.37: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:12.678684] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.123: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:12.679074] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.405: attempting to move from vmware2-replicate-16 to vmware2-replicate-15
[2017-03-17 11:41:12.679995] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.973: attempting to move from vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:12.680029] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.39: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:12.680065] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:12.680076] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.763: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:12.680076] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.135: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:12.680447] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.146: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:12.681707] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.412: attempting to move from vmware2-replicate-16 to vmware2-replicate-15
[2017-03-17 11:41:12.681723] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.765: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:12.681863] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.442: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:12.682083] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:12.682219] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.451: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:13.292629] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 11.00 secs
[2017-03-17 11:41:13.292649] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 17, size: 3590979668, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:13.356465] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.36 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:13.405233] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.420: attempting to move from vmware2-replicate-16 to vmware2-replicate-15
[2017-03-17 11:41:13.722298] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.711 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:13.730385] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.57: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:16.047339] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 14.00 secs
[2017-03-17 11:41:16.047360] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 19, size: 3868590164, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:17.241862] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 15.00 secs
[2017-03-17 11:41:17.241880] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 19, size: 3868590164, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:17.538310] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.247 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:17.538334] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.312 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:17.554018] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.152: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:17.556066] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.843: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:17.811414] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.2 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:17.820571] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.111: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:19.681459] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.49 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:19.857457] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:20.064825] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 18.00 secs
[2017-03-17 11:41:20.064848] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 23, size: 4942331988, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:20.164412] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.21 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:20.172449] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.10: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:20.561989] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.526 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:20.571404] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.64: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:20.869373] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.871 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:20.886805] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.165: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:21.110171] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 19.00 secs
[2017-03-17 11:41:21.110189] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 26, size: 5747638356, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:21.157258] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.61 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:21.174843] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.925: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:22.214407] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:22.223366] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.120: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:22.263421] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 20.00 secs
[2017-03-17 11:41:22.263437] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 28, size: 6284509268, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:22.851428] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.38 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:22.862755] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:23.313297] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.958 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:23.313824] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.919 from subvolume vmware2-replicate-12 to vmware2-replicate-11
[2017-03-17 11:41:23.313949] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.32 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:23.314074] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.973 from subvolume vmware2-replicate-8 to vmware2-replicate-9
[2017-03-17 11:41:23.314194] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:23.314401] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.989 from subvolume vmware2-replicate-12 to vmware2-replicate-11
[2017-03-17 11:41:23.319586] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.88: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:23.322358] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.97: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:23.323678] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.177: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:23.323913] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.943: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:23.356998] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.193: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:23.360523] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:23.579654] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 21.00 secs
[2017-03-17 11:41:23.579674] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 35, size: 8163557460, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:23.873114] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.529 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:23.883060] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.89: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:24.883475] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:24.883566] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:24.884227] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:24.895179] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.260: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:24.895276] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.229: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:24.895954] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.101: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:25.254291] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.55 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:25.255410] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.39 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:25.260474] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.340: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:25.263186] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.93: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:26.127729] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.57 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:26.136567] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.706 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:26.144368] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.150: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:26.194709] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.251: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:27.098477] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.765 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:27.098516] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.763 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:27.105045] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.272: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:27.106547] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:27.684659] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.399 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:27.690991] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.117: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:29.406904] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.104 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:29.407546] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.843 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:29.416317] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.205: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:29.418942] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.253: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:30.277793] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.400 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:30.285854] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.311: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:31.394103] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.442 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:31.394220] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.436 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:31.394292] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.451 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 11:41:31.398176] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:31.400754] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.131: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:31.401828] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.218: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:31.457548] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.64 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:31.458037] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.925 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:31.467789] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.255: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:31.471570] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.335: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:32.638576] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:32.642602] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:33.585733] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.943 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 11:41:33.585822] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.97 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:33.589826] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.154: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:33.591682] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.236: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:33.973777] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:33.977297] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.354: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:34.136479] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.101 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:34.136948] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:34.141068] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.371: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:34.141808] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:34.226041] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 32.00 secs
[2017-03-17 11:41:34.226059] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 60, size: 14874443860, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:35.608397] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.340 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:35.610471] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.167: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:36.623998] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.150 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:36.628354] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.264: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:37.168114] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.146 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:37.168289] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.135 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:37.168436] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.123 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:37.168643] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:37.177839] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.393: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:37.179377] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.404: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:37.179521] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:37.181503] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.224: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:37.798032] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 35.00 secs
[2017-03-17 11:41:37.798053] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 66, size: 16485056596, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:37.991058] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.882 from subvolume vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 11:41:38.004488] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.270: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:38.228672] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.205 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:38.242167] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.408: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:38.722603] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.912 from subvolume vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 11:41:38.746572] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.415: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:38.813364] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 36.00 secs
[2017-03-17 11:41:38.813382] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 69, size: 17290362964, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:39.801572] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 37.00 secs
[2017-03-17 11:41:39.801594] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 69, size: 17290362964, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:40.716502] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 38.00 secs
[2017-03-17 11:41:40.716519] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 69, size: 17290362964, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:41.743574] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 39.00 secs
[2017-03-17 11:41:41.743595] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 69, size: 17290362964, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:41.912901] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.218 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:41.913472] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:41.917113] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:41.947607] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.345: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:42.062599] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.10 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:42.063000] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.6 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:42.067193] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.271: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:42.129327] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.456: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:42.634468] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 40.00 secs
[2017-03-17 11:41:42.634489] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 73, size: 18364104788, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:41:43.699100] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.236 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:43.699630] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.37 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:43.699813] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.111 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:43.707752] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.423: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:43.710418] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:43.714813] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.366: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:44.162436] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:44.165117] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.279: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:45.605036] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.88 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:45.605104] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.120 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:45.608980] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:45.609192] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.264 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:45.609339] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.405 from subvolume vmware2-replicate-16 to vmware2-replicate-15
[2017-03-17 11:41:45.609708] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.412 from subvolume vmware2-replicate-16 to vmware2-replicate-15
[2017-03-17 11:41:45.610028] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.420 from subvolume vmware2-replicate-16 to vmware2-replicate-15
[2017-03-17 11:41:45.615966] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.9: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:45.617213] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.455: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:45.617314] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:45.619221] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.376: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:45.619364] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.82: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:45.619909] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.435: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:41:45.622422] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.503: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:46.027243] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.89 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:46.038641] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.446: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:46.127684] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.270 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:46.138314] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.385: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:47.627903] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.193 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:47.673896] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.281: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:48.235379] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:48.241156] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.143: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:48.840383] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.271 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:48.845343] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.515: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:49.098335] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.152 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:49.112279] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:53.430150] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.165 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:53.430676] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.279 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:53.430927] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:53.430934] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.229 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:53.431119] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.177 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:53.435243] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.391: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:53.435428] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.337: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:53.440705] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:53.440907] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.522: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:53.441751] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.181: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:54.124349] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.251 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:54.124401] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:54.124715] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.281 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:54.126538] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.431: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:54.126990] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.355: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:54.570048] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.34 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:54.570149] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.93 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:54.570242] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.260 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:54.570544] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.272 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:54.575356] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.192: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:54.576174] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.536: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:54.610087] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.467: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:54.610619] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.449: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:54.612680] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.370: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:54.934665] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:54.938428] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.199: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:55.472616] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.446 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:55.473004] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.253 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:55.479852] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.543: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:56.093507] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.479: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:56.839597] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.82 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:56.839643] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.9 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:56.873797] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.452: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:56.876518] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.387: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:56.907073] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.255 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:56.912461] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.212: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:41:58.969607] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.354 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:58.969970] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.337 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:58.976430] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.549: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:59.003523] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:41:59.030707] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.355 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:41:59.037784] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.453: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:41:59.049066] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.404 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:41:59.054813] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.547: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:41:59.187196] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.311 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:41:59.224546] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.239: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:01.043063] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.408 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:42:01.043080] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.143 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:01.047149] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.583: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:01.047651] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.520: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:01.437967] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.456 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 11:42:01.438443] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.370 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:01.438466] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.435 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:01.448643] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.256: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:01.448939] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.424: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:01.450082] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.459: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:01.646192] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.335 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:01.646562] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.371 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:01.957453] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.532: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:01.960142] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.599: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:02.134739] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.393 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:02.145935] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.460: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:02.201392] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:02.213801] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.568: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:02.597002] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.415 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:02.612009] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.289: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:03.350261] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.117 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:03.360224] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.674: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:04.741509] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.35 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:04.748381] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:06.458342] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.131 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:06.469248] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.463: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:06.934844] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.154 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:07.050497] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.454: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:07.055164] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.387 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:07.065818] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.298: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:07.136110] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.423 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:07.150414] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.697: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:07.996230] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.167 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:08.005546] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:08.078787] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.224 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:08.090350] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.470: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:09.193093] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:09.196011] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.619: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:09.923492] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.455 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:09.923693] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.503 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:09.928051] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.708: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:09.931472] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.300: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:10.085079] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.467 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:10.088023] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.564: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:11.677416] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.424 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:11.677556] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.515 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:11.686209] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.524: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:11.691234] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.643: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:11.705405] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.479 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:11.822435] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.547 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:11.868613] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.305: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:11.874734] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.779: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:12.154192] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.181 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:12.165031] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.578: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:12.917207] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.454 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:12.930583] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.540: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:14.241515] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.345 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:14.253355] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.690: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:14.762351] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.192 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:14.762405] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:14.764437] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.333: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:14.908942] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.781: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:15.778415] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.199 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:16.363979] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.568 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:16.367790] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.580: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:16.383726] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.579: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:16.427798] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.522 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:16.427861] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.212 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:16.431406] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.704: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:16.433161] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.368: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:16.473623] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.536 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:16.496600] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.811: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:16.542097] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.520 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:16.568271] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.625: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:17.352312] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.543 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:17.391122] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.600: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:19.563954] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.532 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:19.569381] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.519: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:21.171982] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.619 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:21.172063] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.549 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:21.226267] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:21.226645] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.239 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:21.230227] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.377: attempting to move from vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:21.232477] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.924: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:21.234067] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:21.236255] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.698: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:21.979495] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.256 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:21.985535] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.538: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:22.034551] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.583 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:22.042022] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.937: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:23.032382] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.289 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:23.041604] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:23.115489] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.643 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:23.123257] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.634: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:24.410287] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:24.454358] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.945: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:24.682282] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.690 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:24.689027] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:25.302970] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.366 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:25.303391] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.599 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:25.315012] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.893: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:25.315489] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.996: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:25.393772] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.298 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:25.403051] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:25.990342] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.674 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:26.002073] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.647: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:26.191668] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.564 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:26.200327] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:26.515189] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.376 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:26.527887] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.894: attempting to move from vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:27.216091] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.385 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:27.224976] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:27.227886] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.578 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:27.238308] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.689: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:27.755157] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 85.00 secs
[2017-03-17 11:42:27.755182] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 170, size: 44377899092, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:42:28.790527] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 86.00 secs
[2017-03-17 11:42:28.790542] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 170, size: 44377899092, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:42:29.549904] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.391 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:29.553515] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:29.597100] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.431 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:29.604061] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.743: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:29.634624] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 87.00 secs
[2017-03-17 11:42:29.634638] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 172, size: 44914770004, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:42:30.120406] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.519 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:30.123289] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:30.260106] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.300 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:30.297344] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.822: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:30.379228] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.704 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:30.387098] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:30.456648] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.449 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:30.461474] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.845: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:30.507226] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.697 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:30.515746] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.785: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:30.557039] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 88.00 secs
[2017-03-17 11:42:30.557058] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 177, size: 46256947284, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:42:31.326459] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.452 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:31.336179] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.967: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:31.574031] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.305 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:31.586598] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:31.648190] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.453 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:31.659135] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.834: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:31.712719] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.580 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:31.724257] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:32.044778] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.625 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:32.050030] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:32.480395] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.459 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:32.483790] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:32.853597] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.333 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:32.853822] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.460 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:32.866633] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:32.867431] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:33.614185] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.708 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:33.626930] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.368 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:33.630456] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:33.637420] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.901: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:35.964555] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.538 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:35.978053] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:35.984925] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.377 from subvolume vmware2-replicate-18 to vmware2-replicate-14
[2017-03-17 11:42:35.989132] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.893 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:35.995279] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/vmware-0.log: attempting to move from vmware2-replicate-6 to vmware2-replicate-16
[2017-03-17 11:42:35.997512] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929: attempting to move from vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:36.074240] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.779 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:36.087050] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012-flat.vmdk: attempting to move from vmware2-replicate-12 to vmware2-replicate-7
[2017-03-17 11:42:36.480497] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/vmware-0.log from subvolume vmware2-replicate-6 to vmware2-replicate-16
[2017-03-17 11:42:36.486614] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012-def754db.vswp: attempting to move from vmware2-replicate-16 to vmware2-replicate-10
[2017-03-17 11:42:36.552152] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.463 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:36.561563] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012-50d0cb87.hlog: attempting to move from vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:36.600745] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012-def754db.vswp from subvolume vmware2-replicate-16 to vmware2-replicate-10
[2017-03-17 11:42:36.609100] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-1cdb3411d12294bb: attempting to move from vmware2-replicate-6 to vmware2-replicate-18
[2017-03-17 11:42:36.664952] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012-50d0cb87.hlog from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:36.677462] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-b19efee28761f9a2: attempting to move from vmware2-replicate-6 to vmware2-replicate-18
[2017-03-17 11:42:36.746018] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/.lck-1cdb3411d12294bb from subvolume vmware2-replicate-6 to vmware2-replicate-18
[2017-03-17 11:42:36.754097] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_2-flat.vmdk: attempting to move from vmware2-replicate-0 to vmware2-replicate-2
[2017-03-17 11:42:36.819606] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/.lck-b19efee28761f9a2 from subvolume vmware2-replicate-6 to vmware2-replicate-18
[2017-03-17 11:42:36.839495] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_3-flat.vmdk: attempting to move from vmware2-replicate-6 to vmware2-replicate-7
[2017-03-17 11:42:36.842152] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_2-flat.vmdk from subvolume vmware2-replicate-0 to vmware2-replicate-2
[2017-03-17 11:42:36.851466] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_3.vmdk: attempting to move from vmware2-replicate-4 to vmware2-replicate-2
[2017-03-17 11:42:36.931817] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_3-flat.vmdk from subvolume vmware2-replicate-6 to vmware2-replicate-7
[2017-03-17 11:42:36.940295] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_1.vmdk: attempting to move from vmware2-replicate-8 to vmware2-replicate-12
[2017-03-17 11:42:36.949603] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_3.vmdk from subvolume vmware2-replicate-4 to vmware2-replicate-2
[2017-03-17 11:42:36.957989] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4-68248bda.vswp: attempting to move from vmware2-replicate-2 to vmware2-replicate-0
[2017-03-17 11:42:37.345461] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_1.vmdk from subvolume vmware2-replicate-8 to vmware2-replicate-12
[2017-03-17 11:42:37.345677] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4-68248bda.vswp from subvolume vmware2-replicate-2 to vmware2-replicate-0
[2017-03-17 11:42:37.349057] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp: attempting to move from vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:37.349192] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4.vmx.lck: attempting to move from vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:37.773256] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.470 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:37.781752] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-05e51f9720402193: attempting to move from vmware2-replicate-20 to vmware2-replicate-13
[2017-03-17 11:42:37.819144] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4.vmx.lck from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:37.819397] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:37.828049] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-6abc4421c388aa9e: attempting to move from vmware2-replicate-8 to vmware2-replicate-17
[2017-03-17 11:42:37.828094] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_2.vmdk: attempting to move from vmware2-replicate-12 to vmware2-replicate-14
[2017-03-17 11:42:37.875383] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/.lck-05e51f9720402193 from subvolume vmware2-replicate-20 to vmware2-replicate-13
[2017-03-17 11:42:37.882964] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-fbaf07c39eecf0a9: attempting to move from vmware2-replicate-20 to vmware2-replicate-13
[2017-03-17 11:42:37.919995] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/.lck-6abc4421c388aa9e from subvolume vmware2-replicate-8 to vmware2-replicate-17
[2017-03-17 11:42:37.930623] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_2.vmdk from subvolume vmware2-replicate-12 to vmware2-replicate-14
[2017-03-17 11:42:38.541389] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/.lck-fbaf07c39eecf0a9 from subvolume vmware2-replicate-20 to vmware2-replicate-13
[2017-03-17 11:42:39.817265] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.894 from subvolume vmware2-replicate-20 to vmware2-replicate-12
[2017-03-17 11:42:39.817343] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:44.688371] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.634 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:44.689507] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.524 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:44.689576] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:44.689626] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.781 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:44.689682] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.540 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:44.689756] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.811 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:44.689843] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.647 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:44.689907] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:45.534798] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.924 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:45.535136] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.579 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:45.535319] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:45.535406] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.600 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:46.860547] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.689 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:46.860646] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012-flat.vmdk from subvolume vmware2-replicate-12 to vmware2-replicate-7
[2017-03-17 11:42:46.860720] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.698 from subvolume vmware2-replicate-16 to vmware2-replicate-12
[2017-03-17 11:42:46.860896] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.937 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:46.861080] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.945 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:46.861270] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.996 from subvolume vmware2-replicate-12 to vmware2-replicate-16
[2017-03-17 11:42:46.945077] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:50.719313] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.743 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:50.719384] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.822 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:50.720747] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.845 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:50.720911] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.967 from subvolume vmware2-replicate-20 to vmware2-replicate-19
[2017-03-17 11:42:50.805748] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:52.029355] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:52.460778] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:53.072682] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.785 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:53.072739] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:53.645997] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:53.646086] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.834 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:53.944892] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:54.087194] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:54.460884] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:54.853576] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:55.407977] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:55.408035] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.901 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:55.465977] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:56.448729] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:57.141045] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916 from subvolume vmware2-replicate-14 to vmware2-replicate-18
[2017-03-17 11:42:57.143610] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 115.00 secs
[2017-03-17 11:42:57.143652] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 250, size: 61558111139, lookups: 741, failures: 0, skipped: 1
[2017-03-17 11:42:57.143955] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7ff7340c3dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7ff735755cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7ff735755b4b] ) 0-: received signum (15), shutting down
[2017-03-17 11:50:27.265611] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=4 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328076826 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 11:50:27.285118] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:50:27.285218] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 11:50:27.285280] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 11:50:32.253465] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328076826'
[2017-03-17 11:50:32.253495] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:50:32.253509] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '4'
[2017-03-17 11:50:32.253522] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 11:50:32.253545] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:50:32.253557] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:50:32.253569] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:50:32.253583] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:50:32.253604] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:50:32.253617] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:50:32.253643] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:50:32.253661] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:50:32.253674] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:50:32.253692] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:50:32.253704] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:50:32.253715] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:50:32.253729] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:50:32.253740] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:50:32.253752] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:50:32.253784] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:50:32.253802] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:50:32.253813] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:50:32.253827] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:50:32.253839] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:50:32.253850] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:50:32.253864] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:50:32.253875] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:50:32.253887] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:50:32.253900] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:50:32.253912] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:50:32.253923] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:50:32.253943] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:50:32.253955] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:50:32.253966] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:50:32.253980] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:50:32.253991] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:50:32.254002] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:50:32.254016] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:50:32.254027] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:50:32.254039] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:50:32.254052] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:50:32.254064] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:50:32.254075] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:50:32.254089] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:50:32.254100] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:50:32.254112] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:50:32.254126] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:50:32.254137] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:50:32.254148] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:50:32.254163] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:50:32.254174] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:50:32.254187] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:50:32.254208] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:50:32.254225] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:50:32.254237] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:50:32.254251] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:50:32.254267] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:50:32.254278] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:50:32.254292] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:50:32.254303] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:50:32.254314] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:50:32.254328] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:50:32.254339] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:50:32.254350] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:50:32.254363] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:50:32.254374] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:50:32.254385] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:50:32.254398] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:50:32.254409] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:50:32.254420] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:50:32.254434] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:50:32.254445] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:50:32.254456] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:50:32.257009] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328076826
[2017-03-17 11:50:32.373140] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:50:32.389772] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.395687] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.396079] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 11:50:32.400212] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.405273] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.405747] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:50:32.405786] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.405877] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 11:50:32.405942] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 11:50:32.408930] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.413424] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.417924] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.418188] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 11:50:32.422376] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.427524] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.428101] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:50:32.428143] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.428227] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 11:50:32.428312] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 11:50:32.431039] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.435053] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.439012] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.439317] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 11:50:32.442935] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.448100] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.448586] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:50:32.448621] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.448692] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 11:50:32.448800] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 11:50:32.451178] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.454934] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.458659] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.458967] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 11:50:32.462402] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.467221] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.467698] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:50:32.467724] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.467810] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 11:50:32.467883] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 11:50:32.470175] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.473702] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.477234] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.477528] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 11:50:32.480794] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.485628] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.486158] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:50:32.486192] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.486274] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 11:50:32.486348] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 11:50:32.488313] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.491659] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.494940] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.495236] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 11:50:32.498125] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.502976] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.503477] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:50:32.503500] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.503578] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 11:50:32.503652] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 11:50:32.505681] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.508868] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.512063] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.512344] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 11:50:32.515251] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.520109] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.520596] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:50:32.520616] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.520690] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 11:50:32.520774] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 11:50:32.522660] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.525853] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.529075] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.529361] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 11:50:32.532272] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.537529] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.538101] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:50:32.538138] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.538241] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 11:50:32.538323] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 11:50:32.539908] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.542949] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.546004] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.546315] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 11:50:32.549059] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.554008] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.554460] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:50:32.554491] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.554577] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 11:50:32.554642] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 11:50:32.556253] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.559165] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.562090] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.562373] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 11:50:32.564897] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.570177] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.570663] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:50:32.570683] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.570747] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 11:50:32.570847] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 11:50:32.572410] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.575211] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.578042] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.578311] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 11:50:32.580847] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 11:50:32.585728] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:32.586227] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:50:32.586261] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:32.586330] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 11:50:32.586408] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 11:50:32.587722] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-24575-2017/03/17-11:50:27:246286-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 4
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328076826
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 11:50:37.255155] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 11:50:37.255381] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 11:50:37.260655] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 11:50:37.260741] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 11:50:37.260863] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 11:50:37.260902] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 11:50:37.260958] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 11:50:37.265069] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 11:50:37.273419] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 11:50:37.277458] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 11:50:37.277510] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 11:50:37.281643] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 11:50:37.281700] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 11:50:37.281729] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 11:50:37.281752] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 11:50:37.281821] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 11:50:37.281874] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 11:50:37.281900] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 11:50:37.281923] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 11:50:37.281944] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 11:50:37.281966] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 11:50:37.281990] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 11:50:37.282012] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 11:50:37.282034] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 11:50:37.282057] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 11:50:37.282079] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 11:50:37.282101] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 11:50:37.282123] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 11:50:37.282145] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 11:50:37.282174] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 11:50:37.282195] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 11:50:37.282217] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 11:50:37.282247] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.282355] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 11:50:37.373620] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:50:37.373652] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.373838] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.373906] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.373962] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374054] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374116] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374509] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 11:50:37.374558] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374612] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374669] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374716] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374758] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374823] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374866] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374911] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374957] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.374998] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375042] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375083] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375129] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375171] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375220] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:50:37.375231] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.375268] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-2' came back up; going online.
[2017-03-17 11:50:37.375294] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375342] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375386] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375439] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:50:37.375450] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.375554] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:50:37.375567] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.375672] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375731] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375808] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375861] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375904] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375950] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.375991] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.376032] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.376087] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:50:37.376102] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376133] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-6' came back up; going online.
[2017-03-17 11:50:37.376158] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.376207] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:50:37.376217] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376299] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:50:37.376311] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376425] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:50:37.376438] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376538] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:50:37.376551] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376585] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-14' came back up; going online.
[2017-03-17 11:50:37.376617] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:50:37.376634] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376735] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:50:37.376753] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376758] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:50:37.376796] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376799] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-10' came back up; going online.
[2017-03-17 11:50:37.376844] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:50:37.376854] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376856] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-18' came back up; going online.
[2017-03-17 11:50:37.376890] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-22' came back up; going online.
[2017-03-17 11:50:37.376905] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:50:37.376917] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.376923] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:50:37.376936] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377038] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 11:50:37.377097] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:50:37.377108] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377169] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-26' came back up; going online.
[2017-03-17 11:50:37.377219] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:50:37.377234] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377249] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:50:37.377279] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377320] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 11:50:37.377347] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-34' came back up; going online.
[2017-03-17 11:50:37.377358] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:50:37.377378] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377404] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:50:37.377412] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-30' came back up; going online.
[2017-03-17 11:50:37.377433] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377440] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 11:50:37.377491] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:50:37.377501] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377558] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:50:37.377575] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377593] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:50:37.377605] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377727] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:50:37.377745] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377775] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:50:37.377797] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377814] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-38' came back up; going online.
[2017-03-17 11:50:37.377858] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:50:37.377871] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377891] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 11:50:37.377915] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 11:50:37.377942] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:50:37.377957] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.377992] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-42' came back up; going online.
[2017-03-17 11:50:37.377997] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:50:37.378017] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.378021] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:50:37.378031] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.378115] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:50:37.378132] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.378199] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:50:37.378223] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.378225] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 11:50:37.378247] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 11:50:37.378270] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 11:50:37.378298] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:50:37.378306] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.378380] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 11:50:37.378397] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 11:50:37.378417] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 11:50:37.378421] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 11:50:37.378444] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 11:50:37.378463] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 11:50:37.378466] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 11:50:37.378487] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 11:50:37.378504] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 11:50:37.378512] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 11:50:37.378518] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 11:50:37.378547] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 11:50:37.378549] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 11:50:37.378571] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 11:50:37.378587] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 11:50:37.378605] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 11:50:37.378619] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 11:50:37.378629] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 11:50:37.378636] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 11:50:37.378650] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 11:50:37.378665] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 11:50:37.378685] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 11:50:37.378708] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 11:50:37.378712] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:50:37.379279] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:50:37.379312] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:50:37.379523] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 11:50:37.390401] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 11:50:37.391078] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 11:50:37.391363] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 11:50:37.391590] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 11:50:37.391945] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 11:50:37.392177] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 11:50:37.392272] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 11:50:37.392353] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 11:50:37.392420] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 11:50:37.392456] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328076826
[2017-03-17 11:50:37.392507] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 11:50:37.392530] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 11:50:37.395394] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 11:50:37.422052] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 11:50:37.447689] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 11:50:37.488362] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 11:50:37.618139] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 11:50:37.679619] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /mahdi-test-2012
[2017-03-17 11:50:37.738449] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /IT-Mahdi4
[2017-03-17 11:50:37.778644] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 11:50:37.778714] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 0.00 secs
[2017-03-17 11:50:37.778733] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 0, size: 0, lookups: 0, failures: 0, skipped: 0
[2017-03-17 11:50:37.778955] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f38344fedc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f3835b90cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f3835b90b4b] ) 0-: received signum (15), shutting down
[2017-03-17 11:50:58.561296] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=1 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328077073 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 11:50:58.579907] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 11:50:58.580007] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 11:50:58.580080] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 11:51:03.559923] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328077073'
[2017-03-17 11:51:03.559955] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 11:51:03.559969] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '1'
[2017-03-17 11:51:03.559981] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 11:51:03.560011] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:51:03.560024] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:51:03.560036] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 11:51:03.560050] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:51:03.560070] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:51:03.560083] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 11:51:03.560098] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:51:03.560114] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:51:03.560127] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 11:51:03.560145] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:51:03.560157] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:51:03.560169] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 11:51:03.560183] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:51:03.560194] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:51:03.560206] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 11:51:03.560220] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:51:03.560231] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:51:03.560243] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 11:51:03.560256] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:51:03.560268] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:51:03.560279] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 11:51:03.560293] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:51:03.560309] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:51:03.560321] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 11:51:03.560335] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:51:03.560346] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:51:03.560358] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 11:51:03.560372] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:51:03.560383] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:51:03.560395] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 11:51:03.560409] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:51:03.560420] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:51:03.560431] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 11:51:03.560445] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:51:03.560457] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:51:03.560468] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 11:51:03.560482] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:51:03.560494] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:51:03.560505] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 11:51:03.560519] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:51:03.560531] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:51:03.560542] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 11:51:03.560556] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:51:03.560572] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:51:03.560584] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 11:51:03.560599] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:51:03.560611] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:51:03.560623] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 11:51:03.560644] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:51:03.560656] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:51:03.560667] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 11:51:03.560681] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:51:03.560698] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:51:03.560710] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 11:51:03.560724] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:51:03.560735] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:51:03.560747] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 11:51:03.560761] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:51:03.560788] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:51:03.560800] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 11:51:03.560814] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:51:03.560825] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:51:03.560836] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 11:51:03.560850] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:51:03.560862] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:51:03.560878] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 11:51:03.560893] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:51:03.560904] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:51:03.560915] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 11:51:03.563396] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328077073
[2017-03-17 11:51:03.652490] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 11:51:03.670728] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.674027] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.674422] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 11:51:03.676767] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.682410] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.682913] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:51:03.682943] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.683038] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 11:51:03.683106] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 11:51:03.684143] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.686864] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.689558] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.689857] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 11:51:03.692258] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.697523] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.698105] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:51:03.698149] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.698236] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 11:51:03.698335] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 11:51:03.699475] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.702063] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.704664] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.704954] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 11:51:03.707256] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.712128] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.712550] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:51:03.712571] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.712629] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 11:51:03.712673] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 11:51:03.714290] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.716881] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.720278] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.720549] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 11:51:03.722915] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.727205] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.727690] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:51:03.727714] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.727793] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 11:51:03.727849] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 11:51:03.729184] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.731781] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.734739] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.735003] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 11:51:03.737592] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.742218] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.742637] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:51:03.742661] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.742724] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 11:51:03.742757] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 11:51:03.744368] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.747179] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.750188] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.750451] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 11:51:03.752799] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.757253] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.757654] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:51:03.757672] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.757733] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 11:51:03.757774] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 11:51:03.759274] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.761873] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.764788] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.765036] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 11:51:03.767682] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.771672] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.772132] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:51:03.772161] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.772245] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 11:51:03.772316] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 11:51:03.773702] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.776300] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.778929] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.779145] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 11:51:03.781530] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.785417] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.785842] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:51:03.785865] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.785915] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 11:51:03.785959] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 11:51:03.787353] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.789858] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.792368] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.792650] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 11:51:03.794879] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.799803] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.800239] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:51:03.800273] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.800366] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 11:51:03.800427] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 11:51:03.801877] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.804386] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.806907] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.807185] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 11:51:03.809413] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.814196] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.814589] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:51:03.814614] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.814670] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 11:51:03.814701] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 11:51:03.816105] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.818618] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.821169] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.821437] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 11:51:03.823682] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 11:51:03.828159] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:03.828637] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:51:03.828662] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:03.828729] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 11:51:03.828814] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 11:51:03.830077] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-24778-2017/03/17-11:50:58:552303-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 1
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328077073
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 11:51:08.561160] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 11:51:08.561179] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 11:51:08.567417] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 11:51:08.567632] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 11:51:08.567683] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 11:51:08.571940] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 11:51:08.576443] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 11:51:08.580664] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 11:51:08.580751] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 11:51:08.580797] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 11:51:08.580822] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 11:51:08.580844] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 11:51:08.580866] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 11:51:08.580887] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 11:51:08.580911] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 11:51:08.580935] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 11:51:08.580981] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 11:51:08.581004] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 11:51:08.581028] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 11:51:08.581050] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 11:51:08.581073] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 11:51:08.581094] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 11:51:08.581122] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 11:51:08.581145] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 11:51:08.581168] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 11:51:08.581191] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 11:51:08.581212] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 11:51:08.581242] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 11:51:08.581286] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 11:51:08.581325] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 11:51:08.581415] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 11:51:08.581454] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 11:51:08.581478] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 11:51:08.581507] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.682627] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:51:08.682653] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.682848] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.682912] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.682990] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683474] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 11:51:08.683500] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683586] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683632] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683674] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683714] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683760] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683820] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683863] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683903] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.683956] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:51:08.683967] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.684003] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-2' came back up; going online.
[2017-03-17 11:51:08.684028] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684068] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684126] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684173] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684215] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684255] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684295] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684337] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684380] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684431] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684488] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684535] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684585] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 11:51:08.684594] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.684680] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684723] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684780] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684841] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.684892] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:51:08.684901] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685006] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.685069] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.685135] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.685188] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:51:08.685199] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685239] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-6' came back up; going online.
[2017-03-17 11:51:08.685268] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:51:08.685276] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685308] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-10' came back up; going online.
[2017-03-17 11:51:08.685333] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:51:08.685341] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685406] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-14' came back up; going online.
[2017-03-17 11:51:08.685438] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:51:08.685446] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685537] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 11:51:08.685562] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 11:51:08.685571] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685687] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:51:08.685701] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685818] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:51:08.685836] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.685937] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 11:51:08.685949] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686033] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:51:08.686050] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686104] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-18' came back up; going online.
[2017-03-17 11:51:08.686153] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:51:08.686168] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686163] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 11:51:08.686193] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686210] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-22' came back up; going online.
[2017-03-17 11:51:08.686241] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 11:51:08.686250] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686316] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:51:08.686332] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686350] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:51:08.686363] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686389] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-26' came back up; going online.
[2017-03-17 11:51:08.686439] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:51:08.686451] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686492] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 11:51:08.686537] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 11:51:08.686553] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686588] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:51:08.686605] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686651] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:51:08.686664] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686775] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:51:08.686798] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:51:08.686798] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686819] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686857] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-34' came back up; going online.
[2017-03-17 11:51:08.686881] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-38' came back up; going online.
[2017-03-17 11:51:08.686886] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:51:08.686909] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686918] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 11:51:08.686944] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-30' came back up; going online.
[2017-03-17 11:51:08.686958] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:51:08.686970] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.686987] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:51:08.686998] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.687083] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 11:51:08.687097] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.687092] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-42' came back up; going online.
[2017-03-17 11:51:08.687150] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 11:51:08.687181] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:51:08.687181] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 11:51:08.687191] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.687214] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 11:51:08.687225] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.687310] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 11:51:08.687355] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 11:51:08.687365] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 11:51:08.687378] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.687379] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 11:51:08.687391] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.687468] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 11:51:08.687491] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 11:51:08.687497] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 11:51:08.687524] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 11:51:08.687544] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 11:51:08.687561] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 11:51:08.687573] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 11:51:08.687579] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 11:51:08.687595] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 11:51:08.687609] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 11:51:08.687614] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 11:51:08.687631] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 11:51:08.687646] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 11:51:08.687646] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 11:51:08.687681] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 11:51:08.687685] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 11:51:08.687696] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 11:51:08.687702] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 11:51:08.687721] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 11:51:08.687729] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 11:51:08.687756] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 11:51:08.687777] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 11:51:08.687800] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 11:51:08.687813] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 11:51:08.687879] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 11:51:08.688428] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 11:51:08.688460] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 11:51:08.689455] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 11:51:08.698835] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 11:51:08.702041] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 11:51:08.702421] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 11:51:08.702598] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 11:51:08.702916] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 11:51:08.703028] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 11:51:08.703125] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 11:51:08.703223] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 11:51:08.703263] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 11:51:08.703295] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328077073
[2017-03-17 11:51:08.703341] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 11:51:08.703386] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 11:51:08.706422] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 11:51:08.723342] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 11:51:08.723374] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 11:51:08.723388] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 11:51:08.723398] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 11:51:08.723408] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 11:51:08.723418] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 11:51:08.723428] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 11:51:08.723437] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 11:51:08.723446] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 11:51:08.723455] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 11:51:08.723464] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 11:51:08.723549] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 11:51:08.723602] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 11:51:08.723622] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 11:51:08.723654] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 11:51:08.723761] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 11:51:08.723806] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 11:51:08.723829] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 11:51:08.723869] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 11:51:08.723877] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 11:51:08.724700] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 11:51:08.724701] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 11:51:08.724747] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 11:51:08.724792] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 11:51:08.724824] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 11:51:08.724886] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 11:51:08.724902] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 11:51:08.724944] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 11:51:08.724964] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 11:51:08.725011] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 11:51:08.725039] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 11:51:08.725077] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 11:51:08.725102] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 11:51:08.725166] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 11:51:08.725200] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 11:51:08.725244] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 11:51:08.725269] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 11:51:08.725311] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 11:51:08.725329] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 11:51:08.725400] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 11:51:08.725416] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 11:51:08.725458] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 11:51:08.725477] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 11:51:08.725521] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 11:51:08.725542] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 11:51:08.725579] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 11:51:08.725598] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 11:51:08.725617] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 11:51:08.725681] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 11:51:08.725712] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 11:51:08.725746] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 11:51:08.725761] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 11:51:08.725795] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 11:51:08.725807] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 11:51:08.725846] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 11:51:08.725857] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 11:51:08.725889] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 11:51:08.725923] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 11:51:08.725958] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 11:51:08.725998] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 11:51:08.726034] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 11:51:08.726075] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 11:51:08.726108] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 11:51:08.726145] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 11:51:08.726180] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 11:51:08.726215] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 11:51:08.726256] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 11:51:08.726301] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 11:51:08.726335] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 11:51:08.726369] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 11:51:08.726401] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 11:51:08.726434] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 11:51:08.726471] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 11:51:08.726508] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 11:51:08.726544] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 11:51:08.726579] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 11:51:08.726619] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 11:51:08.727709] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 1757032074 - 1952257859 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 11:51:08.727744] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:51:08.727941] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 2147483646 - 2342709431 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 11:51:08.727994] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:51:08.728271] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 195225786 - 390451571 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 11:51:08.728295] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:51:08.728520] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 585677358 - 780903143 - 1; disk layout - 2147483646 - 2342709431 - 1
[2017-03-17 11:51:08.728575] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 11:51:08.731738] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 11:51:08.743448] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.lck-2c739d20965fb485: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 11:51:08.749180] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.02 secs
[2017-03-17 11:51:08.749820] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/.lck-2c739d20965fb485) } would result in dst node (vmware2-replicate-19:1847639448) having lower disk space then the source node (vmware2-replicate-8:1853952792).Skipping file.
[2017-03-17 11:51:08.754300] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 11:51:08.769490] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-0; inode layout - 3123612576 - 3318838361 - 1; disk layout - 3514064148 - 3709289933 - 1
[2017-03-17 11:51:08.769536] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.769994] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 2537935218 - 2733161003 - 1; disk layout - 1171354716 - 1366580501 - 1
[2017-03-17 11:51:08.770031] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.770134] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 390451572 - 585677357 - 1; disk layout - 3123612576 - 3318838361 - 1
[2017-03-17 11:51:08.770158] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.770342] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 585677358 - 780903143 - 1; disk layout - 3318838362 - 3514064147 - 1
[2017-03-17 11:51:08.770367] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.770507] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 1171354716 - 1366580501 - 1; disk layout - 2537935218 - 2733161003 - 1
[2017-03-17 11:51:08.770530] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.771077] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-18; inode layout - 3514064148 - 3709289933 - 1; disk layout - 390451572 - 585677357 - 1
[2017-03-17 11:51:08.771118] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.771140] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-19; inode layout - 3318838362 - 3514064147 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 11:51:08.771171] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 11:51:08.773434] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 11:51:08.783398] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 11:51:08.788080] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 11:51:08.805088] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 11:51:08.814966] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 11:51:08.836317] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 11:51:08.851266] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 2733161004 - 2928386789 - 1; disk layout - 390451572 - 585677357 - 1
[2017-03-17 11:51:08.851298] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.851564] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-6; inode layout - 3904515720 - 4099741505 - 1; disk layout - 1366580502 - 1561806287 - 1
[2017-03-17 11:51:08.851596] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.851794] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 0 - 195225785 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 11:51:08.851826] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.851918] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 195225786 - 390451571 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 11:51:08.851941] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.852086] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 3709289934 - 3904515719 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 11:51:08.852101] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.852114] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-11; inode layout - 390451572 - 585677357 - 1; disk layout - 2733161004 - 2928386789 - 1
[2017-03-17 11:51:08.852136] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.852365] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 1366580502 - 1561806287 - 1; disk layout - 0 - 195225785 - 1
[2017-03-17 11:51:08.852392] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.852429] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 1952257860 - 2147483645 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 11:51:08.852449] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 11:51:08.855152] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 11:51:08.868134] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:08.871742] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.19: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:08.885952] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.19) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1852339584).Skipping file.
[2017-03-17 11:51:08.886380] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.1: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:08.892702] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:2176 name:(/.shard/994e99c6-80c4-4128-851e-fdd18f848090.1) } would result in dst node (vmware2-replicate-17:1841364768) having lower disk space then the source node (vmware2-replicate-4:1848707072).Skipping file.
[2017-03-17 11:51:08.905029] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.16: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:08.908400] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:08.914327] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35) } would result in dst node (vmware2-replicate-7:1846618176) having lower disk space then the source node (vmware2-replicate-8:1853952792).Skipping file.
[2017-03-17 11:51:08.917166] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.33: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:08.923483] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.33) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1848185568).Skipping file.
[2017-03-17 11:51:08.927895] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.16 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:08.938551] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:08.970802] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.882: attempting to move from vmware2-replicate-14 to vmware2-replicate-15
[2017-03-17 11:51:08.977541] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.197: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:08.977644] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.882) } would result in dst node (vmware2-replicate-15:1841365720) having lower disk space then the source node (vmware2-replicate-14:1852380120).Skipping file.
[2017-03-17 11:51:09.002750] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:09.008323] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.108: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:09.017872] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.92: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:09.027218] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.92) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1852339584).Skipping file.
[2017-03-17 11:51:09.035257] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.22: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:09.040071] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:09.044575] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.16: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:09.046373] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.22) } would result in dst node (vmware2-replicate-17:1841364768) having lower disk space then the source node (vmware2-replicate-4:1848707072).Skipping file.
[2017-03-17 11:51:09.053361] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.62: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:09.054906] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:512 name:(/.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.16) } would result in dst node (vmware2-replicate-16:1842610032) having lower disk space then the source node (vmware2-replicate-8:1853937592).Skipping file.
[2017-03-17 11:51:09.060530] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:09.063778] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.62) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1848185568).Skipping file.
[2017-03-17 11:51:09.067426] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.912: attempting to move from vmware2-replicate-14 to vmware2-replicate-15
[2017-03-17 11:51:09.073437] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.262: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:09.077779] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:09.078597] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.912) } would result in dst node (vmware2-replicate-15:1841365720) having lower disk space then the source node (vmware2-replicate-14:1852380120).Skipping file.
[2017-03-17 11:51:09.087251] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.222: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:09.095587] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.132: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:09.108846] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.132) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1852339584).Skipping file.
[2017-03-17 11:51:09.111342] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.161: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:09.117264] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.74: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:09.124408] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.51: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:09.125547] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.161) } would result in dst node (vmware2-replicate-17:1841364768) having lower disk space then the source node (vmware2-replicate-4:1848707072).Skipping file.
[2017-03-17 11:51:09.139397] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.51) } would result in dst node (vmware2-replicate-16:1842610032) having lower disk space then the source node (vmware2-replicate-8:1853924448).Skipping file.
[2017-03-17 11:51:09.148419] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.284: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:09.161459] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.284) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1848184248).Skipping file.
[2017-03-17 11:51:09.227510] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.435: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:09.258998] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.291: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:09.272229] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:09.286223] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.295: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:09.293732] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.162: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:09.296191] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.180: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:09.305248] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.85: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:09.310200] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.162) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1852331320).Skipping file.
[2017-03-17 11:51:09.313747] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.94: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:09.314240] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.180) } would result in dst node (vmware2-replicate-17:1841364768) having lower disk space then the source node (vmware2-replicate-4:1848707072).Skipping file.
[2017-03-17 11:51:09.322434] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.308: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:09.332203] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.94) } would result in dst node (vmware2-replicate-16:1842610032) having lower disk space then the source node (vmware2-replicate-8:1853876568).Skipping file.
[2017-03-17 11:51:09.341808] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.308) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1848159536).Skipping file.
[2017-03-17 11:51:09.775775] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.547: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:09.788433] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.750: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:09.808831] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:09.820005] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.403: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:09.822797] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.164: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:09.827554] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.207: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:09.841437] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.164) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1852227224).Skipping file.
[2017-03-17 11:51:09.849028] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.207) } would result in dst node (vmware2-replicate-17:1841364768) having lower disk space then the source node (vmware2-replicate-4:1848707072).Skipping file.
[2017-03-17 11:51:09.849774] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.175: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:09.856890] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.99: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:09.882673] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.99) } would result in dst node (vmware2-replicate-16:1842610032) having lower disk space then the source node (vmware2-replicate-8:1853683208).Skipping file.
[2017-03-17 11:51:09.890768] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.499: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:09.920992] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.499) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1848036648).Skipping file.
[2017-03-17 11:51:09.930622] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.568: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:11.096217] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 3.00 secs
[2017-03-17 11:51:11.096236] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 1, size: 196608, lookups: 419, failures: 0, skipped: 23
[2017-03-17 11:51:13.710714] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 4.86 secs
[2017-03-17 11:51:13.832167] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 11:51:13.931321] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 11:51:13.942585] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.01 secs
[2017-03-17 11:51:13.998030] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /mahdi-test-2012
[2017-03-17 11:51:14.113111] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 2342709432 - 2537935217 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 11:51:14.113138] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /mahdi-test-2012, gfid = f32801ab-a6e1-4707-b03e-28ced6d3d5eb
[2017-03-17 11:51:14.114979] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-5; inode layout - 195225786 - 390451571 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 11:51:14.114995] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /mahdi-test-2012, gfid = f32801ab-a6e1-4707-b03e-28ced6d3d5eb
[2017-03-17 11:51:14.116924] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-19; inode layout - 3709289934 - 3904515719 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 11:51:14.116942] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /mahdi-test-2012, gfid = f32801ab-a6e1-4707-b03e-28ced6d3d5eb
[2017-03-17 11:51:14.125719] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-1; inode layout - 1757032074 - 1952257859 - 1; disk layout - 2342709432 - 2537935217 - 1
[2017-03-17 11:51:14.125741] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /mahdi-test-2012, gfid = f32801ab-a6e1-4707-b03e-28ced6d3d5eb
[2017-03-17 11:51:14.157325] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /mahdi-test-2012
[2017-03-17 11:51:14.318903] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /mahdi-test-2012 took 0.16 secs
[2017-03-17 11:51:14.362799] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /IT-Mahdi4
[2017-03-17 11:51:14.447504] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 585677358 - 780903143 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 11:51:14.447546] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:51:14.448435] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 1757032074 - 1952257859 - 1; disk layout - 1561806288 - 1757032073 - 1
[2017-03-17 11:51:14.448459] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:51:14.448647] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 976128930 - 1171354715 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 11:51:14.448661] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:51:14.450508] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-21; inode layout - 1561806288 - 1757032073 - 1; disk layout - 976128930 - 1171354715 - 1
[2017-03-17 11:51:14.450525] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /IT-Mahdi4, gfid = db00a20c-5949-4ebd-95db-b335133b3358
[2017-03-17 11:51:14.455134] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /IT-Mahdi4
[2017-03-17 11:51:15.032171] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 7.00 secs
[2017-03-17 11:51:15.032199] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 1, size: 196608, lookups: 623, failures: 0, skipped: 23
[2017-03-17 11:51:15.269356] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /IT-Mahdi4 took 0.81 secs
[2017-03-17 11:51:15.356363] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 11:51:15.356436] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 11:51:15.356476] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 11:51:15.356552] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 11:51:15.356594] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 11:51:15.356662] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 11:51:15.356693] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 11:51:15.356801] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 11:51:15.356855] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 11:51:15.356902] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 11:51:15.356997] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 11:51:15.357775] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 11:51:15.357896] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 11:51:15.357921] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 11:51:15.357964] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 11:51:15.357988] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 11:51:15.358036] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 11:51:15.358064] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 11:51:15.358116] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 11:51:15.358172] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 11:51:15.358209] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 11:51:15.358265] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 11:51:15.358290] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 11:51:15.360560] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.318: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:15.361027] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.237: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:15.361058] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.507: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:15.361435] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.6: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:15.362032] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.661: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:15.362129] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.267: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:15.362144] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.235: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:15.362725] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.544: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:15.362746] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.740: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:15.362994] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.619: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:15.363006] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.144: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:15.363207] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:15.363400] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.815: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:15.363730] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.643: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:15.363907] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.721: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:15.366414] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.977: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:15.366975] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.266: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:15.367984] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.163: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:15.368083] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.630: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:15.368434] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:15.368954] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.684: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:15.369452] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:15.396104] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.163) } would result in dst node (vmware2-replicate-16:1842609840) having lower disk space then the source node (vmware2-replicate-8:1850832696).Skipping file.
[2017-03-17 11:51:15.397918] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.144) } would result in dst node (vmware2-replicate-16:1842609840) having lower disk space then the source node (vmware2-replicate-8:1850831672).Skipping file.
[2017-03-17 11:51:15.410265] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.237) } would result in dst node (vmware2-replicate-17:1841889056) having lower disk space then the source node (vmware2-replicate-4:1848634760).Skipping file.
[2017-03-17 11:51:15.411353] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.318) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1850851832).Skipping file.
[2017-03-17 11:51:15.413748] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.507) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1846879160).Skipping file.
[2017-03-17 11:51:15.414046] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.286: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:15.415455] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.346: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:15.418628] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.267) } would result in dst node (vmware2-replicate-17:1841889056) having lower disk space then the source node (vmware2-replicate-4:1848634680).Skipping file.
[2017-03-17 11:51:15.418696] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.740) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1846876072).Skipping file.
[2017-03-17 11:51:15.418755] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.661) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1850850808).Skipping file.
[2017-03-17 11:51:15.422438] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.544) } would result in dst node (vmware2-replicate-1:1844432688) having lower disk space then the source node (vmware2-replicate-0:1844260056).Skipping file.
[2017-03-17 11:51:15.423494] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.721) } would result in dst node (vmware2-replicate-3:1847975256) having lower disk space then the source node (vmware2-replicate-2:1850850808).Skipping file.
[2017-03-17 11:51:15.427781] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.189: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:15.427849] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.684) } would result in dst node (vmware2-replicate-1:1844431944) having lower disk space then the source node (vmware2-replicate-0:1844260056).Skipping file.
[2017-03-17 11:51:15.428465] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.630) } would result in dst node (vmware2-replicate-1:1844432168) having lower disk space then the source node (vmware2-replicate-0:1844260056).Skipping file.
[2017-03-17 11:51:15.430258] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.789: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:15.432277] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.690: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:15.432884] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.37: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:15.434008] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:15.434609] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.764: attempting to move from vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:15.436965] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.793: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:15.438589] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.324: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:15.445165] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.384: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:15.445414] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.204: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:15.467132] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.286) } would result in dst node (vmware2-replicate-17:1841889056) having lower disk space then the source node (vmware2-replicate-4:1848634008).Skipping file.
[2017-03-17 11:51:15.469219] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.189) } would result in dst node (vmware2-replicate-7:1846618176) having lower disk space then the source node (vmware2-replicate-8:1850793256).Skipping file.
[2017-03-17 11:51:15.473783] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.789) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1846859584).Skipping file.
[2017-03-17 11:51:15.476918] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.793) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1850844840).Skipping file.
[2017-03-17 11:51:15.478545] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.204) } would result in dst node (vmware2-replicate-16:1842609840) having lower disk space then the source node (vmware2-replicate-8:1850788616).Skipping file.
[2017-03-17 11:51:15.482691] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.764) } would result in dst node (vmware2-replicate-1:1844422144) having lower disk space then the source node (vmware2-replicate-0:1844260056).Skipping file.
[2017-03-17 11:51:15.482831] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.797: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:15.484332] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.704: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:15.487388] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.111: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:15.489450] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:15.491374] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.890: attempting to move from vmware2-replicate-2 to vmware2-replicate-3
[2017-03-17 11:51:15.492580] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.324) } would result in dst node (vmware2-replicate-17:1841889056) having lower disk space then the source node (vmware2-replicate-4:1848633688).Skipping file.
[2017-03-17 11:51:15.500663] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.379: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:15.508212] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.394: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:15.524497] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.797) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1846845584).Skipping file.
[2017-03-17 11:51:15.533182] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.890) } would result in dst node (vmware2-replicate-3:1847975408) having lower disk space then the source node (vmware2-replicate-2:1850831224).Skipping file.
[2017-03-17 11:51:15.537678] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.232: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:15.540341] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.379) } would result in dst node (vmware2-replicate-17:1841889056) having lower disk space then the source node (vmware2-replicate-4:1848632432).Skipping file.
[2017-03-17 11:51:15.545577] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.819: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:15.558454] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.893: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:15.585956] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.232) } would result in dst node (vmware2-replicate-7:1846618176) having lower disk space then the source node (vmware2-replicate-8:1850721728).Skipping file.
[2017-03-17 11:51:15.586731] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.819) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1846826304).Skipping file.
[2017-03-17 11:51:15.598330] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.120: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:15.606308] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:16.222533] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 8.00 secs
[2017-03-17 11:51:16.222549] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 1, size: 196608, lookups: 634, failures: 0, skipped: 47
[2017-03-17 11:51:17.481375] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 9.00 secs
[2017-03-17 11:51:17.481394] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 1, size: 196608, lookups: 634, failures: 0, skipped: 47
[2017-03-17 11:51:18.230192] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 10.00 secs
[2017-03-17 11:51:18.230211] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 1, size: 196608, lookups: 634, failures: 0, skipped: 47
[2017-03-17 11:51:19.218241] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:19.230531] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.392: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:19.296381] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.392) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848593928).Skipping file.
[2017-03-17 11:51:19.313745] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.606: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:19.314276] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:19.330232] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.257: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:19.383569] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.257) } would result in dst node (vmware2-replicate-7:1846618176) having lower disk space then the source node (vmware2-replicate-8:1849011864).Skipping file.
[2017-03-17 11:51:19.400498] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.976: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:19.428974] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.976) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1845911200).Skipping file.
[2017-03-17 11:51:19.436284] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.894: attempting to move from vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:19.591029] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 11.00 secs
[2017-03-17 11:51:19.591046] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 3, size: 537067520, lookups: 634, failures: 0, skipped: 50
[2017-03-17 11:51:21.063553] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.197 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:21.063545] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:21.064293] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.108 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:21.064488] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.495 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:21.069600] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.193: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:21.071418] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:21.073126] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.429: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:21.075701] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.725: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:21.092305] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.429) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848539928).Skipping file.
[2017-03-17 11:51:21.098823] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.269: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:21.114957] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.269) } would result in dst node (vmware2-replicate-16:1843658416) having lower disk space then the source node (vmware2-replicate-8:1848968256).Skipping file.
[2017-03-17 11:51:21.121906] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.991: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 11:51:21.139115] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.991) } would result in dst node (vmware2-replicate-11:1842414320) having lower disk space then the source node (vmware2-replicate-10:1845785704).Skipping file.
[2017-03-17 11:51:21.147202] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.260: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:21.300179] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.262 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:21.305978] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:21.404229] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.74 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:21.414346] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.444: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:21.455239] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.444) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:21.467885] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.733: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:21.620589] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:21.621033] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.291 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:21.627776] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.288: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:21.628194] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 13.00 secs
[2017-03-17 11:51:21.628211] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 11, size: 2684551168, lookups: 634, failures: 0, skipped: 54
[2017-03-17 11:51:21.628280] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.272: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:22.725991] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 14.00 secs
[2017-03-17 11:51:22.726008] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 11, size: 2684551168, lookups: 634, failures: 0, skipped: 54
[2017-03-17 11:51:22.784438] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.85 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:22.784672] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.716 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:22.785234] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.222 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:22.786567] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.295 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:22.786744] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.750 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:22.787080] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.729 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:22.787257] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.403 from subvolume vmware2-replicate-0 to vmware2-replicate-1
[2017-03-17 11:51:22.787375] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.175 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:22.790397] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.311: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:22.790747] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.557: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:22.790952] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:22.791838] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.561: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:22.792075] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:22.793097] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.303: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:22.793172] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.840: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:22.794517] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.846: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:22.806341] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.288) } would result in dst node (vmware2-replicate-16:1844706992) having lower disk space then the source node (vmware2-replicate-8:1848771712).Skipping file.
[2017-03-17 11:51:22.806665] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.557) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:22.808038] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.561) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:22.808753] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.303) } would result in dst node (vmware2-replicate-16:1844706992) having lower disk space then the source node (vmware2-replicate-8:1848771712).Skipping file.
[2017-03-17 11:51:22.809749] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.315: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:22.809788] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.335: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:22.812378] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:22.812857] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.570: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:22.819324] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.315) } would result in dst node (vmware2-replicate-16:1844706992) having lower disk space then the source node (vmware2-replicate-8:1848771712).Skipping file.
[2017-03-17 11:51:22.822130] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.570) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:22.823578] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.855: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:22.824595] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.327: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:22.825105] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.840) } would result in dst node (vmware2-replicate-5:1846009672) having lower disk space then the source node (vmware2-replicate-6:1845563296).Skipping file.
[2017-03-17 11:51:22.825834] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.846) } would result in dst node (vmware2-replicate-5:1846008632) having lower disk space then the source node (vmware2-replicate-6:1845563296).Skipping file.
[2017-03-17 11:51:22.831167] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.327) } would result in dst node (vmware2-replicate-16:1844706992) having lower disk space then the source node (vmware2-replicate-8:1848771712).Skipping file.
[2017-03-17 11:51:22.832402] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.371: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:22.834648] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:22.836551] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.601: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:22.845300] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.601) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:22.847925] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.855) } would result in dst node (vmware2-replicate-5:1845995784) having lower disk space then the source node (vmware2-replicate-6:1845563296).Skipping file.
[2017-03-17 11:51:22.848506] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.954: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:22.857524] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.419: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:22.877545] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.419) } would result in dst node (vmware2-replicate-16:1844706992) having lower disk space then the source node (vmware2-replicate-8:1848759376).Skipping file.
[2017-03-17 11:51:22.880874] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.954) } would result in dst node (vmware2-replicate-5:1845979344) having lower disk space then the source node (vmware2-replicate-6:1845563296).Skipping file.
[2017-03-17 11:51:22.883650] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.393: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:22.893088] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.061185] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.435 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:23.061568] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.534 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.069070] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.622: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:23.071386] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.965: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:23.095365] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.622) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:23.105727] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.472: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:23.124416] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.965) } would result in dst node (vmware2-replicate-5:1845877552) having lower disk space then the source node (vmware2-replicate-6:1845563296).Skipping file.
[2017-03-17 11:51:23.125911] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.130105] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.48 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.139637] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.415: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:23.140603] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.649: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:23.143648] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.157241] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.472) } would result in dst node (vmware2-replicate-16:1845231280) having lower disk space then the source node (vmware2-replicate-8:1848549584).Skipping file.
[2017-03-17 11:51:23.169442] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.481: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:23.177052] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.6 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:23.178349] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.649) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:23.187039] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.423: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:23.193229] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.481) } would result in dst node (vmware2-replicate-16:1845231280) having lower disk space then the source node (vmware2-replicate-8:1848518752).Skipping file.
[2017-03-17 11:51:23.198404] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.200125] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.657: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:23.229186] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.657) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:23.240830] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.491: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:23.268723] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.491) } would result in dst node (vmware2-replicate-16:1845231280) having lower disk space then the source node (vmware2-replicate-8:1848463248).Skipping file.
[2017-03-17 11:51:23.279604] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.455: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:23.846046] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 15.00 secs
[2017-03-17 11:51:23.846061] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 24, size: 5637472256, lookups: 634, failures: 0, skipped: 74
[2017-03-17 11:51:23.874345] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.547 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:23.886198] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:23.970483] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.145) } would result in dst node (vmware2-replicate-19:1843877776) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:23.992940] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.744: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:24.011423] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.744) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:24.019415] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.496: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:24.082881] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.496) } would result in dst node (vmware2-replicate-16:1845755568) having lower disk space then the source node (vmware2-replicate-8:1847999912).Skipping file.
[2017-03-17 11:51:24.091574] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.503: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:24.668671] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.37 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:24.670442] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.568 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:24.681243] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:24.682339] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.813: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:24.721205] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.813) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:24.730954] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.581: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:24.751981] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.186) } would result in dst node (vmware2-replicate-19:1843538536) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:24.767649] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 16.00 secs
[2017-03-17 11:51:24.767664] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 27, size: 6442778624, lookups: 634, failures: 0, skipped: 79
[2017-03-17 11:51:24.771475] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.515: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:24.771630] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.581) } would result in dst node (vmware2-replicate-16:1846279856) having lower disk space then the source node (vmware2-replicate-8:1847539064).Skipping file.
[2017-03-17 11:51:24.784353] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:24.838832] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.187) } would result in dst node (vmware2-replicate-19:1843500744) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:24.855820] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.953: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:24.884338] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.953) } would result in dst node (vmware2-replicate-17:1842937632) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:24.895416] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.584: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:24.936238] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.584) } would result in dst node (vmware2-replicate-16:1846279856) having lower disk space then the source node (vmware2-replicate-8:1847427968).Skipping file.
[2017-03-17 11:51:24.944991] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.522: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:25.891936] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 17.00 secs
[2017-03-17 11:51:25.891954] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 27, size: 6442778624, lookups: 634, failures: 0, skipped: 83
[2017-03-17 11:51:26.050653] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.111 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:26.053580] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:26.126006] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.190) } would result in dst node (vmware2-replicate-19:1843467120) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:26.147801] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.978: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:26.179010] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.978) } would result in dst node (vmware2-replicate-17:1843461920) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:26.192696] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.595: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:26.204847] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.120 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:26.217937] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.536: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:26.223393] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.595) } would result in dst node (vmware2-replicate-7:1846618176) having lower disk space then the source node (vmware2-replicate-8:1846513880).Skipping file.
[2017-03-17 11:51:26.240523] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:26.318830] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.227) } would result in dst node (vmware2-replicate-19:1843390016) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:26.347229] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.987: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:26.375493] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.987) } would result in dst node (vmware2-replicate-17:1843986208) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:26.391113] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.604: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:26.430013] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.604) } would result in dst node (vmware2-replicate-7:1846618176) having lower disk space then the source node (vmware2-replicate-8:1846387416).Skipping file.
[2017-03-17 11:51:26.445323] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.543: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:29.916833] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.815 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:29.917219] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.977 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:29.928179] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.988: attempting to move from vmware2-replicate-4 to vmware2-replicate-17
[2017-03-17 11:51:29.930462] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:29.958560] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.988) } would result in dst node (vmware2-replicate-17:1845419488) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:51:29.970582] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.618: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:30.024363] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.336) } would result in dst node (vmware2-replicate-19:1843740720) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:30.048580] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.549: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:30.644148] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.235 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:30.655897] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:30.712974] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.348) } would result in dst node (vmware2-replicate-19:1843383224) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:30.725637] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.620: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:30.884131] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.266 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:30.897080] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.583: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:31.329590] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.346 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:31.330801] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.384 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:31.335070] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.621: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:31.339951] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:31.405030] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.365) } would result in dst node (vmware2-replicate-19:1843001808) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:31.425869] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.599: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:32.129524] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.643 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:32.131340] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.394 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:32.138446] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:32.139189] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.655: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:32.201688] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.372) } would result in dst node (vmware2-replicate-19:1842572912) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:32.229022] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.674: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:32.298494] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.619 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:32.298858] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.690 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:32.305276] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.656: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:32.310071] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:32.365471] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.375) } would result in dst node (vmware2-replicate-19:1842479352) having lower disk space then the source node (vmware2-replicate-18:1842943040).Skipping file.
[2017-03-17 11:51:32.388274] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.697: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:35.406648] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.606 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:35.406700] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.725 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:35.406753] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.704 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:35.406817] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.733 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:51:35.406956] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.893 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:35.410815] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.685: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:35.411168] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.708: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:35.412336] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.699: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:35.413495] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:35.415918] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:36.742624] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.894 from subvolume vmware2-replicate-12 to vmware2-replicate-8
[2017-03-17 11:51:36.746209] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.779: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:36.905929] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.395) } would result in dst node (vmware2-replicate-19:1842123248) having lower disk space then the source node (vmware2-replicate-18:1844515904).Skipping file.
[2017-03-17 11:51:36.906319] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.378) } would result in dst node (vmware2-replicate-19:1842123248) having lower disk space then the source node (vmware2-replicate-18:1844515904).Skipping file.
[2017-03-17 11:51:37.372197] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:37.372989] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.837: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:37.925581] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.407) } would result in dst node (vmware2-replicate-19:1842076560) having lower disk space then the source node (vmware2-replicate-18:1845040192).Skipping file.
[2017-03-17 11:51:37.991556] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.781: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:40.839235] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.732 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.839378] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.541 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.839434] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.676 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.840010] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.737 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.840317] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.831 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.840406] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.632 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.840809] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.618 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:40.840892] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.664 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.840994] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.670 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.842884] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.844336] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.854: attempting to move from vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:40.845274] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.924: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:40.845326] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.811: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:40.845475] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.845568] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.873: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:40.845718] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.889: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:40.846008] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:40.847262] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.937: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:41.100368] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.433) } would result in dst node (vmware2-replicate-19:1840856840) having lower disk space then the source node (vmware2-replicate-18:1847661632).Skipping file.
[2017-03-17 11:51:41.100395] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.448) } would result in dst node (vmware2-replicate-19:1840856840) having lower disk space then the source node (vmware2-replicate-18:1847661632).Skipping file.
[2017-03-17 11:51:41.100437] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.457) } would result in dst node (vmware2-replicate-19:1840856840) having lower disk space then the source node (vmware2-replicate-18:1847661632).Skipping file.
[2017-03-17 11:51:41.138873] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.945: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:41.139050] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.904: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:41.140352] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.195171] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.851) } would result in dst node (vmware2-replicate-19:1840849904) having lower disk space then the source node (vmware2-replicate-18:1848710208).Skipping file.
[2017-03-17 11:51:41.198893] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.363199] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.710 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.363406] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.363483] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.841 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.368075] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.996: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:41.368359] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.920: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:41.368420] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.451806] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.620 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:41.455576] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.927: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:41.458838] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.852) } would result in dst node (vmware2-replicate-19:1840846128) having lower disk space then the source node (vmware2-replicate-18:1848710208).Skipping file.
[2017-03-17 11:51:41.462400] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.881) } would result in dst node (vmware2-replicate-19:1840845616) having lower disk space then the source node (vmware2-replicate-18:1848710208).Skipping file.
[2017-03-17 11:51:41.518630] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.529815] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.883) } would result in dst node (vmware2-replicate-19:1840843304) having lower disk space then the source node (vmware2-replicate-18:1849234496).Skipping file.
[2017-03-17 11:51:41.532315] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.970: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:41.546349] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.2: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:41.549103] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.551377] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.32: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:41.604970] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.889) } would result in dst node (vmware2-replicate-16:1844176280) having lower disk space then the source node (vmware2-replicate-8:1844089520).Skipping file.
[2017-03-17 11:51:41.605192] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.873) } would result in dst node (vmware2-replicate-16:1844176024) having lower disk space then the source node (vmware2-replicate-8:1844088752).Skipping file.
[2017-03-17 11:51:41.605531] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.904) } would result in dst node (vmware2-replicate-16:1844175504) having lower disk space then the source node (vmware2-replicate-8:1844088496).Skipping file.
[2017-03-17 11:51:41.606055] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.920) } would result in dst node (vmware2-replicate-16:1844174984) having lower disk space then the source node (vmware2-replicate-8:1844087720).Skipping file.
[2017-03-17 11:51:41.606151] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.927) } would result in dst node (vmware2-replicate-16:1844174984) having lower disk space then the source node (vmware2-replicate-8:1844087208).Skipping file.
[2017-03-17 11:51:41.658291] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.679960] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.681082] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.49: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:41.733280] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.37: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:41.736077] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.772981] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.621 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:41.777032] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.48: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:41.849985] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.898) } would result in dst node (vmware2-replicate-19:1840841360) having lower disk space then the source node (vmware2-replicate-18:1849758784).Skipping file.
[2017-03-17 11:51:41.850002] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.916) } would result in dst node (vmware2-replicate-19:1840841360) having lower disk space then the source node (vmware2-replicate-18:1849758784).Skipping file.
[2017-03-17 11:51:41.850015] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.929) } would result in dst node (vmware2-replicate-19:1840841360) having lower disk space then the source node (vmware2-replicate-18:1849758784).Skipping file.
[2017-03-17 11:51:41.855327] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:41.856253] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.121: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:41.856999] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.122: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:41.915952] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.31 from subvolume vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 11:51:41.916513] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.970) } would result in dst node (vmware2-replicate-16:1844164720) having lower disk space then the source node (vmware2-replicate-8:1844025736).Skipping file.
[2017-03-17 11:51:41.920518] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.136: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:42.009910] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.61: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:43.265330] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.655 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:43.265386] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.656 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:43.267622] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.188: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:43.267828] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.389: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:44.516447] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.48 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:44.516539] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.685 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:44.516683] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.699 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:44.524397] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.441: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:44.524688] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.468: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:44.525758] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.497: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:44.565237] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.854 from subvolume vmware2-replicate-8 to vmware2-replicate-7
[2017-03-17 11:51:44.575572] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.605: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:51:48.684700] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.837 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 11:51:48.705444] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.34: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:51:49.132917] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 41.00 secs
[2017-03-17 11:51:49.132938] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 68, size: 17181376512, lookups: 634, failures: 0, skipped: 114
[2017-03-17 11:51:51.328080] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 43.00 secs
[2017-03-17 11:51:51.328119] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 68, size: 17181376512, lookups: 634, failures: 0, skipped: 114
[2017-03-17 11:51:52.502854] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 44.00 secs
[2017-03-17 11:51:52.502873] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 68, size: 17181376512, lookups: 634, failures: 0, skipped: 114
[2017-03-17 11:51:54.415730] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 46.00 secs
[2017-03-17 11:51:54.415752] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 68, size: 17181376512, lookups: 634, failures: 0, skipped: 114
[2017-03-17 11:51:55.737928] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 47.00 secs
[2017-03-17 11:51:55.737972] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 68, size: 17181376512, lookups: 634, failures: 0, skipped: 114
[2017-03-17 11:52:00.331638] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.193 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:00.349839] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.607: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:00.351315] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:00.402488] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.613: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:00.403220] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.32 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:00.409787] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.636: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:01.136298] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.260 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:01.138750] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.644: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.425075] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.136 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.425150] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.122 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.425206] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.121 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.425268] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.188 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.425655] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.389 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.429650] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.756: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.429892] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.947: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.429986] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/vmx-mahdi-test-2012-3740751067-1.vswp: attempting to move from vmware2-replicate-0 to vmware2-replicate-6
[2017-03-17 11:52:06.430063] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.949: attempting to move from vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.433760] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-df3375149a8439a4: attempting to move from vmware2-replicate-4 to vmware2-replicate-9
[2017-03-17 11:52:06.440076] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/mahdi-test-2012/.lck-df3375149a8439a4) } would result in dst node (vmware2-replicate-9:1847132448) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:52:06.442942] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-b8552f5aea9554a5: attempting to move from vmware2-replicate-14 to vmware2-replicate-13
[2017-03-17 11:52:06.449457] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/mahdi-test-2012/.lck-b8552f5aea9554a5) } would result in dst node (vmware2-replicate-13:1848703696) having lower disk space then the source node (vmware2-replicate-14:1852380096).Skipping file.
[2017-03-17 11:52:06.452071] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-1cdb3411d12294bb: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:52:06.476337] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.468 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.479875] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/mahdi-test-2012.vmx.lck: attempting to move from vmware2-replicate-0 to vmware2-replicate-6
[2017-03-17 11:52:06.660372] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/vmx-mahdi-test-2012-3740751067-1.vswp from subvolume vmware2-replicate-0 to vmware2-replicate-6
[2017-03-17 11:52:06.660842] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/.lck-1cdb3411d12294bb from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:52:06.661032] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.441 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:06.674746] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /mahdi-test-2012/.lck-b19efee28761f9a2: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:52:06.675204] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-f9e8afd09b84b3aa: attempting to move from vmware2-replicate-4 to vmware2-replicate-8
[2017-03-17 11:52:06.682293] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmware-2.log: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 11:52:06.700252] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:639 name:(/IT-Mahdi4/vmware-2.log) } would result in dst node (vmware2-replicate-5:1844150872) having lower disk space then the source node (vmware2-replicate-6:1849757392).Skipping file.
[2017-03-17 11:52:06.705862] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_2.vmdk: attempting to move from vmware2-replicate-14 to vmware2-replicate-15
[2017-03-17 11:52:06.720801] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:2 name:(/IT-Mahdi4/IT-Mahdi4_2.vmdk) } would result in dst node (vmware2-replicate-15:1847132896) having lower disk space then the source node (vmware2-replicate-14:1852380096).Skipping file.
[2017-03-17 11:52:06.732798] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmware-1.log: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:06.793809] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:574 name:(/IT-Mahdi4/vmware-1.log) } would result in dst node (vmware2-replicate-20:1848164136) having lower disk space then the source node (vmware2-replicate-16:1849949976).Skipping file.
[2017-03-17 11:52:06.814382] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp: attempting to move from vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:06.850270] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/IT-Mahdi4/.lck-f9e8afd09b84b3aa) } would result in dst node (vmware2-replicate-8:1838197896) having lower disk space then the source node (vmware2-replicate-4:1848524880).Skipping file.
[2017-03-17 11:52:06.878320] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:0 name:(/IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp) } would result in dst node (vmware2-replicate-20:1848069712) having lower disk space then the source node (vmware2-replicate-16:1849949976).Skipping file.
[2017-03-17 11:52:07.112591] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/mahdi-test-2012.vmx.lck from subvolume vmware2-replicate-0 to vmware2-replicate-6
[2017-03-17 11:52:07.112654] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.272 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:07.113084] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /mahdi-test-2012/.lck-b19efee28761f9a2 from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 11:52:07.165392] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.756) } would result in dst node (vmware2-replicate-21:1849377784) having lower disk space then the source node (vmware2-replicate-16:1850474264).Skipping file.
[2017-03-17 11:52:07.167603] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.949) } would result in dst node (vmware2-replicate-21:1849377528) having lower disk space then the source node (vmware2-replicate-16:1850474264).Skipping file.
[2017-03-17 11:52:07.167676] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.947) } would result in dst node (vmware2-replicate-21:1849377528) having lower disk space then the source node (vmware2-replicate-16:1850474264).Skipping file.
[2017-03-17 11:52:07.381821] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.497 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:07.382227] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.605 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:08.708266] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.393 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:08.708597] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.335 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.137324] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.371 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.137372] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.415 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.485464] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.311 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.485649] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.503 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.485727] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.423 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.934912] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.455 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:09.935040] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.515 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:10.229077] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.522 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:10.682869] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.536 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:10.917046] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.543 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:12.993955] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.549 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:13.638223] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.583 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:14.323397] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.599 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:15.066873] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.674 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:15.600292] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.697 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:15.651275] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.37 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:17.166186] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.708 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:18.413324] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.779 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:18.762238] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.607 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:19.151975] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.945 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:19.152196] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.924 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:19.152335] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.644 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:19.152411] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.636 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:19.561108] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.613 from subvolume vmware2-replicate-16 to vmware2-replicate-21
[2017-03-17 11:52:19.643126] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.811 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:19.644329] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.781 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:20.028292] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.996 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:20.398794] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.937 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:20.506152] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.2 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:20.509021] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.61 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:20.844051] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.49 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:22.892249] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.34 from subvolume vmware2-replicate-16 to vmware2-replicate-20
[2017-03-17 11:52:22.894131] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 74.00 secs
[2017-03-17 11:52:22.894183] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 120, size: 29981802664, lookups: 634, failures: 0, skipped: 124
[2017-03-17 11:52:22.894486] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f13f4c9ddc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f13f632fcd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f13f632fb4b] ) 0-: received signum (15), shutting down
[2017-03-17 12:50:35.051685] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=5 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328105682 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 12:50:35.071196] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 12:50:35.071274] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 12:50:35.071337] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 12:50:40.264818] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328105682'
[2017-03-17 12:50:40.264839] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 12:50:40.264846] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '5'
[2017-03-17 12:50:40.264852] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 12:50:40.264865] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 12:50:40.264872] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 12:50:40.264878] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 12:50:40.264886] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 12:50:40.264897] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 12:50:40.264904] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 12:50:40.264914] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 12:50:40.264921] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 12:50:40.264929] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 12:50:40.264937] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 12:50:40.264943] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 12:50:40.264949] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 12:50:40.264956] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 12:50:40.264962] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 12:50:40.264968] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 12:50:40.264974] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 12:50:40.264980] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 12:50:40.264991] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 12:50:40.264999] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 12:50:40.265004] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 12:50:40.265010] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 12:50:40.265017] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 12:50:40.265022] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 12:50:40.265028] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 12:50:40.265035] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 12:50:40.265040] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 12:50:40.265046] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 12:50:40.265053] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 12:50:40.265058] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 12:50:40.265064] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 12:50:40.265071] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 12:50:40.265076] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 12:50:40.265082] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 12:50:40.265088] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 12:50:40.265094] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 12:50:40.265100] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 12:50:40.265107] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 12:50:40.265112] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 12:50:40.265118] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 12:50:40.265127] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 12:50:40.265133] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 12:50:40.265139] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 12:50:40.265146] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 12:50:40.265152] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 12:50:40.265161] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 12:50:40.265168] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 12:50:40.265174] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 12:50:40.265179] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 12:50:40.265186] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 12:50:40.265192] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 12:50:40.265197] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 12:50:40.265207] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 12:50:40.265213] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 12:50:40.265219] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 12:50:40.265226] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 12:50:40.265231] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 12:50:40.265237] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 12:50:40.265243] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 12:50:40.265249] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 12:50:40.265255] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 12:50:40.265265] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 12:50:40.265271] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 12:50:40.265276] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 12:50:40.265283] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 12:50:40.265288] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 12:50:40.265294] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 12:50:40.265300] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 12:50:40.265306] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 12:50:40.265315] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 12:50:40.266615] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328105682
[2017-03-17 12:50:40.266690] I [MSGID: 109086] [dht-shared.c:297:dht_parse_decommissioned_bricks] 0-vmware2-dht: decommissioning subvolume vmware2-replicate-20
[2017-03-17 12:50:40.266700] I [MSGID: 109086] [dht-shared.c:297:dht_parse_decommissioned_bricks] 0-vmware2-dht: decommissioning subvolume vmware2-replicate-21
[2017-03-17 12:50:40.378296] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 12:50:40.392960] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.395616] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.395996] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 12:50:40.397962] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.403178] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.403760] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 12:50:40.403799] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.403893] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 12:50:40.403964] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 12:50:40.405126] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.407439] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.409739] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.409989] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 12:50:40.412057] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.417067] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.417606] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 12:50:40.417633] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.417694] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 12:50:40.417792] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 12:50:40.419016] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.421310] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.423618] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.423842] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 12:50:40.425920] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.428721] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.429265] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 12:50:40.429282] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.429323] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 12:50:40.429386] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 12:50:40.430718] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.433025] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.435327] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.435509] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 12:50:40.437630] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.440544] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.441026] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 12:50:40.441048] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.441108] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 12:50:40.441149] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 12:50:40.442557] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.444857] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.447160] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.447388] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 12:50:40.449463] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.453840] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.454426] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 12:50:40.454451] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.454522] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 12:50:40.454611] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 12:50:40.455785] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.458085] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.460416] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.460687] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 12:50:40.462727] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.467794] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.468300] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 12:50:40.468323] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.468404] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 12:50:40.468477] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 12:50:40.469696] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.472009] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.474322] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.474518] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 12:50:40.476633] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.481278] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.481755] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 12:50:40.481794] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.481873] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 12:50:40.481933] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 12:50:40.483198] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.485511] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.487940] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.488138] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 12:50:40.490272] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.493256] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.493707] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 12:50:40.493721] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.493768] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 12:50:40.493861] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 12:50:40.495258] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.497574] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.499896] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.500113] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 12:50:40.502210] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.506026] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.506553] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 12:50:40.506576] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.506641] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 12:50:40.506725] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 12:50:40.507993] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.510306] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.512694] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.512869] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 12:50:40.515034] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.518333] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.518830] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 12:50:40.518849] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.518897] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 12:50:40.518988] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 12:50:40.520408] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.522729] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.525134] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.525348] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 12:50:40.527462] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 12:50:40.532420] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:40.532927] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 12:50:40.532956] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:40.533015] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 12:50:40.533058] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 12:50:40.534499] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-46832-2017/03/17-12:50:35:42591-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 5
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328105682
890:     option decommissioned-bricks vmware2-replicate-20,vmware2-replicate-21
891:     option lock-migration off
892:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
893: end-volume
894:  
895: volume vmware2
896:     type debug/io-stats
897:     option log-level INFO
898:     option latency-measurement off
899:     option count-fop-hits off
900:     subvolumes vmware2-dht
901: end-volume
902:  
+------------------------------------------------------------------------------+
[2017-03-17 12:50:45.325122] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 12:50:45.325182] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 12:50:45.325197] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 12:50:45.325242] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 12:50:45.334879] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 12:50:45.339272] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 12:50:45.339377] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 12:50:45.349574] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 12:50:45.349622] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 12:50:45.349648] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 12:50:45.349667] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 12:50:45.349690] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.349757] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 12:50:45.349796] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 12:50:45.349816] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 12:50:45.349833] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 12:50:45.349850] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 12:50:45.349877] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 12:50:45.349902] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 12:50:45.349928] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 12:50:45.349951] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 12:50:45.349969] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 12:50:45.349990] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.350054] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 12:50:45.350102] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.395885] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 12:50:45.395911] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.395968] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-3' came back up; going online.
[2017-03-17 12:50:45.395997] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.396042] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.396083] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.396129] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 12:50:45.396138] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.396185] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-7' came back up; going online.
[2017-03-17 12:50:45.396228] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 12:50:45.396238] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.396266] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-11' came back up; going online.
[2017-03-17 12:50:45.396821] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 12:50:45.396846] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 12:50:45.396859] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 12:50:45.396875] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.396916] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.396953] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.396994] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397030] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397065] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397102] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397138] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397172] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397207] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397262] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 12:50:45.397273] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.397302] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-19' came back up; going online.
[2017-03-17 12:50:45.397326] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 12:50:45.397333] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.397358] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-15' came back up; going online.
[2017-03-17 12:50:45.397375] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 12:50:45.397401] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 12:50:45.397409] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.397434] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-23' came back up; going online.
[2017-03-17 12:50:45.397451] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 12:50:45.397469] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 12:50:45.397484] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 12:50:45.397499] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 12:50:45.397515] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 12:50:45.397530] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 12:50:45.397549] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 12:50:45.397563] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 12:50:45.397594] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 12:50:45.397631] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 12:50:45.397651] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397706] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397752] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397800] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397844] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.397888] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 12:50:45.397897] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.397934] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-31' came back up; going online.
[2017-03-17 12:50:45.397959] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 12:50:45.397966] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.397992] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-27' came back up; going online.
[2017-03-17 12:50:45.398013] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 12:50:45.398020] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.398217] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 12:50:45.398241] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 12:50:45.398266] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 12:50:45.398274] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.398306] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-35' came back up; going online.
[2017-03-17 12:50:45.403795] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 12:50:45.403814] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.403846] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-39' came back up; going online.
[2017-03-17 12:50:45.403871] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 12:50:45.403878] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.406901] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 12:50:45.414181] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 12:50:45.414203] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.414294] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 12:50:45.414305] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.419143] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 12:50:45.419162] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.419202] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-43' came back up; going online.
[2017-03-17 12:50:45.424497] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 12:50:45.424516] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.424598] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 12:50:45.424622] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 12:50:45.424629] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.424696] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 12:50:45.424717] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 12:50:45.424723] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.424798] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 12:50:45.424823] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 12:50:45.424830] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.424902] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 12:50:45.424911] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.425020] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 12:50:45.425041] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 12:50:45.425047] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.425138] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 12:50:45.425152] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 12:50:45.425222] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 12:50:45.425235] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 12:50:45.425279] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 12:50:45.425323] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 12:50:45.425340] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 12:50:45.425363] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 12:50:45.425389] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 12:50:45.425399] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 12:50:45.425417] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425471] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 12:50:45.425496] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425534] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425567] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425596] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425649] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425680] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425714] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425748] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425788] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425856] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.425950] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 12:50:45.425959] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426066] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 12:50:45.426075] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426132] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 12:50:45.426140] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426194] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 12:50:45.426202] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426260] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 12:50:45.426268] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426323] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 12:50:45.426330] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426381] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 12:50:45.426388] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426435] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 12:50:45.426452] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 12:50:45.426458] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426508] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 12:50:45.426516] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426573] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 12:50:45.426580] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426631] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 12:50:45.426643] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 12:50:45.426658] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 12:50:45.426664] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.426715] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 12:50:45.426727] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 12:50:45.426742] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 12:50:45.426762] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 12:50:45.426789] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 12:50:45.426804] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 12:50:45.426831] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 12:50:45.426885] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 12:50:45.427532] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 12:50:45.427969] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 12:50:45.428006] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 12:50:45.428232] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 12:50:45.438832] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 12:50:45.440968] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 12:50:45.441202] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 12:50:45.441490] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 12:50:45.441655] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 12:50:45.441944] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 12:50:45.442002] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 12:50:45.442077] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 12:50:45.442211] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 12:50:45.442241] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328105682
[2017-03-17 12:50:45.442270] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 12:50:45.442274] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 12:50:45.445545] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 12:50:45.488646] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 12:50:45.488672] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 12:50:45.488682] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 12:50:45.488690] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 12:50:45.488697] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 12:50:45.488704] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 12:50:45.488711] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 12:50:45.488718] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 12:50:45.488725] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 12:50:45.488739] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 12:50:45.488747] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 12:50:45.488831] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 12:50:45.488871] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 12:50:45.488927] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 12:50:45.488944] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 12:50:45.489010] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 12:50:45.489027] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 12:50:45.489097] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 12:50:45.489099] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 12:50:45.489131] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 12:50:45.489168] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 12:50:45.489185] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 12:50:45.489269] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 12:50:45.489269] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 12:50:45.489306] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 12:50:45.489311] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 12:50:45.489348] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 12:50:45.489406] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 12:50:45.489420] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 12:50:45.489451] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 12:50:45.489466] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 12:50:45.489483] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 12:50:45.489506] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 12:50:45.489566] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 12:50:45.489586] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 12:50:45.489643] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 12:50:45.489690] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 12:50:45.489709] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 12:50:45.489809] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 12:50:45.489809] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 12:50:45.489857] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 12:50:45.489866] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 12:50:45.489918] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 12:50:45.489937] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 12:50:45.489964] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 12:50:45.489980] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 12:50:45.490008] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 12:50:45.490029] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 12:50:45.490060] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 12:50:45.490064] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 12:50:45.490113] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 12:50:45.490134] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 12:50:45.490152] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 12:50:45.490182] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 12:50:45.490191] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 12:50:45.490219] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 12:50:45.490225] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 12:50:45.490265] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 12:50:45.490310] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 12:50:45.490332] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 12:50:45.490368] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 12:50:45.490402] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 12:50:45.490434] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 12:50:45.490472] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 12:50:45.490510] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 12:50:45.490540] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 12:50:45.490582] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 12:50:45.490613] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 12:50:45.490653] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 12:50:45.490705] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 12:50:45.490784] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 12:50:45.490861] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 12:50:45.490920] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 12:50:45.490966] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 12:50:45.491005] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 12:50:45.491036] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 12:50:45.491065] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 12:50:45.493108] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 12:50:45.506307] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.01 secs
[2017-03-17 12:50:45.511175] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 12:50:45.529806] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 12:50:45.538953] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 12:50:45.543078] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 12:50:45.560797] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 12:50:45.569529] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 12:50:45.588966] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 12:50:45.605843] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 12:50:45.704585] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.45: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 12:50:45.721362] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.36: attempting to move from vmware2-replicate-4 to vmware2-replicate-3
[2017-03-17 12:50:45.725400] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35 on vmware2-replicate-7 (hashed subvol is vmware2-replicate-16)
[2017-03-17 12:50:45.726319] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35
[2017-03-17 12:50:45.728433] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:45.742955] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.32: attempting to move from vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 12:50:45.886478] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.416: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:45.898511] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.25: attempting to move from vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 12:50:45.902209] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.6: attempting to move from vmware2-replicate-20 to vmware2-replicate-11
[2017-03-17 12:50:46.020902] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.16: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:46.111248] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.461: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:46.212644] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.18: attempting to move from vmware2-replicate-20 to vmware2-replicate-11
[2017-03-17 12:50:46.218210] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12: attempting to move from vmware2-replicate-8 to vmware2-replicate-12
[2017-03-17 12:50:46.227076] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.3: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:46.235560] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.39: attempting to move from vmware2-replicate-20 to vmware2-replicate-11
[2017-03-17 12:50:46.239474] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62: attempting to move from vmware2-replicate-8 to vmware2-replicate-12
[2017-03-17 12:50:46.248109] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.19: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:46.254602] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.6: attempting to move from vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:50:46.261062] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.249: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:46.266212] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.48: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:46.273219] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.37: attempting to move from vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:50:46.279899] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.351: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:46.286812] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.85: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:46.295326] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.2: attempting to move from vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:50:47.078107] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 1.47 secs
[2017-03-17 12:50:47.171986] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 12:50:47.200472] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 12:50:47.240337] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.04 secs
[2017-03-17 12:50:47.260974] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /IT-Mahdi4
[2017-03-17 12:50:47.291433] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /IT-Mahdi4
[2017-03-17 12:50:47.377222] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /IT-Mahdi4/vmware-5.log on vmware2-replicate-19 (hashed subvol is vmware2-replicate-1)
[2017-03-17 12:50:47.377774] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /IT-Mahdi4/vmware-5.log
[2017-03-17 12:50:47.438943] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /IT-Mahdi4 took 0.15 secs
[2017-03-17 12:50:47.485536] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /Mahdi-Test20122
[2017-03-17 12:50:47.517476] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /Mahdi-Test20122
[2017-03-17 12:50:47.765796] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /Mahdi-Test20122 took 0.25 secs
[2017-03-17 12:50:47.803789] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine
[2017-03-17 12:50:47.827392] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /New Virtual Machine
[2017-03-17 12:50:47.852837] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /New Virtual Machine/New Virtual Machine.vmdk on vmware2-replicate-5 (hashed subvol is vmware2-replicate-6)
[2017-03-17 12:50:47.853920] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /New Virtual Machine/New Virtual Machine.vmdk
[2017-03-17 12:50:47.925756] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /New Virtual Machine took 0.10 secs
[2017-03-17 12:50:47.965425] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 12:50:47.965471] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 12:50:47.965521] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 12:50:47.965579] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 12:50:47.965628] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 12:50:47.965676] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 12:50:47.965747] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 12:50:47.965798] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 12:50:47.965829] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 12:50:47.965856] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 12:50:47.965903] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 12:50:47.965998] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 12:50:47.966062] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 12:50:47.966114] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 12:50:47.966164] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 12:50:47.966255] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 12:50:47.966320] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 12:50:47.966416] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 12:50:47.966452] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 12:50:47.966477] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 12:50:47.966502] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 12:50:47.966529] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 12:50:47.966563] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 12:50:47.968188] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.49: attempting to move from vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:50:47.969927] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.61: attempting to move from vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:50:47.970287] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.433: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:47.970518] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.99: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.970527] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.34: attempting to move from vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:50:47.976062] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.104: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.976165] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.20: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:50:47.976192] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.113: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.976542] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.129: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.976602] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.21: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:50:47.976813] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.116: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.977248] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.180: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.977448] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.201: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.977670] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.221: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.977771] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.55: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:50:47.977909] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.335: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:47.977986] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.444: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:47.978769] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/994e99c6-80c4-4128-851e-fdd18f848090.36: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:50:47.978908] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.448: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:47.979139] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.440: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:47.979312] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.106: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:47.979806] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.118: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:48.417394] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/89a78fe1-b2b5-476c-9eaa-88c32144bc6a.16 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:48.430830] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.443: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:48.679882] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.36 from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:50:48.702081] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.161: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:48.995595] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.32 from subvolume vmware2-replicate-10 to vmware2-replicate-1
[2017-03-17 12:50:49.009353] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.42: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:52.907208] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.45 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 12:50:52.907295] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.6 from subvolume vmware2-replicate-20 to vmware2-replicate-11
[2017-03-17 12:50:52.914098] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.95: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:52.914274] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.235: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:52.978136] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.25 from subvolume vmware2-replicate-18 to vmware2-replicate-17
[2017-03-17 12:50:52.990269] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.275: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:53.644453] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/8a036b19-77a6-4709-aab3-849bd0afe8f9.36 from subvolume vmware2-replicate-4 to vmware2-replicate-3
[2017-03-17 12:50:53.654261] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.142: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:54.369566] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.18 from subvolume vmware2-replicate-20 to vmware2-replicate-11
[2017-03-17 12:50:54.376912] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.382: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:50:54.887237] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.39 from subvolume vmware2-replicate-20 to vmware2-replicate-11
[2017-03-17 12:50:54.896694] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.204: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:50:58.855790] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 13.00 secs
[2017-03-17 12:50:58.855814] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 9, size: 1855389696, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:51:01.146533] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 16.00 secs
[2017-03-17 12:51:01.146563] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 9, size: 1855389696, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:51:03.131635] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.12 from subvolume vmware2-replicate-8 to vmware2-replicate-12
[2017-03-17 12:51:03.148189] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.390: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:03.480875] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.62 from subvolume vmware2-replicate-8 to vmware2-replicate-12
[2017-03-17 12:51:03.497975] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.243: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:05.164124] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.2 from subvolume vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:51:05.175964] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.470: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:05.514760] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.37 from subvolume vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:51:05.528542] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.290: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:05.528710] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.6 from subvolume vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:51:05.539917] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.55: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:07.357058] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.49 from subvolume vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:51:07.361726] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.35 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:07.367104] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.349: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:07.374754] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.105: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:07.797232] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.55 from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:51:07.804908] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.133: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:08.331595] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.61 from subvolume vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:51:08.345163] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.153: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:08.345246] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.20 from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:51:08.355711] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.186: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:08.414786] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.21 from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 12:51:08.424390] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.222: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:10.462364] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.416 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:10.479264] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.297: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:11.340913] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.351 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:11.671245] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.250: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:11.725067] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/994e99c6-80c4-4128-851e-fdd18f848090.34 from subvolume vmware2-replicate-20 to vmware2-replicate-8
[2017-03-17 12:51:11.726671] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.337: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:11.768554] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.249 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:11.775968] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.383: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:13.029363] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.461 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:13.039650] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.24: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:14.236891] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.3 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:14.251545] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.457: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:14.991125] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.19 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:15.003586] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.68: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:15.088871] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.48 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:15.102556] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.124: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:15.116174] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.85 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:15.129375] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.108: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:18.936141] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.444 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:18.948533] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.176: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:18.976190] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.433 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.068659] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.150: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:19.137280] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.118 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.147667] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.440 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.150710] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.106 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.152978] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.246: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.154737] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.448 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.162804] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.219: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:19.164751] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.355: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:19.168595] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.268: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:20.149833] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.161 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:20.164158] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.389: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.521430] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.235 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.524563] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.104 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.532865] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.311: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.564403] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.399: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.587858] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.99 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.587945] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.113 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.588006] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.116 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.592186] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.386: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.592617] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.14: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.592939] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.207: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.606209] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.275 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.612140] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.101: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.628981] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.382 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.629267] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.129 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.639405] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.311: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.670802] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.111: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.696624] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.180 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.737401] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.350: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.769938] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.221 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.770011] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.201 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.772430] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.178: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:29.772608] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.37: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.861158] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.335 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:29.866666] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.235: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:31.377792] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.443 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:31.394463] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.90: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:31.829321] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.42 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:31.841185] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.337: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:33.846111] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.95 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:33.857021] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.120: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:34.601579] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.390 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:34.741136] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.429: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:34.865511] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.142 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:34.881400] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.195: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:36.113506] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.204 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:36.124120] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.2: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:37.428056] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.470 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:37.434714] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.228: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:37.736382] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.55 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:37.754134] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.16: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:39.469881] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.105 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:39.482536] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.279: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:40.485981] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.153 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:40.499390] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.44: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:40.933063] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.222 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:40.947438] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.340: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:41.787503] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.243 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:41.792360] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.51: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:51.596786] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.290 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:51.603370] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.400: attempting to move from vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:53.270862] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.250 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:53.284068] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.72: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:53.406794] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.383 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:53.409624] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.349 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:53.413975] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.75: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:53.426700] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.87: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:53.427628] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.133 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:53.440161] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.90: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:54.034834] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.186 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:54.049938] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.117: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:55.778148] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.457 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:55.791808] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.153: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:55.868475] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.124 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:55.871505] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.297 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:55.878206] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.226: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:55.886135] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.361: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:56.207505] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.337 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:56.220815] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.458: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:57.056799] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 72.00 secs
[2017-03-17 12:51:57.056830] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 70, size: 18205507584, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:51:57.155771] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.24 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:57.167076] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.34: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.347972] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.176 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.356920] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.113: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.705317] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.68 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:58.715411] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.217: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.795915] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.108 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:51:58.806238] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.338: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.836420] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.355 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.854000] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.469: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.863487] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.246 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:51:58.876510] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.472: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:00.218849] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.150 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:00.235211] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.474: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:00.327736] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.268 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:00.332254] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.219 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:00.340257] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.479: attempting to move from vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:00.341371] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/IT-Mahdi4_3-flat.vmdk: attempting to move from vmware2-replicate-6 to vmware2-replicate-7
[2017-03-17 12:52:00.381578] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/IT-Mahdi4_3-flat.vmdk from subvolume vmware2-replicate-6 to vmware2-replicate-7
[2017-03-17 12:52:00.385723] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-f9e8afd09b84b3aa: attempting to move from vmware2-replicate-8 to vmware2-replicate-4
[2017-03-17 12:52:00.402912] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.389 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:00.414056] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmware-5.log: attempting to move from vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 12:52:00.490595] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/vmware-5.log from subvolume vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 12:52:00.496606] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmware-3.log: attempting to move from vmware2-replicate-20 to vmware2-replicate-16
[2017-03-17 12:52:00.548134] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/.lck-f9e8afd09b84b3aa from subvolume vmware2-replicate-8 to vmware2-replicate-4
[2017-03-17 12:52:00.555998] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/vmware-3.log from subvolume vmware2-replicate-20 to vmware2-replicate-16
[2017-03-17 12:52:00.560670] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmware.log: attempting to move from vmware2-replicate-16 to vmware2-replicate-17
[2017-03-17 12:52:00.564492] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp: attempting to move from vmware2-replicate-20 to vmware2-replicate-16
[2017-03-17 12:52:00.637161] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/vmx-IT-Mahdi4-1747225562-1.vswp from subvolume vmware2-replicate-20 to vmware2-replicate-16
[2017-03-17 12:52:00.646158] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/vmware.log from subvolume vmware2-replicate-16 to vmware2-replicate-17
[2017-03-17 12:52:00.646864] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /IT-Mahdi4/.lck-356a0dd9c7b04ab1: attempting to move from vmware2-replicate-16 to vmware2-replicate-17
[2017-03-17 12:52:00.662902] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /Mahdi-Test20122/Mahdi-Test20122-e6d4e2c0.vswp: attempting to move from vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 12:52:00.815033] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /IT-Mahdi4/.lck-356a0dd9c7b04ab1 from subvolume vmware2-replicate-16 to vmware2-replicate-17
[2017-03-17 12:52:00.829440] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /Mahdi-Test20122/.lck-35605d1d8611089c: attempting to move from vmware2-replicate-20 to vmware2-replicate-2
[2017-03-17 12:52:00.831252] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /Mahdi-Test20122/Mahdi-Test20122-e6d4e2c0.vswp from subvolume vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 12:52:00.843850] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /Mahdi-Test20122/.lck-a2115f8c1571adb0: attempting to move from vmware2-replicate-20 to vmware2-replicate-18
[2017-03-17 12:52:00.854874] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /Mahdi-Test20122/.lck-35605d1d8611089c from subvolume vmware2-replicate-20 to vmware2-replicate-2
[2017-03-17 12:52:00.858232] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmdk: attempting to move from vmware2-replicate-8 to vmware2-replicate-6
[2017-03-17 12:52:00.889162] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /Mahdi-Test20122/.lck-a2115f8c1571adb0 from subvolume vmware2-replicate-20 to vmware2-replicate-18
[2017-03-17 12:52:00.898104] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/.lck-ebb84164c7aa14a8: attempting to move from vmware2-replicate-14 to vmware2-replicate-13
[2017-03-17 12:52:00.961541] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/.lck-ebb84164c7aa14a8 from subvolume vmware2-replicate-14 to vmware2-replicate-13
[2017-03-17 12:52:00.967147] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmx: attempting to move from vmware2-replicate-16 to vmware2-replicate-7
[2017-03-17 12:52:00.989057] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/New Virtual Machine.vmdk from subvolume vmware2-replicate-8 to vmware2-replicate-6
[2017-03-17 12:52:01.003481] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmsd: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 12:52:01.012224] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/New Virtual Machine.vmx from subvolume vmware2-replicate-16 to vmware2-replicate-7
[2017-03-17 12:52:01.016458] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine-28bee33f.vswp: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 12:52:01.049850] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/New Virtual Machine.vmsd from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 12:52:01.052873] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/.lck-c0fe0be66ed5ec8b: attempting to move from vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 12:52:01.065587] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/New Virtual Machine-28bee33f.vswp from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 12:52:01.114749] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/.lck-c0fe0be66ed5ec8b from subvolume vmware2-replicate-18 to vmware2-replicate-16
[2017-03-17 12:52:02.869564] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.311 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:03.192503] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.207 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:03.198568] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.386 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:03.551747] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.350 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:03.557504] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.311 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:03.621438] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.37 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:04.195252] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.90 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:06.863958] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.120 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:08.485428] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 83.00 secs
[2017-03-17 12:52:08.485456] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 104, size: 23038066544, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:52:09.638398] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.399 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:09.640148] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.111 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:09.669782] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.178 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:09.675392] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.195 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:09.745993] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.101 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:09.753054] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.235 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:09.753819] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.14 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:11.286839] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.228 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:11.384152] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.337 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:12.315955] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 87.00 secs
[2017-03-17 12:52:12.315993] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 113, size: 25453985648, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:52:13.031416] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.279 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:14.164993] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 89.00 secs
[2017-03-17 12:52:14.165018] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 114, size: 25722421104, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:52:14.683027] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.340 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:18.843044] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.429 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:18.843080] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.400 from subvolume vmware2-replicate-16 to vmware2-replicate-8
[2017-03-17 12:52:20.562838] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.2 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:21.467200] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.16 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:25.033295] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.44 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:25.533262] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.51 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:26.457222] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 101.00 secs
[2017-03-17 12:52:26.457244] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 121, size: 27601469296, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:52:26.758312] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.72 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:27.538811] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.87 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:27.540770] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.75 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:27.593425] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.90 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:28.088319] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.117 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:28.974329] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.153 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:29.333334] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.226 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:29.405474] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.361 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:29.842327] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.458 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:30.305876] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 105.00 secs
[2017-03-17 12:52:30.305898] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 130, size: 30017388400, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:52:30.395097] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.34 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:31.613585] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.217 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:31.667436] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.338 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:31.995818] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.113 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:32.432200] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.469 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:32.433297] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.472 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:32.902490] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.474 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:33.353913] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.479 from subvolume vmware2-replicate-8 to vmware2-replicate-16
[2017-03-17 12:52:33.355576] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 108.00 secs
[2017-03-17 12:52:33.355611] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 138, size: 32164872048, lookups: 672, failures: 0, skipped: 0
[2017-03-17 12:52:33.356172] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f35f5cb2dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f35f7344cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f35f7344b4b] ) 0-: received signum (15), shutting down
[2017-03-17 13:14:02.083808] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=4 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328116948 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 13:14:02.100802] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 13:14:02.100881] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 13:14:02.100928] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 13:14:07.081952] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328116948'
[2017-03-17 13:14:07.081981] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 13:14:07.081996] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '4'
[2017-03-17 13:14:07.082008] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 13:14:07.082029] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:14:07.082042] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:14:07.082054] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:14:07.082068] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:14:07.082088] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:14:07.082101] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:14:07.082116] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:14:07.082146] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:14:07.082159] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:14:07.082177] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:14:07.082189] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:14:07.082201] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:14:07.082215] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:14:07.082226] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:14:07.082237] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:14:07.082251] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:14:07.082262] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:14:07.082274] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:14:07.082287] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:14:07.082298] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:14:07.082309] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:14:07.082323] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:14:07.082334] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:14:07.082346] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:14:07.082359] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:14:07.082370] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:14:07.082381] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:14:07.082395] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:14:07.082406] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:14:07.082422] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:14:07.082436] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:14:07.082447] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:14:07.082459] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:14:07.082472] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:14:07.082483] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:14:07.082494] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:14:07.082508] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:14:07.082519] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:14:07.082530] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:14:07.082544] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:14:07.082556] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:14:07.082567] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:14:07.082581] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:14:07.082592] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:14:07.082603] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:14:07.082618] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:14:07.082629] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:14:07.082641] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:14:07.082661] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:14:07.082673] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:14:07.082690] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:14:07.082704] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:14:07.082721] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:14:07.082732] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:14:07.082746] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:14:07.082757] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:14:07.082784] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:14:07.082799] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:14:07.082810] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:14:07.082821] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:14:07.082835] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:14:07.082846] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:14:07.082858] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:14:07.082872] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:14:07.082883] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:14:07.082894] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:14:07.082908] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:14:07.082919] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:14:07.082930] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:14:07.085462] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328116948
[2017-03-17 13:14:07.170211] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 13:14:07.187914] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.190983] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.191342] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 13:14:07.193756] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.199057] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.199672] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:14:07.199695] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.199796] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 13:14:07.199864] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 13:14:07.201108] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.203725] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.206303] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.206521] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 13:14:07.208812] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.213670] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.214156] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:14:07.214190] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.214258] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 13:14:07.214323] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 13:14:07.219150] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.224102] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.228688] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.228963] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 13:14:07.233240] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.238347] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.238969] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:14:07.238998] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.239082] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 13:14:07.239119] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 13:14:07.242184] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.246265] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.250246] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.250512] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 13:14:07.254208] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.259004] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.259586] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:14:07.259614] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.259688] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 13:14:07.259789] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 13:14:07.262257] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.266181] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.269716] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.269988] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 13:14:07.273255] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.278319] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.278813] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:14:07.278843] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.278912] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 13:14:07.278951] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 13:14:07.281319] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.284640] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.288027] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.288292] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 13:14:07.291352] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.296591] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.297218] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:14:07.297249] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.297340] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 13:14:07.297427] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 13:14:07.299318] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.302476] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.305582] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.305836] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 13:14:07.308595] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.312687] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.313174] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:14:07.313200] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.313274] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 13:14:07.313362] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 13:14:07.315235] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.318102] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.320990] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.321239] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 13:14:07.323862] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.328879] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.329507] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:14:07.329532] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.329603] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 13:14:07.329702] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 13:14:07.331331] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.334087] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.336860] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.337115] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 13:14:07.339622] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.344597] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.345163] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:14:07.345201] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.345288] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 13:14:07.345373] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 13:14:07.346869] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.349518] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.352169] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.352416] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 13:14:07.354815] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.358958] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.359557] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:14:07.359578] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.359640] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 13:14:07.359703] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 13:14:07.361201] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.363843] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.366420] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.366639] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 13:14:07.368956] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 13:14:07.372855] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:07.373407] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:14:07.373430] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:07.373484] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 13:14:07.373595] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 13:14:07.375224] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-7675-2017/03/17-13:14:02:73995-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 4
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328116948
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 13:14:12.084636] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 13:14:12.084904] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 13:14:12.084963] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 13:14:12.095130] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 13:14:12.095284] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 13:14:12.099658] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 13:14:12.099746] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 13:14:12.104141] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 13:14:12.104221] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 13:14:12.104255] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 13:14:12.104280] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 13:14:12.104303] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 13:14:12.104348] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 13:14:12.104373] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 13:14:12.104413] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 13:14:12.104439] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 13:14:12.104463] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 13:14:12.104499] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 13:14:12.104523] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 13:14:12.104546] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 13:14:12.104568] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 13:14:12.104591] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 13:14:12.104630] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 13:14:12.104655] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 13:14:12.104677] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 13:14:12.104700] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 13:14:12.104722] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 13:14:12.104744] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 13:14:12.104801] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 13:14:12.104827] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 13:14:12.104849] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 13:14:12.104871] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 13:14:12.104894] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 13:14:12.104923] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.105006] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.204850] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.204940] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:14:12.204955] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.204993] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-2' came back up; going online.
[2017-03-17 13:14:12.205025] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:14:12.205034] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.205209] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.205677] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 13:14:12.205701] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 13:14:12.205719] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.205776] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.205863] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.205910] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.205971] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206016] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206067] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:14:12.206078] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.206109] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-6' came back up; going online.
[2017-03-17 13:14:12.206133] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206173] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206214] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206258] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206304] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206343] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206385] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206426] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206466] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206506] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206547] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206588] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206629] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206685] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206729] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206788] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206839] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206880] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206939] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.206991] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.207032] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.207072] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.207129] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:14:12.207140] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207172] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-10' came back up; going online.
[2017-03-17 13:14:12.207199] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:14:12.207208] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207307] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 13:14:12.207335] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:14:12.207344] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207446] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:14:12.207458] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207489] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-18' came back up; going online.
[2017-03-17 13:14:12.207516] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:14:12.207525] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207559] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-14' came back up; going online.
[2017-03-17 13:14:12.207586] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:14:12.207594] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207633] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-22' came back up; going online.
[2017-03-17 13:14:12.207659] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:14:12.207668] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207698] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-26' came back up; going online.
[2017-03-17 13:14:12.207723] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:14:12.207731] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207791] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:14:12.207817] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207872] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-34' came back up; going online.
[2017-03-17 13:14:12.207885] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:14:12.207902] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207911] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:14:12.207939] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.207965] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-30' came back up; going online.
[2017-03-17 13:14:12.208014] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-38' came back up; going online.
[2017-03-17 13:14:12.208040] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:14:12.208060] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208060] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:14:12.208081] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208195] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:14:12.208207] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208251] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:14:12.208251] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-42' came back up; going online.
[2017-03-17 13:14:12.208281] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208322] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:14:12.208335] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208423] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:14:12.208439] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208441] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:14:12.208455] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208546] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:14:12.208560] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208612] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:14:12.208625] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208662] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:14:12.208674] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208714] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:14:12.208725] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208784] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:14:12.208803] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208813] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 13:14:12.208833] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 13:14:12.208864] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:14:12.208883] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208913] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:14:12.208955] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.208974] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:14:12.208987] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.209113] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:14:12.209140] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.209158] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:14:12.209171] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.209260] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 13:14:12.209315] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:14:12.209324] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.209325] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 13:14:12.209376] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 13:14:12.209393] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 13:14:12.209412] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 13:14:12.209433] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 13:14:12.209443] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 13:14:12.209466] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 13:14:12.209472] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 13:14:12.209485] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 13:14:12.209488] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 13:14:12.209502] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 13:14:12.209525] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 13:14:12.209528] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 13:14:12.209546] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 13:14:12.209561] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 13:14:12.209584] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 13:14:12.209597] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 13:14:12.209603] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 13:14:12.209624] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 13:14:12.209655] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 13:14:12.209670] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 13:14:12.209677] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 13:14:12.209689] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 13:14:12.209693] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 13:14:12.209708] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 13:14:12.209740] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 13:14:12.209793] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:14:12.210318] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:14:12.210333] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:14:12.210490] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 13:14:12.219904] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 13:14:12.222491] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 13:14:12.222828] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 13:14:12.223026] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 13:14:12.223220] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 13:14:12.223291] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 13:14:12.223377] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 13:14:12.223431] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 13:14:12.223427] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328116948
[2017-03-17 13:14:12.223460] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 13:14:12.223468] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 13:14:12.223502] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 13:14:12.226535] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 13:14:12.250538] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 13:14:12.273861] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 13:14:12.312461] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 13:14:12.406311] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 13:14:12.464753] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /gfstest
[2017-03-17 13:14:12.500308] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine
[2017-03-17 13:14:12.539623] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 13:14:12.539677] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 0.00 secs
[2017-03-17 13:14:12.539691] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 0, size: 0, lookups: 0, failures: 0, skipped: 0
[2017-03-17 13:14:12.539922] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f9367eb3dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f9369545cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f9369545b4b] ) 0-: received signum (15), shutting down
[2017-03-17 13:16:32.247874] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=1 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328118145 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 13:16:32.265074] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 13:16:32.265165] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 13:16:32.265220] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 13:16:37.245521] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328118145'
[2017-03-17 13:16:37.245550] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 13:16:37.245564] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '1'
[2017-03-17 13:16:37.245576] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 13:16:37.245596] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:16:37.245609] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:16:37.245634] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:16:37.245649] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:16:37.245669] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:16:37.245681] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:16:37.245696] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:16:37.245712] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:16:37.245725] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:16:37.245743] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:16:37.245755] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:16:37.245781] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:16:37.245796] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:16:37.245808] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:16:37.245819] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:16:37.245833] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:16:37.245845] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:16:37.245856] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:16:37.245870] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:16:37.245881] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:16:37.245892] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:16:37.245906] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:16:37.245917] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:16:37.245934] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:16:37.245948] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:16:37.245960] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:16:37.245971] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:16:37.245985] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:16:37.245996] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:16:37.246008] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:16:37.246021] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:16:37.246032] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:16:37.246044] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:16:37.246057] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:16:37.246069] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:16:37.246080] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:16:37.246093] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:16:37.246105] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:16:37.246116] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:16:37.246130] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:16:37.246142] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:16:37.246153] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:16:37.246167] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:16:37.246178] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:16:37.246189] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:16:37.246208] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:16:37.246220] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:16:37.246232] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:16:37.246251] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:16:37.246263] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:16:37.246274] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:16:37.246288] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:16:37.246303] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:16:37.246315] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:16:37.246329] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:16:37.246340] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:16:37.246351] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:16:37.246365] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:16:37.246376] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:16:37.246387] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:16:37.246401] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:16:37.246412] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:16:37.246423] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:16:37.246436] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:16:37.246447] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:16:37.246458] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:16:37.246476] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:16:37.246487] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:16:37.246499] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:16:37.249045] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328118145
[2017-03-17 13:16:37.330441] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 13:16:37.349175] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.352425] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.352795] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 13:16:37.355357] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.360679] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.361308] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:16:37.361339] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.361442] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 13:16:37.361511] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 13:16:37.363063] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.365926] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.368758] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.369001] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 13:16:37.371603] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.375998] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.376578] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:16:37.376610] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.376674] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 13:16:37.376775] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 13:16:37.378564] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.381412] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.384281] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.384520] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 13:16:37.387126] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.391824] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.392370] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:16:37.392391] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.392456] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 13:16:37.392525] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 13:16:37.394273] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.396996] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.399724] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.399955] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 13:16:37.402453] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.406533] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.407031] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:16:37.407062] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.407133] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 13:16:37.407212] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 13:16:37.409010] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.411729] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.414460] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.414716] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 13:16:37.417192] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.422348] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.422886] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:16:37.422915] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.422995] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 13:16:37.423033] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 13:16:37.424536] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.427145] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.429805] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.430068] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 13:16:37.432417] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.437140] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.437656] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:16:37.437678] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.437754] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 13:16:37.437847] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 13:16:37.439481] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.442108] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.444730] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.444983] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 13:16:37.447358] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.451947] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.452477] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:16:37.452498] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.452580] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 13:16:37.452648] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 13:16:37.454225] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.456741] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.459281] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.459457] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 13:16:37.461814] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.465633] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.466144] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:16:37.466168] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.466220] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 13:16:37.466309] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 13:16:37.468049] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.470570] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.473093] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.473339] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 13:16:37.475614] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.480469] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.481009] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:16:37.481043] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.481122] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 13:16:37.481194] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 13:16:37.482614] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.485039] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.487464] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.487724] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 13:16:37.489907] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.495030] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.495620] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:16:37.495644] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.495711] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 13:16:37.495817] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 13:16:37.497037] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.499464] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.501912] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.502136] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 13:16:37.504338] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 13:16:37.509094] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:37.509780] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:16:37.509811] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:37.509872] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 13:16:37.509972] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 13:16:37.511125] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-8613-2017/03/17-13:16:32:238603-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 1
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328118145
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 13:16:42.249078] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 13:16:42.249471] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 13:16:42.249534] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 13:16:42.249575] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 13:16:42.249646] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 13:16:42.258290] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 13:16:42.266684] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 13:16:42.266775] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 13:16:42.267384] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 13:16:42.270759] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 13:16:42.270820] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 13:16:42.270872] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 13:16:42.270897] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 13:16:42.274421] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 13:16:42.274474] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 13:16:42.274499] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 13:16:42.278350] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 13:16:42.278401] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 13:16:42.278428] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 13:16:42.278450] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 13:16:42.278470] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 13:16:42.278490] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 13:16:42.278509] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 13:16:42.278529] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 13:16:42.278548] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 13:16:42.278588] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 13:16:42.278612] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 13:16:42.278634] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 13:16:42.278670] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 13:16:42.278691] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 13:16:42.278710] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 13:16:42.278730] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 13:16:42.282042] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 13:16:42.282099] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.282172] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.293680] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.297239] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.364376] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.364468] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:16:42.364487] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.364536] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-2' came back up; going online.
[2017-03-17 13:16:42.364570] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:16:42.364580] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.364615] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-6' came back up; going online.
[2017-03-17 13:16:42.364725] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:16:42.364739] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.364914] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:16:42.364932] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.364964] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-10' came back up; going online.
[2017-03-17 13:16:42.365008] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365123] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365429] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365500] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 13:16:42.365522] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365566] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 13:16:42.365585] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365627] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365675] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:16:42.365690] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.365771] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 13:16:42.365809] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365890] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.365938] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 13:16:42.365975] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366036] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366082] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366124] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366171] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366211] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366250] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366303] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366350] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366390] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366445] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366491] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366537] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366577] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366617] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366660] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366700] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366749] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366802] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.366878] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:16:42.366889] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.366918] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-18' came back up; going online.
[2017-03-17 13:16:42.366954] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:16:42.366963] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.366993] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-14' came back up; going online.
[2017-03-17 13:16:42.367020] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 13:16:42.367045] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:16:42.367053] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367080] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-22' came back up; going online.
[2017-03-17 13:16:42.367112] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:16:42.367120] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367199] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:16:42.367210] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367303] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:16:42.367315] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367406] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:16:42.367418] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367455] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-26' came back up; going online.
[2017-03-17 13:16:42.367480] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:16:42.367488] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367620] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:16:42.367633] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367714] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:16:42.367727] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367744] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:16:42.367783] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367835] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:16:42.367850] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367953] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:16:42.367968] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.367996] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:16:42.368011] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368094] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:16:42.368108] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368147] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:16:42.368161] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368230] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:16:42.368243] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368279] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-34' came back up; going online.
[2017-03-17 13:16:42.368284] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:16:42.368307] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368321] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:16:42.368332] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368408] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-30' came back up; going online.
[2017-03-17 13:16:42.368424] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:16:42.368439] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:16:42.368439] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368454] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368498] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-38' came back up; going online.
[2017-03-17 13:16:42.368533] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:16:42.368542] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368568] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 13:16:42.368647] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 13:16:42.368657] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:16:42.368671] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368675] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 13:16:42.368705] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-42' came back up; going online.
[2017-03-17 13:16:42.368709] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:16:42.368722] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368734] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:16:42.368745] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368845] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:16:42.368864] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368877] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 13:16:42.368915] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:16:42.368924] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.368966] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 13:16:42.368985] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 13:16:42.369008] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 13:16:42.369023] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 13:16:42.369037] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 13:16:42.369069] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 13:16:42.369088] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 13:16:42.369088] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 13:16:42.369109] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 13:16:42.369112] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 13:16:42.369123] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 13:16:42.369138] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 13:16:42.369142] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 13:16:42.369162] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 13:16:42.369169] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 13:16:42.369196] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 13:16:42.369198] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 13:16:42.369211] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 13:16:42.369237] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 13:16:42.369247] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 13:16:42.369252] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 13:16:42.369293] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 13:16:42.369303] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 13:16:42.369343] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:16:42.370040] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:16:42.370073] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:16:42.371948] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 13:16:42.383013] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 13:16:42.385480] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 13:16:42.385701] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 13:16:42.386020] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 13:16:42.386057] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 13:16:42.386267] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 13:16:42.386315] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 13:16:42.386352] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 13:16:42.386412] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 13:16:42.386430] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328118145
[2017-03-17 13:16:42.386471] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 13:16:42.386535] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 13:16:42.389026] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 13:16:42.405150] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 13:16:42.405180] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 13:16:42.405192] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 13:16:42.405201] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 13:16:42.405210] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 13:16:42.405218] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 13:16:42.405227] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 13:16:42.405235] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 13:16:42.405243] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 13:16:42.405251] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 13:16:42.405260] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 13:16:42.405339] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 13:16:42.405391] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 13:16:42.405402] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 13:16:42.405427] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 13:16:42.405514] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 13:16:42.405559] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 13:16:42.405578] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 13:16:42.407812] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 13:16:42.407862] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 13:16:42.407884] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 13:16:42.407967] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 13:16:42.407969] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 13:16:42.408015] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 13:16:42.408051] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 13:16:42.408070] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 13:16:42.408132] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 13:16:42.408199] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 13:16:42.408216] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 13:16:42.408986] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 13:16:42.409031] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 13:16:42.409045] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 13:16:42.409141] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 13:16:42.409146] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 13:16:42.409209] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 13:16:42.409220] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 13:16:42.409294] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 13:16:42.409296] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 13:16:42.409330] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 13:16:42.409332] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 13:16:42.409366] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 13:16:42.409415] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 13:16:42.411379] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 13:16:42.411390] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 13:16:42.411424] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 13:16:42.411492] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 13:16:42.411493] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 13:16:42.411528] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 13:16:42.411530] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 13:16:42.411563] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 13:16:42.411627] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 13:16:42.411627] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 13:16:42.411665] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 13:16:42.411672] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 13:16:42.412360] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 13:16:42.412369] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 13:16:42.412403] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 13:16:42.412418] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 13:16:42.412450] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 13:16:42.412456] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 13:16:42.412487] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 13:16:42.412531] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 13:16:42.412549] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 13:16:42.412607] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 13:16:42.412618] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 13:16:42.412654] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 13:16:42.413418] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 13:16:42.413457] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 13:16:42.413494] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 13:16:42.413527] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 13:16:42.413557] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 13:16:42.413596] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 13:16:42.413630] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 13:16:42.413662] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 13:16:42.413692] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 13:16:42.413722] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 13:16:42.413752] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 13:16:42.414458] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-3; inode layout - 1366580502 - 1561806287 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 13:16:42.414526] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 13:16:42.414737] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 1952257860 - 2147483645 - 1; disk layout - 1366580502 - 1561806287 - 1
[2017-03-17 13:16:42.414785] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 13:16:42.414819] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 1757032074 - 1952257859 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 13:16:42.414840] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 13:16:42.414955] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 2147483646 - 2342709431 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 13:16:42.414975] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 13:16:42.415269] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 585677358 - 780903143 - 1; disk layout - 2147483646 - 2342709431 - 1
[2017-03-17 13:16:42.415314] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 13:16:42.415754] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 195225786 - 390451571 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 13:16:42.415815] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 13:16:42.418059] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 13:16:42.426645] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.lck-2c739d20965fb485: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 13:16:42.432944] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.01 secs
[2017-03-17 13:16:42.437892] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 13:16:42.446435] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.lck-2c739d20965fb485 from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 13:16:42.453230] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 2733161004 - 2928386789 - 1; disk layout - 976128930 - 1171354715 - 1
[2017-03-17 13:16:42.453263] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 13:16:42.453611] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 585677358 - 780903143 - 1; disk layout - 3318838362 - 3514064147 - 1
[2017-03-17 13:16:42.453629] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 13:16:42.453831] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 976128930 - 1171354715 - 1; disk layout - 2537935218 - 2733161003 - 1
[2017-03-17 13:16:42.453870] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 13:16:42.454064] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 2537935218 - 2733161003 - 1; disk layout - 2733161004 - 2928386789 - 1
[2017-03-17 13:16:42.454091] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 13:16:42.454308] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-19; inode layout - 3318838362 - 3514064147 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 13:16:42.454333] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 13:16:42.456356] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 13:16:42.466180] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 13:16:42.470571] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 13:16:42.486794] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 13:16:42.495671] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 13:16:42.516455] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 13:16:42.530928] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-0; inode layout - 1561806288 - 1757032073 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 13:16:42.530966] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 13:16:42.531046] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 2928386790 - 3123612575 - 1; disk layout - 0 - 195225785 - 1
[2017-03-17 13:16:42.531079] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 13:16:42.531335] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 3904515720 - 4099741505 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 13:16:42.531379] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 13:16:42.531412] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 0 - 195225785 - 1; disk layout - 2928386790 - 3123612575 - 1
[2017-03-17 13:16:42.531435] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 13:16:42.531619] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 3709289934 - 3904515719 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 13:16:42.531635] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 13:16:42.531800] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-17; inode layout - 1757032074 - 1952257859 - 1; disk layout - 1561806288 - 1757032073 - 1
[2017-03-17 13:16:42.531822] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 13:16:42.533901] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 13:16:42.540232] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.36: attempting to move from vmware2-replicate-0 to vmware2-replicate-16
[2017-03-17 13:16:42.544473] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.37: attempting to move from vmware2-replicate-2 to vmware2-replicate-14
[2017-03-17 13:16:42.546451] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.36) } would result in dst node (vmware2-replicate-16:1865487136) having lower disk space then the source node (vmware2-replicate-0:1870725592).Skipping file.
[2017-03-17 13:16:42.562173] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.43: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:42.577868] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.30: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:42.583717] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.1: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:42.588399] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.3: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 13:16:42.594405] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.38: attempting to move from vmware2-replicate-14 to vmware2-replicate-2
[2017-03-17 13:16:42.597699] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.3) } would result in dst node (vmware2-replicate-11:1864434384) having lower disk space then the source node (vmware2-replicate-10:1868108920).Skipping file.
[2017-03-17 13:16:42.603611] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.38) } would result in dst node (vmware2-replicate-2:1863874016) having lower disk space then the source node (vmware2-replicate-14:1871246952).Skipping file.
[2017-03-17 13:16:42.607193] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.57: attempting to move from vmware2-replicate-12 to vmware2-replicate-7
[2017-03-17 13:16:42.615230] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.57) } would result in dst node (vmware2-replicate-7:1868628896) having lower disk space then the source node (vmware2-replicate-12:1868633144).Skipping file.
[2017-03-17 13:16:42.627922] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.132: attempting to move from vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 13:16:42.636709] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:42.644644] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:42.651778] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.1: attempting to move from vmware2-replicate-2 to vmware2-replicate-14
[2017-03-17 13:16:42.656056] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.44: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:42.667447] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.44: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:42.675783] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.23: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:42.680078] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.49: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 13:16:42.688066] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.55: attempting to move from vmware2-replicate-14 to vmware2-replicate-3
[2017-03-17 13:16:42.693382] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.49) } would result in dst node (vmware2-replicate-11:1864434384) having lower disk space then the source node (vmware2-replicate-10:1868108920).Skipping file.
[2017-03-17 13:16:42.697624] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.53: attempting to move from vmware2-replicate-12 to vmware2-replicate-7
[2017-03-17 13:16:42.700153] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.55) } would result in dst node (vmware2-replicate-3:1869153136) having lower disk space then the source node (vmware2-replicate-14:1871229440).Skipping file.
[2017-03-17 13:16:42.709413] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.53) } would result in dst node (vmware2-replicate-7:1868628896) having lower disk space then the source node (vmware2-replicate-12:1868633144).Skipping file.
[2017-03-17 13:16:42.726719] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.16: attempting to move from vmware2-replicate-16 to vmware2-replicate-17
[2017-03-17 13:16:42.733305] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.16: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:42.739119] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.63: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 13:16:42.746447] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.16) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:42.751930] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.33: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:42.759979] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.64: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:42.765314] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.16: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:42.837740] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.479: attempting to move from vmware2-replicate-16 to vmware2-replicate-0
[2017-03-17 13:16:42.859634] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.26: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:42.879773] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.26) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:42.888400] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.154: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 13:16:42.904929] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.103: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:42.913654] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.73: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:42.924535] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.40: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:42.953297] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27: attempting to move from vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 13:16:42.958770] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.8: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:42.963756] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.11: attempting to move from vmware2-replicate-2 to vmware2-replicate-14
[2017-03-17 13:16:42.986113] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.8) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:42.996448] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.111: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:43.267018] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 0.73 secs
[2017-03-17 13:16:43.342271] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 13:16:43.374934] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 1952257860 - 2147483645 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 13:16:43.374971] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.iorm.sf, gfid = 9d7fdd1e-939a-4175-a3e1-702ae8be98b3
[2017-03-17 13:16:43.375018] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-13; inode layout - 1757032074 - 1952257859 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 13:16:43.375030] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.iorm.sf, gfid = 9d7fdd1e-939a-4175-a3e1-702ae8be98b3
[2017-03-17 13:16:43.375071] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 3904515720 - 4099741505 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 13:16:43.375078] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.iorm.sf, gfid = 9d7fdd1e-939a-4175-a3e1-702ae8be98b3
[2017-03-17 13:16:43.382413] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 13:16:43.425434] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.04 secs
[2017-03-17 13:16:43.456544] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /gfstest
[2017-03-17 13:16:43.498452] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /gfstest
[2017-03-17 13:16:43.590097] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /gfstest took 0.09 secs
[2017-03-17 13:16:43.630755] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine
[2017-03-17 13:16:43.653194] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-4; inode layout - 2928386790 - 3123612575 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 13:16:43.653218] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /New Virtual Machine, gfid = 96217db7-a5e3-4a36-8d4a-3f6acce0a3bb
[2017-03-17 13:16:43.653802] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 3514064148 - 3709289933 - 1; disk layout - 780903144 - 976128929 - 1
[2017-03-17 13:16:43.653818] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /New Virtual Machine, gfid = 96217db7-a5e3-4a36-8d4a-3f6acce0a3bb
[2017-03-17 13:16:43.654274] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-17; inode layout - 780903144 - 976128929 - 1; disk layout - 3514064148 - 3709289933 - 1
[2017-03-17 13:16:43.654295] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /New Virtual Machine, gfid = 96217db7-a5e3-4a36-8d4a-3f6acce0a3bb
[2017-03-17 13:16:43.654485] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 195225786 - 390451571 - 1; disk layout - 2928386790 - 3123612575 - 1
[2017-03-17 13:16:43.654497] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /New Virtual Machine, gfid = 96217db7-a5e3-4a36-8d4a-3f6acce0a3bb
[2017-03-17 13:16:43.658078] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /New Virtual Machine
[2017-03-17 13:16:43.717487] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /New Virtual Machine/New Virtual Machine.vmdk on vmware2-replicate-16 (hashed subvol is vmware2-replicate-11)
[2017-03-17 13:16:43.718182] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /New Virtual Machine/New Virtual Machine.vmdk
[2017-03-17 13:16:43.748768] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /New Virtual Machine took 0.09 secs
[2017-03-17 13:16:43.794031] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 13:16:43.794061] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 13:16:43.794121] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 13:16:43.794193] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 13:16:43.794241] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 13:16:43.794322] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 13:16:43.794365] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 13:16:43.794418] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 13:16:43.794441] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 13:16:43.794479] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 13:16:43.794507] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 13:16:43.794532] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 13:16:43.794553] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 13:16:43.794584] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 13:16:43.794623] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 13:16:43.794671] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 13:16:43.794713] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 13:16:43.794739] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 13:16:43.794761] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 13:16:43.794991] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 13:16:43.795014] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 13:16:43.795046] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 13:16:43.795072] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 13:16:43.797511] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.60: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:43.797511] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.14: attempting to move from vmware2-replicate-16 to vmware2-replicate-0
[2017-03-17 13:16:43.797517] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:43.797721] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.50: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 13:16:43.798381] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.135: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:43.798456] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.2: attempting to move from vmware2-replicate-16 to vmware2-replicate-0
[2017-03-17 13:16:43.798636] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.147: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:43.798636] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.21: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:43.798790] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/gfstest-1a1c7559.vswp: attempting to move from vmware2-replicate-12 to vmware2-replicate-10
[2017-03-17 13:16:43.798798] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/vmware.log: attempting to move from vmware2-replicate-0 to vmware2-replicate-9
[2017-03-17 13:16:43.798941] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.63: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:43.799112] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/gfstest.vmdk: attempting to move from vmware2-replicate-2 to vmware2-replicate-8
[2017-03-17 13:16:43.799174] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/.lck-1dc8d4f0ef87d580: attempting to move from vmware2-replicate-14 to vmware2-replicate-12
[2017-03-17 13:16:43.800579] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.55: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:43.800769] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.146: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:43.800946] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.31: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:43.801017] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.102: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:43.801458] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.80: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:43.801546] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.92: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:43.801602] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.6: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 13:16:43.801687] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:43.802038] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/gfstest.vmx.lck: attempting to move from vmware2-replicate-6 to vmware2-replicate-21
[2017-03-17 13:16:43.842800] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/gfstest/.lck-1dc8d4f0ef87d580) } would result in dst node (vmware2-replicate-12:1868478096) having lower disk space then the source node (vmware2-replicate-14:1870958472).Skipping file.
[2017-03-17 13:16:43.842895] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:0 name:(/gfstest/gfstest-1a1c7559.vswp) } would result in dst node (vmware2-replicate-10:1868108920) having lower disk space then the source node (vmware2-replicate-12:1868479120).Skipping file.
[2017-03-17 13:16:43.843060] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:398 name:(/gfstest/vmware.log) } would result in dst node (vmware2-replicate-9:1870201712) having lower disk space then the source node (vmware2-replicate-0:1870667216).Skipping file.
[2017-03-17 13:16:43.843718] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.60) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.844311] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.63) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.846065] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.146) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.848080] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.21) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.849671] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.31) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.850793] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.6) } would result in dst node (vmware2-replicate-19:1867580304) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.857247] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmx: attempting to move from vmware2-replicate-0 to vmware2-replicate-17
[2017-03-17 13:16:43.857298] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/vmware.log: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 13:16:43.857355] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/.lck-06bba37fd1c3d499: attempting to move from vmware2-replicate-14 to vmware2-replicate-15
[2017-03-17 13:16:43.857480] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmdk: attempting to move from vmware2-replicate-18 to vmware2-replicate-11
[2017-03-17 13:16:43.896018] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/New Virtual Machine/New Virtual Machine.vmdk) } would result in dst node (vmware2-replicate-11:1864434384) having lower disk space then the source node (vmware2-replicate-18:1868108896).Skipping file.
[2017-03-17 13:16:43.896811] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:6 name:(/New Virtual Machine/New Virtual Machine.vmx) } would result in dst node (vmware2-replicate-17:1868564024) having lower disk space then the source node (vmware2-replicate-0:1870662264).Skipping file.
[2017-03-17 13:16:43.897674] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:1 name:(/New Virtual Machine/.lck-06bba37fd1c3d499) } would result in dst node (vmware2-replicate-15:1867464384) having lower disk space then the source node (vmware2-replicate-14:1870946656).Skipping file.
[2017-03-17 13:16:43.934686] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /gfstest/gfstest.vmx.lck from subvolume vmware2-replicate-6 to vmware2-replicate-21
[2017-03-17 13:16:43.972410] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /gfstest/gfstest.vmdk from subvolume vmware2-replicate-2 to vmware2-replicate-8
[2017-03-17 13:16:44.029443] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/vmware.log from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 13:16:48.972201] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 6.00 secs
[2017-03-17 13:16:48.972252] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 4, size: 436600, lookups: 250, failures: 0, skipped: 23
[2017-03-17 13:16:52.089059] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.37 from subvolume vmware2-replicate-2 to vmware2-replicate-14
[2017-03-17 13:16:52.089174] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.479 from subvolume vmware2-replicate-16 to vmware2-replicate-0
[2017-03-17 13:16:52.089235] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.63 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 13:16:52.089870] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.132 from subvolume vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 13:16:52.513884] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.154 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 13:16:52.513963] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.1 from subvolume vmware2-replicate-2 to vmware2-replicate-14
[2017-03-17 13:16:52.806779] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27 from subvolume vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 13:16:52.806856] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.43 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:53.189914] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.16 from subvolume vmware2-replicate-16 to vmware2-replicate-17
[2017-03-17 13:16:53.191324] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.11 from subvolume vmware2-replicate-2 to vmware2-replicate-14
[2017-03-17 13:16:53.191727] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.30 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:53.193125] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.44 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:53.888700] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.50 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 13:16:53.889106] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b07557a4-6d44-4e22-a82c-1919b5195896.14 from subvolume vmware2-replicate-16 to vmware2-replicate-0
[2017-03-17 13:16:53.889314] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.2 from subvolume vmware2-replicate-16 to vmware2-replicate-0
[2017-03-17 13:16:53.889420] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.33 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:54.298000] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.44 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:54.299011] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.64 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:54.299142] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.73 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:55.023029] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16 from subvolume vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 13:16:55.028408] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.103 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:55.102544] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.111 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:55.467554] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.147 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 13:16:57.587042] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.1 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:58.201796] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.23 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:58.782223] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.16 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:16:59.412691] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.40 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:01.942983] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.55 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:01.943273] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.135 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:02.311174] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.80 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:02.315672] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:02.317894] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.92 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:02.391702] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.102 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 13:17:02.393379] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 20.00 secs
[2017-03-17 13:17:02.393417] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 37, size: 8858806648, lookups: 250, failures: 0, skipped: 23
[2017-03-17 13:17:02.393716] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f70c0cd3dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f70c2365cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f70c2365b4b] ) 0-: received signum (15), shutting down
[2017-03-17 13:27:19.593166] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=5 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328123324 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 13:27:19.611394] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 13:27:19.611483] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 13:27:19.611536] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 13:27:24.668678] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328123324'
[2017-03-17 13:27:24.668704] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 13:27:24.668728] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '5'
[2017-03-17 13:27:24.668739] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 13:27:24.668757] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:27:24.668782] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:27:24.668793] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:27:24.668807] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:27:24.668825] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:27:24.668838] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:27:24.668855] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:27:24.668866] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:27:24.668880] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:27:24.668893] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:27:24.668904] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:27:24.668915] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:27:24.668927] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:27:24.668938] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:27:24.668949] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:27:24.668961] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:27:24.668972] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:27:24.668982] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:27:24.668995] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:27:24.669005] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:27:24.669021] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:27:24.669034] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:27:24.669044] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:27:24.669054] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:27:24.669067] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:27:24.669078] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:27:24.669088] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:27:24.669101] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:27:24.669111] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:27:24.669121] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:27:24.669134] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:27:24.669144] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:27:24.669155] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:27:24.669167] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:27:24.669178] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:27:24.669188] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:27:24.669201] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:27:24.669211] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:27:24.669222] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:27:24.669235] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:27:24.669245] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:27:24.669260] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:27:24.669274] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:27:24.669284] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:27:24.669300] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:27:24.669314] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:27:24.669324] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:27:24.669334] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:27:24.669347] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:27:24.669357] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:27:24.669368] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:27:24.669391] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:27:24.669402] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:27:24.669412] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:27:24.669425] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:27:24.669435] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:27:24.669446] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:27:24.669458] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:27:24.669468] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:27:24.669479] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:27:24.669491] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:27:24.669502] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:27:24.669512] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:27:24.669530] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:27:24.669541] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:27:24.669551] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:27:24.669563] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:27:24.669574] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:27:24.669588] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:27:24.672560] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328123324
[2017-03-17 13:27:24.672670] I [MSGID: 109086] [dht-shared.c:297:dht_parse_decommissioned_bricks] 0-vmware2-dht: decommissioning subvolume vmware2-replicate-20
[2017-03-17 13:27:24.672684] I [MSGID: 109086] [dht-shared.c:297:dht_parse_decommissioned_bricks] 0-vmware2-dht: decommissioning subvolume vmware2-replicate-21
[2017-03-17 13:27:24.766363] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 13:27:24.784428] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.787403] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.787736] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 13:27:24.790043] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.795386] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.795968] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:27:24.796009] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.796141] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 13:27:24.796199] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 13:27:24.799941] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.804543] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.808911] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.809154] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 13:27:24.813135] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.817787] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.818433] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:27:24.818464] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.818530] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 13:27:24.818626] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 13:27:24.821418] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.825382] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.829361] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.829602] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 13:27:24.833311] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.838833] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.839427] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:27:24.839457] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.839535] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 13:27:24.839620] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 13:27:24.842133] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.845884] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.849420] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.849642] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 13:27:24.852928] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.857588] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.858192] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:27:24.858226] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.858310] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 13:27:24.858390] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 13:27:24.860555] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.863903] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.867083] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.867319] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 13:27:24.870246] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.875241] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.875794] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:27:24.875823] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.875891] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 13:27:24.875929] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 13:27:24.877894] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.880903] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.883955] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.884197] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 13:27:24.886937] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.891369] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.892085] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:27:24.892119] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.892222] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 13:27:24.892306] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 13:27:24.893833] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.896709] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.899599] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.899866] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 13:27:24.902479] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.906933] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.907402] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:27:24.907434] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.907517] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 13:27:24.907573] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 13:27:24.909360] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.912118] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.914906] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.915124] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 13:27:24.917665] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.922127] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.922784] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:27:24.922812] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.922875] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 13:27:24.922985] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 13:27:24.924470] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.927193] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.929852] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.930118] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 13:27:24.932502] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.936937] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.937521] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:27:24.937550] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.937627] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 13:27:24.937716] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 13:27:24.939042] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.941592] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.944174] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.944409] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 13:27:24.946729] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.951886] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.952493] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:27:24.952524] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.952611] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 13:27:24.952704] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 13:27:24.953833] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.956284] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.958742] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.958939] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 13:27:24.961202] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 13:27:24.965930] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:24.966544] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:27:24.966571] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:24.966633] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 13:27:24.966741] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 13:27:24.967878] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-12691-2017/03/17-13:27:19:584893-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 5
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328123324
890:     option decommissioned-bricks vmware2-replicate-20,vmware2-replicate-21
891:     option lock-migration off
892:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
893: end-volume
894:  
895: volume vmware2
896:     type debug/io-stats
897:     option log-level INFO
898:     option latency-measurement off
899:     option count-fop-hits off
900:     subvolumes vmware2-dht
901: end-volume
902:  
+------------------------------------------------------------------------------+
[2017-03-17 13:27:29.843363] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 13:27:29.843435] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 13:27:29.848429] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 13:27:29.848538] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 13:27:29.848604] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 13:27:29.861038] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 13:27:29.861123] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 13:27:29.861154] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 13:27:29.861177] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 13:27:29.861200] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 13:27:29.861222] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 13:27:29.861263] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 13:27:29.861302] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 13:27:29.861325] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 13:27:29.861347] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 13:27:29.861369] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 13:27:29.861391] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 13:27:29.861412] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 13:27:29.861435] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 13:27:29.861456] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 13:27:29.861479] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 13:27:29.861506] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 13:27:29.861537] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.918493] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.918574] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.918628] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.918683] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:27:29.918694] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.919348] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 13:27:29.919378] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919431] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919472] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919516] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919555] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919595] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919659] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919700] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919739] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919789] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919839] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919877] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 13:27:29.919900] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919946] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.919997] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:27:29.920007] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.920101] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.920153] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:27:29.920166] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.920265] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.920333] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 13:27:29.920359] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 13:27:29.920376] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 13:27:29.920391] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 13:27:29.920418] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:27:29.920435] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.920529] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 13:27:29.920556] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 13:27:29.920572] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 13:27:29.920595] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 13:27:29.920611] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 13:27:29.920626] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 13:27:29.920645] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.920686] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.920733] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:27:29.920742] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922078] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:27:29.922106] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922280] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:27:29.922313] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922451] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:27:29.922466] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922576] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:27:29.922589] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922694] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:27:29.922707] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922804] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 13:27:29.922838] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:27:29.922859] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922905] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-3' came back up; going online.
[2017-03-17 13:27:29.922953] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:27:29.922963] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.922998] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-7' came back up; going online.
[2017-03-17 13:27:29.923030] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 13:27:29.923062] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:27:29.923072] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.923105] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-31' came back up; going online.
[2017-03-17 13:27:29.930792] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:27:29.930816] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.930858] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-19' came back up; going online.
[2017-03-17 13:27:29.934082] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:27:29.934108] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.934240] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:27:29.934253] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.934285] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-15' came back up; going online.
[2017-03-17 13:27:29.934311] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:27:29.934320] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.934350] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-23' came back up; going online.
[2017-03-17 13:27:29.936799] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 13:27:29.939908] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:27:29.939933] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.939977] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-11' came back up; going online.
[2017-03-17 13:27:29.951313] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:27:29.951344] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.951387] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-27' came back up; going online.
[2017-03-17 13:27:29.951412] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 13:27:29.951445] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:27:29.951454] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.951485] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-35' came back up; going online.
[2017-03-17 13:27:29.951510] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:27:29.951518] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.951549] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-39' came back up; going online.
[2017-03-17 13:27:29.951588] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 13:27:29.951613] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 13:27:29.951626] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 13:27:29.951645] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 13:27:29.951673] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 13:27:29.951692] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 13:27:29.951719] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 13:27:29.951731] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 13:27:29.951798] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 13:27:29.951837] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 13:27:29.951860] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 13:27:29.951873] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 13:27:29.951922] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 13:27:29.952001] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 13:27:29.952034] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 13:27:29.952072] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 13:27:29.952090] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952214] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952264] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952315] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952358] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952462] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952514] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952555] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952595] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952643] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952684] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.952744] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:27:29.952755] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.952791] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-43' came back up; going online.
[2017-03-17 13:27:29.952823] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:27:29.952831] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.952907] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:27:29.952918] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.952988] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:27:29.952998] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953066] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:27:29.953076] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953138] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 13:27:29.953160] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 13:27:29.953181] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:27:29.953194] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953263] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 13:27:29.953285] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:27:29.953293] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953363] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:27:29.953373] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953438] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:27:29.953448] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953524] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:27:29.953534] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953601] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:27:29.953610] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.953678] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 13:27:29.953721] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 13:27:29.953754] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 13:27:29.953789] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 13:27:29.953808] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 13:27:29.953827] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 13:27:29.953839] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 13:27:29.953870] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 13:27:29.954147] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:27:29.954681] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:27:29.954718] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:27:29.954962] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 13:27:29.964349] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 13:27:29.967315] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 13:27:29.967455] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 13:27:29.968155] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 13:27:29.968358] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 13:27:29.968425] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 13:27:29.968532] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 13:27:29.968627] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 13:27:29.968642] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328123324
[2017-03-17 13:27:29.968692] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 13:27:29.968720] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 13:27:29.968770] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 13:27:29.971360] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 13:27:29.991391] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 13:27:29.991426] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 13:27:29.991438] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 13:27:29.991447] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 13:27:29.991456] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 13:27:29.991466] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 13:27:29.991479] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 13:27:29.991487] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 13:27:29.991496] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 13:27:29.991504] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 13:27:29.991512] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 13:27:29.991593] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 13:27:29.991641] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 13:27:29.991705] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 13:27:29.991726] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 13:27:29.991814] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 13:27:29.991835] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 13:27:29.991953] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 13:27:29.991951] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 13:27:29.991998] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 13:27:29.992002] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 13:27:29.992817] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 13:27:29.992912] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 13:27:29.992925] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 13:27:29.992957] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 13:27:29.993013] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 13:27:29.993032] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 13:27:29.993071] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 13:27:29.993093] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 13:27:29.993125] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 13:27:29.993150] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 13:27:29.993179] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 13:27:29.993201] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 13:27:29.994021] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 13:27:29.994028] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 13:27:29.994086] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 13:27:29.994118] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 13:27:29.994151] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 13:27:29.994170] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 13:27:29.994200] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 13:27:29.994218] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 13:27:29.994251] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 13:27:29.994299] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 13:27:29.994321] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 13:27:29.994369] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 13:27:29.994389] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 13:27:29.995216] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 13:27:29.995284] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 13:27:29.995304] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 13:27:29.995420] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 13:27:29.995421] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 13:27:29.995459] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 13:27:29.995498] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 13:27:29.995517] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 13:27:29.995573] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 13:27:29.995594] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 13:27:29.995656] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 13:27:29.995676] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 13:27:29.995697] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 13:27:29.996516] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 13:27:29.996569] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 13:27:29.996591] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 13:27:29.996629] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 13:27:29.996666] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 13:27:29.996699] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 13:27:29.996743] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 13:27:29.996788] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 13:27:29.999207] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 13:27:29.999264] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 13:27:29.999309] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 13:27:29.999346] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 13:27:29.999379] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 13:27:29.999422] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 13:27:29.999455] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 13:27:29.999495] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 13:27:29.999529] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 13:27:29.999571] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 13:27:30.001984] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 13:27:30.014318] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.01 secs
[2017-03-17 13:27:30.018605] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 13:27:30.037668] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 13:27:30.046432] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 13:27:30.050711] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 13:27:30.068586] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 13:27:30.078000] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 13:27:30.097376] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 13:27:30.115296] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 13:27:30.119714] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.36: attempting to move from vmware2-replicate-0 to vmware2-replicate-16
[2017-03-17 13:27:30.176256] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.36: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.200297] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.56: attempting to move from vmware2-replicate-12 to vmware2-replicate-13
[2017-03-17 13:27:30.203145] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.38: attempting to move from vmware2-replicate-14 to vmware2-replicate-2
[2017-03-17 13:27:30.250668] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.43: attempting to move from vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:30.304096] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.43: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.321726] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.25: attempting to move from vmware2-replicate-12 to vmware2-replicate-13
[2017-03-17 13:27:30.327886] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.126: attempting to move from vmware2-replicate-14 to vmware2-replicate-15
[2017-03-17 13:27:30.332162] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.44: attempting to move from vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:30.337936] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.70: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.354565] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.33: attempting to move from vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:30.360417] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.2: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.367877] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.56: attempting to move from vmware2-replicate-20 to vmware2-replicate-5
[2017-03-17 13:27:30.387304] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.53: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.394585] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.103: attempting to move from vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:30.401779] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.60: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.409601] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.111: attempting to move from vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:30.416565] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.151: attempting to move from vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:30.425284] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.147: attempting to move from vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:30.436386] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 0.32 secs
[2017-03-17 13:27:30.515692] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 13:27:30.564578] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 13:27:30.600550] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.04 secs
[2017-03-17 13:27:30.627740] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /gfstest
[2017-03-17 13:27:30.665211] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /gfstest
[2017-03-17 13:27:30.679514] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/vmware-1.log: attempting to move from vmware2-replicate-0 to vmware2-replicate-5
[2017-03-17 13:27:30.714192] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /gfstest/.lck-5279768c111cada5: attempting to move from vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 13:27:30.732020] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /gfstest took 0.07 secs
[2017-03-17 13:27:30.749620] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /gfstest/vmware-1.log from subvolume vmware2-replicate-0 to vmware2-replicate-5
[2017-03-17 13:27:30.772035] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /gfstest/.lck-5279768c111cada5 from subvolume vmware2-replicate-16 to vmware2-replicate-14
[2017-03-17 13:27:30.775156] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine
[2017-03-17 13:27:30.820090] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /New Virtual Machine
[2017-03-17 13:27:30.851933] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/.lck-9219333f56b36b9c: attempting to move from vmware2-replicate-12 to vmware2-replicate-0
[2017-03-17 13:27:30.857626] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /New Virtual Machine/New Virtual Machine.vmdk on vmware2-replicate-11 (hashed subvol is vmware2-replicate-12)
[2017-03-17 13:27:30.860913] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /New Virtual Machine/New Virtual Machine.vmdk
[2017-03-17 13:27:30.866095] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmdk: attempting to move from vmware2-replicate-14 to vmware2-replicate-12
[2017-03-17 13:27:30.889120] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /New Virtual Machine took 0.07 secs
[2017-03-17 13:27:30.907493] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/.lck-9219333f56b36b9c from subvolume vmware2-replicate-12 to vmware2-replicate-0
[2017-03-17 13:27:30.914770] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/New Virtual Machine.vmdk from subvolume vmware2-replicate-14 to vmware2-replicate-12
[2017-03-17 13:27:30.929134] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 13:27:30.929314] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 13:27:30.929341] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 13:27:30.929361] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 13:27:30.929381] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 13:27:30.929400] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 13:27:30.929428] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 13:27:30.929452] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 13:27:30.929476] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 13:27:30.929495] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 13:27:30.929511] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 13:27:30.929528] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 13:27:30.929541] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 13:27:30.929557] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 13:27:30.929570] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 13:27:30.929580] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 13:27:30.929601] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 13:27:30.929614] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 13:27:30.929625] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 13:27:30.929638] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 13:27:30.929649] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 13:27:30.929661] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 13:27:30.929678] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 13:27:36.329866] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.36 from subvolume vmware2-replicate-0 to vmware2-replicate-16
[2017-03-17 13:27:36.380422] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.38 from subvolume vmware2-replicate-14 to vmware2-replicate-2
[2017-03-17 13:27:37.433969] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.43 from subvolume vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:37.645206] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.56 from subvolume vmware2-replicate-12 to vmware2-replicate-13
[2017-03-17 13:27:38.129222] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.126 from subvolume vmware2-replicate-14 to vmware2-replicate-15
[2017-03-17 13:27:38.240212] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.25 from subvolume vmware2-replicate-12 to vmware2-replicate-13
[2017-03-17 13:27:38.809819] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.44 from subvolume vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:38.810595] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.56 from subvolume vmware2-replicate-20 to vmware2-replicate-5
[2017-03-17 13:27:38.810643] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.36 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:39.145875] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.33 from subvolume vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:39.145914] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.43 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:39.581327] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.103 from subvolume vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:40.217115] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.2 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:40.564670] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.111 from subvolume vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:40.857322] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.147 from subvolume vmware2-replicate-20 to vmware2-replicate-4
[2017-03-17 13:27:42.106669] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/5159ca0a-0ebf-4d2f-8a03-efdf8f71e37d.53 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:42.106709] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.70 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:42.106772] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.60 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:42.106864] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.151 from subvolume vmware2-replicate-8 to vmware2-replicate-11
[2017-03-17 13:27:42.108691] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 13.00 secs
[2017-03-17 13:27:42.108731] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 23, size: 5100503418, lookups: 248, failures: 0, skipped: 0
[2017-03-17 13:27:42.109001] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f4e5533fdc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f4e569d1cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f4e569d1b4b] ) 0-: received signum (15), shutting down
[2017-03-17 13:59:27.543182] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=4 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328138746 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 13:59:27.561022] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 13:59:27.561124] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 13:59:27.561177] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 13:59:32.542026] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328138746'
[2017-03-17 13:59:32.542054] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 13:59:32.542068] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '4'
[2017-03-17 13:59:32.542079] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 13:59:32.542101] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:59:32.542113] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:59:32.542124] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 13:59:32.542137] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:59:32.542155] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:59:32.542167] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 13:59:32.542181] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:59:32.542196] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:59:32.542208] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 13:59:32.542225] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:59:32.542237] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:59:32.542247] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 13:59:32.542260] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:59:32.542271] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:59:32.542290] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 13:59:32.542304] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:59:32.542314] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:59:32.542325] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 13:59:32.542338] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:59:32.542348] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:59:32.542359] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 13:59:32.542372] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:59:32.542383] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:59:32.542394] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 13:59:32.542406] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:59:32.542417] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:59:32.542428] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 13:59:32.542441] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:59:32.542451] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:59:32.542462] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 13:59:32.542475] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:59:32.542485] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:59:32.542496] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 13:59:32.542509] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:59:32.542519] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:59:32.542534] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 13:59:32.542548] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:59:32.542559] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:59:32.542569] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 13:59:32.542583] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:59:32.542593] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:59:32.542604] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 13:59:32.542617] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:59:32.542628] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:59:32.542638] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 13:59:32.542652] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:59:32.542663] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:59:32.542674] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 13:59:32.542694] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:59:32.542705] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:59:32.542716] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 13:59:32.542729] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:59:32.542744] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:59:32.542756] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 13:59:32.542795] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:59:32.542807] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:59:32.542817] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 13:59:32.542836] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:59:32.542848] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:59:32.542858] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 13:59:32.542871] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:59:32.542882] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:59:32.542893] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 13:59:32.542905] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:59:32.542916] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:59:32.542927] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 13:59:32.542940] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:59:32.542950] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:59:32.542961] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 13:59:32.545333] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328138746
[2017-03-17 13:59:32.653215] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 13:59:32.670855] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.673732] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.674118] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 13:59:32.676288] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.681571] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.682244] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:59:32.682282] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.682395] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 13:59:32.682459] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 13:59:32.683549] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.685978] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.688377] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.688633] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 13:59:32.690782] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.695532] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.696160] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:59:32.696201] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.696278] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 13:59:32.696364] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 13:59:32.697620] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.700025] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.702442] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.702737] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 13:59:32.704849] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.709838] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.710401] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:59:32.710428] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.710503] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 13:59:32.710570] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 13:59:32.711959] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.714272] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.716599] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.716911] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 13:59:32.718929] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.723949] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.724489] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:59:32.724516] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.724585] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 13:59:32.724668] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 13:59:32.725901] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.728220] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.730545] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.730822] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 13:59:32.732870] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.737355] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.737869] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:59:32.737895] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.737954] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 13:59:32.738049] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 13:59:32.739384] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.741704] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.744074] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.744356] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 13:59:32.746399] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.751520] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.752042] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:59:32.752071] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.752154] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 13:59:32.752231] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 13:59:32.753505] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.755838] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.758180] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.758446] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 13:59:32.760509] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.765335] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.765812] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:59:32.765838] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.765914] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 13:59:32.765985] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 13:59:32.767456] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.769794] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.772147] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.772365] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 13:59:32.774479] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.778313] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.778811] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:59:32.778835] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.778888] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 13:59:32.778990] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 13:59:32.780295] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.782638] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.784981] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.785255] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 13:59:32.787322] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.792129] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.792578] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:59:32.792605] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.792689] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 13:59:32.792729] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 13:59:32.794406] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.796762] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.799128] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.799370] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 13:59:32.801472] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.805666] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.806171] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:59:32.806201] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.806268] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 13:59:32.806331] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 13:59:32.807811] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.810162] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.812543] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.812801] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 13:59:32.814915] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 13:59:32.819134] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:32.819594] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:59:32.819616] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:32.819672] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 13:59:32.819745] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 13:59:32.821142] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-24733-2017/03/17-13:59:27:534784-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 4
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328138746
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 13:59:37.546800] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 13:59:37.547047] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 13:59:37.547081] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 13:59:37.554399] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 13:59:37.554438] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 13:59:37.554493] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 13:59:37.561101] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 13:59:37.565409] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 13:59:37.565468] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 13:59:37.565497] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 13:59:37.565544] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 13:59:37.565578] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 13:59:37.565605] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 13:59:37.565640] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 13:59:37.565665] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 13:59:37.565689] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 13:59:37.565711] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 13:59:37.565735] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 13:59:37.565758] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 13:59:37.565808] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 13:59:37.565833] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 13:59:37.565857] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 13:59:37.565879] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 13:59:37.565903] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 13:59:37.565926] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 13:59:37.565949] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 13:59:37.565971] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 13:59:37.565994] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 13:59:37.566032] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 13:59:37.566057] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 13:59:37.566078] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 13:59:37.566101] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 13:59:37.566123] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 13:59:37.566181] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.566268] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.646929] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.647013] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:59:37.647024] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.647057] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-3' came back up; going online.
[2017-03-17 13:59:37.647084] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:59:37.647091] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.647115] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-7' came back up; going online.
[2017-03-17 13:59:37.647177] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.647235] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.647692] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 13:59:37.647709] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 13:59:37.647723] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.647787] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:59:37.647802] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.647831] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-11' came back up; going online.
[2017-03-17 13:59:37.647862] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.647899] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.647959] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648019] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648069] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648105] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648137] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648171] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648218] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648252] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648297] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648353] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:59:37.648366] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.648487] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:59:37.648497] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.648526] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-15' came back up; going online.
[2017-03-17 13:59:37.648561] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648607] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648648] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648681] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648712] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648744] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648792] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648833] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648866] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648910] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648944] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.648996] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.649054] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.649141] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.649189] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.649222] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 13:59:37.649245] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 13:59:37.649251] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649331] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:59:37.649340] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649390] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-31' came back up; going online.
[2017-03-17 13:59:37.649444] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:59:37.649458] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649512] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-19' came back up; going online.
[2017-03-17 13:59:37.649576] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:59:37.649587] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649617] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-27' came back up; going online.
[2017-03-17 13:59:37.649651] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:59:37.649658] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649683] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-23' came back up; going online.
[2017-03-17 13:59:37.649704] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:59:37.649718] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649848] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:59:37.649867] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649906] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-43' came back up; going online.
[2017-03-17 13:59:37.649925] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 13:59:37.649942] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:59:37.649949] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.649972] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-39' came back up; going online.
[2017-03-17 13:59:37.649992] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:59:37.649998] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650095] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 13:59:37.650104] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650188] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:59:37.650198] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650235] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-35' came back up; going online.
[2017-03-17 13:59:37.650254] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 13:59:37.650305] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:59:37.650319] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650438] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:59:37.650433] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 13:59:37.650453] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650468] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650562] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:59:37.650579] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650669] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 13:59:37.650686] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650702] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:59:37.650721] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650807] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:59:37.650828] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650853] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 13:59:37.650866] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.650963] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 13:59:37.650977] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651001] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:59:37.651014] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651106] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 13:59:37.651122] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651133] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:59:37.651146] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651219] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:59:37.651247] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651270] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 13:59:37.651294] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 13:59:37.651301] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651342] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 13:59:37.651379] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 13:59:37.651398] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 13:59:37.651402] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 13:59:37.651414] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651419] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.651534] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 13:59:37.651577] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 13:59:37.651577] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 13:59:37.651608] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 13:59:37.651614] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 13:59:37.651626] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 13:59:37.651652] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 13:59:37.651672] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 13:59:37.651705] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 13:59:37.651728] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 13:59:37.651731] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 13:59:37.651804] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 13:59:37.651790] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 13:59:37.651825] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 13:59:37.651847] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 13:59:37.651852] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 13:59:37.651878] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 13:59:37.651892] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 13:59:37.651902] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 13:59:37.651903] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 13:59:37.651947] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 13:59:37.651949] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 13:59:37.651986] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 13:59:37.652004] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 13:59:37.652066] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 13:59:37.652488] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 13:59:37.652502] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 13:59:37.653330] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 13:59:37.672419] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 13:59:37.672650] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 13:59:37.672993] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 13:59:37.673203] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 13:59:37.673343] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 13:59:37.673484] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 13:59:37.673556] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 13:59:37.673709] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 13:59:37.673748] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 13:59:37.673750] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328138746
[2017-03-17 13:59:37.673778] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 13:59:37.673802] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 13:59:37.675805] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 13:59:37.697774] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 13:59:37.718011] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 13:59:37.751809] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 13:59:37.841641] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 13:59:37.895717] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine
[2017-03-17 13:59:37.927431] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /Testse
[2017-03-17 13:59:37.980377] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine 5
[2017-03-17 13:59:38.016752] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 13:59:38.016825] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 1.00 secs
[2017-03-17 13:59:38.016843] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 0, size: 0, lookups: 0, failures: 0, skipped: 0
[2017-03-17 13:59:38.017035] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7fe240f3bdc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7fe2425cdcd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7fe2425cdb4b] ) 0-: received signum (15), shutting down
[2017-03-17 14:00:47.107926] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.10 (args: /usr/sbin/glusterfs -s localhost --volfile-id rebalance/vmware2 --xlator-option *dht.use-readdirp=yes --xlator-option *dht.lookup-unhashed=yes --xlator-option *dht.assert-no-child-down=yes --xlator-option *replicate*.data-self-heal=off --xlator-option *replicate*.metadata-self-heal=off --xlator-option *replicate*.entry-self-heal=off --xlator-option *dht.readdir-optimize=on --xlator-option *dht.rebalance-cmd=1 --xlator-option *dht.node-uuid=f15808d9-ab37-4126-b4e4-1d14011e4e0f --xlator-option *dht.commit-hash=3328139388 --socket-file /var/run/gluster/gluster-rebalance-02328d46-a285-4533-aa3a-fb9bfeb688bf.sock --pid-file /var/lib/glusterd/vols/vmware2/rebalance/f15808d9-ab37-4126-b4e4-1d14011e4e0f.pid -l /var/log/glusterfs/vmware2-rebalance.log)
[2017-03-17 14:00:47.125828] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-03-17 14:00:47.125922] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused)
[2017-03-17 14:00:47.125981] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: localhost (Transport endpoint is not connected)
[2017-03-17 14:00:52.106282] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'commit-hash' for volume 'vmware2-dht' with value '3328139388'
[2017-03-17 14:00:52.106308] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'node-uuid' for volume 'vmware2-dht' with value 'f15808d9-ab37-4126-b4e4-1d14011e4e0f'
[2017-03-17 14:00:52.106320] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'rebalance-cmd' for volume 'vmware2-dht' with value '1'
[2017-03-17 14:00:52.106330] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'readdir-optimize' for volume 'vmware2-dht' with value 'on'
[2017-03-17 14:00:52.106348] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'assert-no-child-down' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 14:00:52.106359] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'lookup-unhashed' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 14:00:52.106369] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-dht: adding option 'use-readdirp' for volume 'vmware2-dht' with value 'yes'
[2017-03-17 14:00:52.106382] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'entry-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 14:00:52.106399] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'metadata-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 14:00:52.106410] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-21: adding option 'data-self-heal' for volume 'vmware2-replicate-21' with value 'off'
[2017-03-17 14:00:52.106423] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'entry-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 14:00:52.106437] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'metadata-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 14:00:52.106458] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-20: adding option 'data-self-heal' for volume 'vmware2-replicate-20' with value 'off'
[2017-03-17 14:00:52.106474] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'entry-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 14:00:52.106485] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'metadata-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 14:00:52.106495] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-19: adding option 'data-self-heal' for volume 'vmware2-replicate-19' with value 'off'
[2017-03-17 14:00:52.106507] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'entry-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 14:00:52.106517] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'metadata-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 14:00:52.106526] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-18: adding option 'data-self-heal' for volume 'vmware2-replicate-18' with value 'off'
[2017-03-17 14:00:52.106538] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'entry-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 14:00:52.106548] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'metadata-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 14:00:52.106557] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-17: adding option 'data-self-heal' for volume 'vmware2-replicate-17' with value 'off'
[2017-03-17 14:00:52.106569] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'entry-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 14:00:52.106579] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'metadata-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 14:00:52.106589] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-16: adding option 'data-self-heal' for volume 'vmware2-replicate-16' with value 'off'
[2017-03-17 14:00:52.106600] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'entry-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 14:00:52.106610] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'metadata-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 14:00:52.106620] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-15: adding option 'data-self-heal' for volume 'vmware2-replicate-15' with value 'off'
[2017-03-17 14:00:52.106632] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'entry-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 14:00:52.106641] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'metadata-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 14:00:52.106651] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-14: adding option 'data-self-heal' for volume 'vmware2-replicate-14' with value 'off'
[2017-03-17 14:00:52.106663] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'entry-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 14:00:52.106672] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'metadata-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 14:00:52.106686] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-13: adding option 'data-self-heal' for volume 'vmware2-replicate-13' with value 'off'
[2017-03-17 14:00:52.106698] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'entry-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 14:00:52.106708] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'metadata-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 14:00:52.106717] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-12: adding option 'data-self-heal' for volume 'vmware2-replicate-12' with value 'off'
[2017-03-17 14:00:52.106729] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'entry-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 14:00:52.106739] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'metadata-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 14:00:52.106748] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-11: adding option 'data-self-heal' for volume 'vmware2-replicate-11' with value 'off'
[2017-03-17 14:00:52.106760] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'entry-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 14:00:52.106785] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'metadata-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 14:00:52.106795] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-10: adding option 'data-self-heal' for volume 'vmware2-replicate-10' with value 'off'
[2017-03-17 14:00:52.106808] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'entry-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 14:00:52.106818] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'metadata-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 14:00:52.106828] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-9: adding option 'data-self-heal' for volume 'vmware2-replicate-9' with value 'off'
[2017-03-17 14:00:52.106840] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'entry-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 14:00:52.106850] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'metadata-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 14:00:52.106859] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-8: adding option 'data-self-heal' for volume 'vmware2-replicate-8' with value 'off'
[2017-03-17 14:00:52.106872] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'entry-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 14:00:52.106882] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'metadata-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 14:00:52.106892] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-7: adding option 'data-self-heal' for volume 'vmware2-replicate-7' with value 'off'
[2017-03-17 14:00:52.106910] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'entry-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 14:00:52.106920] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'metadata-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 14:00:52.106930] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-6: adding option 'data-self-heal' for volume 'vmware2-replicate-6' with value 'off'
[2017-03-17 14:00:52.106948] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'entry-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 14:00:52.106962] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'metadata-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 14:00:52.106973] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-5: adding option 'data-self-heal' for volume 'vmware2-replicate-5' with value 'off'
[2017-03-17 14:00:52.106984] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'entry-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 14:00:52.106994] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'metadata-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 14:00:52.107004] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-4: adding option 'data-self-heal' for volume 'vmware2-replicate-4' with value 'off'
[2017-03-17 14:00:52.107016] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'entry-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 14:00:52.107025] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'metadata-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 14:00:52.107035] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-3: adding option 'data-self-heal' for volume 'vmware2-replicate-3' with value 'off'
[2017-03-17 14:00:52.107047] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'entry-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 14:00:52.107056] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'metadata-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 14:00:52.107066] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-2: adding option 'data-self-heal' for volume 'vmware2-replicate-2' with value 'off'
[2017-03-17 14:00:52.107078] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'entry-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 14:00:52.107087] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'metadata-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 14:00:52.107097] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-1: adding option 'data-self-heal' for volume 'vmware2-replicate-1' with value 'off'
[2017-03-17 14:00:52.107108] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'entry-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 14:00:52.107118] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'metadata-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 14:00:52.107127] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-vmware2-replicate-0: adding option 'data-self-heal' for volume 'vmware2-replicate-0' with value 'off'
[2017-03-17 14:00:52.109326] I [MSGID: 109104] [dht-shared.c:643:dht_init] 0-vmware2-dht: dht_init using commit hash 3328139388
[2017-03-17 14:00:52.216170] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2
[2017-03-17 14:00:52.232876] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-0: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.235529] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-1: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.235916] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-0: changing port to 49512 (from 0)
[2017-03-17 14:00:52.237911] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-2: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.243202] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.243678] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-0: Connected to vmware2-client-0, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 14:00:52.243702] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.243810] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-0: Subvolume 'vmware2-client-0' came back up; going online.
[2017-03-17 14:00:52.243859] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-0: Server lk version = 1
[2017-03-17 14:00:52.247174] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-3: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.252194] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-4: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.256762] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-5: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.257013] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-4: changing port to 49513 (from 0)
[2017-03-17 14:00:52.261302] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-6: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.265969] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.266556] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-4: Connected to vmware2-client-4, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 14:00:52.266586] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.266652] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-2: Subvolume 'vmware2-client-4' came back up; going online.
[2017-03-17 14:00:52.266746] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-4: Server lk version = 1
[2017-03-17 14:00:52.269835] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-7: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.273878] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-8: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.277951] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-9: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.278227] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-8: changing port to 49514 (from 0)
[2017-03-17 14:00:52.281861] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-10: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.286507] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.287062] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-8: Connected to vmware2-client-8, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 14:00:52.287089] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.287152] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-4: Subvolume 'vmware2-client-8' came back up; going online.
[2017-03-17 14:00:52.287221] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-8: Server lk version = 1
[2017-03-17 14:00:52.289994] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-11: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.293735] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-12: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.297456] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-13: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.297738] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-12: changing port to 49515 (from 0)
[2017-03-17 14:00:52.301180] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-14: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.306235] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-12: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.306878] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-12: Connected to vmware2-client-12, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 14:00:52.306918] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-12: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.307004] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-6: Subvolume 'vmware2-client-12' came back up; going online.
[2017-03-17 14:00:52.307078] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-12: Server lk version = 1
[2017-03-17 14:00:52.309350] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-15: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.312871] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-16: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.316410] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-17: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.316649] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-16: changing port to 49516 (from 0)
[2017-03-17 14:00:52.319929] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-18: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.323979] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-16: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.324556] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-16: Connected to vmware2-client-16, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 14:00:52.324575] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-16: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.324628] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-8: Subvolume 'vmware2-client-16' came back up; going online.
[2017-03-17 14:00:52.324727] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-16: Server lk version = 1
[2017-03-17 14:00:52.326910] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-19: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.330241] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-20: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.333574] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-21: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.333873] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-20: changing port to 49517 (from 0)
[2017-03-17 14:00:52.336432] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-22: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.339276] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-20: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.339911] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-20: Connected to vmware2-client-20, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 14:00:52.339935] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-20: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.340010] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-10: Subvolume 'vmware2-client-20' came back up; going online.
[2017-03-17 14:00:52.340100] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-20: Server lk version = 1
[2017-03-17 14:00:52.341718] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-23: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.344391] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-24: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.347037] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-25: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.347306] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-24: changing port to 49518 (from 0)
[2017-03-17 14:00:52.349676] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-26: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.354406] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-24: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.354919] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-24: Connected to vmware2-client-24, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 14:00:52.354946] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-24: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.355025] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-12: Subvolume 'vmware2-client-24' came back up; going online.
[2017-03-17 14:00:52.355102] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-24: Server lk version = 1
[2017-03-17 14:00:52.356637] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-27: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.359262] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-28: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.361934] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-29: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.362177] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-28: changing port to 49519 (from 0)
[2017-03-17 14:00:52.364456] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-30: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.368312] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-28: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.368853] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-28: Connected to vmware2-client-28, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 14:00:52.368878] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-28: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.368936] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-14: Subvolume 'vmware2-client-28' came back up; going online.
[2017-03-17 14:00:52.369022] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-28: Server lk version = 1
[2017-03-17 14:00:52.370458] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-31: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.372924] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-32: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.375355] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-33: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.375599] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-32: changing port to 49520 (from 0)
[2017-03-17 14:00:52.377783] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-34: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.380803] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-32: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.381295] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-32: Connected to vmware2-client-32, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 14:00:52.381313] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-32: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.381366] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-16: Subvolume 'vmware2-client-32' came back up; going online.
[2017-03-17 14:00:52.381459] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-32: Server lk version = 1
[2017-03-17 14:00:52.382828] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-35: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.385166] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-36: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.387554] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-37: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.387809] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-36: changing port to 49521 (from 0)
[2017-03-17 14:00:52.390056] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-38: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.392540] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-36: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.393054] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-36: Connected to vmware2-client-36, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 14:00:52.393075] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-36: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.393129] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-18: Subvolume 'vmware2-client-36' came back up; going online.
[2017-03-17 14:00:52.393192] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-36: Server lk version = 1
[2017-03-17 14:00:52.394717] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-39: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.397194] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-40: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.399654] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-41: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.399881] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-40: changing port to 49523 (from 0)
[2017-03-17 14:00:52.402047] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-42: parent translators are ready, attempting connect on transport
[2017-03-17 14:00:52.406657] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-40: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:52.407093] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-40: Connected to vmware2-client-40, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 14:00:52.407125] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-40: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:52.407178] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-20: Subvolume 'vmware2-client-40' came back up; going online.
[2017-03-17 14:00:52.407225] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-40: Server lk version = 1
[2017-03-17 14:00:52.408649] I [MSGID: 114020] [client.c:2356:notify] 0-vmware2-client-43: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume vmware2-client-0
  2:     type protocol/client
  3:     option clnt-lk-version 1
  4:     option volfile-checksum 0
  5:     option volfile-key rebalance/vmware2
  6:     option client-version 3.8.10
  7:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-0-0-0
  8:     option fops-version 1298437
  9:     option ping-timeout 5
 10:     option remote-host gluster01
 11:     option remote-subvolume /mnt/disk1/vmware2
 12:     option transport-type socket
 13:     option transport.address-family inet
 14:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 15:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 16:     option filter-O_DIRECT enable
 17:     option event-threads 2
 18: end-volume
 19:  
 20: volume vmware2-client-1
 21:     type protocol/client
 22:     option ping-timeout 5
 23:     option remote-host gluster03
 24:     option remote-subvolume /mnt/disk1/vmware2
 25:     option transport-type socket
 26:     option transport.address-family inet
 27:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 28:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 29:     option filter-O_DIRECT enable
 30:     option event-threads 2
 31: end-volume
 32:  
 33: volume vmware2-replicate-0
 34:     type cluster/replicate
 35:     option data-self-heal off
 36:     option metadata-self-heal off
 37:     option entry-self-heal off
 38:     option data-self-heal-algorithm full
 39:     option eager-lock enable
 40:     option favorite-child-policy size
 41:     subvolumes vmware2-client-0 vmware2-client-1
 42: end-volume
 43:  
 44: volume vmware2-client-2
 45:     type protocol/client
 46:     option ping-timeout 5
 47:     option remote-host gluster02
 48:     option remote-subvolume /mnt/disk1/vmware2
 49:     option transport-type socket
 50:     option transport.address-family inet
 51:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 52:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 53:     option filter-O_DIRECT enable
 54:     option event-threads 2
 55: end-volume
 56:  
 57: volume vmware2-client-3
 58:     type protocol/client
 59:     option ping-timeout 5
 60:     option remote-host gluster04
 61:     option remote-subvolume /mnt/disk1/vmware2
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 65:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 66:     option filter-O_DIRECT enable
 67:     option event-threads 2
 68: end-volume
 69:  
 70: volume vmware2-replicate-1
 71:     type cluster/replicate
 72:     option data-self-heal off
 73:     option metadata-self-heal off
 74:     option entry-self-heal off
 75:     option data-self-heal-algorithm full
 76:     option eager-lock enable
 77:     option favorite-child-policy size
 78:     subvolumes vmware2-client-2 vmware2-client-3
 79: end-volume
 80:  
 81: volume vmware2-client-4
 82:     type protocol/client
 83:     option clnt-lk-version 1
 84:     option volfile-checksum 0
 85:     option volfile-key rebalance/vmware2
 86:     option client-version 3.8.10
 87:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-4-0-0
 88:     option fops-version 1298437
 89:     option ping-timeout 5
 90:     option remote-host gluster01
 91:     option remote-subvolume /mnt/disk2/vmware2
 92:     option transport-type socket
 93:     option transport.address-family inet
 94:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
 95:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
 96:     option filter-O_DIRECT enable
 97:     option event-threads 2
 98: end-volume
 99:  
100: volume vmware2-client-5
101:     type protocol/client
102:     option ping-timeout 5
103:     option remote-host gluster03
104:     option remote-subvolume /mnt/disk2/vmware2
105:     option transport-type socket
106:     option transport.address-family inet
107:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
108:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
109:     option filter-O_DIRECT enable
110:     option event-threads 2
111: end-volume
112:  
113: volume vmware2-replicate-2
114:     type cluster/replicate
115:     option data-self-heal off
116:     option metadata-self-heal off
117:     option entry-self-heal off
118:     option data-self-heal-algorithm full
119:     option eager-lock enable
120:     option favorite-child-policy size
121:     subvolumes vmware2-client-4 vmware2-client-5
122: end-volume
123:  
124: volume vmware2-client-6
125:     type protocol/client
126:     option ping-timeout 5
127:     option remote-host gluster02
128:     option remote-subvolume /mnt/disk2/vmware2
129:     option transport-type socket
130:     option transport.address-family inet
131:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
132:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
133:     option filter-O_DIRECT enable
134:     option event-threads 2
135: end-volume
136:  
137: volume vmware2-client-7
138:     type protocol/client
139:     option ping-timeout 5
140:     option remote-host gluster04
141:     option remote-subvolume /mnt/disk2/vmware2
142:     option transport-type socket
143:     option transport.address-family inet
144:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
145:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
146:     option filter-O_DIRECT enable
147:     option event-threads 2
148: end-volume
149:  
150: volume vmware2-replicate-3
151:     type cluster/replicate
152:     option data-self-heal off
153:     option metadata-self-heal off
154:     option entry-self-heal off
155:     option data-self-heal-algorithm full
156:     option eager-lock enable
157:     option favorite-child-policy size
158:     subvolumes vmware2-client-6 vmware2-client-7
159: end-volume
160:  
161: volume vmware2-client-8
162:     type protocol/client
163:     option clnt-lk-version 1
164:     option volfile-checksum 0
165:     option volfile-key rebalance/vmware2
166:     option client-version 3.8.10
167:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-8-0-0
168:     option fops-version 1298437
169:     option ping-timeout 5
170:     option remote-host gluster01
171:     option remote-subvolume /mnt/disk3/vmware2
172:     option transport-type socket
173:     option transport.address-family inet
174:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
175:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
176:     option filter-O_DIRECT enable
177:     option event-threads 2
178: end-volume
179:  
180: volume vmware2-client-9
181:     type protocol/client
182:     option ping-timeout 5
183:     option remote-host gluster03
184:     option remote-subvolume /mnt/disk3/vmware2
185:     option transport-type socket
186:     option transport.address-family inet
187:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
188:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
189:     option filter-O_DIRECT enable
190:     option event-threads 2
191: end-volume
192:  
193: volume vmware2-replicate-4
194:     type cluster/replicate
195:     option data-self-heal off
196:     option metadata-self-heal off
197:     option entry-self-heal off
198:     option data-self-heal-algorithm full
199:     option eager-lock enable
200:     option favorite-child-policy size
201:     subvolumes vmware2-client-8 vmware2-client-9
202: end-volume
203:  
204: volume vmware2-client-10
205:     type protocol/client
206:     option ping-timeout 5
207:     option remote-host gluster02
208:     option remote-subvolume /mnt/disk3/vmware2
209:     option transport-type socket
210:     option transport.address-family inet
211:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
212:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
213:     option filter-O_DIRECT enable
214:     option event-threads 2
215: end-volume
216:  
217: volume vmware2-client-11
218:     type protocol/client
219:     option ping-timeout 5
220:     option remote-host gluster04
221:     option remote-subvolume /mnt/disk3/vmware2
222:     option transport-type socket
223:     option transport.address-family inet
224:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
225:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
226:     option filter-O_DIRECT enable
227:     option event-threads 2
228: end-volume
229:  
230: volume vmware2-replicate-5
231:     type cluster/replicate
232:     option data-self-heal off
233:     option metadata-self-heal off
234:     option entry-self-heal off
235:     option data-self-heal-algorithm full
236:     option eager-lock enable
237:     option favorite-child-policy size
238:     subvolumes vmware2-client-10 vmware2-client-11
239: end-volume
240:  
241: volume vmware2-client-12
242:     type protocol/client
243:     option clnt-lk-version 1
244:     option volfile-checksum 0
245:     option volfile-key rebalance/vmware2
246:     option client-version 3.8.10
247:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-12-0-0
248:     option fops-version 1298437
249:     option ping-timeout 5
250:     option remote-host gluster01
251:     option remote-subvolume /mnt/disk4/vmware2
252:     option transport-type socket
253:     option transport.address-family inet
254:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
255:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
256:     option filter-O_DIRECT enable
257:     option event-threads 2
258: end-volume
259:  
260: volume vmware2-client-13
261:     type protocol/client
262:     option ping-timeout 5
263:     option remote-host gluster03
264:     option remote-subvolume /mnt/disk4/vmware2
265:     option transport-type socket
266:     option transport.address-family inet
267:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
268:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
269:     option filter-O_DIRECT enable
270:     option event-threads 2
271: end-volume
272:  
273: volume vmware2-replicate-6
274:     type cluster/replicate
275:     option data-self-heal off
276:     option metadata-self-heal off
277:     option entry-self-heal off
278:     option data-self-heal-algorithm full
279:     option eager-lock enable
280:     option favorite-child-policy size
281:     subvolumes vmware2-client-12 vmware2-client-13
282: end-volume
283:  
284: volume vmware2-client-14
285:     type protocol/client
286:     option ping-timeout 5
287:     option remote-host gluster02
288:     option remote-subvolume /mnt/disk4/vmware2
289:     option transport-type socket
290:     option transport.address-family inet
291:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
292:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
293:     option filter-O_DIRECT enable
294:     option event-threads 2
295: end-volume
296:  
297: volume vmware2-client-15
298:     type protocol/client
299:     option ping-timeout 5
300:     option remote-host gluster04
301:     option remote-subvolume /mnt/disk4/vmware2
302:     option transport-type socket
303:     option transport.address-family inet
304:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
305:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
306:     option filter-O_DIRECT enable
307:     option event-threads 2
308: end-volume
309:  
310: volume vmware2-replicate-7
311:     type cluster/replicate
312:     option data-self-heal off
313:     option metadata-self-heal off
314:     option entry-self-heal off
315:     option data-self-heal-algorithm full
316:     option eager-lock enable
317:     option favorite-child-policy size
318:     subvolumes vmware2-client-14 vmware2-client-15
319: end-volume
320:  
321: volume vmware2-client-16
322:     type protocol/client
323:     option clnt-lk-version 1
324:     option volfile-checksum 0
325:     option volfile-key rebalance/vmware2
326:     option client-version 3.8.10
327:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-16-0-0
328:     option fops-version 1298437
329:     option ping-timeout 5
330:     option remote-host gluster01
331:     option remote-subvolume /mnt/disk5/vmware2
332:     option transport-type socket
333:     option transport.address-family inet
334:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
335:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
336:     option filter-O_DIRECT enable
337:     option event-threads 2
338: end-volume
339:  
340: volume vmware2-client-17
341:     type protocol/client
342:     option ping-timeout 5
343:     option remote-host gluster03
344:     option remote-subvolume /mnt/disk5/vmware2
345:     option transport-type socket
346:     option transport.address-family inet
347:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
348:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
349:     option filter-O_DIRECT enable
350:     option event-threads 2
351: end-volume
352:  
353: volume vmware2-replicate-8
354:     type cluster/replicate
355:     option data-self-heal off
356:     option metadata-self-heal off
357:     option entry-self-heal off
358:     option data-self-heal-algorithm full
359:     option eager-lock enable
360:     option favorite-child-policy size
361:     subvolumes vmware2-client-16 vmware2-client-17
362: end-volume
363:  
364: volume vmware2-client-18
365:     type protocol/client
366:     option ping-timeout 5
367:     option remote-host gluster02
368:     option remote-subvolume /mnt/disk5/vmware2
369:     option transport-type socket
370:     option transport.address-family inet
371:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
372:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
373:     option filter-O_DIRECT enable
374:     option event-threads 2
375: end-volume
376:  
377: volume vmware2-client-19
378:     type protocol/client
379:     option ping-timeout 5
380:     option remote-host gluster04
381:     option remote-subvolume /mnt/disk5/vmware2
382:     option transport-type socket
383:     option transport.address-family inet
384:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
385:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
386:     option filter-O_DIRECT enable
387:     option event-threads 2
388: end-volume
389:  
390: volume vmware2-replicate-9
391:     type cluster/replicate
392:     option data-self-heal off
393:     option metadata-self-heal off
394:     option entry-self-heal off
395:     option data-self-heal-algorithm full
396:     option eager-lock enable
397:     option favorite-child-policy size
398:     subvolumes vmware2-client-18 vmware2-client-19
399: end-volume
400:  
401: volume vmware2-client-20
402:     type protocol/client
403:     option clnt-lk-version 1
404:     option volfile-checksum 0
405:     option volfile-key rebalance/vmware2
406:     option client-version 3.8.10
407:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-20-0-0
408:     option fops-version 1298437
409:     option ping-timeout 5
410:     option remote-host gluster01
411:     option remote-subvolume /mnt/disk6/vmware2
412:     option transport-type socket
413:     option transport.address-family inet
414:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
415:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
416:     option filter-O_DIRECT enable
417:     option event-threads 2
418: end-volume
419:  
420: volume vmware2-client-21
421:     type protocol/client
422:     option ping-timeout 5
423:     option remote-host gluster03
424:     option remote-subvolume /mnt/disk6/vmware2
425:     option transport-type socket
426:     option transport.address-family inet
427:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
428:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
429:     option filter-O_DIRECT enable
430:     option event-threads 2
431: end-volume
432:  
433: volume vmware2-replicate-10
434:     type cluster/replicate
435:     option data-self-heal off
436:     option metadata-self-heal off
437:     option entry-self-heal off
438:     option data-self-heal-algorithm full
439:     option eager-lock enable
440:     option favorite-child-policy size
441:     subvolumes vmware2-client-20 vmware2-client-21
442: end-volume
443:  
444: volume vmware2-client-22
445:     type protocol/client
446:     option ping-timeout 5
447:     option remote-host gluster02
448:     option remote-subvolume /mnt/disk6/vmware2
449:     option transport-type socket
450:     option transport.address-family inet
451:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
452:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
453:     option filter-O_DIRECT enable
454:     option event-threads 2
455: end-volume
456:  
457: volume vmware2-client-23
458:     type protocol/client
459:     option ping-timeout 5
460:     option remote-host gluster04
461:     option remote-subvolume /mnt/disk6/vmware2
462:     option transport-type socket
463:     option transport.address-family inet
464:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
465:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
466:     option filter-O_DIRECT enable
467:     option event-threads 2
468: end-volume
469:  
470: volume vmware2-replicate-11
471:     type cluster/replicate
472:     option data-self-heal off
473:     option metadata-self-heal off
474:     option entry-self-heal off
475:     option data-self-heal-algorithm full
476:     option eager-lock enable
477:     option favorite-child-policy size
478:     subvolumes vmware2-client-22 vmware2-client-23
479: end-volume
480:  
481: volume vmware2-client-24
482:     type protocol/client
483:     option clnt-lk-version 1
484:     option volfile-checksum 0
485:     option volfile-key rebalance/vmware2
486:     option client-version 3.8.10
487:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-24-0-0
488:     option fops-version 1298437
489:     option ping-timeout 5
490:     option remote-host gluster01
491:     option remote-subvolume /mnt/disk7/vmware2
492:     option transport-type socket
493:     option transport.address-family inet
494:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
495:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
496:     option filter-O_DIRECT enable
497:     option event-threads 2
498: end-volume
499:  
500: volume vmware2-client-25
501:     type protocol/client
502:     option ping-timeout 5
503:     option remote-host gluster03
504:     option remote-subvolume /mnt/disk7/vmware2
505:     option transport-type socket
506:     option transport.address-family inet
507:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
508:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
509:     option filter-O_DIRECT enable
510:     option event-threads 2
511: end-volume
512:  
513: volume vmware2-replicate-12
514:     type cluster/replicate
515:     option data-self-heal off
516:     option metadata-self-heal off
517:     option entry-self-heal off
518:     option data-self-heal-algorithm full
519:     option eager-lock enable
520:     option favorite-child-policy size
521:     subvolumes vmware2-client-24 vmware2-client-25
522: end-volume
523:  
524: volume vmware2-client-26
525:     type protocol/client
526:     option ping-timeout 5
527:     option remote-host gluster02
528:     option remote-subvolume /mnt/disk7/vmware2
529:     option transport-type socket
530:     option transport.address-family inet
531:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
532:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
533:     option filter-O_DIRECT enable
534:     option event-threads 2
535: end-volume
536:  
537: volume vmware2-client-27
538:     type protocol/client
539:     option ping-timeout 5
540:     option remote-host gluster04
541:     option remote-subvolume /mnt/disk7/vmware2
542:     option transport-type socket
543:     option transport.address-family inet
544:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
545:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
546:     option filter-O_DIRECT enable
547:     option event-threads 2
548: end-volume
549:  
550: volume vmware2-replicate-13
551:     type cluster/replicate
552:     option data-self-heal off
553:     option metadata-self-heal off
554:     option entry-self-heal off
555:     option data-self-heal-algorithm full
556:     option eager-lock enable
557:     option favorite-child-policy size
558:     subvolumes vmware2-client-26 vmware2-client-27
559: end-volume
560:  
561: volume vmware2-client-28
562:     type protocol/client
563:     option clnt-lk-version 1
564:     option volfile-checksum 0
565:     option volfile-key rebalance/vmware2
566:     option client-version 3.8.10
567:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-28-0-0
568:     option fops-version 1298437
569:     option ping-timeout 5
570:     option remote-host gluster01
571:     option remote-subvolume /mnt/disk8/vmware2
572:     option transport-type socket
573:     option transport.address-family inet
574:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
575:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
576:     option filter-O_DIRECT enable
577:     option event-threads 2
578: end-volume
579:  
580: volume vmware2-client-29
581:     type protocol/client
582:     option ping-timeout 5
583:     option remote-host gluster03
584:     option remote-subvolume /mnt/disk8/vmware2
585:     option transport-type socket
586:     option transport.address-family inet
587:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
588:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
589:     option filter-O_DIRECT enable
590:     option event-threads 2
591: end-volume
592:  
593: volume vmware2-replicate-14
594:     type cluster/replicate
595:     option data-self-heal off
596:     option metadata-self-heal off
597:     option entry-self-heal off
598:     option data-self-heal-algorithm full
599:     option eager-lock enable
600:     option favorite-child-policy size
601:     subvolumes vmware2-client-28 vmware2-client-29
602: end-volume
603:  
604: volume vmware2-client-30
605:     type protocol/client
606:     option ping-timeout 5
607:     option remote-host gluster02
608:     option remote-subvolume /mnt/disk8/vmware2
609:     option transport-type socket
610:     option transport.address-family inet
611:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
612:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
613:     option filter-O_DIRECT enable
614:     option event-threads 2
615: end-volume
616:  
617: volume vmware2-client-31
618:     type protocol/client
619:     option ping-timeout 5
620:     option remote-host gluster04
621:     option remote-subvolume /mnt/disk8/vmware2
622:     option transport-type socket
623:     option transport.address-family inet
624:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
625:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
626:     option filter-O_DIRECT enable
627:     option event-threads 2
628: end-volume
629:  
630: volume vmware2-replicate-15
631:     type cluster/replicate
632:     option data-self-heal off
633:     option metadata-self-heal off
634:     option entry-self-heal off
635:     option data-self-heal-algorithm full
636:     option eager-lock enable
637:     option favorite-child-policy size
638:     subvolumes vmware2-client-30 vmware2-client-31
639: end-volume
640:  
641: volume vmware2-client-32
642:     type protocol/client
643:     option clnt-lk-version 1
644:     option volfile-checksum 0
645:     option volfile-key rebalance/vmware2
646:     option client-version 3.8.10
647:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-32-0-0
648:     option fops-version 1298437
649:     option ping-timeout 5
650:     option remote-host gluster01
651:     option remote-subvolume /mnt/disk9/vmware2
652:     option transport-type socket
653:     option transport.address-family inet
654:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
655:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
656:     option filter-O_DIRECT enable
657:     option event-threads 2
658: end-volume
659:  
660: volume vmware2-client-33
661:     type protocol/client
662:     option ping-timeout 5
663:     option remote-host gluster03
664:     option remote-subvolume /mnt/disk9/vmware2
665:     option transport-type socket
666:     option transport.address-family inet
667:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
668:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
669:     option filter-O_DIRECT enable
670:     option event-threads 2
671: end-volume
672:  
673: volume vmware2-replicate-16
674:     type cluster/replicate
675:     option data-self-heal off
676:     option metadata-self-heal off
677:     option entry-self-heal off
678:     option data-self-heal-algorithm full
679:     option eager-lock enable
680:     option favorite-child-policy size
681:     subvolumes vmware2-client-32 vmware2-client-33
682: end-volume
683:  
684: volume vmware2-client-34
685:     type protocol/client
686:     option ping-timeout 5
687:     option remote-host gluster02
688:     option remote-subvolume /mnt/disk9/vmware2
689:     option transport-type socket
690:     option transport.address-family inet
691:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
692:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
693:     option filter-O_DIRECT enable
694:     option event-threads 2
695: end-volume
696:  
697: volume vmware2-client-35
698:     type protocol/client
699:     option ping-timeout 5
700:     option remote-host gluster04
701:     option remote-subvolume /mnt/disk9/vmware2
702:     option transport-type socket
703:     option transport.address-family inet
704:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
705:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
706:     option filter-O_DIRECT enable
707:     option event-threads 2
708: end-volume
709:  
710: volume vmware2-replicate-17
711:     type cluster/replicate
712:     option data-self-heal off
713:     option metadata-self-heal off
714:     option entry-self-heal off
715:     option data-self-heal-algorithm full
716:     option eager-lock enable
717:     option favorite-child-policy size
718:     subvolumes vmware2-client-34 vmware2-client-35
719: end-volume
720:  
721: volume vmware2-client-36
722:     type protocol/client
723:     option clnt-lk-version 1
724:     option volfile-checksum 0
725:     option volfile-key rebalance/vmware2
726:     option client-version 3.8.10
727:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-36-0-0
728:     option fops-version 1298437
729:     option ping-timeout 5
730:     option remote-host gluster01
731:     option remote-subvolume /mnt/disk10/vmware2
732:     option transport-type socket
733:     option transport.address-family inet
734:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
735:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
736:     option filter-O_DIRECT enable
737:     option event-threads 2
738: end-volume
739:  
740: volume vmware2-client-37
741:     type protocol/client
742:     option ping-timeout 5
743:     option remote-host gluster03
744:     option remote-subvolume /mnt/disk10/vmware2
745:     option transport-type socket
746:     option transport.address-family inet
747:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
748:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
749:     option filter-O_DIRECT enable
750:     option event-threads 2
751: end-volume
752:  
753: volume vmware2-replicate-18
754:     type cluster/replicate
755:     option data-self-heal off
756:     option metadata-self-heal off
757:     option entry-self-heal off
758:     option data-self-heal-algorithm full
759:     option eager-lock enable
760:     option favorite-child-policy size
761:     subvolumes vmware2-client-36 vmware2-client-37
762: end-volume
763:  
764: volume vmware2-client-38
765:     type protocol/client
766:     option ping-timeout 5
767:     option remote-host gluster02
768:     option remote-subvolume /mnt/disk10/vmware2
769:     option transport-type socket
770:     option transport.address-family inet
771:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
772:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
773:     option filter-O_DIRECT enable
774:     option event-threads 2
775: end-volume
776:  
777: volume vmware2-client-39
778:     type protocol/client
779:     option ping-timeout 5
780:     option remote-host gluster04
781:     option remote-subvolume /mnt/disk10/vmware2
782:     option transport-type socket
783:     option transport.address-family inet
784:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
785:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
786:     option filter-O_DIRECT enable
787:     option event-threads 2
788: end-volume
789:  
790: volume vmware2-replicate-19
791:     type cluster/replicate
792:     option data-self-heal off
793:     option metadata-self-heal off
794:     option entry-self-heal off
795:     option data-self-heal-algorithm full
796:     option eager-lock enable
797:     option favorite-child-policy size
798:     subvolumes vmware2-client-38 vmware2-client-39
799: end-volume
800:  
801: volume vmware2-client-40
802:     type protocol/client
803:     option clnt-lk-version 1
804:     option volfile-checksum 0
805:     option volfile-key rebalance/vmware2
806:     option client-version 3.8.10
807:     option process-uuid gluster01-25236-2017/03/17-14:00:47:99346-vmware2-client-40-0-0
808:     option fops-version 1298437
809:     option ping-timeout 5
810:     option remote-host gluster01
811:     option remote-subvolume /mnt/disk11/vmware2
812:     option transport-type socket
813:     option transport.address-family inet
814:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
815:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
816:     option filter-O_DIRECT enable
817:     option event-threads 2
818: end-volume
819:  
820: volume vmware2-client-41
821:     type protocol/client
822:     option ping-timeout 5
823:     option remote-host gluster03
824:     option remote-subvolume /mnt/disk11/vmware2
825:     option transport-type socket
826:     option transport.address-family inet
827:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
828:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
829:     option filter-O_DIRECT enable
830:     option event-threads 2
831: end-volume
832:  
833: volume vmware2-replicate-20
834:     type cluster/replicate
835:     option data-self-heal off
836:     option metadata-self-heal off
837:     option entry-self-heal off
838:     option data-self-heal-algorithm full
839:     option eager-lock enable
840:     option favorite-child-policy size
841:     subvolumes vmware2-client-40 vmware2-client-41
842: end-volume
843:  
844: volume vmware2-client-42
845:     type protocol/client
846:     option ping-timeout 5
847:     option remote-host gluster02
848:     option remote-subvolume /mnt/disk11/vmware2
849:     option transport-type socket
850:     option transport.address-family inet
851:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
852:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
853:     option filter-O_DIRECT enable
854:     option event-threads 2
855: end-volume
856:  
857: volume vmware2-client-43
858:     type protocol/client
859:     option ping-timeout 5
860:     option remote-host gluster04
861:     option remote-subvolume /mnt/disk11/vmware2
862:     option transport-type socket
863:     option transport.address-family inet
864:     option username 3a215959-1d65-4907-bf78-c3ac81a3e744
865:     option password e2a2a9b6-b3fc-4783-9540-facce887713a
866:     option filter-O_DIRECT enable
867:     option event-threads 2
868: end-volume
869:  
870: volume vmware2-replicate-21
871:     type cluster/replicate
872:     option data-self-heal off
873:     option metadata-self-heal off
874:     option entry-self-heal off
875:     option data-self-heal-algorithm full
876:     option eager-lock enable
877:     option favorite-child-policy size
878:     subvolumes vmware2-client-42 vmware2-client-43
879: end-volume
880:  
881: volume vmware2-dht
882:     type cluster/distribute
883:     option use-readdirp yes
884:     option lookup-unhashed yes
885:     option assert-no-child-down yes
886:     option readdir-optimize on
887:     option rebalance-cmd 1
888:     option node-uuid f15808d9-ab37-4126-b4e4-1d14011e4e0f
889:     option commit-hash 3328139388
890:     option lock-migration off
891:     subvolumes vmware2-replicate-0 vmware2-replicate-1 vmware2-replicate-2 vmware2-replicate-3 vmware2-replicate-4 vmware2-replicate-5 vmware2-replicate-6 vmware2-replicate-7 vmware2-replicate-8 vmware2-replicate-9 vmware2-replicate-10 vmware2-replicate-11 vmware2-replicate-12 vmware2-replicate-13 vmware2-replicate-14 vmware2-replicate-15 vmware2-replicate-16 vmware2-replicate-17 vmware2-replicate-18 vmware2-replicate-19 vmware2-replicate-20 vmware2-replicate-21
892: end-volume
893:  
894: volume vmware2
895:     type debug/io-stats
896:     option log-level INFO
897:     option latency-measurement off
898:     option count-fop-hits off
899:     subvolumes vmware2-dht
900: end-volume
901:  
+------------------------------------------------------------------------------+
[2017-03-17 14:00:57.111871] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-1: changing port to 49489 (from 0)
[2017-03-17 14:00:57.112185] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-5: changing port to 49490 (from 0)
[2017-03-17 14:00:57.112242] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-3: changing port to 49385 (from 0)
[2017-03-17 14:00:57.121825] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-9: changing port to 49491 (from 0)
[2017-03-17 14:00:57.121919] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-2: changing port to 49414 (from 0)
[2017-03-17 14:00:57.121953] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-13: changing port to 49492 (from 0)
[2017-03-17 14:00:57.122934] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-17: changing port to 49493 (from 0)
[2017-03-17 14:00:57.134745] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-7: changing port to 49386 (from 0)
[2017-03-17 14:00:57.134824] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-21: changing port to 49494 (from 0)
[2017-03-17 14:00:57.134858] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-25: changing port to 49495 (from 0)
[2017-03-17 14:00:57.134881] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-6: changing port to 49415 (from 0)
[2017-03-17 14:00:57.134903] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-29: changing port to 49496 (from 0)
[2017-03-17 14:00:57.134925] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-33: changing port to 49497 (from 0)
[2017-03-17 14:00:57.134948] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-11: changing port to 49387 (from 0)
[2017-03-17 14:00:57.134969] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-10: changing port to 49416 (from 0)
[2017-03-17 14:00:57.134990] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-37: changing port to 49498 (from 0)
[2017-03-17 14:00:57.135012] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-14: changing port to 49417 (from 0)
[2017-03-17 14:00:57.135035] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-15: changing port to 49388 (from 0)
[2017-03-17 14:00:57.135069] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-18: changing port to 49418 (from 0)
[2017-03-17 14:00:57.135092] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-19: changing port to 49389 (from 0)
[2017-03-17 14:00:57.135113] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-22: changing port to 49419 (from 0)
[2017-03-17 14:00:57.135136] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-41: changing port to 49500 (from 0)
[2017-03-17 14:00:57.135158] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-26: changing port to 49420 (from 0)
[2017-03-17 14:00:57.135184] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-23: changing port to 49390 (from 0)
[2017-03-17 14:00:57.135220] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-27: changing port to 49391 (from 0)
[2017-03-17 14:00:57.135250] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-30: changing port to 49421 (from 0)
[2017-03-17 14:00:57.135272] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-31: changing port to 49392 (from 0)
[2017-03-17 14:00:57.135294] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-34: changing port to 49422 (from 0)
[2017-03-17 14:00:57.135317] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-38: changing port to 49423 (from 0)
[2017-03-17 14:00:57.135338] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-35: changing port to 49393 (from 0)
[2017-03-17 14:00:57.135359] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-42: changing port to 49425 (from 0)
[2017-03-17 14:00:57.135381] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-39: changing port to 49394 (from 0)
[2017-03-17 14:00:57.135406] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-vmware2-client-43: changing port to 49395 (from 0)
[2017-03-17 14:00:57.139245] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.139360] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.236491] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.236566] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.236614] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.236678] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-5: Connected to vmware2-client-5, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 14:00:57.236689] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.236860] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-1: Connected to vmware2-client-1, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 14:00:57.236897] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.237433] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-13: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.237491] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-5: Server lk version = 1
[2017-03-17 14:00:57.237509] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-1: Server lk version = 1
[2017-03-17 14:00:57.237557] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-3: Connected to vmware2-client-3, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 14:00:57.237576] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.237610] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-1: Subvolume 'vmware2-client-3' came back up; going online.
[2017-03-17 14:00:57.237647] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-9: Connected to vmware2-client-9, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 14:00:57.237657] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.237750] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.237813] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-2: Connected to vmware2-client-2, attached to remote volume '/mnt/disk1/vmware2'.
[2017-03-17 14:00:57.237829] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.237946] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-21: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238018] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-17: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238065] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-25: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238125] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238164] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-11: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238206] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-29: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238244] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-10: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238282] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-33: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238318] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-37: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238361] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-15: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238399] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-14: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238435] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-18: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238476] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-22: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238514] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-23: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238569] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-41: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238621] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-26: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238666] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-27: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238706] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-19: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238742] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-30: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238791] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-34: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238837] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-38: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238874] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-31: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238911] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-42: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.238953] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-39: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.239008] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-35: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.239044] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-3: Server lk version = 1
[2017-03-17 14:00:57.239058] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-9: Server lk version = 1
[2017-03-17 14:00:57.239091] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-13: Connected to vmware2-client-13, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 14:00:57.239100] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-13: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239208] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-2: Server lk version = 1
[2017-03-17 14:00:57.239247] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-7: Connected to vmware2-client-7, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 14:00:57.239263] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239304] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-3: Subvolume 'vmware2-client-7' came back up; going online.
[2017-03-17 14:00:57.239334] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-21: Connected to vmware2-client-21, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 14:00:57.239342] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-21: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239435] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-17: Connected to vmware2-client-17, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 14:00:57.239447] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-17: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239540] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-6: Connected to vmware2-client-6, attached to remote volume '/mnt/disk2/vmware2'.
[2017-03-17 14:00:57.239559] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239654] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-25: Connected to vmware2-client-25, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 14:00:57.239673] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-25: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239684] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-11: Connected to vmware2-client-11, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 14:00:57.239709] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-11: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239774] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-5: Subvolume 'vmware2-client-11' came back up; going online.
[2017-03-17 14:00:57.239803] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-29: Connected to vmware2-client-29, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 14:00:57.239830] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-29: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239834] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-10: Connected to vmware2-client-10, attached to remote volume '/mnt/disk3/vmware2'.
[2017-03-17 14:00:57.239847] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-10: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239940] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-33: Connected to vmware2-client-33, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 14:00:57.239956] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-33: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.239993] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-37: Connected to vmware2-client-37, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 14:00:57.240007] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-37: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240057] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-15: Connected to vmware2-client-15, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 14:00:57.240069] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-15: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240102] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-7: Subvolume 'vmware2-client-15' came back up; going online.
[2017-03-17 14:00:57.240114] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-14: Connected to vmware2-client-14, attached to remote volume '/mnt/disk4/vmware2'.
[2017-03-17 14:00:57.240127] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-14: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240128] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-18: Connected to vmware2-client-18, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 14:00:57.240139] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-18: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240209] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-9: Subvolume 'vmware2-client-18' came back up; going online.
[2017-03-17 14:00:57.240233] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-23: Connected to vmware2-client-23, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 14:00:57.240247] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-23: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240253] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-22: Connected to vmware2-client-22, attached to remote volume '/mnt/disk6/vmware2'.
[2017-03-17 14:00:57.240264] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-22: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240285] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-11: Subvolume 'vmware2-client-23' came back up; going online.
[2017-03-17 14:00:57.240321] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-41: Connected to vmware2-client-41, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 14:00:57.240330] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-41: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240426] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-26: Connected to vmware2-client-26, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 14:00:57.240430] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-27: Connected to vmware2-client-27, attached to remote volume '/mnt/disk7/vmware2'.
[2017-03-17 14:00:57.240451] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-26: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240459] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-27: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240501] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-13: Subvolume 'vmware2-client-26' came back up; going online.
[2017-03-17 14:00:57.240537] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-30: Connected to vmware2-client-30, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 14:00:57.240545] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-30: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240570] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-19: Connected to vmware2-client-19, attached to remote volume '/mnt/disk5/vmware2'.
[2017-03-17 14:00:57.240577] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-15: Subvolume 'vmware2-client-30' came back up; going online.
[2017-03-17 14:00:57.240584] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-19: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240607] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-13: Server lk version = 1
[2017-03-17 14:00:57.240631] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-34: Connected to vmware2-client-34, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 14:00:57.240639] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-34: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240672] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-17: Subvolume 'vmware2-client-34' came back up; going online.
[2017-03-17 14:00:57.240684] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-38: Connected to vmware2-client-38, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 14:00:57.240699] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-39: Connected to vmware2-client-39, attached to remote volume '/mnt/disk10/vmware2'.
[2017-03-17 14:00:57.240699] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-38: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240722] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-39: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240772] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-19: Subvolume 'vmware2-client-39' came back up; going online.
[2017-03-17 14:00:57.240817] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-31: Connected to vmware2-client-31, attached to remote volume '/mnt/disk8/vmware2'.
[2017-03-17 14:00:57.240826] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-31: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240872] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-42: Connected to vmware2-client-42, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 14:00:57.240891] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-42: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240910] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-7: Server lk version = 1
[2017-03-17 14:00:57.240929] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-vmware2-replicate-21: Subvolume 'vmware2-client-42' came back up; going online.
[2017-03-17 14:00:57.240945] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-35: Connected to vmware2-client-35, attached to remote volume '/mnt/disk9/vmware2'.
[2017-03-17 14:00:57.240955] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-35: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.240955] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-21: Server lk version = 1
[2017-03-17 14:00:57.240978] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-17: Server lk version = 1
[2017-03-17 14:00:57.241033] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-6: Server lk version = 1
[2017-03-17 14:00:57.241040] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-25: Server lk version = 1
[2017-03-17 14:00:57.241053] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-11: Server lk version = 1
[2017-03-17 14:00:57.241075] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-10: Server lk version = 1
[2017-03-17 14:00:57.241086] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-29: Server lk version = 1
[2017-03-17 14:00:57.241094] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-33: Server lk version = 1
[2017-03-17 14:00:57.241118] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-37: Server lk version = 1
[2017-03-17 14:00:57.241132] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-15: Server lk version = 1
[2017-03-17 14:00:57.241145] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-14: Server lk version = 1
[2017-03-17 14:00:57.241160] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-18: Server lk version = 1
[2017-03-17 14:00:57.241161] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-23: Server lk version = 1
[2017-03-17 14:00:57.241189] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-22: Server lk version = 1
[2017-03-17 14:00:57.241211] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-41: Server lk version = 1
[2017-03-17 14:00:57.241224] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-27: Server lk version = 1
[2017-03-17 14:00:57.241230] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-26: Server lk version = 1
[2017-03-17 14:00:57.241255] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-30: Server lk version = 1
[2017-03-17 14:00:57.241262] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-19: Server lk version = 1
[2017-03-17 14:00:57.241269] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-34: Server lk version = 1
[2017-03-17 14:00:57.241280] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-39: Server lk version = 1
[2017-03-17 14:00:57.241285] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-38: Server lk version = 1
[2017-03-17 14:00:57.241301] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-31: Server lk version = 1
[2017-03-17 14:00:57.241313] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-42: Server lk version = 1
[2017-03-17 14:00:57.241348] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-vmware2-client-43: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-03-17 14:00:57.241379] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-35: Server lk version = 1
[2017-03-17 14:00:57.241771] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-vmware2-client-43: Connected to vmware2-client-43, attached to remote volume '/mnt/disk11/vmware2'.
[2017-03-17 14:00:57.241795] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-vmware2-client-43: Server and Client lk-version numbers are not same, reopening the fds
[2017-03-17 14:00:57.241962] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-vmware2-client-43: Server lk version = 1
[2017-03-17 14:00:57.256058] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-0: selecting local read_child vmware2-client-0
[2017-03-17 14:00:57.256168] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-2: selecting local read_child vmware2-client-4
[2017-03-17 14:00:57.256525] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-4: selecting local read_child vmware2-client-8
[2017-03-17 14:00:57.256618] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-6: selecting local read_child vmware2-client-12
[2017-03-17 14:00:57.257034] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-8: selecting local read_child vmware2-client-16
[2017-03-17 14:00:57.257535] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-10: selecting local read_child vmware2-client-20
[2017-03-17 14:00:57.257644] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-12: selecting local read_child vmware2-client-24
[2017-03-17 14:00:57.257777] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-14: selecting local read_child vmware2-client-28
[2017-03-17 14:00:57.257876] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-16: selecting local read_child vmware2-client-32
[2017-03-17 14:00:57.257939] I [dht-rebalance.c:3668:gf_defrag_start_crawl] 0-vmware2-dht: gf_defrag_start_crawl using commit hash 3328139388
[2017-03-17 14:00:57.257954] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-18: selecting local read_child vmware2-client-36
[2017-03-17 14:00:57.257990] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-vmware2-replicate-20: selecting local read_child vmware2-client-40
[2017-03-17 14:00:57.261066] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /
[2017-03-17 14:00:57.275828] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-0
[2017-03-17 14:00:57.275859] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-2
[2017-03-17 14:00:57.275871] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-6
[2017-03-17 14:00:57.275880] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-4
[2017-03-17 14:00:57.275889] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-8
[2017-03-17 14:00:57.275897] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-10
[2017-03-17 14:00:57.275906] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-12
[2017-03-17 14:00:57.275915] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-14
[2017-03-17 14:00:57.275923] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-16
[2017-03-17 14:00:57.275931] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-18
[2017-03-17 14:00:57.275939] I [MSGID: 0] [dht-rebalance.c:3746:gf_defrag_start_crawl] 0-vmware2-dht: local subvols are vmware2-replicate-20
[2017-03-17 14:00:57.276029] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[0] creation successful
[2017-03-17 14:00:57.276093] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[1] creation successful
[2017-03-17 14:00:57.276104] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 43
[2017-03-17 14:00:57.276154] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[2] creation successful
[2017-03-17 14:00:57.276200] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 42
[2017-03-17 14:00:57.276253] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[3] creation successful
[2017-03-17 14:00:57.276266] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 41
[2017-03-17 14:00:57.278469] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[4] creation successful
[2017-03-17 14:00:57.278544] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 40
[2017-03-17 14:00:57.278563] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[5] creation successful
[2017-03-17 14:00:57.278634] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[6] creation successful
[2017-03-17 14:00:57.278650] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 39
[2017-03-17 14:00:57.278677] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[7] creation successful
[2017-03-17 14:00:57.278750] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[8] creation successful
[2017-03-17 14:00:57.278748] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 38
[2017-03-17 14:00:57.278795] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[9] creation successful
[2017-03-17 14:00:57.278831] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[10] creation successful
[2017-03-17 14:00:57.278873] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 37
[2017-03-17 14:00:57.279626] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[11] creation successful
[2017-03-17 14:00:57.279708] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[12] creation successful
[2017-03-17 14:00:57.279701] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 36
[2017-03-17 14:00:57.279758] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[13] creation successful
[2017-03-17 14:00:57.279825] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[14] creation successful
[2017-03-17 14:00:57.279842] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 35
[2017-03-17 14:00:57.279871] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[15] creation successful
[2017-03-17 14:00:57.279920] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 34
[2017-03-17 14:00:57.279948] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[16] creation successful
[2017-03-17 14:00:57.279977] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 33
[2017-03-17 14:00:57.280026] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[17] creation successful
[2017-03-17 14:00:57.280053] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 32
[2017-03-17 14:00:57.282730] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[18] creation successful
[2017-03-17 14:00:57.282742] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 31
[2017-03-17 14:00:57.282797] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[19] creation successful
[2017-03-17 14:00:57.282857] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 30
[2017-03-17 14:00:57.282876] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[20] creation successful
[2017-03-17 14:00:57.282918] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[21] creation successful
[2017-03-17 14:00:57.282986] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 29
[2017-03-17 14:00:57.282997] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[22] creation successful
[2017-03-17 14:00:57.283033] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 28
[2017-03-17 14:00:57.283049] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[23] creation successful
[2017-03-17 14:00:57.283094] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[24] creation successful
[2017-03-17 14:00:57.284871] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[25] creation successful
[2017-03-17 14:00:57.284937] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 27
[2017-03-17 14:00:57.284955] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[26] creation successful
[2017-03-17 14:00:57.285052] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[27] creation successful
[2017-03-17 14:00:57.285054] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 26
[2017-03-17 14:00:57.285087] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[28] creation successful
[2017-03-17 14:00:57.285097] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 25
[2017-03-17 14:00:57.285120] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[29] creation successful
[2017-03-17 14:00:57.285188] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[30] creation successful
[2017-03-17 14:00:57.285191] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 24
[2017-03-17 14:00:57.285222] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[31] creation successful
[2017-03-17 14:00:57.285254] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 23
[2017-03-17 14:00:57.287009] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[32] creation successful
[2017-03-17 14:00:57.287081] I [dht-rebalance.c:2235:gf_defrag_task] 0-DHT: Thread sleeping. defrag->current_thread_count: 22
[2017-03-17 14:00:57.287100] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[33] creation successful
[2017-03-17 14:00:57.287173] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[34] creation successful
[2017-03-17 14:00:57.287205] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[35] creation successful
[2017-03-17 14:00:57.287237] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[36] creation successful
[2017-03-17 14:00:57.287279] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[37] creation successful
[2017-03-17 14:00:57.287311] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[38] creation successful
[2017-03-17 14:00:57.288818] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[39] creation successful
[2017-03-17 14:00:57.288862] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[40] creation successful
[2017-03-17 14:00:57.288891] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[41] creation successful
[2017-03-17 14:00:57.288925] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[42] creation successful
[2017-03-17 14:00:57.288963] I [dht-rebalance.c:3791:gf_defrag_start_crawl] 0-DHT: Thread[43] creation successful
[2017-03-17 14:00:57.289725] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-3; inode layout - 1366580502 - 1561806287 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 14:00:57.289761] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 14:00:57.290016] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 1757032074 - 1952257859 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 14:00:57.290045] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 14:00:57.290117] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 1952257860 - 2147483645 - 1; disk layout - 1366580502 - 1561806287 - 1
[2017-03-17 14:00:57.290149] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 14:00:57.290235] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 2147483646 - 2342709431 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 14:00:57.290261] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 14:00:57.290617] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 195225786 - 390451571 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 14:00:57.290648] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 14:00:57.290888] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-14; inode layout - 585677358 - 780903143 - 1; disk layout - 2147483646 - 2342709431 - 1
[2017-03-17 14:00:57.290928] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /, gfid = 00000000-0000-0000-0000-000000000001
[2017-03-17 14:00:57.293821] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /
[2017-03-17 14:00:57.303685] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.lck-2c739d20965fb485: attempting to move from vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 14:00:57.310550] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir / took 0.02 secs
[2017-03-17 14:00:57.315721] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan
[2017-03-17 14:00:57.323399] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.lck-2c739d20965fb485 from subvolume vmware2-replicate-8 to vmware2-replicate-19
[2017-03-17 14:00:57.329303] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 2733161004 - 2928386789 - 1; disk layout - 976128930 - 1171354715 - 1
[2017-03-17 14:00:57.329328] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 14:00:57.329747] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 585677358 - 780903143 - 1; disk layout - 3318838362 - 3514064147 - 1
[2017-03-17 14:00:57.329787] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 14:00:57.329845] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 976128930 - 1171354715 - 1; disk layout - 2537935218 - 2733161003 - 1
[2017-03-17 14:00:57.329855] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 14:00:57.330062] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 2537935218 - 2733161003 - 1; disk layout - 2733161004 - 2928386789 - 1
[2017-03-17 14:00:57.330092] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 14:00:57.330316] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-19; inode layout - 3318838362 - 3514064147 - 1; disk layout - 585677358 - 780903143 - 1
[2017-03-17 14:00:57.330344] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.trashcan, gfid = 00000000-0000-0000-0000-000000000005
[2017-03-17 14:00:57.332104] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan
[2017-03-17 14:00:57.341284] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan took 0.01 secs
[2017-03-17 14:00:57.345242] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.trashcan/internal_op
[2017-03-17 14:00:57.360609] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.trashcan/internal_op
[2017-03-17 14:00:57.369177] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.trashcan/internal_op took 0.01 secs
[2017-03-17 14:00:57.389035] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.shard
[2017-03-17 14:00:57.402730] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-0; inode layout - 1561806288 - 1757032073 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 14:00:57.402755] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 14:00:57.402846] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-2; inode layout - 2928386790 - 3123612575 - 1; disk layout - 0 - 195225785 - 1
[2017-03-17 14:00:57.402863] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 14:00:57.403100] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-7; inode layout - 3904515720 - 4099741505 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 14:00:57.403138] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 14:00:57.403155] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 0 - 195225785 - 1; disk layout - 2928386790 - 3123612575 - 1
[2017-03-17 14:00:57.403180] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 14:00:57.403373] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 3709289934 - 3904515719 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 14:00:57.403388] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 14:00:57.403885] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-17; inode layout - 1757032074 - 1952257859 - 1; disk layout - 1561806288 - 1757032073 - 1
[2017-03-17 14:00:57.403931] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.shard, gfid = be318638-e8a0-4c6d-977d-7a937aa84806
[2017-03-17 14:00:57.405704] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.shard
[2017-03-17 14:00:57.420024] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.16: attempting to move from vmware2-replicate-0 to vmware2-replicate-17
[2017-03-17 14:00:57.425177] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/e25db064-7223-4fa4-b0ad-71158c5f11a2.16) } would result in dst node (vmware2-replicate-17:1862337120) having lower disk space then the source node (vmware2-replicate-0:1867055968).Skipping file.
[2017-03-17 14:00:57.428839] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.154: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:00:57.454066] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.44: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 14:00:57.461226] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.44) } would result in dst node (vmware2-replicate-5:1868628848) having lower disk space then the source node (vmware2-replicate-6:1868632944).Skipping file.
[2017-03-17 14:00:57.473751] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.33: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.479546] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.3: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.482113] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.3: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 14:00:57.489939] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.3) } would result in dst node (vmware2-replicate-11:1866531472) having lower disk space then the source node (vmware2-replicate-10:1866011416).Skipping file.
[2017-03-17 14:00:57.499069] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.53: attempting to move from vmware2-replicate-12 to vmware2-replicate-7
[2017-03-17 14:00:57.508357] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.53) } would result in dst node (vmware2-replicate-7:1866006552) having lower disk space then the source node (vmware2-replicate-12:1864962992).Skipping file.
[2017-03-17 14:00:57.513956] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.55: attempting to move from vmware2-replicate-14 to vmware2-replicate-3
[2017-03-17 14:00:57.522481] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.55) } would result in dst node (vmware2-replicate-3:1868628848) having lower disk space then the source node (vmware2-replicate-14:1867584424).Skipping file.
[2017-03-17 14:00:57.529008] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.132: attempting to move from vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 14:00:57.535776] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.544046] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.24) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.545298] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.14: attempting to move from vmware2-replicate-0 to vmware2-replicate-17
[2017-03-17 14:00:57.553172] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/ce032b39-fc21-4732-a146-ca21828b56f0.14) } would result in dst node (vmware2-replicate-17:1862337120) having lower disk space then the source node (vmware2-replicate-0:1867055968).Skipping file.
[2017-03-17 14:00:57.561346] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.50: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:00:57.565084] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.64: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 14:00:57.569351] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.103: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.574045] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.64) } would result in dst node (vmware2-replicate-5:1868628848) having lower disk space then the source node (vmware2-replicate-6:1868632944).Skipping file.
[2017-03-17 14:00:57.576337] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.16: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.600748] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.17: attempting to move from vmware2-replicate-10 to vmware2-replicate-11
[2017-03-17 14:00:57.610835] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/ce032b39-fc21-4732-a146-ca21828b56f0.17) } would result in dst node (vmware2-replicate-11:1866531472) having lower disk space then the source node (vmware2-replicate-10:1866011416).Skipping file.
[2017-03-17 14:00:57.619713] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.44: attempting to move from vmware2-replicate-12 to vmware2-replicate-7
[2017-03-17 14:00:57.630691] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/ce032b39-fc21-4732-a146-ca21828b56f0.44) } would result in dst node (vmware2-replicate-7:1866006552) having lower disk space then the source node (vmware2-replicate-12:1864962992).Skipping file.
[2017-03-17 14:00:57.664666] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27: attempting to move from vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 14:00:57.677090] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.8: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.687832] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.51: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:00:57.687887] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.8) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.693454] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.73: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 14:00:57.698692] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.111: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.705385] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.73) } would result in dst node (vmware2-replicate-5:1868628848) having lower disk space then the source node (vmware2-replicate-6:1868632944).Skipping file.
[2017-03-17 14:00:57.707408] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.92: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.720873] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.41: attempting to move from vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 14:00:57.722413] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.21: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.729137] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.62: attempting to move from vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:00:57.735989] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16: attempting to move from vmware2-replicate-6 to vmware2-replicate-5
[2017-03-17 14:00:57.736875] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.21) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.742038] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.147: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.751823] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.753298] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.16) } would result in dst node (vmware2-replicate-5:1868628848) having lower disk space then the source node (vmware2-replicate-6:1868632944).Skipping file.
[2017-03-17 14:00:57.774359] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.63: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.795188] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.63) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.797590] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.9: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.806305] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.13: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.811189] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.146: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.822517] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.48: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.831127] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.146) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.833187] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.80: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.848683] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.859129] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.55: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:57.867263] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.38: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:57.869486] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:0 name:(/.shard/877544d3-d928-4888-a9f0-ec9ec307affb.63) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.876124] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.31: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:57.901301] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.31) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1867060264).Skipping file.
[2017-03-17 14:00:57.910434] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.8: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:58.086769] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.shard took 0.68 secs
[2017-03-17 14:00:58.184829] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /.iorm.sf
[2017-03-17 14:00:58.231820] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 1952257860 - 2147483645 - 1; disk layout - 1757032074 - 1952257859 - 1
[2017-03-17 14:00:58.231850] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.iorm.sf, gfid = 9d7fdd1e-939a-4175-a3e1-702ae8be98b3
[2017-03-17 14:00:58.231959] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 3904515720 - 4099741505 - 1; disk layout - 1952257860 - 2147483645 - 1
[2017-03-17 14:00:58.231975] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.iorm.sf, gfid = 9d7fdd1e-939a-4175-a3e1-702ae8be98b3
[2017-03-17 14:00:58.232163] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-13; inode layout - 1757032074 - 1952257859 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 14:00:58.232178] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /.iorm.sf, gfid = 9d7fdd1e-939a-4175-a3e1-702ae8be98b3
[2017-03-17 14:00:58.243908] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /.iorm.sf
[2017-03-17 14:00:58.280791] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /.iorm.sf took 0.04 secs
[2017-03-17 14:00:58.318136] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine
[2017-03-17 14:00:58.372956] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-16; inode layout - 3904515720 - 4099741505 - 1; disk layout - 1561806288 - 1757032073 - 1
[2017-03-17 14:00:58.372982] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /New Virtual Machine, gfid = 96217db7-a5e3-4a36-8d4a-3f6acce0a3bb
[2017-03-17 14:00:58.374031] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-15; inode layout - 1561806288 - 1757032073 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 14:00:58.374047] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /New Virtual Machine, gfid = 96217db7-a5e3-4a36-8d4a-3f6acce0a3bb
[2017-03-17 14:00:58.382524] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /New Virtual Machine
[2017-03-17 14:00:58.481611] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /New Virtual Machine took 0.10 secs
[2017-03-17 14:00:58.528538] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /Testse
[2017-03-17 14:00:58.586192] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-0; inode layout - 2342709432 - 2537935217 - 1; disk layout - 3709289934 - 3904515719 - 1
[2017-03-17 14:00:58.586218] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.586760] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-4; inode layout - 3709289934 - 3904515719 - 1; disk layout - 2342709432 - 2537935217 - 1
[2017-03-17 14:00:58.586786] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.586857] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-5; inode layout - 3904515720 - 4099741505 - 1; disk layout - 2537935218 - 2733161003 - 1
[2017-03-17 14:00:58.586872] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.587002] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-12; inode layout - 3123612576 - 3318838361 - 1; disk layout - 195225786 - 390451571 - 1
[2017-03-17 14:00:58.587027] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.587123] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-8; inode layout - 195225786 - 390451571 - 1; disk layout - 3123612576 - 3318838361 - 1
[2017-03-17 14:00:58.587137] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.587189] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-9; inode layout - 390451572 - 585677357 - 1; disk layout - 3318838362 - 3514064147 - 1
[2017-03-17 14:00:58.587198] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.587261] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-1; inode layout - 2537935218 - 2733161003 - 1; disk layout - 3904515720 - 4099741505 - 1
[2017-03-17 14:00:58.587272] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.587603] I [MSGID: 109064] [dht-layout.c:837:dht_layout_dir_mismatch] 0-vmware2-dht: subvol: vmware2-replicate-13; inode layout - 3318838362 - 3514064147 - 1; disk layout - 390451572 - 585677357 - 1
[2017-03-17 14:00:58.587614] I [MSGID: 109018] [dht-common.c:1096:dht_revalidate_cbk] 0-vmware2-dht: Mismatching layouts for /Testse, gfid = 378518a9-21fe-4f20-83de-c3e8259be05f
[2017-03-17 14:00:58.595580] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /Testse
[2017-03-17 14:00:58.640333] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /Testse took 0.04 secs
[2017-03-17 14:00:58.668506] I [MSGID: 109081] [dht-common.c:4203:dht_setxattr] 0-vmware2-dht: fixing the layout of /New Virtual Machine 5
[2017-03-17 14:00:58.711733] I [dht-rebalance.c:2652:gf_defrag_process_dir] 0-vmware2-dht: migrate data called on /New Virtual Machine 5
[2017-03-17 14:00:58.746541] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /New Virtual Machine 5/New Virtual Machine 5.vmdk on vmware2-replicate-12 (hashed subvol is vmware2-replicate-19)
[2017-03-17 14:00:58.748521] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /New Virtual Machine 5/New Virtual Machine 5.vmdk
[2017-03-17 14:00:58.773941] I [MSGID: 109045] [dht-common.c:2012:dht_lookup_everywhere_cbk] 0-vmware2-dht: attempting deletion of stale linkfile /New Virtual Machine 5/New Virtual Machine 5.vmx on vmware2-replicate-10 (hashed subvol is vmware2-replicate-3)
[2017-03-17 14:00:58.774758] I [MSGID: 109069] [dht-common.c:1324:dht_lookup_unlink_cbk] 0-vmware2-dht: lookup_unlink returned with op_ret -> 0 and op-errno -> 0 for /New Virtual Machine 5/New Virtual Machine 5.vmx
[2017-03-17 14:00:58.812380] E [MSGID: 109023] [dht-rebalance.c:2463:gf_defrag_get_entry] 0-vmware2-dht: Migrate file failed:/New Virtual Machine 5/New Virtual Machine 5.vmx lookup failed
[2017-03-17 14:00:58.816469] I [dht-rebalance.c:2866:gf_defrag_process_dir] 0-vmware2-dht: Migration operation on dir /New Virtual Machine 5 took 0.10 secs
[2017-03-17 14:00:58.867802] I [dht-rebalance.c:3838:gf_defrag_start_crawl] 0-DHT: crawling file-system completed
[2017-03-17 14:00:58.867846] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 23
[2017-03-17 14:00:58.867902] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 24
[2017-03-17 14:00:58.867967] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 25
[2017-03-17 14:00:58.868016] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 26
[2017-03-17 14:00:58.868049] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 27
[2017-03-17 14:00:58.868105] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 28
[2017-03-17 14:00:58.868155] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 29
[2017-03-17 14:00:58.868188] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 30
[2017-03-17 14:00:58.868222] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 31
[2017-03-17 14:00:58.868386] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 32
[2017-03-17 14:00:58.868412] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 33
[2017-03-17 14:00:58.868461] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 34
[2017-03-17 14:00:58.868479] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 35
[2017-03-17 14:00:58.868501] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 36
[2017-03-17 14:00:58.868522] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 37
[2017-03-17 14:00:58.868553] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 38
[2017-03-17 14:00:58.868583] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 39
[2017-03-17 14:00:58.868614] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 40
[2017-03-17 14:00:58.868679] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 41
[2017-03-17 14:00:58.868725] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 42
[2017-03-17 14:00:58.868773] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 43
[2017-03-17 14:00:58.868852] I [dht-rebalance.c:2246:gf_defrag_task] 0-DHT: Thread wokeup. defrag->current_thread_count: 44
[2017-03-17 14:00:58.871343] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.23: attempting to move from vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:00:58.871393] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.21: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:58.871680] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine 5/.lck-e5e4e1401348bcb0: attempting to move from vmware2-replicate-2 to vmware2-replicate-12
[2017-03-17 14:00:58.871743] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/.lck-9219333f56b36b9c: attempting to move from vmware2-replicate-0 to vmware2-replicate-20
[2017-03-17 14:00:58.871889] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.6: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:58.872336] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.31: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:58.872742] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine 5/New Virtual Machine 5.vmx: attempting to move from vmware2-replicate-14 to vmware2-replicate-3
[2017-03-17 14:00:58.872750] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/New Virtual Machine.vmdk: attempting to move from vmware2-replicate-12 to vmware2-replicate-11
[2017-03-17 14:00:58.872885] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine/.lck-650d7f98b8400d84: attempting to move from vmware2-replicate-8 to vmware2-replicate-13
[2017-03-17 14:00:58.872902] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine 5/vmware.log: attempting to move from vmware2-replicate-10 to vmware2-replicate-17
[2017-03-17 14:00:58.873199] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:58.874019] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.55: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:58.875153] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.17: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:58.875279] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.40: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:58.875386] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.16: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:58.875533] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine 5/New Virtual Machine 5.vmdk: attempting to move from vmware2-replicate-10 to vmware2-replicate-19
[2017-03-17 14:00:58.875784] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.102: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:58.875977] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.43: attempting to move from vmware2-replicate-18 to vmware2-replicate-19
[2017-03-17 14:00:58.876114] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.135: attempting to move from vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:00:58.876248] I [dht-rebalance.c:1230:dht_migrate_file] 0-vmware2-dht: /New Virtual Machine 5/vmx-New Virtual Machine 5-1409594196-1.vswp: attempting to move from vmware2-replicate-12 to vmware2-replicate-19
[2017-03-17 14:00:58.914254] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.6) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1866928024).Skipping file.
[2017-03-17 14:00:58.917110] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:330 name:(/New Virtual Machine 5/vmware.log) } would result in dst node (vmware2-replicate-17:1862337120) having lower disk space then the source node (vmware2-replicate-10:1866011416).Skipping file.
[2017-03-17 14:00:58.917634] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.31) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1866927768).Skipping file.
[2017-03-17 14:00:58.919185] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:2 name:(/New Virtual Machine 5/New Virtual Machine 5.vmdk) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-10:1866011416).Skipping file.
[2017-03-17 14:00:58.921106] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/5394ac3a-ece1-4f08-b14a-b0c7d90d6a35.63) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1866927248).Skipping file.
[2017-03-17 14:00:58.921504] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/ce032b39-fc21-4732-a146-ca21828b56f0.16) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1866926872).Skipping file.
[2017-03-17 14:00:58.922198] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.17) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1866927128).Skipping file.
[2017-03-17 14:00:58.923309] W [MSGID: 109023] [dht-rebalance.c:737:__dht_check_free_space] 0-vmware2-dht: data movement of file {blocks:524288 name:(/.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.43) } would result in dst node (vmware2-replicate-19:1866006760) having lower disk space then the source node (vmware2-replicate-18:1866926736).Skipping file.
[2017-03-17 14:00:58.973939] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine 5/.lck-e5e4e1401348bcb0 from subvolume vmware2-replicate-2 to vmware2-replicate-12
[2017-03-17 14:00:58.981594] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine 5/vmx-New Virtual Machine 5-1409594196-1.vswp from subvolume vmware2-replicate-12 to vmware2-replicate-19
[2017-03-17 14:00:58.984517] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/.lck-9219333f56b36b9c from subvolume vmware2-replicate-0 to vmware2-replicate-20
[2017-03-17 14:00:58.986168] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/New Virtual Machine.vmdk from subvolume vmware2-replicate-12 to vmware2-replicate-11
[2017-03-17 14:00:58.986627] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine 5/New Virtual Machine 5.vmx from subvolume vmware2-replicate-14 to vmware2-replicate-3
[2017-03-17 14:00:58.990099] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /New Virtual Machine/.lck-650d7f98b8400d84 from subvolume vmware2-replicate-8 to vmware2-replicate-13
[2017-03-17 14:01:00.905742] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-glusterfs: Rebalance is in progress. Time taken is 3.00 secs
[2017-03-17 14:01:00.905760] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated: 7, size: 3620, lookups: 299, failures: 0, skipped: 26
[2017-03-17 14:01:05.207061] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.132 from subvolume vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 14:01:05.234391] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.154 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:01:05.913397] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.27 from subvolume vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 14:01:05.952422] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.50 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:01:06.334803] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.41 from subvolume vmware2-replicate-16 to vmware2-replicate-1
[2017-03-17 14:01:06.334882] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.51 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:01:07.058446] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.62 from subvolume vmware2-replicate-2 to vmware2-replicate-15
[2017-03-17 14:01:11.307569] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.33 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:11.527690] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.3 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:11.916992] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.103 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.260849] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.16 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:12.264936] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.111 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.453655] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.147 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.453896] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.9 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.820815] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.92 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:12.821959] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.48 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.824235] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.55 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.824305] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.8 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:12.922748] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/b078f284-e074-4be5-a2f9-6187e2fe9eb1.49 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:13.215884] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.23 from subvolume vmware2-replicate-4 to vmware2-replicate-20
[2017-03-17 14:01:13.580483] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.13 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:13.959352] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.80 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:14.038903] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/de789e92-1bc2-430f-a1db-c118a3b70a27.38 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:17.490866] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.102 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:17.492926] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.40 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:17.493485] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.21 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:18.388628] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/ce032b39-fc21-4732-a146-ca21828b56f0.55 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:18.460812] I [MSGID: 109022] [dht-rebalance.c:1703:dht_migrate_file] 0-vmware2-dht: completed migration of /.shard/7ae534a9-a215-43ea-99d4-c3d17fa3bb06.135 from subvolume vmware2-replicate-8 to vmware2-replicate-21
[2017-03-17 14:01:18.462390] I [MSGID: 109028] [dht-rebalance.c:4079:gf_defrag_status_get] 0-vmware2-dht: Rebalance is completed. Time taken is 21.00 secs
[2017-03-17 14:01:18.462430] I [MSGID: 109028] [dht-rebalance.c:4083:gf_defrag_status_get] 0-vmware2-dht: Files migrated: 35, size: 7516196388, lookups: 299, failures: 0, skipped: 26
[2017-03-17 14:01:18.462698] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f9d480f3dc5] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xe5) [0x7f9d49785cd5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b) [0x7f9d49785b4b] ) 0-: received signum (15), shutting down

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users