SAMBA VFS module for GlusterFS crashes

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

I'm trying to set up a SAMBA server serving a GlusterFS volume.
Everything works fine if I locally mount the GlusterFS volume (`mount
-t glusterfs ...`) and then serve the mounted FS through SAMBA, but
the performance is slower by a 2x/3x compared to a SAMBA server with a
local ext4 filesystem.

I gather that SAMBA vfs_glusterfs module can give better
performance. However, as soon as I switch SMBD to using GFAPI (`vfs
objects = glusterfs`), the SMBD process crashes leaving a backtrace in
the logs.  I can see no errors in the associated GlusterFS log file
and everything runs fine when locally-mounting.  I am copying below
the share definition, SMBD crash dump from the logs, and the GlusterFS
client logs (produced by the `vfs_glusterfs.so` module in SMBD).

I'm using Ubuntu 16.04.3 with samba package
2:4.3.11+dfsg-0ubuntu0.16.04.12 (I locally recompiled
`samba-vfs-modules` to enable the GlusterFS VFS which is by default
disabled in Ubuntu builds).

Any suggestions on what/where to look?

Alternatively: how to improve the performance of SAMBA over
locally-mounted GlusterFS? right now, I'm getting a 2x to 4x slowdown
compared to SAMBA with local disk.

Thanks for any help!

Riccardo


### share definition from /etc/samba/smb.conf

[archive]
   browsable =yes
   writable = yes
   create mask = 0775
   directory mask = 0775

   guest ok = yes

   vfs objects = glusterfs
   kernel share modes = No

   glusterfs:loglevel = 7
   glusterfs:logfile = /var/log/samba/glusterfs-vol-archive.log
   glusterfs:volfile_server = glusterfs-01
   glusterfs:volume = archive
   path = /


### SMBD crash from SAMBA logs

Dec  5 10:20:13 samba-04 smbd[31932]: [2017/12/05 10:20:13.996199,  0] ../source3/modules/vfs_glusterfs.c:258(vfs_gluster_connect)
Dec  5 10:20:13 samba-04 smbd[31932]:   archive: Initialized volume from server glusterfs-01
Dec  5 10:20:13 samba-04 smbd[31932]: [2017/12/05 10:20:13.999371,  0] ../lib/util/fault.c:78(fault_report)
Dec  5 10:20:13 samba-04 smbd[31932]:   ===============================================================
Dec  5 10:20:14 samba-04 smbd[31932]: [2017/12/05 10:20:14.000042,  0] ../lib/util/fault.c:79(fault_report)
Dec  5 10:20:14 samba-04 smbd[31932]:   INTERNAL ERROR: Signal 6 in pid 31932 (4.3.11-Ubuntu)
Dec  5 10:20:14 samba-04 smbd[31932]:   Please read the Trouble-Shooting section of the Samba HOWTO
Dec  5 10:20:14 samba-04 smbd[31932]: [2017/12/05 10:20:14.000594,  0] ../lib/util/fault.c:81(fault_report)
Dec  5 10:20:14 samba-04 smbd[31932]:   ===============================================================
Dec  5 10:20:14 samba-04 smbd[31932]: [2017/12/05 10:20:14.000954,  0] ../source3/lib/util.c:789(smb_panic_s3)
Dec  5 10:20:14 samba-04 smbd[31932]:   PANIC (pid 31932): internal error
Dec  5 10:20:14 samba-04 smbd[31932]: [2017/12/05 10:20:14.001712,  0] ../source3/lib/util.c:900(log_stack_trace)
Dec  5 10:20:14 samba-04 smbd[31932]:   BACKTRACE: 29 stack frames:
Dec  5 10:20:14 samba-04 smbd[31932]:    #0 /usr/lib/x86_64-linux-gnu/samba/libsmbregistry.so.0(log_stack_trace+0x1a) [0x7f5e8b5427aa]
Dec  5 10:20:14 samba-04 smbd[31932]:    #1 /usr/lib/x86_64-linux-gnu/samba/libsmbregistry.so.0(smb_panic_s3+0x20) [0x7f5e8b542880]
Dec  5 10:20:14 samba-04 smbd[31932]:    #2 /usr/lib/x86_64-linux-gnu/libsamba-util.so.0(smb_panic+0x2f) [0x7f5e8c2b5f1f]
Dec  5 10:20:14 samba-04 smbd[31932]:    #3 /usr/lib/x86_64-linux-gnu/libsamba-util.so.0(+0x1b136) [0x7f5e8c2b6136]
Dec  5 10:20:14 samba-04 smbd[31932]:    #4 /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390) [0x7f5e8c514390]
Dec  5 10:20:14 samba-04 smbd[31932]:    #5 /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38) [0x7f5e88a87428]
Dec  5 10:20:14 samba-04 smbd[31932]:    #6 /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a) [0x7f5e88a8902a]
Dec  5 10:20:14 samba-04 smbd[31932]:    #7 /lib/x86_64-linux-gnu/libc.so.6(+0x777ea) [0x7f5e88ac97ea]
Dec  5 10:20:14 samba-04 smbd[31932]:    #8 /lib/x86_64-linux-gnu/libc.so.6(+0x8037a) [0x7f5e88ad237a]
Dec  5 10:20:14 samba-04 smbd[31932]:    #9 /lib/x86_64-linux-gnu/libc.so.6(cfree+0x4c) [0x7f5e88ad653c]
Dec  5 10:20:14 samba-04 smbd[31932]:    #10 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(+0x117955) [0x7f5e8be88955]
Dec  5 10:20:14 samba-04 smbd[31932]:    #11 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(+0x1188b7) [0x7f5e8be898b7]
Dec  5 10:20:14 samba-04 smbd[31932]:    #12 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(make_connection_smb2+0x62) [0x7f5e8be8a662]
Dec  5 10:20:14 samba-04 smbd[31932]:    #13 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(smbd_smb2_request_process_tcon+0x6ad) [0x7f5e8be9e48d]
Dec  5 10:20:14 samba-04 smbd[31932]:    #14 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(smbd_smb2_request_dispatch+0x974) [0x7f5e8be98bd4]
Dec  5 10:20:14 samba-04 smbd[31932]:    #15 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(+0x1287fb) [0x7f5e8be997fb]
Dec  5 10:20:14 samba-04 smbd[31932]:    #16 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(run_events_poll+0x167) [0x7f5e8a1d5917]
Dec  5 10:20:14 samba-04 smbd[31932]:    #17 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x2cb77) [0x7f5e8a1d5b77]
Dec  5 10:20:14 samba-04 smbd[31932]:    #18 /usr/lib/x86_64-linux-gnu/libtevent.so.0(_tevent_loop_once+0x8d) [0x7f5e88e1fd3d]
Dec  5 10:20:14 samba-04 smbd[31932]:    #19 /usr/lib/x86_64-linux-gnu/libtevent.so.0(tevent_common_loop_wait+0x1b) [0x7f5e88e1fedb]
Dec  5 10:20:14 samba-04 smbd[31932]:    #20 /usr/lib/x86_64-linux-gnu/samba/libsmbd-base.so.0(smbd_process+0x718) [0x7f5e8be88578]
Dec  5 10:20:14 samba-04 smbd[31932]:    #21 /usr/sbin/smbd(+0x8e12) [0x55ba26c51e12]
Dec  5 10:20:14 samba-04 smbd[31932]:    #22 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(run_events_poll+0x167) [0x7f5e8a1d5917]
Dec  5 10:20:14 samba-04 smbd[31932]:    #23 /usr/lib/x86_64-linux-gnu/libsmbconf.so.0(+0x2cb77) [0x7f5e8a1d5b77]
Dec  5 10:20:14 samba-04 smbd[31932]:    #24 /usr/lib/x86_64-linux-gnu/libtevent.so.0(_tevent_loop_once+0x8d) [0x7f5e88e1fd3d]
Dec  5 10:20:14 samba-04 smbd[31932]:    #25 /usr/lib/x86_64-linux-gnu/libtevent.so.0(tevent_common_loop_wait+0x1b) [0x7f5e88e1fedb]
Dec  5 10:20:14 samba-04 smbd[31932]:    #26 /usr/sbin/smbd(main+0x1899) [0x55ba26c50099]
Dec  5 10:20:14 samba-04 smbd[31932]:    #27 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f5e88a72830]
Dec  5 10:20:14 samba-04 smbd[31932]:    #28 /usr/sbin/smbd(_start+0x29) [0x55ba26c50199]
Dec  5 10:20:14 samba-04 smbd[31932]: [2017/12/05 10:20:14.006804,  0] ../source3/lib/dumpcore.c:303(dump_core)
Dec  5 10:20:14 samba-04 smbd[31932]:   dumping core in /var/log/samba/cores/smbd
Dec  5 10:20:14 samba-04 smbd[31932]:
Dec  5 10:20:14 samba-04 smbd[31944]: [2017/12/05 10:20:14.213971,  0] ../source3/smbd/smb2_server.c:547(smbd_smb2_request_create)
Dec  5 10:20:14 samba-04 smbd[31944]:   Invalid SMB packet: first request: 0x0003

### GlusterFS client logs (issued from the `vfs_gluster.so` module within `smbd`)

[2017-12-05 10:20:13.949861] W [MSGID: 101002] [options.c:995:xl_opt_validate] 0-gfapi: option 'address-family' is deprecated, preferred is 'transport.address-family', continuing with correction
[2017-12-05 10:20:13.965822] I [MSGID: 122067] [ec-code.c:1046:ec_code_detect] 0-archive-disperse-0: Using 'avx' CPU extensions
[2017-12-05 10:20:13.969808] W [MSGID: 101174] [graph.c:363:_log_if_unknown_option] 0-archive-readdir-ahead: option 'parallel-readdir' is not recognized
[2017-12-05 10:20:13.970295] I [MSGID: 104045] [glfs-master.c:91:notify] 0-gfapi: New graph 70656c6b-6d61-6e73-6c61-622d73616d62 (0) coming up
[2017-12-05 10:20:13.970352] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-0: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.970718] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-1: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.971011] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-2: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.971205] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-3: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.971401] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-4: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.971576] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-5: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.971770] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-6: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.971985] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-7: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.972254] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-8: parent translators are ready, attempting connect on transport
[2017-12-05 10:20:13.972495] I [MSGID: 114020] [client.c:2360:notify] 0-archive-client-9: parent translators are ready, attempting connect on transport
Final graph:
+------------------------------------------------------------------------------+
  1: volume archive-client-0
  2:     type protocol/client
  3:     option ping-timeout 42
  4:     option remote-host glusterfs-10
  5:     option remote-subvolume /srv/glusterfs/brick/archive
  6:     option transport-type socket
  7:     option transport.address-family inet
  8:     option transport.tcp-user-timeout 0
  9:     option transport.socket.keepalive-time 20
 10:     option transport.socket.keepalive-interval 2
 11:     option transport.socket.keepalive-count 9
 12:     option send-gids true
 13: end-volume
 14:
 15: volume archive-client-1
 16:     type protocol/client
 17:     option ping-timeout 42
 18:     option remote-host glusterfs-09
 19:     option remote-subvolume /srv/glusterfs/brick/archive
 20:     option transport-type socket
 21:     option transport.address-family inet
 22:     option transport.tcp-user-timeout 0
 23:     option transport.socket.keepalive-time 20
 24:     option transport.socket.keepalive-interval 2
 25:     option transport.socket.keepalive-count 9
 26:     option send-gids true
 27: end-volume
 28:
 28:
 29: volume archive-client-2
 30:     type protocol/client
 31:     option ping-timeout 42
[2017-12-05 10:20:13.972846] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-0: changing port to 49153 (from 0)
 32:     option remote-host glusterfs-08
 33:     option remote-subvolume /srv/glusterfs/brick/archive
 34:     option transport-type socket
 35:     option transport.address-family inet
 36:     option transport.tcp-user-timeout 0
 37:     option transport.socket.keepalive-time 20
 38:     option transport.socket.keepalive-interval 2
 39:     option transport.socket.keepalive-count 9
 40:     option send-gids true
 41: end-volume
 42:
 43: volume archive-client-3
 44:     type protocol/client
 45:     option ping-timeout 42
 46:     option remote-host glusterfs-07
 47:     option remote-subvolume /srv/glusterfs/brick/archive
 48:     option transport-type socket
 49:     option transport.address-family inet
 50:     option transport.tcp-user-timeout 0
[2017-12-05 10:20:13.972929] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-3: changing port to 49153 (from 0)
 51:     option transport.socket.keepalive-time 20
 52:     option transport.socket.keepalive-interval 2
 53:     option transport.socket.keepalive-count 9
 54:     option send-gids true
 55: end-volume
 56:
 57: volume archive-client-4
 58:     type protocol/client
 59:     option ping-timeout 42
 60:     option remote-host glusterfs-06
 61:     option remote-subvolume /srv/glusterfs/brick/archive
 62:     option transport-type socket
 63:     option transport.address-family inet
 64:     option transport.tcp-user-timeout 0
 65:     option transport.socket.keepalive-time 20
 66:     option transport.socket.keepalive-interval 2
 67:     option transport.socket.keepalive-count 9
 68:     option send-gids true
 69: end-volume
 70:
 71: volume archive-client-5
 72:     type protocol/client
 73:     option ping-timeout 42
 74:     option remote-host glusterfs-05
 75:     option remote-subvolume /srv/glusterfs/brick/archive
 76:     option transport-type socket
 77:     option transport.address-family inet
 78:     option transport.tcp-user-timeout 0
 79:     option transport.socket.keepalive-time 20
 80:     option transport.socket.keepalive-interval 2
 81:     option transport.socket.keepalive-count 9
 82:     option send-gids true
 83: end-volume
 84:
 85: volume archive-client-6
 86:     type protocol/client
 87:     option ping-timeout 42
 88:     option remote-host glusterfs-04
 89:     option remote-subvolume /srv/glusterfs/brick/archive
 90:     option transport-type socket
 91:     option transport.address-family inet
 92:     option transport.tcp-user-timeout 0
 93:     option transport.socket.keepalive-time 20
 94:     option transport.socket.keepalive-interval 2
 95:     option transport.socket.keepalive-count 9
 96:     option send-gids true
 97: end-volume
 98:
 99: volume archive-client-7
100:     type protocol/client
101:     option ping-timeout 42
102:     option remote-host glusterfs-03
103:     option remote-subvolume /srv/glusterfs/brick/archive
104:     option transport-type socket
105:     option transport.address-family inet
106:     option transport.tcp-user-timeout 0
107:     option transport.socket.keepalive-time 20
108:     option transport.socket.keepalive-interval 2
109:     option transport.socket.keepalive-count 9
110:     option send-gids true
111: end-volume
112:
113: volume archive-client-8
114:     type protocol/client
115:     option ping-timeout 42
116:     option remote-host glusterfs-02
117:     option remote-subvolume /srv/glusterfs/brick/archive
118:     option transport-type socket
119:     option transport.address-family inet
120:     option transport.tcp-user-timeout 0
121:     option transport.socket.keepalive-time 20
122:     option transport.socket.keepalive-interval 2
123:     option transport.socket.keepalive-count 9
124:     option send-gids true
125: end-volume
126:
127: volume archive-client-9
128:     type protocol/client
129:     option ping-timeout 42
130:     option remote-host glusterfs-01
131:     option remote-subvolume /srv/glusterfs/brick/archive
132:     option transport-type socket
133:     option transport.address-family inet
134:     option transport.tcp-user-timeout 0
135:     option transport.socket.keepalive-time 20
136:     option transport.socket.keepalive-interval 2
137:     option transport.socket.keepalive-count 9
138:     option send-gids true
139: end-volume
140:
141: volume archive-disperse-0
142:     type cluster/disperse
143:     option redundancy 2
144:     subvolumes archive-client-0 archive-client-1 archive-client-2 archive-client-3 archive-client-4 archive-client-5 archive-client-6 archive-client-7 archive-client-8 archive-client-9
145: end-volume
146:
147: volume archive-dht
148:     type cluster/distribute
149:     option lock-migration off
150:     subvolumes archive-disperse-0
151: end-volume
152:
153: volume archive-write-behind
154:     type performance/write-behind
155:     subvolumes archive-dht
156: end-volume
157:
158: volume archive-read-ahead
159:     type performance/read-ahead
160:     subvolumes archive-write-behind
161: end-volume
162:
163: volume archive-readdir-ahead
164:     type performance/readdir-ahead
165:     option parallel-readdir off
166:     option rda-request-size 131072
167:     option rda-cache-limit 10MB
168:     subvolumes archive-read-ahead
169: end-volume
170:
171: volume archive-io-cache
172:     type performance/io-cache
173:     subvolumes archive-readdir-ahead
174: end-volume
175:
176: volume archive-quick-read
177:     type performance/quick-read
178:     subvolumes archive-io-cache
179: end-volume
180:
181: volume archive-open-behind
182:     type performance/open-behind
183:     subvolumes archive-quick-read
184: end-volume
185:
186: volume archive-md-cache
187:     type performance/md-cache
188:     option cache-posix-acl true
189:     subvolumes archive-open-behind
190: end-volume
191:
192: volume archive-io-threads
193:     type performance/io-threads
194:     subvolumes archive-md-cache
195: end-volume
196:
197: volume archive
198:     type debug/io-stats
199:     option log-level INFO
200:     option latency-measurement off
201:     option count-fop-hits off
202:     subvolumes archive-io-threads
203: end-volume
204:
205: volume meta-autoload
206:     type meta
207:     subvolumes archive
208: end-volume
209:
+------------------------------------------------------------------------------+
[2017-12-05 10:20:13.973638] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-4: changing port to 49153 (from 0)
[2017-12-05 10:20:13.973683] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-1: changing port to 49153 (from 0)
[2017-12-05 10:20:13.974177] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-6: changing port to 49153 (from 0)
[2017-12-05 10:20:13.974236] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-2: changing port to 49153 (from 0)
[2017-12-05 10:20:13.974818] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-5: changing port to 49153 (from 0)
[2017-12-05 10:20:13.974862] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.974877] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-7: changing port to 49153 (from 0)
[2017-12-05 10:20:13.974925] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.974936] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-9: changing port to 49153 (from 0)
[2017-12-05 10:20:13.975363] I [rpc-clnt.c:1986:rpc_clnt_reconfig] 0-archive-client-8: changing port to 49153 (from 0)
[2017-12-05 10:20:13.975458] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-4: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.975482] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.975980] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-6: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.976005] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.976211] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-0: Connected to archive-client-0, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.976244] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.976299] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-3: Connected to archive-client-3, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.976314] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-3: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.976492] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-5: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.976501] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-7: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.976599] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-9: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.976628] I [MSGID: 114057] [client-handshake.c:1478:select_server_supported_programs] 0-archive-client-8: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2017-12-05 10:20:13.976792] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-0: Server lk version = 1
[2017-12-05 10:20:13.976806] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-3: Server lk version = 1
[2017-12-05 10:20:13.976941] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-6: Connected to archive-client-6, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.976953] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.976972] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-1: Connected to archive-client-1, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.976806] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-3: Server lk version = 1
[2017-12-05 10:20:13.976941] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-6: Connected to archive-client-6, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.976953] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-6: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.976972] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-1: Connected to archive-client-1, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.976986] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.977015] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-2: Connected to archive-client-2, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.977025] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-2: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.977318] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-6: Server lk version = 1
[2017-12-05 10:20:13.977411] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-2: Server lk version = 1
[2017-12-05 10:20:13.977427] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-1: Server lk version = 1
[2017-12-05 10:20:13.977453] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-8: Connected to archive-client-8, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.977463] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-8: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.977637] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-7: Connected to archive-client-7, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.977647] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-7: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.977815] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-8: Server lk version = 1
[2017-12-05 10:20:13.977993] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-7: Server lk version = 1
[2017-12-05 10:20:13.978005] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-9: Connected to archive-client-9, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.978017] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-9: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.978364] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-9: Server lk version = 1
[2017-12-05 10:20:13.979511] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-5: Connected to archive-client-5, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.979545] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-5: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.980131] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-5: Server lk version = 1
[2017-12-05 10:20:13.990225] I [MSGID: 114046] [client-handshake.c:1231:client_setvolume_cbk] 0-archive-client-4: Connected to archive-client-4, attached to remote volume '/srv/glusterfs/brick/archive'.
[2017-12-05 10:20:13.990267] I [MSGID: 114047] [client-handshake.c:1242:client_setvolume_cbk] 0-archive-client-4: Server and Client lk-version numbers are not same, reopening the fds
[2017-12-05 10:20:13.990350] I [MSGID: 122061] [ec.c:344:ec_up] 0-archive-disperse-0: Going UP
[2017-12-05 10:20:13.990942] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-archive-client-4: Server lk version = 1
[2017-12-05 10:20:13.996048] I [MSGID: 104041] [glfs-resolve.c:971:__glfs_active_subvol] 0-archive: switched to graph 70656c6b-6d61-6e73-6c61-622d73616d62 (0)

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users



[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux