On Sun, Aug 19, 2012 at 5:43 AM, Emmanuel Dreyfus <manu@xxxxxxxxxx> wrote:
On Sun, Aug 19, 2012 at 12:13:08AM -0700, Anand Avati wrote:It succeeds as well: below is the log output without the added sleep(2).
> Do you see all the protocol/client's connection succeeding on graph 1
> before 'switched to graph 1' log? In the above excerpt you have shown
> "client-1" succeeding log. What about other protocol clients?
I understand the client is signaled to reload the volume before the
truster.gluster.dht attributes are set.
The trusted.gluster.dht attribute will not be set for the newly added brick by default, and that should not be an error condition. The funny part is that in the new graph it is finding a "hole". Adding a new brick (even though the new brick does not contribute towards filling the layout) should not cause a hole as the old bricks are already covering the full hash range.
Oh BTW, did you add-brick from 1 brick to 2 bricks? If so it might be understandable as with 1 brick DHT is not loaded and there will be no hash ranges pre-assigned. If so can you try by starting with (volume create) with 2 bricks and then add-brick a 3rd one?
Avati
Is it possible there is
a barrier missing somewhere server side? Where is that supposed to
happen?
[2012-08-19 14:32:09.664064] I [rpc-clnt.c:1660:rpc_clnt_reconfig]
1-vndfs-client-0: changing port to 24058 (from 0)
[2012-08-19 14:32:09.666053] I [rpc-clnt.c:1660:rpc_clnt_reconfig]
1-vndfs-client-1: changing port to 24059 (from 0)
[2012-08-19 14:32:12.807520] I [client-handshake.c:1636:
select_server_supported_programs] 1-vndfs-client-0: Using Program
GlusterFS 3.3git, Num (1298437), Version (330)[2012-08-19 14:32:12.808697] I [client-handshake.c:1433:client_setvolume_cbk]
1-vndfs-client-0: Connected to 192.0.2.103:24058, attached to remote
volume '/export/vnd0a'.
[2012-08-19 14:32:12.808792] I [client-handshake.c:1445:client_setvolume_cbk]
1-vndfs-client-0: Server and Client lk-version numbers are not same,
reopening the fds
[2012-08-19 14:32:12.809469] I [client-handshake.c:1636:
select_server_supported_programs] 1-vndfs-client-1: Using Program
GlusterFS 3.3git, Num (1298437), Version (330)[2012-08-19 14:32:12.809827] I [client-handshake.c:453:
client_set_lk_version_cbk] 1-vndfs-client-0: Server lk version = 1
[2012-08-19 14:32:12.819362] I [client-handshake.c:1433:client_setvolume_cbk]
1-vndfs-client-1: Connected to 192.0.2.103:24059, attached to remote
volume '/export/vnd1a'.
[2012-08-19 14:32:12.819475] I [client-handshake.c:1445:
client_setvolume_cbk] 1-vndfs-client-1: Server and Client lk-version
numbers are not same, reopening the fds[2012-08-19 14:32:12.855737] I [fuse-bridge.c:4195:fuse_graph_setup] 0-fuse:
switched to graph 1
[2012-08-19 14:32:12.858810] I [client-handshake.c:453:
client_set_lk_version_cbk] 1-vndfs-client-1: Server lk version = 1[2012-08-19 14:32:12.899641] I [client.c:2151:notify] 0-vndfs-client-0:
current graph is no longer active, destroying rpc_client[2012-08-19 14:32:12.902488] I [client.c:2090:client_rpc_notify]
0-vndfs-client-0: disconnected
[2012-08-19 14:32:12.909907] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
(Invalid argument)
[2012-08-19 14:32:12.910014] E [fuse-bridge.c:353:fuse_lookup_resume]
0-fuse: failed to resolve path (null)[2012-08-19 14:32:12.912901] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
(Invalid argument)
[2012-08-19 14:32:12.913002] E [fuse-bridge.c:353:fuse_lookup_resume]
0-fuse: failed to resolve path (null)[2012-08-19 14:32:12.915572] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
(Invalid argument)
[2012-08-19 14:32:12.915673] W [fuse-bridge.c:1749:fuse_create_resume]
0-glusterfs-fuse: 2063 CREATE
00000000-0000-0000-0000-000000000000/bb9e267890c23aaa1ada196f222f166d5846f6
resolution failed
[2012-08-19 14:32:12.920535] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
(Invalid argument)
[2012-08-19 14:32:12.920645] E [fuse-bridge.c:844:fuse_setattr_resume]
0-glusterfs-fuse: 2064: SETATTR 3107999480
(a10abc68-284d-4768-a65b-be200d965aa5) resolution failed
--
Emmanuel Dreyfus
manu@xxxxxxxxxx
