Installed 3.0.4 by hand on a 13 node cluster... used glusterfs-volgen on the servers, but I see no client volume. Tried the mount -t glusterfs IP /data but that failed, tried my own client volume, that failed. Read the docs... uhh, the client config docs are kind of sparse. So, in the spirit of "it works with 2.0.9", I tried my old client config file. It also fails. Note, so there is no confusion, I am using the first server as the client in this test setup. I tried it from a machine that is not running the glusterfs server, but that does not work either. Anyone know what I am missing in the client setup on 3.0.4? Thanks. Here is the output of a debug: level56 glusterfs # glusterfs --debug -f ./glusterfs.vol /data [2010-04-25 19:56:07] D [glusterfsd.c:432:_get_specfp] glusterfs: loading volume file ./glusterfs.vol [2010-04-25 19:56:07] D [xlator.c:740:xlator_set_type] xlator: dlsym(notify) on /usr/local/lib/glusterfs/3.0.4/xlator/performance/write-behind.so: undefined symbol: notify -- neglecting [2010-04-25 19:56:07] D [xlator.c:740:xlator_set_type] xlator: dlsym(notify) on /usr/local/lib/glusterfs/3.0.4/xlator/performance/io-cache.so: undefined symbol: notify -- neglecting [2010-04-25 19:56:07] D [xlator.c:745:xlator_set_type] xlator: dlsym(dumpops) on /usr/local/lib/glusterfs/3.0.4/xlator/performance/io-cache.so: undefined symbol: dumpops -- neglecting ================================================================================ Version : glusterfs 3.0.4 built on Apr 25 2010 07:12:27 git: v3.0.4 Starting Time: 2010-04-25 19:56:07 Command line : glusterfs --debug -f ./glusterfs.vol /data PID : 25863 System name : Linux Nodename : level56.lite3d.com Kernel Release : 2.6.26-gentoo-r3 Hardware Identifier: x86_64 Given volfile: +------------------------------------------------------------------------------+ 1: volume level56 2: type protocol/client 3: option transport-type tcp 4: option remote-host 10.1.85.36 5: option transport.socket.nodelay on 6: option remote-subvolume brick 7: end-volume 8: 9: volume level57 10: type protocol/client 11: option transport-type tcp 12: option remote-host 10.1.85.37 13: option transport.socket.nodelay on 14: option remote-subvolume brick 15: end-volume 16: 17: volume level58 18: type protocol/client 19: option transport-type tcp 20: option remote-host 10.1.85.38 21: option transport.socket.nodelay on 22: option remote-subvolume brick 23: end-volume 24: 25: volume level59 26: type protocol/client 27: option transport-type tcp 28: option remote-host 10.1.85.39 29: option transport.socket.nodelay on 30: option remote-subvolume brick 31: end-volume 32: 33: volume level60 34: type protocol/client 35: option transport-type tcp 36: option remote-host 10.1.85.40 37: option transport.socket.nodelay on 38: option remote-subvolume brick 39: end-volume 40: 41: #61 is not here yet... 42: #volume level61 43: # type protocol/client 44: # option transport-type tcp 45: # option remote-host 10.1.85.41 46: # option transport.socket.nodelay on 47: # option remote-subvolume brick 48: #end-volume 49: 50: volume level62 51: type protocol/client 52: option transport-type tcp 53: option remote-host 10.1.85.42 54: option transport.socket.nodelay on 55: option remote-subvolume brick 56: end-volume 57: 58: volume level63 59: type protocol/client 60: option transport-type tcp 61: option remote-host 10.1.85.43 62: option transport.socket.nodelay on 63: option remote-subvolume brick 64: end-volume 65: 66: volume level64 67: type protocol/client 68: option transport-type tcp 69: option remote-host 10.1.85.44 70: option transport.socket.nodelay on 71: option remote-subvolume brick 72: end-volume 73: 74: volume level65 75: type protocol/client 76: option transport-type tcp 77: option remote-host 10.1.85.45 78: option transport.socket.nodelay on 79: option remote-subvolume brick 80: end-volume 81: 82: volume level66 83: type protocol/client 84: option transport-type tcp 85: option remote-host 10.1.85.46 86: option transport.socket.nodelay on 87: option remote-subvolume brick 88: end-volume 89: 90: volume level67 91: type protocol/client 92: option transport-type tcp 93: option remote-host 10.1.85.47 94: option transport.socket.nodelay on 95: option remote-subvolume brick 96: end-volume 97: 98: volume level68 99: type protocol/client 100: option transport-type tcp 101: option remote-host 10.1.85.48 102: option transport.socket.nodelay on 103: option remote-subvolume brick 104: end-volume 105: 106: volume level69 107: type protocol/client 108: option transport-type tcp 109: option remote-host 10.1.85.49 110: option transport.socket.nodelay on 111: option remote-subvolume brick 112: end-volume 113: 114: 115: volume distribute 116: type cluster/distribute 117: option lookup-unhashed off 118: subvolumes level56 level57 level58 level59 level60 level62 level63 level64 level65 level66 level67 level68 level69 119: end-volume 120: 121: volume wb 122: type performance/write-behind 123: option cache-size 5MB 124: option flush-behind off 125: subvolumes distribute 126: end-volume 127: 128: volume ioc 129: type performance/io-cache 130: option cache-size 128MB 131: subvolumes wb 132: end-volume +------------------------------------------------------------------------------+ [2010-04-25 19:56:07] D [glusterfsd.c:1382:main] glusterfs: running in pid 25863 [2010-04-25 19:56:07] D [write-behind.c:2526:init] wb: disabling write-behind for first 1 bytes [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level69: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level69: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level68: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level68: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level67: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level67: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level66: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level66: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level65: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level65: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level64: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level64: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level63: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level63: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level62: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level62: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level60: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level60: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level59: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level59: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level58: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level58: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level57: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level57: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:6603:init] level56: defaulting frame-timeout to 30mins [2010-04-25 19:56:07] D [client-protocol.c:6614:init] level56: defaulting ping-timeout to 42 [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [transport.c:123:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/3.0.4/transport/socket.so [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level56: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level56: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level56: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level56: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level57: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level57: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level57: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level57: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level58: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level58: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level58: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level58: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level59: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level59: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level59: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level59: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level60: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level60: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level60: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level60: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level62: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level62: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level62: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level62: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level63: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level63: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level63: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level63: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level64: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level64: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level64: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level64: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level65: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level65: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level65: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level65: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level66: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level66: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level66: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level66: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level67: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level67: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level67: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level67: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level68: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level68: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level68: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level68: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level69: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level69: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level69: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [name.c:155:client_fill_address_family] level69: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level56: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level56: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level57: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level57: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level58: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level58: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level59: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level59: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level60: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level60: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level62: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level62: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level63: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level63: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level64: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level64: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level65: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level65: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level66: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level66: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level67: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level67: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level68: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level68: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level69: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] D [client-protocol.c:7027:notify] level69: got GF_EVENT_PARENT_UP, attempting connect on transport [2010-04-25 19:56:07] N [glusterfsd.c:1408:main] glusterfs: Successfully started [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level56: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level56: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level57: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level57: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level59: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level58: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level59: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level58: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level60: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level60: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level62: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level65: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level63: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level64: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level62: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level65: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level64: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level63: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level56: setvolume failed (No such file or directory) [2010-04-25 19:56:07] D [fuse-bridge.c:3100:fuse_thread_proc] fuse: pthread_cond_timedout returned non zero value ret: 0 errno: 0 [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level56: setvolume failed (No such file or directory) [2010-04-25 19:56:07] N [fuse-bridge.c:2950:fuse_init] glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.8 [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level57: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level57: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level59: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level58: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level59: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level58: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level60: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level60: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level62: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level65: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level62: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level63: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level64: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level63: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level65: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level64: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level68: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level66: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level68: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level66: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level68: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level66: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level69: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level67: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level69: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:7041:notify] level67: got GF_EVENT_CHILD_UP [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level69: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level67: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level69: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level68: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level66: setvolume failed (Invalid argument) [2010-04-25 19:56:07] D [client-protocol.c:6178:client_setvolume_cbk] level67: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level56: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level56: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level56: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level56: setvolume failed (No such file or directory) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level57: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level56: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level56: setvolume failed (No such file or directory) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level57: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level57: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level57: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level58: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level57: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level57: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level58: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level58: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level59: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level58: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level58: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level59: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level59: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level58: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level59: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level60: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level59: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level59: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level60: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level60: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level60: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level62: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level60: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level62: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level60: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level62: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level63: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level62: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level62: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level62: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level63: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level63: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level64: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level63: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level63: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level64: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level63: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level64: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level65: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level64: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level64: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level64: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level65: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level65: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level66: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level65: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level65: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level65: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level66: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level66: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level66: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level67: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level66: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level66: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level67: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level67: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level67: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level68: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level67: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level67: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level68: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level68: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level68: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level69: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level68: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level68: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [name.c:155:client_fill_address_family] level69: address-family not specified, guessing it to be inet/inet6 [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level69: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level69: setvolume failed (Invalid argument) [2010-04-25 19:56:17] D [client-protocol.c:7041:notify] level69: got GF_EVENT_CHILD_UP [2010-04-25 19:56:17] D [client-protocol.c:6178:client_setvolume_cbk] level69: setvolume failed (Invalid argument) And here is the server vol from the first server: level56 glusterfs # more /etc/glusterfs/level56-store1-export.vol ## file auto generated by /usr/local/bin/glusterfs-volgen (export.vol) # Cmd line: # $ /usr/local/bin/glusterfs-volgen --name store1 level56:/space/export level57: /space/export level58:/space/export level59:/space/export level60:/space/export level61:/space/export level62:/space/export level63:/space/export level64:/space /export level65:/space/export level66:/space/export level67:/space/export level6 8:/space/export level69:/space/export volume posix1 type storage/posix option directory /space/export end-volume volume locks1 type features/locks subvolumes posix1 end-volume volume brick1 type performance/io-threads option thread-count 8 subvolumes locks1 end-volume volume server-tcp type protocol/server option transport-type tcp option auth.addr.brick1.allow * option transport.socket.listen-port 6996 option transport.socket.nodelay on subvolumes brick1 end-volume