GlusterFS 2.0.8 client crushes while accessing files on the mounted volume. (OS: FreeBSD 7.2) Here is the log file: [2009-12-07 22:25:21] D [glusterfsd.c:410:_get_specfp] glusterfs: loading volume file /usr/local/etc/glusterfs/store01-mount.vol [2009-12-07 22:25:21] D [xlator.c:634:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting [2009-12-07 22:25:21] D [xlator.c:634:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting ================================================================================ Version : glusterfs 2.0.8 built on Dec 7 2009 22:20:03 git: v2.0.8 Starting Time: 2009-12-07 22:25:21 Command line : /usr/local/sbin/glusterfs --log-level=DEBUG -l /var/log/glusterfs_client.log --pid-file=/var/run/glusterfs_client.pid -f /usr/local/etc/glusterfs/store01-mount.vol /mnt/store01 PID : 42996 System name : FreeBSD Nodename : cn04 Kernel Release : 7.2-RELEASE-p4 Hardware Identifier: i386 Given volfile: +------------------------------------------------------------------------------+ 1: ## file auto generated by /usr/local/bin/glusterfs-volgen (mount.vol) 2: # Cmd line: 3: # $ /usr/local/bin/glusterfs-volgen --name store01 --export-directory /usr/export/ 192.168.1.101 192.168.1.102 192.168.1.103 4: 5: # TRANSPORT-TYPE tcp 6: # PORT 6996 7: 8: volume 192.168.1.101 9: type protocol/client 10: option transport-type tcp 11: option remote-host 192.168.1.101 12: option remote-port 6996 13: option remote-subvolume brick 14: end-volume 15: 16: volume 192.168.1.102 17: type protocol/client 18: option transport-type tcp 19: option remote-host 192.168.1.102 20: option remote-port 6996 21: option remote-subvolume brick 22: end-volume 23: 24: volume 192.168.1.103 25: type protocol/client 26: option transport-type tcp 27: option remote-host 192.168.1.103 28: option remote-port 6996 29: option remote-subvolume brick 30: end-volume 31: 32: volume distribute 33: type cluster/distribute 34: subvolumes 192.168.1.101 192.168.1.102 192.168.1.103 35: end-volume 36: 37: volume writebehind 38: type performance/write-behind 39: option cache-size 4MB 40: subvolumes distribute 41: end-volume 42: 43: volume io-cache 44: type performance/io-cache 45: option cache-size 1GB 46: subvolumes writebehind 47: end-volume 48: +------------------------------------------------------------------------------+ [2009-12-07 22:25:21] D [glusterfsd.c:1279:main] glusterfs: running in pid 42996 [2009-12-07 22:25:21] D [client-protocol.c:6130:init] 192.168.1.101: defaulting frame-timeout to 30mins [2009-12-07 22:25:21] D [client-protocol.c:6141:init] 192.168.1.101: defaulting ping-timeout to 10 [2009-12-07 22:25:21] D [transport.c:141:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/2.0.8/transport/socket.so [2009-12-07 22:25:21] D [xlator.c:276:_volume_option_value_validate] 192.168.1.101: no range check required for 'option remote-port 6996' [2009-12-07 22:25:21] D [transport.c:141:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/2.0.8/transport/socket.so [2009-12-07 22:25:21] D [xlator.c:276:_volume_option_value_validate] 192.168.1.101: no range check required for 'option remote-port 6996' [2009-12-07 22:25:21] D [client-protocol.c:6130:init] 192.168.1.102: defaulting frame-timeout to 30mins [2009-12-07 22:25:21] D [client-protocol.c:6141:init] 192.168.1.102: defaulting ping-timeout to 10 [2009-12-07 22:25:21] D [transport.c:141:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/2.0.8/transport/socket.so [2009-12-07 22:25:21] D [xlator.c:276:_volume_option_value_validate] 192.168.1.102: no range check required for 'option remote-port 6996' [2009-12-07 22:25:21] D [transport.c:141:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/2.0.8/transport/socket.so [2009-12-07 22:25:21] D [xlator.c:276:_volume_option_value_validate] 192.168.1.102: no range check required for 'option remote-port 6996' [2009-12-07 22:25:21] D [client-protocol.c:6130:init] 192.168.1.103: defaulting frame-timeout to 30mins [2009-12-07 22:25:21] D [client-protocol.c:6141:init] 192.168.1.103: defaulting ping-timeout to 10 [2009-12-07 22:25:21] D [transport.c:141:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/2.0.8/transport/socket.so [2009-12-07 22:25:21] D [xlator.c:276:_volume_option_value_validate] 192.168.1.103: no range check required for 'option remote-port 6996' [2009-12-07 22:25:21] D [transport.c:141:transport_load] transport: attempt to load file /usr/local/lib/glusterfs/2.0.8/transport/socket.so [2009-12-07 22:25:21] D [xlator.c:276:_volume_option_value_validate] 192.168.1.103: no range check required for 'option remote-port 6996' [2009-12-07 22:25:21] D [write-behind.c:1980:init] writebehind: disabling write-behind for first 1 bytes [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.101: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.101: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.102: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.102: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.103: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.103: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.101: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.101: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.102: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.102: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.103: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] D [client-protocol.c:6472:notify] 192.168.1.103: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-07 22:25:21] N [glusterfsd.c:1306:main] glusterfs: Successfully started [2009-12-07 22:25:21] D [client-protocol.c:6486:notify] 192.168.1.101: got GF_EVENT_CHILD_UP [2009-12-07 22:25:21] D [client-protocol.c:6486:notify] 192.168.1.101: got GF_EVENT_CHILD_UP [2009-12-07 22:25:21] D [client-protocol.c:6486:notify] 192.168.1.102: got GF_EVENT_CHILD_UP [2009-12-07 22:25:21] D [client-protocol.c:6486:notify] 192.168.1.102: got GF_EVENT_CHILD_UP [2009-12-07 22:25:21] D [client-protocol.c:6486:notify] 192.168.1.103: got GF_EVENT_CHILD_UP [2009-12-07 22:25:21] D [client-protocol.c:6486:notify] 192.168.1.103: got GF_EVENT_CHILD_UP [2009-12-07 22:25:21] N [client-protocol.c:5733:client_setvolume_cbk] 192.168.1.101: Connected to 192.168.1.101:6996, attached to remote volume 'brick'. [2009-12-07 22:25:21] N [client-protocol.c:5733:client_setvolume_cbk] 192.168.1.101: Connected to 192.168.1.101:6996, attached to remote volume 'brick'. [2009-12-07 22:25:21] N [client-protocol.c:5733:client_setvolume_cbk] 192.168.1.103: Connected to 192.168.1.103:6996, attached to remote volume 'brick'. [2009-12-07 22:25:21] N [client-protocol.c:5733:client_setvolume_cbk] 192.168.1.102: Connected to 192.168.1.102:6996, attached to remote volume 'brick'. [2009-12-07 22:25:21] N [client-protocol.c:5733:client_setvolume_cbk] 192.168.1.102: Connected to 192.168.1.102:6996, attached to remote volume 'brick'. [2009-12-07 22:25:21] N [client-protocol.c:5733:client_setvolume_cbk] 192.168.1.103: Connected to 192.168.1.103:6996, attached to remote volume 'brick'. pending frames: patchset: v2.0.8 signal received: 11 time of crash: 2009-12-07 22:25:37 configuration details: db.h 1 dlfcn 1 libpthread 1 spinlock 1 extattr.h 1 st_atimespec.tv_nsec 1 package-string: glusterfs 2.0.8