[root at localhost /]# uname -a Linux localhost.localdomain 2.6.30 #2 SMP Mon Jul 6 15:35:46 CST 2009 i686 i686 i386 GNU/Linux [root at localhost /]# glusterfs -V glusterfs 2.0.3 built on Jul 7 2009 13:17:27 Repository revision: v2.0.3 Copyright (c) 2006-2009 Z RESEARCH Inc. <http://www.zresearch.com> GlusterFS comes with ABSOLUTELY NO WARRANTY. You may redistribute copies of GlusterFS under the terms of the GNU General Public License. dmesg |grep fuse fuse init (API version 7.11) [root at localhost /]# grep -i FUSE_MINOR_VERSION /usr/local/include/fuse/fuse_common.h #define FUSE_MINOR_VERSION 8 #define FUSE_VERSION FUSE_MAKE_VERSION(FUSE_MAJOR_VERSION, FUSE_MINOR_VERSION) # undef FUSE_MINOR_VERSION # define FUSE_MINOR_VERSION 5 # define FUSE_MINOR_VERSION 4 # define FUSE_MINOR_VERSION 1 # define FUSE_MINOR_VERSION 1 [root at localhost /]# cat /var/log/glusterfs/glusterfsd-sever.vol.log ================================================================================ Version : glusterfs 2.0.3 built on Jul 7 2009 13:17:27 TLA Revision : v2.0.3 Starting Time: 2009-07-07 13:20:50 Command line : glusterfsd -f glusterfsd-sever.vol PID : 20516 System name : Linux Nodename : localhost.localdomain Kernel Release : 2.6.30 Hardware Identifier: i686 Given volfile: +------------------------------------------------------------------------------+ 1: 2: 3: volume posix1 4: type storage/posix # POSIX FS translator 5: option directory /opt/data1 # Export this directory 6: end-volume 7: 8: volume posix2 9: type storage/posix # POSIX FS translator 10: option directory /opt/data2 # Export this directory 11: end-volume 12: 13: volume posix3 14: type storage/posix # POSIX FS translator 15: option directory /opt/data3 # Export this directory 16: end-volume 17: 18: volume posix4 19: type storage/posix # POSIX FS translator 20: option directory /opt/data4 # Export this directory 21: end-volume 22: 23: volume brick1 24: type features/posix-locks 25: option mandatory-locks on # enables mandatory locking on all files 26: subvolumes posix1 27: end-volume 28: 29: volume brick2 30: type features/posix-locks 31: option mandatory-locks on # enables mandatory locking on all files 32: subvolumes posix2 33: end-volume 34: 35: volume brick3 36: type features/posix-locks 37: option mandatory-locks on # enables mandatory locking on all files 38: subvolumes posix3 39: end-volume 40: 41: volume brick4 42: type features/posix-locks 43: option mandatory-locks on # enables mandatory locking on all files 44: subvolumes posix4 45: end-volume 46: 47: 48: ### Add network serving capability to above brick. 49: volume server 50: type protocol/server 51: option transport-type tcp 52: option transport.socket.bind-address 172.16.36.46 # Default is to listen on all interfaces 53: option transport.socket.listen-port 6996 # Default is 6996 54: subvolumes brick1 brick2 brick3 brick4 55: option auth.addr.brick1.allow * # Allow access to "brick" volume 56: option auth.addr.brick2.allow * # Allow access to "brick" volume 57: option auth.addr.brick3.allow * # Allow access to "brick" volume 58: option auth.addr.brick4.allow * # Allow access to "brick" volume 59: end-volume +------------------------------------------------------------------------------+ [2009-07-07 13:20:50] N [glusterfsd.c:1224:main] glusterfs: Successfully started [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1023 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1022 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1021 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1020 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1019 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1018 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1017 [2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1016 [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1023 disconnected [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1022 disconnected [2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client1 [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1021 disconnected [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1020 disconnected [2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client2 [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1019 disconnected [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1018 disconnected [2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client4 [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1017 disconnected [2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1016 disconnected [2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client3 [root at localhost /]# cat /var/log/glusterfs/mnt.log ================================================================================ Version : glusterfs 2.0.3 built on Jul 7 2009 13:17:27 TLA Revision : v2.0.3 Starting Time: 2009-07-07 13:21:54 Command line : glusterfs -f glusterfs-client.vol.nio /mnt PID : 20524 System name : Linux Nodename : localhost.localdomain Kernel Release : 2.6.30 Hardware Identifier: i686 Given volfile: +------------------------------------------------------------------------------+ 1: ### Add client feature and attach to remote subvolume 2: volume client1 3: type protocol/client 4: option transport-type tcp 5: option remote-host 172.16.36.46 # IP address of the remote io 6: option remote-port 6996 # default server port is 6996 7: option remote-subvolume brick1 # name of the remote volume 8: end-volume 9: 10: volume client2 11: type protocol/client 12: option transport-type tcp 13: option remote-host 172.16.36.46 # IP address of the remote io 14: option remote-port 6996 # default server port is 6996 15: option remote-subvolume brick2 # name of the remote volume 16: end-volume 17: 18: volume client3 19: type protocol/client 20: option transport-type tcp 21: option remote-host 172.16.36.46 # IP address of the remote io 22: option remote-port 6996 # default server port is 6996 23: option remote-subvolume brick3 # name of the remote volume 24: end-volume 25: 26: 27: volume client4 28: type protocol/client 29: option transport-type tcp 30: option remote-host 172.16.36.46 # IP address of the remote io 31: option remote-port 6996 # default server port is 6996 32: option remote-subvolume brick4 # name of the remote volume 33: end-volume 34: 35: 36: 37: #volume afr2 38: # type cluster/afr 39: # subvolumes client2 client4 40: #end-volume 41: 42: volume dht 43: type cluster/dht 44: option min-free-disk 20% 45: subvolumes client1 client2 46: end-volume 47: 48: 49: 50: ### Add readahead feature 51: volume readahead 52: type performance/read-ahead 53: option page-count 16 # cache per file = (page-count x page-size) 54: subvolumes dht 55: end-volume 56: 57: ### Add IO-Cache feature 58: volume iocache 59: type performance/io-cache 60: option page-size 256KB 61: subvolumes readahead 62: end-volume 63: 64: ### Add writeback feature 65: volume writeback 66: type performance/write-behind 67: option cache-size 32MB 68: option flush-behind on 69: subvolumes iocache 70: end-volume +------------------------------------------------------------------------------+ [2009-07-07 13:21:54] W [client-protocol.c:5935:init] client4: Volume is dangling. [2009-07-07 13:21:54] W [client-protocol.c:5935:init] client3: Volume is dangling. [2009-07-07 13:21:54] W [glusterfsd.c:470:_log_if_option_is_invalid] iocache: option 'page-size' is not recognized [2009-07-07 13:21:54] N [glusterfsd.c:1224:main] glusterfs: Successfully started [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client1: Connected to 172.16.36.46:6996, attached to remote volume 'brick1'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client1: Connected to 172.16.36.46:6996, attached to remote volume 'brick1'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client2: Connected to 172.16.36.46:6996, attached to remote volume 'brick2'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client2: Connected to 172.16.36.46:6996, attached to remote volume 'brick2'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client4: Connected to 172.16.36.46:6996, attached to remote volume 'brick4'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client4: Connected to 172.16.36.46:6996, attached to remote volume 'brick4'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client3: Connected to 172.16.36.46:6996, attached to remote volume 'brick3'. [2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client3: Connected to 172.16.36.46:6996, attached to remote volume 'brick3'. pending frames: frame : type(1) op(READ) frame : type(1) op(READ) frame : type(1) op(READ) patchset: v2.0.3 signal received: 11 configuration details:argp 1 backtrace 1 dlfcn 1 fdatasync 1 libpthread 1 llistxattr 1 setfsid 1 spinlock 1 epoll.h 1 xattr.h 1 st_atim.tv_nsec 1 package-string: glusterfs 2.0.3 [0xffffe400] /usr/local/lib/libfuse.so.2(fuse_session_process+0x17)[0xb779725f] /lib/glusterfs/2.0.3/xlator/mount/fuse.so[0xb77c5e8a] /lib/tls/libpthread.so.0[0x8bc341] /lib/tls/libc.so.6(__clone+0x5e)[0x74e6fe] --------- [root at localhost /]# gdb glusterfs core.20524 GNU gdb Red Hat Linux (6.3.0.0-1.63rh) Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1". Reading symbols from shared object read from target memory...done. Loaded system supplied DSO at 0xffffe000 Core was generated by `glusterfs -f glusterfs-client.vol.nio /mnt'. Program terminated with signal 11, Segmentation fault. warning: svr4_current_sos: Can't read pathname for load map: ??/???? Reading symbols from /lib/libglusterfs.so.0...done. Loaded symbols for /lib/libglusterfs.so.0 Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/tls/libpthread.so.0...done. Loaded symbols for /lib/tls/libpthread.so.0 Reading symbols from /lib/tls/libc.so.6...done. Loaded symbols for /lib/tls/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/glusterfs/2.0.3/xlator/protocol/client.so...done. Loaded symbols for /lib/glusterfs/2.0.3/xlator/protocol/client.so Reading symbols from /lib/glusterfs/2.0.3/xlator/cluster/dht.so...done. Loaded symbols for /lib/glusterfs/2.0.3/xlator/cluster/dht.so Reading symbols from /lib/glusterfs/2.0.3/xlator/performance/read-ahead.so...done. Loaded symbols for /lib/glusterfs/2.0.3/xlator/performance/read-ahead.so Reading symbols from /lib/glusterfs/2.0.3/xlator/performance/io-cache.so...done. Loaded symbols for /lib/glusterfs/2.0.3/xlator/performance/io-cache.so Reading symbols from /lib/glusterfs/2.0.3/xlator/performance/write-behind.so...done. Loaded symbols for /lib/glusterfs/2.0.3/xlator/performance/write-behind.so Reading symbols from /lib/glusterfs/2.0.3/xlator/mount/fuse.so...done. Loaded symbols for /lib/glusterfs/2.0.3/xlator/mount/fuse.so Reading symbols from /usr/local/lib/libfuse.so.2...done. Loaded symbols for /usr/local/lib/libfuse.so.2 Reading symbols from /lib/tls/librt.so.1...done. Loaded symbols for /lib/tls/librt.so.1 Reading symbols from /lib/glusterfs/2.0.3/transport/socket.so...done. Loaded symbols for /lib/glusterfs/2.0.3/transport/socket.so Reading symbols from /lib/libnss_files.so.2...done. Loaded symbols for /lib/libnss_files.so.2 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 #0 0xb7795c73 in fuse_ll_process (data=0x80591d0, buf=0xb801f000 "8", len=56, ch=0xb6600718) at fuse_lowlevel.c:1049 1049 if (curr->u.i.unique == req->unique) { (gdb) bg Undefined command: "bg". Try "help". (gdb) bt #0 0xb7795c73 in fuse_ll_process (data=0x80591d0, buf=0xb801f000 "8", len=56, ch=0xb6600718) at fuse_lowlevel.c:1049 #1 0xb779725f in fuse_session_process (se=0xb6600718, buf=0xb801f000 "8", len=56, ch=0x8058e98) at fuse_session.c:80 #2 0xb77c5e8a in fuse_thread_proc (data=0x804fd18) at fuse-bridge.c:2480 #3 0x008bc341 in start_thread () from /lib/tls/libpthread.so.0 #4 0x0074e6fe in clone () from /lib/tls/libc.so.6 The error seem only happened "read" operation ,i write files into gluster no error . 2009-07-07 eagleeyes ???? Harshavardhana ????? 2009-07-07 13:08:43 ???? eagleeyes ??? Anand Avati; gluster-users ??? Re: Error : gluster2.0.0 with fuse2.8 inkernel2.6.30 Eagleeyes, Please install the latest 2.0.3 release. From the log file i see glusterfs version under use is 2.0.0 which is not supported for fuse 2.8.0 and it will segfault as shown. Regards -- Harshavardhana Z Research Inc http://www.zresearch.com/ On Tue, Jul 7, 2009 at 9:43 AM, eagleeyes <eagleeyes at 126.com> wrote: gluster2.0.3rc2 ,kernel 2.6.30 in SUSE Linux Enterprise Server 10 SP1 (i586) fuse init (API version 7.11) FUSE_MINOR_VERSION 8 gfs1:/ # gdb glusterfs core GNU gdb 6.6 Copyright (C) 2006 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i586-suse-linux"... Using host libthread_db library "/lib/libthread_db.so.1". warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/libglusterfs.so.0...done. Loaded symbols for /lib/libglusterfs.so.0 Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libpthread.so.0...done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/protocol/client.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/protocol/client.so Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/cluster/dht.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/cluster/dht.so Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/performance/read-ahead.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/performance/read-ahead.so Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/performance/io-cache.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/performance/io-cache.so Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/performance/write-behind.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/performance/write-behind.so Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/mount/fuse.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/mount/fuse.so Reading symbols from /usr/local/lib/libfuse.so.2...done. Loaded symbols for /usr/local/lib/libfuse.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/glusterfs/2.0.3rc2/transport/socket.so...done. Loaded symbols for /lib/glusterfs/2.0.3rc2/transport/socket.so Reading symbols from /lib/libnss_files.so.2...done. Loaded symbols for /lib/libnss_files.so.2 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `glusterfs -f /etc/glusterfs/glusterfs-client.vol.dht --disable-direct-io-mode /'. Program terminated with signal 11, Segmentation fault. #0 0xb7584d38 in fuse_ll_process (data=0x805b6a8, buf=0xb7cae000 "Y?", len=16217, ch=0x805b348) at fuse_lowlevel.c:1049 1049 if (curr->u.i.unique == req->unique) { (gdb) bt #0 0xb7584d38 in fuse_ll_process (data=0x805b6a8, buf=0xb7cae000 "Y?", len=16217, ch=0x805b348) at fuse_lowlevel.c:1049 #1 0xb7587b56 in fuse_session_process (se=0x805b540, buf=0xb7cae000 "Y?", len=16217, ch=0x805b348) at fuse_session.c:80 #2 0xb75b5e25 in fuse_thread_proc (data=0x804fd18) at fuse-bridge.c:2480 #3 0xb7f652ab in start_thread () from /lib/libpthread.so.0 #4 0xb7efca4e in clone () from /lib/libc.so.6 (gdb) exit 2009-07-07 eagleeyes ???? Anand Avati ????? 2009-07-07 11:44:28 ???? eagleeyes ??? gluster-users ??? Re: Error : gluster2.0.0 with fuse2.8 inkernel2.6.30 > ? > I want to use java nio with mmap ,so had to updata kernel 2.6.27 or > newer . The fuse in kernel 2.6.30 is api 7.11 . > > How can i give your details with gdb? what should i do ? Do you have a file in your system / with a name like /core.XXXX ? If you do, run this command - sh$ gdb glusterfs /core.XXX ... (gdb) bt and give us the output. Thanks, Avati _______________________________________________ Gluster-users mailing list Gluster-users at gluster.org http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://zresearch.com/pipermail/gluster-users/attachments/20090707/f0d09916/attachment-0001.htm>