Should I post these in bug tracker?
Im testing on 2 setups. One works when the other doesnt.
* No work: Linux (ubuntu feisty) 2.6.20. Fuse 2.6.5. Glusterfs
mainline-2.5 patch 187.
* Works ok: Linux (ubuntu dapper) 2.6.15. Fuse 2.6.5. Glusterfs
mainline-2.5 patch 187.
Doing the following causes sig11. /volumes is the glusterfs mount. I
pasted the rsync output at the bottom of this email.
cd /etc; rsync -av --progress . /volumes/
=========================================
GDB glusterfs -c /core + bt:
This GDB was configured as "i486-linux-gnu"...
Using host libthread_db library "/lib/tls/i686/cmov/libthread_db.so.1".
warning: Can't read pathname for load map: Input/output error.
Reading symbols from /lib/libglusterfs.so.0...done.
Loaded symbols for /lib/libglusterfs.so.0
Reading symbols from /usr/local/lib/libfuse.so.2...done.
Loaded symbols for /usr/local/lib/libfuse.so.2
Reading symbols from /lib/tls/i686/cmov/libdl.so.2...done.
Loaded symbols for /lib/tls/i686/cmov/libdl.so.2
Reading symbols from /lib/tls/i686/cmov/libpthread.so.0...done.
Loaded symbols for /lib/tls/i686/cmov/libpthread.so.0
Reading symbols from /lib/tls/i686/cmov/libc.so.6...done.
Loaded symbols for /lib/tls/i686/cmov/libc.so.6
Reading symbols from /lib/tls/i686/cmov/librt.so.1...done.
Loaded symbols for /lib/tls/i686/cmov/librt.so.1
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from
/lib/glusterfs/1.3.0-pre5/xlator/protocol/client.so...done.
Loaded symbols for /lib/glusterfs/1.3.0-pre5/xlator/protocol/client.so
Reading symbols from
/lib/glusterfs/1.3.0-pre5/xlator/cluster/unify.so...done.
Loaded symbols for /lib/glusterfs/1.3.0-pre5/xlator/cluster/unify.so
Reading symbols from
/lib/glusterfs/1.3.0-pre5/transport/tcp/client.so...done.
Loaded symbols for /lib/glusterfs/1.3.0-pre5/transport/tcp/client.so
Reading symbols from /lib/glusterfs/1.3.0-pre5/scheduler/rr.so...done.
Loaded symbols for /lib/glusterfs/1.3.0-pre5/scheduler/rr.so
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
Core was generated by
`[glusterfs] '.
Program terminated with signal 11, Segmentation fault.
#0 inode_ref (inode=0x0) at inode.c:402
402 pthread_mutex_lock (&table->lock);
(gdb) bt
#0 inode_ref (inode=0x0) at inode.c:402
#1 0xb7628a20 in unify_symlink_cbk (frame=0x8097458, cookie=0x8057128,
this=0x80573d8, op_ret=-1, op_errno=2, inode=0x0, buf=0x8096a90) at
unify.c:3544
#2 0xb763660f in client_symlink_cbk (frame=0x8096798, args=0x80969a8)
at client-protocol.c:2516
#3 0xb7634452 in notify (this=0x8057128, event=2, data=0x8091040) at
client-protocol.c:4126
#4 0xb7fc2707 in transport_notify (this=0x1cb48, event=20) at
transport.c:152
#5 0xb7fc3229 in sys_epoll_iteration (ctx=0xbfa37bd4) at epoll.c:54
#6 0xb7fc27dd in poll_iteration (ctx=0xbfa37bd4) at transport.c:260
#7 0x0804a160 in main (argc=3, argv=0xbfa37cb4) at glusterfs.c:341
=======================================
glusterfsd.log:
2007-06-21 17:13:10 E [protocol.c:262:gf_block_unserialize_transport]
libglusterfs/protocol: full_read of header failed: peer (127.0.0.1)
2007-06-21 17:13:10 C [tcp.c:82:tcp_disconnect] transport/tcp:
clusterfs: connection disconnected
2007-06-21 17:13:10 E [protocol.c:262:gf_block_unserialize_transport]
libglusterfs/protocol: full_read of header failed: peer (127.0.0.1)
2007-06-21 17:13:10 C [tcp.c:82:tcp_disconnect] transport/tcp:
clusterfs: connection disconnected
2007-06-21 17:13:10 E [protocol.c:262:gf_block_unserialize_transport]
libglusterfs/protocol: full_read of header failed: peer (127.0.0.1)
2007-06-21 17:13:10 C [tcp.c:82:tcp_disconnect] transport/tcp:
clusterfs: connection disconnected
=======================================
glusterfs.log:
2007-06-21 17:13:10 C [common-utils.c:205:gf_print_trace]
debug-backtrace: Got signal (11), printing backtrace
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/libglusterfs.so.0(gf_print_trace+0x2d) [0xb7fc11bd]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: [0xffffe420]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/glusterfs/1.3.0-pre5/xlator/cluster/unify.so
[0xb7628a20]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/glusterfs/1.3.0-pre5/xlator/protocol/client.so
[0xb763660f]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace:
/lib/glusterfs/1.3.0-pre5/xlator/protocol/client.so(notify+0x892)
[0xb7634452]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/libglusterfs.so.0(transport_notify+0x37) [0xb7fc2707]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/libglusterfs.so.0(sys_epoll_iteration+0xd9)
[0xb7fc3229]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/libglusterfs.so.0(poll_iteration+0x1d) [0xb7fc27dd]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: [glusterfs] [0x804a160]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xdc)
[0xb7e5aebc]
2007-06-21 17:13:10 C [common-utils.c:207:gf_print_trace]
debug-backtrace: [glusterfs] [0x8049d61]
=======================================
glusterfs-server.vol:
volume clusterfs1
type storage/posix
option directory /volume1
end-volume
#######
volume clusterfs2
type storage/posix
option directory /volume2
end-volume
#######
volume clusterfs-ns
type storage/posix
option directory /volume.namespace
end-volume
###
volume clusterfs
type protocol/server
option transport-type tcp/server
subvolumes clusterfs1 clusterfs2 clusterfs-ns
option auth.ip.clusterfs1.allow *
option auth.ip.clusterfs2.allow *
option auth.ip.clusterfs-ns.allow *
end-volume
======================================
glusterfs-client.vol:
volume clusterfs-ns
type protocol/client
option transport-type tcp/client # for TCP/IP transport
option remote-host 127.0.0.1 # IP address of the remote brick
option remote-subvolume clusterfs-ns
end-volume
volume server1vol1
type protocol/client
option transport-type tcp/client # for TCP/IP transport
option remote-host 127.0.0.1 # IP address of the remote brick
option remote-subvolume clusterfs1
end-volume
volume server1vol2
type protocol/client
option transport-type tcp/client # for TCP/IP transport
option remote-host 127.0.0.1 # IP address of the remote brick
option remote-subvolume clusterfs2
end-volume
###################
volume bricks
type cluster/unify
option namespace clusterfs-ns
option readdir-force-success on # ignore failed mounts
subvolumes server1vol1 server1vol2
option scheduler rr
option rr.limits.min-free-disk 5 #%
end-volume
=======================================
RSYNC OUTPUT SNIPPET:
building file list ...
667 files to consider
./
.pwd.lock
0 100% 0.00kB/s 0:00:00 (xfer#1, to-check=665/667)
Net
611 100% 0.00kB/s 0:00:00 (xfer#2, to-check=664/667)
adduser.conf
2657 100% 2.53MB/s 0:00:00 (xfer#3, to-check=663/667)
adjtime
45 100% 43.95kB/s 0:00:00 (xfer#4, to-check=662/667)
aliases
51 100% 49.80kB/s 0:00:00 (xfer#5, to-check=661/667)
at.deny
144 100% 140.62kB/s 0:00:00 (xfer#6, to-check=660/667)
bash.bashrc
1566 100% 1.49MB/s 0:00:00 (xfer#7, to-check=659/667)
bash_completion
215938 100% 68.64MB/s 0:00:00 (xfer#8, to-check=658/667)
blkid.tab
644 100% 209.64kB/s 0:00:00 (xfer#9, to-check=657/667)
blkid.tab.old
760 100% 247.40kB/s 0:00:00 (xfer#10, to-check=656/667)
checkinstallrc
3694 100% 1.17MB/s 0:00:00 (xfer#11, to-check=655/667)
crontab
724 100% 235.68kB/s 0:00:00 (xfer#12, to-check=654/667)
debconf.conf
2673 100% 652.59kB/s 0:00:00 (xfer#13, to-check=653/667)
debian_version
4 100% 0.98kB/s 0:00:00 (xfer#14, to-check=652/667)
deluser.conf
600 100% 146.48kB/s 0:00:00 (xfer#15, to-check=651/667)
environment
98 100% 23.93kB/s 0:00:00 (xfer#16, to-check=650/667)
fdmount.conf
354 100% 86.43kB/s 0:00:00 (xfer#17, to-check=649/667)
fstab
753 100% 183.84kB/s 0:00:00 (xfer#18, to-check=648/667)
fstab.pre-uuid
615 100% 150.15kB/s 0:00:00 (xfer#19, to-check=647/667)
group
659 100% 160.89kB/s 0:00:00 (xfer#20, to-check=646/667)
group-
647 100% 126.37kB/s 0:00:00 (xfer#21, to-check=645/667)
gshadow
553 100% 108.01kB/s 0:00:00 (xfer#22, to-check=644/667)
gshadow-
544 100% 106.25kB/s 0:00:00 (xfer#23, to-check=643/667)
hdparm.conf
4793 100% 936.13kB/s 0:00:00 (xfer#24, to-check=642/667)
host.conf
92 100% 17.97kB/s 0:00:00 (xfer#25, to-check=641/667)
hostname
21 100% 4.10kB/s 0:00:00 (xfer#26, to-check=640/667)
hosts
61 100% 11.91kB/s 0:00:00 (xfer#27, to-check=639/667)
iftab
154 100% 30.08kB/s 0:00:00 (xfer#28, to-check=638/667)
inputrc
1723 100% 280.44kB/s 0:00:00 (xfer#29, to-check=637/667)
issue
19 100% 3.09kB/s 0:00:00 (xfer#30, to-check=636/667)
issue.net
12 100% 1.95kB/s 0:00:00 (xfer#31, to-check=635/667)
kernel-img.conf
167 100% 27.18kB/s 0:00:00 (xfer#32, to-check=634/667)
ld.so.cache
12327 100% 1.96MB/s 0:00:00 (xfer#33, to-check=633/667)
ld.so.conf
48 100% 7.81kB/s 0:00:00 (xfer#34, to-check=632/667)
ld.so.hwcappkgs
70 100% 9.77kB/s 0:00:00 (xfer#35, to-check=631/667)
locale.alias
2586 100% 360.77kB/s 0:00:00 (xfer#36, to-check=630/667)
localtime
1017 100% 141.88kB/s 0:00:00 (xfer#37, to-check=629/667)
login.defs
9707 100% 1.32MB/s 0:00:00 (xfer#38, to-check=628/667)
logrotate.conf
599 100% 83.57kB/s 0:00:00 (xfer#39, to-check=627/667)
lsb-base-logging.sh
3786 100% 528.18kB/s 0:00:00 (xfer#40, to-check=626/667)
lsb-release
97 100% 13.53kB/s 0:00:00 (xfer#41, to-check=625/667)
ltrace.conf
10814 100% 1.29MB/s 0:00:00 (xfer#42, to-check=624/667)
magic
111 100% 13.55kB/s 0:00:00 (xfer#43, to-check=623/667)
mailcap
2136 100% 260.74kB/s 0:00:00 (xfer#44, to-check=622/667)
mailcap.order
449 100% 54.81kB/s 0:00:00 (xfer#45, to-check=621/667)
manpath.config
4696 100% 573.24kB/s 0:00:00 (xfer#46, to-check=620/667)
mediaprm
11742 100% 1.24MB/s 0:00:00 (xfer#47, to-check=619/667)
mime.types
20847 100% 2.21MB/s 0:00:00 (xfer#48, to-check=618/667)
mke2fs.conf
330 100% 35.81kB/s 0:00:00 (xfer#49, to-check=617/667)
modules
203 100% 22.03kB/s 0:00:00 (xfer#50, to-check=616/667)
motd -> /var/run/motd
motd.tail
266 100% 28.86kB/s 0:00:00 (xfer#51, to-check=614/667)
mtab
692 100% 75.09kB/s 0:00:00 (xfer#52, to-check=613/667)
mtab.fuselock
0 100% 0.00kB/s 0:00:00 (xfer#53, to-check=612/667)
nanorc
7672 100% 749.22kB/s 0:00:00 (xfer#54, to-check=611/667)
networks
23 100% 2.25kB/s 0:00:00 (xfer#55, to-check=610/667)
nsswitch.conf
475 100% 46.39kB/s 0:00:00 (xfer#56, to-check=609/667)
pam.conf
552 100% 53.91kB/s 0:00:00 (xfer#57, to-check=608/667)
passwd
939 100% 91.70kB/s 0:00:00 (xfer#58, to-check=607/667)
passwd-
889 100% 86.82kB/s 0:00:00 (xfer#59, to-check=606/667)
popularity-contest.conf
342 100% 30.36kB/s 0:00:00 (xfer#60, to-check=605/667)
profile
369 100% 32.76kB/s 0:00:00 (xfer#61, to-check=604/667)
protocols
2478 100% 219.99kB/s 0:00:00 (xfer#62, to-check=603/667)
rc.local
306 100% 27.17kB/s 0:00:00 (xfer#63, to-check=602/667)
resolv.conf
34 100% 3.02kB/s 0:00:00 (xfer#64, to-check=601/667)
rmt
268 100% 23.79kB/s 0:00:00 (xfer#65, to-check=600/667)
rpc
887 100% 78.75kB/s 0:00:00 (xfer#66, to-check=599/667)
securetty
994 100% 88.25kB/s 0:00:00 (xfer#67, to-check=598/667)
services
18038 100% 1.43MB/s 0:00:00 (xfer#68, to-check=597/667)
shadow
642 100% 52.25kB/s 0:00:00 (xfer#69, to-check=596/667)
shadow-
642 100% 52.25kB/s 0:00:00 (xfer#70, to-check=595/667)
shells
165 100% 13.43kB/s 0:00:00 (xfer#71, to-check=594/667)
sudoers
403 100% 32.80kB/s 0:00:00 (xfer#72, to-check=593/667)
sysctl.conf
764 100% 62.17kB/s 0:00:00 (xfer#73, to-check=592/667)
syslog.conf
1664 100% 125.00kB/s 0:00:00 (xfer#74, to-check=591/667)
timezone
11 100% 0.83kB/s 0:00:00 (xfer#75, to-check=590/667)
ucf.conf
1260 100% 94.65kB/s 0:00:00 (xfer#76, to-check=589/667)
updatedb.conf
805 100% 60.47kB/s 0:00:00 (xfer#77, to-check=588/667)
wgetrc
4221 100% 317.08kB/s 0:00:00 (xfer#78, to-check=587/667)
X11/
X11/xkb/
rsync: symlink "/volumes/X11/xkb/compat" -> "/usr/share/X11/xkb/compat"
failed: Software caused connection abort (103)
rsync: symlink "/volumes/X11/xkb/compat.dir" ->
"/usr/share/X11/xkb/compat.dir" failed: Transport endpoint is not
connected (107)
rsync: symlink "/volumes/X11/xkb/geometry" ->
"/usr/share/X11/xkb/geometry" failed: Transport endpoint is not
connected (107)
rsync: symlink "/volumes/X11/xkb/geometry.dir" ->
"/usr/share/X11/xkb/geometry.dir" failed: Transport endpoint is not
connected (107)