Hi Harris, Thanks for giving this strace output. Actually the bug is not in glusterfs's statfs(), but is in the way the 'df' works in old version and new version. In new version, it gets every information from statfs() only, where it works fine. But with Gentoo (ie, the old coreutils), it gets f_bfree field (or say st_blksize from stat()) is taken from stat(), where it is different as fuse overrides the values sent by us to 4096. This reduces your storage's size by 256 times. This change in statfs was brought as to enhance the read/write as few applications send buffers depending on this field. Anyways, reverting it back to how it was earlier. So it should work fine now. (patch-292) -amar On 7/10/07, Harris Landgarten <harrisl@xxxxxxxxxxxxx> wrote:
Relevant strace output. Ubuntu statfs64("/mnt/glusterfs", 84, {f_type=0x65735546, f_bsize=1048576, f_blocks=300616, f_bfree=278894, f_bavail=263624, f_files=39092224, f_ffree=38579410, f_fsid={0, 0}, f_namelen=255,0 write(1, "glusterfs 294G 22G"..., 59glusterfs 294G 22G 258G 8% /mnt/glusterfs Gentoo statfs64("/mnt/glusterfs", 84, {f_type=0x65735546, f_bsize=1048576, f_blocks=300616, f_bfree=278894, f_bavail=263624, f_files=39092224, f_ffree=38579410, f_fsid={0, 0}, f_namelen=255, f_frsize=4096}) = 0 stat64("/mnt/glusterfs", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0 open("/proc/mounts", O_RDONLY) = 3 fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7fae000 read(3, "rootfs / rootfs rw 0 0\n/dev/root"..., 1024) = 503 stat64("/mnt/glusterfs", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0 close(3) = 0 munmap(0xb7fae000, 4096) = 0 write(1, "glusterfs 1.2G 85M"..., 59glusterfs 1.2G 85M 1.1G 8% /mnt/glusterfs Harris ----- Original Message ----- From: "Harris Landgarten" <harrisl@xxxxxxxxxxxxx> To: "Harris Landgarten" <harrisl@xxxxxxxxxxxxx> Cc: "gluster-devel" <gluster-devel@xxxxxxxxxx> Sent: Tuesday, July 10, 2007 10:04:35 AM (GMT-0500) America/New_York Subject: Re: Patch 290 breaks df -h calc on some clients. Ubuntu client is running coreutils-5.96. The Gentoo client is running coreutils-6.9-r1 Harris ----- Original Message ----- From: "Harris Landgarten" <harrisl@xxxxxxxxxxxxx> To: "gluster-devel" <gluster-devel@xxxxxxxxxx> Sent: Tuesday, July 10, 2007 9:06:46 AM (GMT-0500) America/New_York Subject: Patch 290 breaks df -h calc on some clients. After upgrading all servers and clients to patch 290 Ubuntu-6.06 client glusterfs 294G 22G 258G 8% /mnt/glusterfs This is correct. Gentoo client glusterfs 1.2G 85M 1.1G 8% /mnt/glusterfs This bug was fixed earlier and is now broken again. Harris _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxx http://lists.nongnu.org/mailman/listinfo/gluster-devel _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxx http://lists.nongnu.org/mailman/listinfo/gluster-devel
-- Amar Tumballi http://amar.80x25.org [bulde on #gluster/irc.gnu.org]