Hi Avati, I really appreciate your help and solutions. I tested TLA 650. Lots of problem where solved. I'm getting following error in log when ever we access or list a directory or a file. 2008-02-08 14:31:59 E [fuse-bridge.c:431:fuse_entry_cbk] glusterfs-fuse: 57556: / => -1 (116) Debug logs 2008-02-08 14:34:43 E [fuse-bridge.c:431:fuse_entry_cbk] glusterfs-fuse: 57604: / => -1 (116) 2008-02-08 14:34:43 D [fuse-bridge.c:437:fuse_entry_cbk] glusterfs-fuse: unlinking stale dentry for `/' 2008-02-08 14:34:43 D [fuse-bridge.c:354:fuse_entry_cbk] glusterfs-fuse: 57604: / => 1 2008-02-08 14:34:43 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 57605: GETXATTR //1 (system.posix_acl_access) 2008-02-08 14:34:43 D [inode.c:308:__destroy_inode] fuse/inode: destroy inode(0) [@0x2aaab0120170] 2008-02-08 14:34:43 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 57605: / => 98 2008-02-08 14:34:43 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 57606: GETXATTR //1 (system.posix_acl_default) 2008-02-08 14:34:43 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 57606: / => 98 2008-02-08 14:34:43 E [fuse-bridge.c:431:fuse_entry_cbk] glusterfs-fuse: 57607: / => -1 (116) 2008-02-08 14:34:43 D [fuse-bridge.c:437:fuse_entry_cbk] glusterfs-fuse: unlinking stale dentry for `/' 2008-02-08 14:34:43 D [fuse-bridge.c:354:fuse_entry_cbk] glusterfs-fuse: 57607: / => 1 2008-02-08 14:34:43 D [fuse-bridge.c:1699:fuse_opendir] glusterfs-fuse: 57608: OPEN / 2008-02-08 14:34:43 D [inode.c:308:__destroy_inode] fuse/inode: destroy inode(0) [@0x2aaab80ce1a0] 2008-02-08 14:34:43 D [fuse-bridge.c:656:fuse_fd_cbk] glusterfs-fuse: 57608: / => 0x2aaab0117090 2008-02-08 14:34:43 E [fuse-bridge.c:431:fuse_entry_cbk] glusterfs-fuse: 57609: / => -1 (116) 2008-02-08 14:34:43 D [fuse-bridge.c:437:fuse_entry_cbk] glusterfs-fuse: unlinking stale dentry for `/' 2008-02-08 14:34:43 D [fuse-bridge.c:354:fuse_entry_cbk] glusterfs-fuse: 57609: / => 1 2008-02-08 14:34:43 D [fuse-bridge.c:1877:fuse_readdir] glusterfs-fuse: 57610: READDIR (0x2aaab0117090, size=4096, offset=0) 2008-02-08 14:34:43 D [afr.c:4674:afr_readdir] afr-ns: getdenting from child 0 2008-02-08 14:34:43 D [inode.c:308:__destroy_inode] fuse/inode: destroy inode(0) [@0x1452e1a0] 2008-02-08 14:34:43 D [fuse-bridge.c:1845:fuse_readdir_cbk] glusterfs-fuse: 57610: READDIR => 152/4096,0 2008-02-08 14:34:43 D [fuse-bridge.c:500:fuse_lookup] glusterfs-fuse: 57611: LOOKUP /IOtest(5199938) 2008-02-08 14:34:43 D [fuse-bridge.c:354:fuse_entry_cbk] glusterfs-fuse: 57611: /IOtest => 5199938 2008-02-08 14:34:43 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 57612: GETXATTR /IOtest/5199938 (system.posix_acl_access) 2008-02-08 14:34:43 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 57612: /IOtest => 55 2008-02-08 14:34:43 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 57613: GETXATTR /IOtest/5199938 (system.posix_acl_default) 2008-02-08 14:34:43 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 57613: /IOtest => 55 2008-02-08 14:34:43 D [fuse-bridge.c:1877:fuse_readdir] glusterfs-fuse: 57614: READDIR (0x2aaab0117090, size=4096, offset=2147483647) 2008-02-08 14:34:43 D [afr.c:4674:afr_readdir] afr-ns: getdenting from child 0 2008-02-08 14:34:43 D [fuse-bridge.c:1845:fuse_readdir_cbk] glusterfs-fuse: 57614: READDIR => 0/4096,2147483647 2008-02-08 14:34:43 D [fuse-bridge.c:1903:fuse_releasedir] glusterfs-fuse: 57615: CLOSEDIR 0x2aaab0117090 2008-02-08 14:34:43 D [fuse-bridge.c:887:fuse_err_cbk] glusterfs-fuse: 57615: ERR => 0 _____ From: anand.avati@xxxxxxxxx [mailto:anand.avati@xxxxxxxxx] On Behalf Of Anand Avati Sent: Friday, February 08, 2008 9:05 AM To: Rohan Cc: gluster-devel@xxxxxxxxxx Subject: Re: May issues with GLuster Rohan, patch-650 has a lot of fixes including fixes for hanging with unify. Please update yourself to patch-650. It has fixes for issues which has the same symptoms as those reported by you. thanks, avati 2008/2/4, Rohan <rohan.thale@xxxxxxxxxxxxxxxx>: Resending to list. _____ From: Rohan [mailto:rohan.thale@xxxxxxxxxxxxxxxx] Sent: Monday, February 04, 2008 5:05 PM To: 'Anand Avati' Subject: RE: May issues with GLuster Hi Anand, I'm testing GLfs using apache. I've written a small script which creates random name file in /gfs-data/IOtest/php_test/ but instead on creating at desire location it create it at default path, /gfs-data/. Flowing are client log for that particular file. "TestFile200802041624-270txt" file is not created at /gfs-data/IOtest/php_test/. It got created at /gfs-data/ [root@Sun2200-68 ~]# cat /var/log/glusterfs/glusterfs-client.log|grep TestFile200802041624-270txt 2008-02-04 16:49:24 D [fuse-bridge.c:492:fuse_lookup] glusterfs-fuse: 45858: LOOKUP /IOtest/php_test/TestFile200802041624-270txt 2008-02-04 16:49:24 D [fuse-bridge.c:427:fuse_entry_cbk] glusterfs-fuse: 45858: /IOtest/php_test/TestFile200802041624-270txt => -1 (2) 2008-02-04 16:49:25 D [fuse-bridge.c:492:fuse_lookup] glusterfs-fuse: 46147: LOOKUP /IOtest/php_test/TestFile200802041624-270txt 2008-02-04 16:49:25 D [fuse-bridge.c:427:fuse_entry_cbk] glusterfs-fuse: 46147: /IOtest/php_test/TestFile200802041624-270txt => -1 (2) 2008-02-04 16:49:25 D [fuse-bridge.c:1426:fuse_create] glusterfs-fuse: 46151: CREATE /TestFile200802041624-270txt 2008-02-04 16:49:25 D [fuse-bridge.c:1326:fuse_create_cbk] glusterfs-fuse: 46151: /TestFile200802041624-270txt => 0x2aaab808b4e0 2008-02-04 16:52:03 D [fuse-bridge.c:492:fuse_lookup] glusterfs-fuse: 61914: LOOKUP /TestFile200802041624-270txt 2008-02-04 16:52:03 D [fuse-bridge.c:354:fuse_entry_cbk] glusterfs-fuse: 61914: /TestFile200802041624-270txt => 5209942 2008-02-04 16:52:03 W [fuse-bridge.c:381:fuse_entry_cbk] glusterfs-fuse: 61914: /TestFile200802041624-270txt => 5209942 Rehashing because st_nlink less than dentry maps 2008-02-04 16:52:03 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 61915: GETXATTR /TestFile200802041624-270txt/5209942 (system.posix_acl_access) 2008-02-04 16:52:03 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 61915: /TestFile200802041624-270txt => 55 2008-02-04 16:52:03 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 61916: GETXATTR /TestFile200802041624-270txt/5209942 (system.posix_acl_default) 2008-02-04 16:52:03 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 61916: /TestFile200802041624-270txt => 55 2008-02-04 17:00:36 D [fuse-bridge.c:500:fuse_lookup] glusterfs-fuse: 62140: LOOKUP /TestFile200802041624-270txt(5209942) 2008-02-04 17:00:36 D [fuse-bridge.c:354:fuse_entry_cbk] glusterfs-fuse: 62140: /TestFile200802041624-270txt => 5209942 2008-02-04 17:00:36 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 62141: GETXATTR /TestFile200802041624-270txt/5209942 (system.posix_acl_access) 2008-02-04 17:00:36 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 62141: /TestFile200802041624-270txt => 55 2008-02-04 17:00:36 D [fuse-bridge.c:2157:fuse_getxattr] glusterfs-fuse: 62142: GETXATTR /TestFile200802041624-270txt/5209942 (system.posix_acl_default) 2008-02-04 17:00:36 D [fuse-bridge.c:2067:fuse_xattr_cbk] glusterfs-fuse: 62142: /TestFile200802041624-270txt => 55 Please let me know if you need entire logs. Rohan -- If I traveled to the end of the rainbow As Dame Fortune did intend, Murphy would be there to tell me The pot's at the other end.