Hi, We got a huge problem on our sun grid engine cluster with glusterfs 3.3.0. Could somebody help me? Based on my understanding, if a folder is removed and recreated on other client node, a program that tries to create a new file under the folder fails very often. We partially fixed this problem by "ls" the folder before doing anything in our command, however, Sun Grid Engine tries to create a new log file before executing our script. We often get the error message "no such file or directory" in SGE log and cannot do anything about it. flush-behind is already turned off. What's the next thing we should try? Error log on client is [2012-09-10 11:18:48.129102] W [client3_1-fops.c:2630:client3_1_lookup_cbk] 0-home-client-0: remote operation failed: Stale NFS file handle. Path: XXXXXXXXXXXXXX (488a7270-1039-473b-9122-ae07b9e2c617) [2012-09-10 11:18:48.129162] W [client3_1-fops.c:2630:client3_1_lookup_cbk] 0-home-client-1: remote operation failed: Stale NFS file handle. Path: XXXXXXXXXXXXXX (488a7270-1039-473b-9122-ae07b9e2c617) Error log on two brick severs are [2012-09-10 11:18:48.046828] I [server3_1-fops.c:1707:server_stat_cbk] 0-home-server: 3531033: STAT (null) (--) ==> -1 (No such file or directory) [2012-09-10 11:18:48.047176] I [server3_1-fops.c:1707:server_stat_cbk] 0-home-server: 3531035: STAT (null) (--) ==> -1 (No such file or directory) [2012-09-10 11:18:48.054315] I [server3_1-fops.c:1707:server_stat_cbk] 0-home-server: 5347741: STAT (null) (--) ==> -1 (No such file or directory) [2012-09-10 11:18:48.054544] I [server3_1-fops.c:1707:server_stat_cbk] 0-home-server: 5347742: STAT (null) (--) ==> -1 (No such file or directory) [2012-09-10 11:18:48.056036] I [server3_1-fops.c:1707:server_stat_cbk] 0-home-server: 5347746: STAT (null) (--) ==> -1 (No such file or directory) Best, Manhong -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://gluster.org/pipermail/gluster-users/attachments/20120910/8e763302/attachment.htm>