Sorry, I missed your note below. This is definitely due to an NFS client's silly rename. All ".nfs<random>" are due to silly rename implementation in NFS client. You might want to read about it. >> rm: cannot remove ‘/mnt/nfs/ltp-JEYAuky2dz/.nfsaa46457a6a72f8ea000014f5’: Device or resource busy On Thu, Apr 13, 2017 at 7:37 AM, Malahal Naineni <malahal@xxxxxxxxx> wrote: > What are the file names under the directory? What does "ls -la" show > both at the client and at the server in that directory? > > On Thu, Apr 13, 2017 at 5:13 AM, Kinglong Mee <mijinlong@xxxxxxxxxxx> wrote: >> There are some files under "rmderQsjV" (that's not a silly rename dir) really >> at underlying filesystem, but the nfs client shows empty. >> >> Are there some problems in MDCACHE or cache timeouts? >> >> On 4/12/2017 22:48, Malahal Naineni wrote: >>> Could be due to NFS client silly rename. >>> >>> On Apr 12, 2017 8:06 PM, "Kinglong Mee" <mijinlong@xxxxxxxxxxx <mailto:mijinlong@xxxxxxxxxxx>> wrote: >>> >>> When I testing ganesha nfs bases on glusterfs, the runltp always warning as, >>> >>> rm: cannot remove ‘/mnt/nfs/ltp-JEYAuky2dz/.nfsaa46457a6a72f8ea000014f5’: Device or resource busy >>> rm: cannot remove ‘/mnt/nfs/ltp-JEYAuky2dz/rmderQsjV’: Directory not empty >>> >>> and, "rmderQsjV" also contains files at the back-end, and nfs client shows empty. >>> >>> My test environments are, >>> Centos 7 (kernel-3.10.0-514.10.2.el7.x86_64), >>> Glusterfs (glusterfs-3.8.10-1.el7.x86_64), >>> NFS-Ganesha (nfs-ganesha-2.3.3-1.el7.x86_64). >>> >>> #cat /etc/ganesha/ganesha.conf >>> EXPORT >>> { >>> SecType = "sys"; >>> Pseudo = "/gvtest"; >>> Squash = "No_Root_Squash"; >>> Access_Type = "RW"; >>> Path = "/gvtest"; >>> Export_Id = 1; >>> FSAL { >>> Name = "GLUSTER"; >>> Hostname = "localhost"; >>> Volume = "gvtest"; >>> Volpath = "/"; >>> } >>> } >>> >>> # gluster volume info >>> >>> Volume Name: gvtest >>> Type: Distribute >>> Volume ID: 65d20de1-16cd-4ae8-a860-254b3d6c56d0 >>> Status: Started >>> Snapshot Count: 0 >>> Number of Bricks: 2 >>> Transport-type: tcp >>> Bricks: >>> Brick1: 192.168.9.111:/gluster-test/gvtest >>> Brick2: 192.168.9.112:/gluster-test/gvtest >>> Options Reconfigured: >>> nfs.disable: on >>> performance.readdir-ahead: off >>> transport.address-family: inet >>> performance.write-behind: off >>> performance.read-ahead: off >>> performance.io-cache: off >>> performance.quick-read: off >>> performance.open-behind: off >>> performance.stat-prefetch: off >>> >>> >>> ------------------------------------------------------------------------------ >>> Check out the vibrant tech community on one of the world's most >>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot >>> _______________________________________________ >>> Nfs-ganesha-devel mailing list >>> Nfs-ganesha-devel@xxxxxxxxxxxxxxxxxxxxx <mailto:Nfs-ganesha-devel@xxxxxxxxxxxxxxxxxxxxx> >>> https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel <https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel> >>> >>> >>> >>> ------------------------------------------------------------------------------ >>> Check out the vibrant tech community on one of the world's most >>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot >>> >>> >>> >>> _______________________________________________ >>> Nfs-ganesha-devel mailing list >>> Nfs-ganesha-devel@xxxxxxxxxxxxxxxxxxxxx >>> https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel >>> _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://lists.gluster.org/mailman/listinfo/gluster-devel