Our workaround is to touch the directory itself. That pokes the client to refresh the rstats (which are otherwise cached forever). -- dan On Tue, Jun 13, 2017 at 3:10 PM, Wyllys Ingersoll <wyllys.ingersoll@xxxxxxxxxxxxxx> wrote: > I didnt try that, but I did touch the large file in the directory and > that did not change anything. Right now, I cannot recreate the > problem because we re-mounted the filesystem and now it is correct. > Obviously, remounting is not a good solution though. > > On Tue, Jun 13, 2017 at 9:06 AM, Dan van der Ster <dan@xxxxxxxxxxxxxx> wrote: >> If you touch the dir, do the rstats synchronize? >> >> -- dan >> >> >> On Tue, Jun 13, 2017 at 3:05 PM, Wyllys Ingersoll >> <wyllys.ingersoll@xxxxxxxxxxxxxx> wrote: >>> >>> That sounds similar but Im not sure if its the same issue. Our mounts >>> were done using kernel mounting, not fuse. >>> >>> On Tue, Jun 13, 2017 at 6:02 AM, Dan van der Ster <dan@xxxxxxxxxxxxxx> >>> wrote: >>> > Sounds like this issue? >>> > >>> > http://tracker.ceph.com/issues/17939 >>> > >>> > Cheers, Dan >>> > >>> > >>> > >>> > On Mon, Jun 12, 2017 at 9:45 PM, Wyllys Ingersoll >>> > <wyllys.ingersoll@xxxxxxxxxxxxxx> wrote: >>> >> Ceph 10.2.7 >>> >> Ubuntu 16.04.2 >>> >> >>> >> We have 2 hosts running identical versions of ceph with identical >>> >> ceph.conf configuration files. >>> >> Both mount /cephfs with the same options. >>> >> >>> >> We have a directory under /cephfs with a 4GB file in it. The >>> >> ceph.dir.rbytes xattr reported by ceph is different on the 2 hosts. >>> >> One is correct, one is not. >>> >> >>> >> One host reports the 'ceph.dir.rbytes' correctly as 4129644548, the >>> >> other reports it incorrectly as 2389190660 >>> >> Any ideas why this would be happening ? >>> >> >>> >> - Wyllys Ingersoll >>> >> Keeper Technology, LLC >>> >> >>> >> >>> >> HOST A (correct values): >>> >> $ ls -alF /cephfs/exports/smbtest >>> >> total 4032857 >>> >> drwxrwxrwx 1 root root 4129644548 May 31 11:28 ./ >>> >> drwxr-xr-x 1 root root 4129644548 May 31 11:25 ../ >>> >> -rw-r--r-- 1 2000501 2000514 4096 May 31 11:26 ._.DS_Store >>> >> -rw-r--r-- 1 2000501 2000514 6148 Jun 1 14:37 .DS_Store >>> >> -rw-r--r-- 1 2000501 2000514 4129634304 Jun 12 15:25 >>> >> test-2017-05-30-m1.iso >>> >> >>> >> $ getfattr -d -m ceph.dir /cephfs/exports/smbtest >>> >> getfattr: Removing leading '/' from absolute path names >>> >> # file: cephfs/exports/smbtest >>> >> ceph.dir.rbytes="4129644548" >>> >> >>> >> HOST B (incorrect values) >>> >> $ ls -alF /cephfs/exports/smbtest >>> >> total 4032857 >>> >> drwxrwxrwx 1 root root 2389190660 May 31 11:28 ./ >>> >> drwxr-xr-x 1 root root 4129644548 May 31 11:25 ../ >>> >> -rw-r--r-- 1 2000501 2000514 4096 May 31 11:26 ._.DS_Store >>> >> -rw-r--r-- 1 2000501 2000514 6148 Jun 1 14:37 .DS_Store >>> >> -rw-r--r-- 1 2000501 2000514 4129634304 Jun 12 15:25 >>> >> test-2017-05-30-m1.iso >>> >> >>> >> $ getfattr -d -m ceph.dir.rbytes /cephfs/exports/smbtest >>> >> getfattr: Removing leading '/' from absolute path names >>> >> # file: cephfs/exports/smbtest >>> >> ceph.dir.rbytes="2389190660" >>> >> -- >>> >> To unsubscribe from this list: send the line "unsubscribe ceph-devel" >>> >> in >>> >> the body of a message to majordomo@xxxxxxxxxxxxxxx >>> >> More majordomo info at http://vger.kernel.org/majordomo-info.html >> >> -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
