Hi Nicola, Yes, this issue is already fixed in main [1] and the quincy backport is still pending to be merged. Hopefully will be available in the next Quincy release. [1] https://github.com/ceph/ceph/pull/48027 [2] https://github.com/ceph/ceph/pull/54469 Thanks and Regards, Kotresh H R On Wed, May 15, 2024 at 7:51 PM Fabien Sirjean <fsirjean@xxxxxxxxxxxx> wrote: > Hi, > > We have the same issue. It seems to come from this bug : > https://access.redhat.com/solutions/6982902 > > We had to disable root_squash, which of course is a huge issue... > > Cheers, > > Fabien > > > On 5/15/24 12:54, Nicola Mori wrote: > > Dear Ceph users, > > > > I'm trying to export a CephFS with the root_squash option. This is the > > client configuration: > > > > client.wizardfs_rootsquash > > key: XXXXXXXXXXXX > > caps: [mds] allow rw fsname=wizardfs root_squash > > caps: [mon] allow r fsname=wizardfs > > caps: [osd] allow rw tag cephfs data=wizardfs > > > > I can mount it flawlessly on several machines using the kernel driver, > > but when a machine writes on it then the content seems fine from the > > writing machine but it's not actually written on disk since other > > machines just see an empty file: > > > > [12:43 mori@stryke ~]$ echo test > /wizard/ceph/software/el9/test > > [12:43 mori@stryke ~]$ ll /wizard/ceph/software/el9/test > > -rw-r--r-- 1 mori wizard 5 mag 15 12:43 /wizard/ceph/software/el9/test > > [12:43 mori@stryke ~]$ cat /wizard/ceph/software/el9/test > > test > > [12:43 mori@stryke ~]$ > > > > [mori@fili ~]$ ll /wizard/ceph/software/el9/test > > -rw-r--r--. 1 mori 1014 0 May 15 06:43 /wizard/ceph/software/el9/test > > [mori@fili ~]$ cat /wizard/ceph/software/el9/test > > [mori@fili ~]$ > > > > Unmounting and then remounting on "stryke" the file is seen as empty, > > so I guess that the content shown just after the write is only a cache > > effect and nothing is effectively written on disk. I checked the posix > > permissions on the folder and I have rw rights from both the machines. > > > > All of the above using Ceph 18.2.2 on the cluster (deployed with > > cephadm) and both the machines. Machine "fili" has kernel 5.14.0 while > > "stryke" has 6.8.9. The same issue happens consistently also in the > > reverse direction (writing from "fili" and reading from "stryke"), and > > also with other machines. > > > > Removing the squash_root option the problem vanishes. > > > > I don't know what might > > > > > > _______________________________________________ > > ceph-users mailing list -- ceph-users@xxxxxxx > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx