Hi Zheng, Yes, it was mounted implicitly with acl's enabled. I disabled it by adding "noacl" to the mount command, and now the behaviour is correct! No more changing permissions. So it appears to be related to acl's indeed, even though I didn't actually set any acl's. Simply mounting with acl's enabled was enough to cause the issue apparently. So, do you have enough information to possibly fix it, or is there any way that I can provide additional information? Thanks, Erik. On 06/30/2014 05:13 AM, Yan, Zheng wrote: > On Mon, Jun 30, 2014 at 4:25 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: >> Hi Zheng, >> >> Okay, so on host1 I did: >> >> # echo module ceph +p > /sys/kernel/debug/dynamic_debug/control >> # mkdir hoi >> mkdir: kan map 'hoi' niet aanmaken: Bestand bestaat al >> # mkdir hoi2 >> # ls -al >> drwxr-xr-x 1 root root 0 29 jun 22:12 hoi >> drwxr-xr-x 1 root root 0 29 jun 22:16 hoi2 >> # dmesg > /host1.log > > Did you have Posix ACL enabled? A bug in Posix ACL support code can > cause this issue. > > Regards > Yan, Zheng > > >> >> On host2 I did: >> >> # echo module ceph +p > /sys/kernel/debug/dynamic_debug/control >> # ls -al >> drwxrwxrwx 1 root root 0 29 jun 22:12 hoi >> drwxrwxrwx 1 root root 0 29 jun 22:16 hoi2 >> # dmesg > /host2.log >> >> Please find attached both host1.log and host2.log >> >> Thanks, >> >> Erik. >> >> >> On 06/20/2014 08:04 AM, Yan, Zheng wrote: >>> On Fri, Jun 20, 2014 at 6:13 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: >>>> Hi Zheng, >>>> >>>> Additionally, I notice that as long as I don't do anything with that >>>> directory, the permissions stay wrong. >>>> >>>> Previously I noticed that the permissions eventually got right by >>>> themselves, but I don't know what triggered it. >>>> >>>> Also, the permission problem is not just with the first ever created >>>> directory, it happens to files too: >>>> >>>> [host1 bla]# touch hoi >>>> [host1 bla]# ls -al >>>> -rw-r--r-- 1 root root 0 20 jun 00:05 hoi >>>> >>>> [host2 bla]# ls -al >>>> -rw-rw-rw- 1 root root 0 20 jun 00:05 hoi >>>> >>>> Notice the additional group and world writable flags. It works the other >>>> way round too: >>>> >>>> [host2 bla]# touch hoi2 >>>> [host2 bla]# ls -al >>>> -rw-r--r-- 1 root root 0 20 jun 00:09 hoi2 >>>> >>>> [host1 bla]# ls -al >>>> -rw-rw-rw- 1 root root 0 20 jun 00:09 hoi2 >>>> >>>> However now after a couple of seconds I re-check on host2, and the >>>> permissons have changed there as well: >>>> >>>> [host2 bla]# ls -al >>>> -rw-rw-rw- 1 root root 0 20 jun 00:09 hoi2 >>>> >>>> So now it's group and world writable on both hosts. >>> >>> I can't reproduce this locally. Please enable dynamic debugging for >>> ceph (echo module ceph +p > /sys/kernel/debug/dynamic_debug/control) >>> and send kernel log to me. >>> >>> Regards >>> Yan, Zheng >>> >>>> >>>> Kind regards, >>>> >>>> Erik. >>>> >>>> >>>> On 06/19/2014 11:37 PM, Erik Logtenberg wrote: >>>>> I am using the kernel client. >>>>> >>>>> kernel: 3.14.4-100.fc19.x86_64 >>>>> ceph: ceph-0.80.1-0.fc19.x86_64 >>>>> >>>>> Actually, I seem to be able to reproduce it quite reliably. I just reset >>>>> my cephfs (fiddling with erasure coded pools which was no success), so >>>>> just for kicks tried again with creating a directory. Exactly the same >>>>> results. >>>>> >>>>> Kind regards, >>>>> >>>>> Erik. >>>>> >>>>> >>>>> >>>>> On 06/16/2014 02:32 PM, Yan, Zheng wrote: >>>>>> were you using ceph-fuse or kernel client? ceph version and kernel >>>>>> version? how reliably you can reproduce this problem? >>>>>> >>>>>> Regards >>>>>> Yan, Zheng >>>>>> >>>>>> On Sun, Jun 15, 2014 at 4:42 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: >>>>>>> Hi, >>>>>>> >>>>>>> So... I wrote some files into that directory to test performance, and >>>>>>> now I notice that both hosts see the permissions the right way, like >>>>>>> they were when I first created the directory. >>>>>>> >>>>>>> What is going on here? .. >>>>>>> >>>>>>> Erik. >>>>>>> >>>>>>> >>>>>>> On 06/14/2014 10:32 PM, Erik Logtenberg wrote: >>>>>>>> Hi, >>>>>>>> >>>>>>>> I ran into a weird issue with cephfs today. I create a directory like this: >>>>>>>> >>>>>>>> # mkdir bla >>>>>>>> # ls -al >>>>>>>> drwxr-xr-x 1 root root 0 14 jun 22:22 bla >>>>>>>> >>>>>>>> Now on another host, with the same cephfs mounted, I see different >>>>>>>> permissions: >>>>>>>> >>>>>>>> # ls -al >>>>>>>> drwxrwxrwx 1 root root 0 14 jun 22:22 bla >>>>>>>> >>>>>>>> Weird, huh? >>>>>>>> >>>>>>>> Back to host #1, I unmount cephfs and mount it again. Now it sees the >>>>>>>> same (changed) permissions as I saw on the second host: >>>>>>>> >>>>>>>> # ls -al >>>>>>>> drwxrwxrwx 1 root root 0 14 jun 22:22 bla >>>>>>>> >>>>>>>> So... what happened to the original permissions and why did they change? >>>>>>>> >>>>>>>> Thanks, >>>>>>>> >>>>>>>> Erik. >>>>>>>> _______________________________________________ >>>>>>>> ceph-users mailing list >>>>>>>> ceph-users at lists.ceph.com >>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>>>> >>>>>>> _______________________________________________ >>>>>>> ceph-users mailing list >>>>>>> ceph-users at lists.ceph.com >>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> ceph-users at lists.ceph.com >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> >>>> _______________________________________________ >>>> ceph-users mailing list >>>> ceph-users at lists.ceph.com >>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |