On Wed, Jul 2, 2014 at 5:19 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: > Hi Zheng, > > Yes, it was mounted implicitly with acl's enabled. I disabled it by > adding "noacl" to the mount command, and now the behaviour is correct! > No more changing permissions. > > So it appears to be related to acl's indeed, even though I didn't > actually set any acl's. Simply mounting with acl's enabled was enough to > cause the issue apparently. > > So, do you have enough information to possibly fix it, or is there any > way that I can provide additional information? Yes, I already have enough information. Thank you for reporting this. Yan, Zheng > > Thanks, > > Erik. > > > On 06/30/2014 05:13 AM, Yan, Zheng wrote: >> On Mon, Jun 30, 2014 at 4:25 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: >>> Hi Zheng, >>> >>> Okay, so on host1 I did: >>> >>> # echo module ceph +p > /sys/kernel/debug/dynamic_debug/control >>> # mkdir hoi >>> mkdir: kan map 'hoi' niet aanmaken: Bestand bestaat al >>> # mkdir hoi2 >>> # ls -al >>> drwxr-xr-x 1 root root 0 29 jun 22:12 hoi >>> drwxr-xr-x 1 root root 0 29 jun 22:16 hoi2 >>> # dmesg > /host1.log >> >> Did you have Posix ACL enabled? A bug in Posix ACL support code can >> cause this issue. >> >> Regards >> Yan, Zheng >> >> >>> >>> On host2 I did: >>> >>> # echo module ceph +p > /sys/kernel/debug/dynamic_debug/control >>> # ls -al >>> drwxrwxrwx 1 root root 0 29 jun 22:12 hoi >>> drwxrwxrwx 1 root root 0 29 jun 22:16 hoi2 >>> # dmesg > /host2.log >>> >>> Please find attached both host1.log and host2.log >>> >>> Thanks, >>> >>> Erik. >>> >>> >>> On 06/20/2014 08:04 AM, Yan, Zheng wrote: >>>> On Fri, Jun 20, 2014 at 6:13 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: >>>>> Hi Zheng, >>>>> >>>>> Additionally, I notice that as long as I don't do anything with that >>>>> directory, the permissions stay wrong. >>>>> >>>>> Previously I noticed that the permissions eventually got right by >>>>> themselves, but I don't know what triggered it. >>>>> >>>>> Also, the permission problem is not just with the first ever created >>>>> directory, it happens to files too: >>>>> >>>>> [host1 bla]# touch hoi >>>>> [host1 bla]# ls -al >>>>> -rw-r--r-- 1 root root 0 20 jun 00:05 hoi >>>>> >>>>> [host2 bla]# ls -al >>>>> -rw-rw-rw- 1 root root 0 20 jun 00:05 hoi >>>>> >>>>> Notice the additional group and world writable flags. It works the other >>>>> way round too: >>>>> >>>>> [host2 bla]# touch hoi2 >>>>> [host2 bla]# ls -al >>>>> -rw-r--r-- 1 root root 0 20 jun 00:09 hoi2 >>>>> >>>>> [host1 bla]# ls -al >>>>> -rw-rw-rw- 1 root root 0 20 jun 00:09 hoi2 >>>>> >>>>> However now after a couple of seconds I re-check on host2, and the >>>>> permissons have changed there as well: >>>>> >>>>> [host2 bla]# ls -al >>>>> -rw-rw-rw- 1 root root 0 20 jun 00:09 hoi2 >>>>> >>>>> So now it's group and world writable on both hosts. >>>> >>>> I can't reproduce this locally. Please enable dynamic debugging for >>>> ceph (echo module ceph +p > /sys/kernel/debug/dynamic_debug/control) >>>> and send kernel log to me. >>>> >>>> Regards >>>> Yan, Zheng >>>> >>>>> >>>>> Kind regards, >>>>> >>>>> Erik. >>>>> >>>>> >>>>> On 06/19/2014 11:37 PM, Erik Logtenberg wrote: >>>>>> I am using the kernel client. >>>>>> >>>>>> kernel: 3.14.4-100.fc19.x86_64 >>>>>> ceph: ceph-0.80.1-0.fc19.x86_64 >>>>>> >>>>>> Actually, I seem to be able to reproduce it quite reliably. I just reset >>>>>> my cephfs (fiddling with erasure coded pools which was no success), so >>>>>> just for kicks tried again with creating a directory. Exactly the same >>>>>> results. >>>>>> >>>>>> Kind regards, >>>>>> >>>>>> Erik. >>>>>> >>>>>> >>>>>> >>>>>> On 06/16/2014 02:32 PM, Yan, Zheng wrote: >>>>>>> were you using ceph-fuse or kernel client? ceph version and kernel >>>>>>> version? how reliably you can reproduce this problem? >>>>>>> >>>>>>> Regards >>>>>>> Yan, Zheng >>>>>>> >>>>>>> On Sun, Jun 15, 2014 at 4:42 AM, Erik Logtenberg <erik at logtenberg.eu> wrote: >>>>>>>> Hi, >>>>>>>> >>>>>>>> So... I wrote some files into that directory to test performance, and >>>>>>>> now I notice that both hosts see the permissions the right way, like >>>>>>>> they were when I first created the directory. >>>>>>>> >>>>>>>> What is going on here? .. >>>>>>>> >>>>>>>> Erik. >>>>>>>> >>>>>>>> >>>>>>>> On 06/14/2014 10:32 PM, Erik Logtenberg wrote: >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> I ran into a weird issue with cephfs today. I create a directory like this: >>>>>>>>> >>>>>>>>> # mkdir bla >>>>>>>>> # ls -al >>>>>>>>> drwxr-xr-x 1 root root 0 14 jun 22:22 bla >>>>>>>>> >>>>>>>>> Now on another host, with the same cephfs mounted, I see different >>>>>>>>> permissions: >>>>>>>>> >>>>>>>>> # ls -al >>>>>>>>> drwxrwxrwx 1 root root 0 14 jun 22:22 bla >>>>>>>>> >>>>>>>>> Weird, huh? >>>>>>>>> >>>>>>>>> Back to host #1, I unmount cephfs and mount it again. Now it sees the >>>>>>>>> same (changed) permissions as I saw on the second host: >>>>>>>>> >>>>>>>>> # ls -al >>>>>>>>> drwxrwxrwx 1 root root 0 14 jun 22:22 bla >>>>>>>>> >>>>>>>>> So... what happened to the original permissions and why did they change? >>>>>>>>> >>>>>>>>> Thanks, >>>>>>>>> >>>>>>>>> Erik. >>>>>>>>> _______________________________________________ >>>>>>>>> ceph-users mailing list >>>>>>>>> ceph-users at lists.ceph.com >>>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> ceph-users mailing list >>>>>>>> ceph-users at lists.ceph.com >>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>> _______________________________________________ >>>>>> ceph-users mailing list >>>>>> ceph-users at lists.ceph.com >>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>> >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> ceph-users at lists.ceph.com >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com