On Wed, Dec 21, 2016 at 6:58 PM, Stéphane Klein <contact@xxxxxxxxxxxxxxxxxxx> wrote: > > > 2016-12-21 18:47 GMT+01:00 Ilya Dryomov <idryomov@xxxxxxxxx>: >> >> On Wed, Dec 21, 2016 at 5:50 PM, Stéphane Klein >> <contact@xxxxxxxxxxxxxxxxxxx> wrote: >> > I have configured: >> > >> > ``` >> > ceph osd crush tunables firefly >> > ``` >> >> If it gets to rm, then it's probably not tunables. Are you running >> these commands by hand? > > > Yes, I have executed this command on my mon-1 host > >> >> >> Anything in dmesg? > > > > This: > > ``` > [ 614.278589] SELinux: initialized (dev tmpfs, type tmpfs), uses transition > SIDs > [ 910.797793] SELinux: initialized (dev tmpfs, type tmpfs), uses transition > SIDs > [ 1126.251705] SELinux: initialized (dev tmpfs, type tmpfs), uses transition > SIDs > [ 1214.030659] Key type dns_resolver registered > [ 1214.042308] Key type ceph registered > [ 1214.043852] libceph: loaded (mon/osd proto 15/24) > [ 1214.045944] rbd: loaded (major 252) > [ 1214.053449] libceph: client4200 fsid 7ecb6ebd-2e7a-44c3-bf0d-ff8d193e03ac > [ 1214.056406] libceph: mon0 172.28.128.2:6789 session established > [ 1214.066596] rbd0: unknown partition table > [ 1214.066875] rbd: rbd0: added with size 0x19000000 > [ 1219.120342] EXT4-fs (rbd0): mounted filesystem with ordered data mode. > Opts: (null) > [ 1219.120754] SELinux: initialized (dev rbd0, type ext4), uses xattr > ``` > > If I reboot my client host, and remount this disk then I can delete the > folder with "rm -rf" with success. I'm not following - you are running 7 VMs - 3 mon VMs, 3 osd VMs and a "ceph-client" VM. If ceph-client is debian the test case works, if it's something RHEL-based it doesn't, correct? Are they all on the same bare metal host? Which of these are you rebooting? Try dumping /sys/kernel/debug/ceph/<fsid.clientid>/osdc on the ceph-client VM when rm hangs. That should show in-flight OSD requests, if any. Thanks, Ilya _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com