Hello Greg, even after 48h the files are still there and the PG is still in: active+clean+inconsistent+snaptrim state. Greets, Stefan Am 05.08.2017 um 21:43 schrieb Gregory Farnum: > is OSD 20 actually a member of the pg right now? It could be stray data > that is slowly getting cleaned up. > > Also, you've got "snapdir" listings there. Those indicate the object is > snapshotted but the "head" got deleted. So it may just be delayed > cleanup of snapshots. > > On Sat, Aug 5, 2017 at 12:34 PM Stefan Priebe - Profihost AG > <s.priebe@xxxxxxxxxxxx <mailto:s.priebe@xxxxxxxxxxxx>> wrote: > > Hello, > > today i deleted an rbd image which had the following > prefix: > > block_name_prefix: rbd_data.106dd406b8b4567 > > the rm command went fine. > > also the rados list command does not show any objects with that string: > # rados -p rbd ls | grep 106dd406b8b4567 > > But find on an osd still has them? > > osd.20]# find . -name "*106dd406b8b4567*" -exec ls -la "{}" \; > -rw-r--r-- 1 ceph ceph 4194304 Aug 5 09:32 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_8/rbd\udata.106dd406b8b4567.0000000000002315__9d5e4_9E65861A__3 > -rw-r--r-- 1 ceph ceph 4194304 Aug 5 09:36 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_8/rbd\udata.106dd406b8b4567.0000000000002315__9d84a_9E65861A__3 > -rw-r--r-- 1 ceph ceph 0 Aug 5 11:47 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_8/rbd\udata.106dd406b8b4567.0000000000002315__snapdir_9E65861A__3 > -rw-r--r-- 1 ceph ceph 4194304 Aug 5 09:49 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d455_BCB2A61A__3 > -rw-r--r-- 1 ceph ceph 1400832 Aug 5 09:32 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d5e4_BCB2A61A__3 > -rw-r--r-- 1 ceph ceph 1400832 Aug 5 09:32 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d84a_BCB2A61A__3 > -rw-r--r-- 1 ceph ceph 0 Aug 5 11:47 > ./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__snapdir_BCB2A61A__3 > > Greets, > Stefan > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com