Hi Greg,
yes directory is hashed four levels deep and contain files
# ls -l /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/
total 908
-rw-r--r--. 1 root root 601 Mar 15 15:01 10000021bdf.00000000__head_E5BD0000__1
-rw-r--r--. 1 root root 178571 Mar 15 15:06 10000026de5.00000000__head_7E280000__1
-rw-r--r--. 1 root root 7853 Mar 15 15:16 10000030a58.00000000__head_0DA40000__1
-rw-r--r--. 1 root root 0 Mar 17 12:51 100000c1ccc.00000000__head_D0730000__1
-rw-r--r--. 1 root root 0 Mar 17 17:23 100000fc00c.00000000__head_83020000__1
-rw-r--r--. 1 root root 0 Mar 17 17:23 100000fcae7.00000000__head_C3A70000__1
[...]
2016-04-25 17:27 GMT+02:00 Gregory Farnum <gfarnum@xxxxxxxxxx>:
On Thursday, April 21, 2016, Benoît LORIOT <benoit.loriot@xxxxxxxx> wrote:Hello,
we want to disable readproxy cache tier but before doing so we would like to make sure we won't loose data.
Is there a way to confirm that flush actually write objects to disk ?
We're using ceph version 0.94.6.
I tried that, with cephfs_data_ro_cache being the hot storage pool and cephfs_data being the cold storage pool
# rados -p cephfs_data_ro_cache ls
then choose a random object in the list : 100004d6142.00000000
Find the object on cache disk :
# ceph osd map cephfs_data_ro_cache 100004d6142.00000000
osdmap e301 pool 'cephfs_data_ro_cache' (6) object '100004d6142.00000000' -> pg 6.d010000 (6.0) -> up ([4,5,8], p4) acting ([4,5,8], p4)
Object is in the pg 6.0 on OSD 4, 5 and 8, I can find the file on disk.
# ls -l /var/lib/ceph/osd/ceph-4/current/6.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.00000000__head_0D010000__6
-rw-r--r--. 1 root root 0 Apr 8 19:36 /var/lib/ceph/osd/ceph-4/current/6.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.00000000__head_0D010000__6
Flush the object :
# rados -p cephfs_data_ro_cache cache-try-flush 100004d6142.00000000
Find the object on disk :
# ceph osd map cephfs_data 100004d6142.00000000
osdmap e301 pool 'cephfs_data' (1) object '100004d6142.00000000' -> pg 1.d010000 (1.0) -> up ([1,7,2], p1) acting ([1,7,2], p1)
Object is in the pg 1.0 on OSD 1, 7 and 2, I can't find the file on disk on any of the 3 OSDs
# ls -l /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.*
ls: cannot access /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.*: No such file or directory
What am I doing wrong ? To me it seems that nothing is actually flushed to disk.Is the directory actually hashed four levels deep? Or is it shallower and you're looking too far down?-GregThank you,Ben.
--
________________________________________________________
Cordialement,
Benoit LORIOT
Cordialement,
Benoit LORIOT
Ligne directe: 07 85 22 44 57
________________________________________________________
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
