Hello,
we want to disable readproxy cache tier but before doing so we would like to make sure we won't loose data.
Is there a way to confirm that flush actually write objects to disk ?
We're using ceph version 0.94.6.
I tried that, with cephfs_data_ro_cache being the hot storage pool and cephfs_data being the cold storage pool
# rados -p cephfs_data_ro_cache ls
then choose a random object in the list : 100004d6142.00000000
Find the object on cache disk :
# ceph osd map cephfs_data_ro_cache 100004d6142.00000000
osdmap e301 pool 'cephfs_data_ro_cache' (6) object '100004d6142.00000000' -> pg 6.d010000 (6.0) -> up ([4,5,8], p4) acting ([4,5,8], p4)
Object is in the pg 6.0 on OSD 4, 5 and 8, I can find the file on disk.
# ls -l /var/lib/ceph/osd/ceph-4/current/6.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.00000000__head_0D010000__6
-rw-r--r--. 1 root root 0 Apr 8 19:36 /var/lib/ceph/osd/ceph-4/current/6.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.00000000__head_0D010000__6
Flush the object :
# rados -p cephfs_data_ro_cache cache-try-flush 100004d6142.00000000
Find the object on disk :
# ceph osd map cephfs_data 100004d6142.00000000
osdmap e301 pool 'cephfs_data' (1) object '100004d6142.00000000' -> pg 1.d010000 (1.0) -> up ([1,7,2], p1) acting ([1,7,2], p1)
Object is in the pg 1.0 on OSD 1, 7 and 2, I can't find the file on disk on any of the 3 OSDs
# ls -l /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.*
ls: cannot access /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.*: No such file or directory
What am I doing wrong ? To me it seems that nothing is actually flushed to disk.
we want to disable readproxy cache tier but before doing so we would like to make sure we won't loose data.
Is there a way to confirm that flush actually write objects to disk ?
We're using ceph version 0.94.6.
I tried that, with cephfs_data_ro_cache being the hot storage pool and cephfs_data being the cold storage pool
# rados -p cephfs_data_ro_cache ls
then choose a random object in the list : 100004d6142.00000000
Find the object on cache disk :
# ceph osd map cephfs_data_ro_cache 100004d6142.00000000
osdmap e301 pool 'cephfs_data_ro_cache' (6) object '100004d6142.00000000' -> pg 6.d010000 (6.0) -> up ([4,5,8], p4) acting ([4,5,8], p4)
Object is in the pg 6.0 on OSD 4, 5 and 8, I can find the file on disk.
# ls -l /var/lib/ceph/osd/ceph-4/current/6.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.00000000__head_0D010000__6
-rw-r--r--. 1 root root 0 Apr 8 19:36 /var/lib/ceph/osd/ceph-4/current/6.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.00000000__head_0D010000__6
Flush the object :
# rados -p cephfs_data_ro_cache cache-try-flush 100004d6142.00000000
Find the object on disk :
# ceph osd map cephfs_data 100004d6142.00000000
osdmap e301 pool 'cephfs_data' (1) object '100004d6142.00000000' -> pg 1.d010000 (1.0) -> up ([1,7,2], p1) acting ([1,7,2], p1)
Object is in the pg 1.0 on OSD 1, 7 and 2, I can't find the file on disk on any of the 3 OSDs
# ls -l /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.*
ls: cannot access /var/lib/ceph/osd/ceph-1/current/1.0_head/DIR_0/DIR_0/DIR_0/DIR_0/100004d6142.*: No such file or directory
What am I doing wrong ? To me it seems that nothing is actually flushed to disk.
Thank you,
Ben.
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
