Please disregard this. I have a error in my target_max_bytes, that was causing the issue. I now have it evicting the cache. Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Jim Kilborn<mailto:jim@xxxxxxxxxxxx> Sent: Tuesday, September 20, 2016 12:59 PM To: ceph-users@xxxxxxxxxxxxxx<mailto:ceph-users@xxxxxxxxxxxxxx> Subject: cache tier not flushing 10.2.2 Simple issue I cant find with the cache tier. Thanks for taking the time… Setup a new cluster with ssd cache tier. My cache tier is on 1TB ssd. With 2 replicas. It just fills up my cache until the ceph filesystem stops allowing access. I even set the target_max_bytes to 1048576 (1GB) and still doesn’t flush. Here are the settings: Setup the pools ceph osd pool create cephfs-cache 512 512 replicated ssd_ruleset ceph osd pool create cephfs-metadata 512 512 replicated ssd_ruleset ceph osd pool create cephfs-data 512 512 erasure default spinning_ruleset ceph osd pool set cephfs-cache min_size 1 ceph osd pool set cephfs-cache size 2 ceph osd pool set cephfs-metadata min_size 1 ceph osd pool set cephfs-metadata size 2 Add tiers ceph osd tier add cephfs-data cephfs-cache ceph osd tier cache-mode cephfs-cache writeback ceph osd tier set-overlay cephfs-data cephfs-cache ceph osd pool set cephfs-cache hit_set_type bloom ceph osd pool set cephfs-cache hit_set_count 1 ceph osd pool set cephfs-cache hit_set_period 3600 ceph osd pool set cephfs-cache target_max_bytes 1048576 # 1 TB ceph osd pool set cephfs-cache cache_target_dirty_ratio 0.4 # percentage of target_max_bytes before flushes dirty objects ceph osd pool set cephfs-cache cache_target_dirty_high_ratio 0.6 # percentage of target_max_bytes before flushes dirty objects more aggressively ceph osd pool set cephfs-cache cache_target_full_ratio 0.80 # percentage of cache full before evicts objects Am I missing something stupid? Must be. I can cause it to flush with rados -p cephfs-cache cache-try-flush-evict-all Should my metadata not be on the same pool as the cache pool? I cant figure out why it doesn’t start flushing when I copy over 2 GB data. It just goes to 'cephfs-cache' at/near target max Regards, Jim Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |