Hello, > Try to work with the tunables: > > $ *ceph osd crush show-tunables* > { > "choose_local_tries": 0, > "choose_local_fallback_tries": 0, > "choose_total_tries": 50, > "chooseleaf_descend_once": 1, > "chooseleaf_vary_r": 1, > "chooseleaf_stable": 0, > "straw_calc_version": 1, > "allowed_bucket_algs": 54, > "profile": "hammer", > "optimal_tunables": 0, > "legacy_tunables": 0, > "minimum_required_version": "firefly", > "require_feature_tunables": 1, > "require_feature_tunables2": 1, > "has_v2_rules": 0, > "require_feature_tunables3": 1, > "has_v3_rules": 0, > "has_v4_buckets": 0, > "require_feature_tunables5": 0, > "has_v5_rules": 0 > } > > try to 'disable' the '*require_feature_tunables5*', with that I think you should be ok, maybe there's another way, but that works for me. One > way to change it, is to comment out in the crushmap the option "*tunable chooseleaf_stable 1*" and inject the crushmap again in the cluster (of > course that would produce on a lot of data moving on the pgs) Thanks a lot, I removed the line "tunable chooseleaf_stable 1" from the crushmap and it works now ! root@iccluster013:~# df -h /mnt/ Filesystem Size Used Avail Use% Mounted on 10.90.38.17,10.90.38.18,10.90.39.5:/ 66T 19G 66T 1% /mnt Best regards, -- Yoann Moulin EPFL IC-IT _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com