Hi, We are observing MAX-Available capacity is not reflecting the full size of the cluster. We are running mimic version. initially we installed 3 osd-host containing 5.5TB X 8 each . That time max_available was 39TB. After two year we had installed two more servers with the same spec(5.5TB X 8 each). So total capacity should around 75TB. But still its showing 39TB. # ceph df GLOBAL: SIZE AVAIL RAW USED %RAW USED 272 TiB 197 TiB 75 TiB 27.68 POOLS: NAME ID USED %USED MAX AVAIL OBJECTS images 16 243 GiB 0.60 39 TiB 31955 volumes 17 22 TiB 36.34 39 TiB 5951619 vms 18 82 MiB 0 39 TiB 1950 gnocchi 32 1.7 GiB 0 39 TiB 184973 .rgw.root 35 1.1 KiB 0 39 TiB 4 default.rgw.control 36 0 B 0 39 TiB 8 default.rgw.meta 37 37 KiB 0 39 TiB 189 default.rgw.log 38 0 B 0 39 TiB 207 default.rgw.buckets.index 39 0 B 0 39 TiB 66 default.rgw.buckets.data 40 930 GiB 2.25 39 TiB 322068 default.rgw.buckets.non-ec 49 0 B 0 39 TiB 4 # ceph osd df ID CLASS WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR PGS 0 hdd 5.57100 1.00000 5.6 TiB 2.1 TiB 3.5 TiB 37.45 1.35 871 1 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.99 1.23 840 2 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.8 TiB 31.30 1.13 831 3 hdd 5.57100 1.00000 5.6 TiB 2.1 TiB 3.4 TiB 38.51 1.39 888 4 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.7 TiB 32.97 1.19 866 5 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.6 TiB 35.85 1.30 837 6 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.8 TiB 31.89 1.15 858 7 hdd 5.57100 1.00000 5.6 TiB 1.6 TiB 3.9 TiB 29.42 1.06 851 8 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.31 1.20 799 9 hdd 5.57100 1.00000 5.6 TiB 1.6 TiB 4.0 TiB 28.53 1.03 793 10 hdd 5.57100 1.00000 5.6 TiB 1.6 TiB 3.9 TiB 29.29 1.06 839 11 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.6 TiB 35.92 1.30 860 12 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.37 1.21 904 13 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.8 TiB 32.28 1.17 807 14 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.92 1.23 845 15 hdd 5.57100 1.00000 5.6 TiB 2.1 TiB 3.5 TiB 37.33 1.35 836 16 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.9 TiB 30.89 1.12 881 17 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.8 TiB 32.42 1.17 876 18 hdd 5.57100 1.00000 5.6 TiB 2.3 TiB 3.2 TiB 41.98 1.52 860 19 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.9 TiB 29.70 1.07 828 20 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 34.39 1.24 854 21 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.38 1.21 845 22 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.7 TiB 32.97 1.19 797 23 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.5 TiB 36.47 1.32 839 24 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.5 TiB 36.71 1.33 829 25 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.9 TiB 30.63 1.11 878 26 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.5 TiB 36.40 1.32 867 27 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.8 TiB 30.90 1.12 842 28 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.8 TiB 31.88 1.15 821 29 hdd 5.57100 1.00000 5.6 TiB 1.8 TiB 3.7 TiB 33.20 1.20 871 30 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.6 TiB 35.71 1.29 813 31 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.9 TiB 30.37 1.10 812 32 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 34.39 1.24 836 33 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.8 TiB 31.34 1.13 884 34 hdd 5.57100 1.00000 5.6 TiB 2.0 TiB 3.5 TiB 36.40 1.32 829 35 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.6 TiB 34.54 1.25 900 36 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.51 1.21 838 37 hdd 5.57100 1.00000 5.6 TiB 2.1 TiB 3.5 TiB 37.92 1.37 796 38 hdd 5.57100 1.00000 5.6 TiB 1.7 TiB 3.8 TiB 31.03 1.12 841 39 hdd 5.57100 1.00000 5.6 TiB 1.9 TiB 3.7 TiB 33.51 1.21 830 Regards, Munna _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx