Dear all,
I'm running Ceph 14.2.11. I have 140 HDDs in my cluster of 4 nodes, 35 HDDs
per node. I am observing fill ratios of 66% to 70% of OSDs and then one
with 82% (see attached ceph-osd-df.txt for output of "ceph osd df").
Previously, I had problems with single OSDs filling up to 85% and then
everything coming to a grinding halt. Ideally, I would like to have all OSD
fill grade to be close to the mean of 67%... At the very least I need to
get the 82% OSD back into the range.
I have upmap balancing enabled and the balancer says:
# ceph balancer status
{
"last_optimize_duration": "0:00:00.053686",
"plans": [],
"mode": "upmap",
"active": true,
"optimize_result": "Unable to find further optimization, or pool(s)
pg_num is decreasing, or distribution is already perfect",
"last_optimize_started": "Wed Jul 28 09:03:02 2021"
}
Creating an offline balancing plan looks like this:
# ceph osd getmap -o om
got osdmap epoch 281708
# osdmaptool om --upmap out.txt --upmap-pool hdd_ec --upmap-deviation 1
--upmap-active
osdmaptool: osdmap file 'om'
writing upmap command output to: out.txt
checking for upmap cleanups
upmap, max-count 10, max deviation 1
limiting to pools hdd_ec ([3])
pools hdd_ec
prepared 0/10 changes
Time elapsed 0.0275739 secs
Unable to find further optimization, or distribution is already perfect
osd.0 pgs 43
[...]
# wc -l out.txt
0 out.txt
Does anyone have a suggestion how to proceed getting the 82% OSD closer to
the mean fill ratio (and maybe the other OSDs as well?)
Thanks,
Manuel
ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS
0 hdd 14.55298 1.00000 15 TiB 12 TiB 12 TiB 38 MiB 31 GiB 2.7 TiB 81.51 1.22 48 up
5 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 49 MiB 30 GiB 4.7 TiB 67.55 1.01 52 up
10 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 29 MiB 29 GiB 4.7 TiB 67.52 1.01 50 up
14 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 32 MiB 29 GiB 4.7 TiB 67.41 1.01 50 up
19 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 43 MiB 16 GiB 4.7 TiB 67.62 1.01 52 up
23 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 22 MiB 30 GiB 4.7 TiB 67.59 1.01 49 up
27 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.9 TiB 44 MiB 28 GiB 4.7 TiB 67.99 1.02 50 up
31 hdd 14.55298 1.00000 15 TiB 9.7 TiB 9.7 TiB 67 MiB 28 GiB 4.9 TiB 66.57 1.00 49 up
35 hdd 14.55298 1.00000 15 TiB 9.7 TiB 9.7 TiB 40 MiB 28 GiB 4.8 TiB 66.89 1.00 51 up
39 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 37 MiB 29 GiB 4.7 TiB 67.73 1.02 50 up
43 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.42 1.01 49 up
60 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 24 MiB 16 GiB 4.7 TiB 67.45 1.01 52 up
61 hdd 14.55299 1.00000 15 TiB 9.6 TiB 9.6 TiB 35 MiB 16 GiB 5.0 TiB 65.98 0.99 51 up
65 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 38 MiB 16 GiB 4.7 TiB 67.62 1.01 53 up
69 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 37 MiB 16 GiB 4.7 TiB 67.61 1.01 52 up
73 hdd 14.55299 1.00000 15 TiB 10 TiB 10 TiB 27 MiB 17 GiB 4.4 TiB 69.83 1.05 52 up
77 hdd 14.55299 1.00000 15 TiB 9.6 TiB 9.6 TiB 35 MiB 17 GiB 5.0 TiB 65.96 0.99 51 up
81 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.63 1.01 53 up
84 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 22 MiB 16 GiB 4.7 TiB 67.44 1.01 50 up
89 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 16 GiB 4.7 TiB 67.67 1.01 49 up
92 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.64 1.01 52 up
97 hdd 14.55299 1.00000 15 TiB 9.6 TiB 9.6 TiB 27 MiB 16 GiB 4.9 TiB 66.10 0.99 50 up
100 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.7 TiB 67.39 1.01 49 up
104 hdd 14.55298 1.00000 15 TiB 10 TiB 10 TiB 27 MiB 16 GiB 4.5 TiB 69.21 1.04 52 up
108 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 66 MiB 29 GiB 4.7 TiB 67.58 1.01 50 up
112 hdd 14.55298 1.00000 15 TiB 9.6 TiB 9.6 TiB 18 MiB 16 GiB 5.0 TiB 65.79 0.99 48 up
116 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.8 TiB 67.32 1.01 50 up
120 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 34 MiB 17 GiB 4.7 TiB 67.38 1.01 50 up
124 hdd 14.55298 1.00000 15 TiB 10 TiB 10 TiB 18 MiB 16 GiB 4.5 TiB 68.80 1.03 49 up
128 hdd 14.55298 1.00000 15 TiB 9.6 TiB 9.6 TiB 18 MiB 16 GiB 4.9 TiB 66.01 0.99 50 up
132 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.8 TiB 67.34 1.01 49 up
140 hdd 14.55298 1.00000 15 TiB 9.5 TiB 9.5 TiB 18 MiB 15 GiB 5.0 TiB 65.60 0.98 46 up
141 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 37 MiB 16 GiB 4.7 TiB 67.46 1.01 50 up
148 hdd 14.55269 1.00000 15 TiB 9.8 TiB 9.8 TiB 37 MiB 15 GiB 4.7 TiB 67.44 1.01 50 up
149 hdd 14.55269 1.00000 15 TiB 9.6 TiB 9.6 TiB 34 MiB 15 GiB 4.9 TiB 66.01 0.99 49 up
47 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.6 GiB 742 MiB 1.7 TiB 0.92 0.01 31 up
51 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.6 GiB 653 MiB 1.7 TiB 0.91 0.01 30 up
55 ssd 1.74699 1.00000 1.7 TiB 32 GiB 14 GiB 17 GiB 904 MiB 1.7 TiB 1.81 0.03 30 up
59 ssd 1.74699 1.00000 1.7 TiB 17 GiB 14 GiB 1.7 GiB 851 MiB 1.7 TiB 0.93 0.01 30 up
1 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 50 MiB 28 GiB 4.7 TiB 67.51 1.01 52 up
6 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 29 MiB 28 GiB 4.7 TiB 67.67 1.01 53 up
11 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 28 GiB 4.7 TiB 67.56 1.01 51 up
15 hdd 14.55298 1.00000 15 TiB 9.7 TiB 9.7 TiB 25 MiB 28 GiB 4.8 TiB 66.99 1.00 50 up
18 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 30 MiB 28 GiB 4.7 TiB 67.61 1.01 52 up
20 hdd 14.55298 1.00000 15 TiB 10 TiB 10 TiB 13 MiB 28 GiB 4.5 TiB 69.02 1.04 51 up
24 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 16 MiB 28 GiB 4.7 TiB 67.38 1.01 49 up
29 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 34 MiB 27 GiB 4.7 TiB 67.50 1.01 51 up
34 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 43 MiB 28 GiB 4.7 TiB 67.72 1.02 52 up
37 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 34 MiB 27 GiB 4.7 TiB 67.53 1.01 50 up
41 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 28 GiB 4.7 TiB 67.51 1.01 51 up
64 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 34 MiB 16 GiB 4.7 TiB 67.45 1.01 52 up
68 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.43 1.01 52 up
72 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 23 MiB 16 GiB 4.7 TiB 67.68 1.02 53 up
75 hdd 14.55299 1.00000 15 TiB 9.9 TiB 9.8 TiB 23 MiB 16 GiB 4.7 TiB 67.70 1.02 53 up
79 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.49 1.01 52 up
83 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 24 MiB 16 GiB 4.7 TiB 67.51 1.01 52 up
87 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 28 MiB 17 GiB 4.7 TiB 67.45 1.01 52 up
90 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.63 1.01 53 up
94 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 46 MiB 16 GiB 4.8 TiB 67.30 1.01 51 up
98 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 24 MiB 16 GiB 4.7 TiB 67.48 1.01 52 up
102 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.7 TiB 67.46 1.01 50 up
106 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.62 1.01 51 up
110 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 12 MiB 16 GiB 4.8 TiB 67.30 1.01 47 up
114 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.7 TiB 67.45 1.01 51 up
118 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 33 MiB 16 GiB 4.7 TiB 67.59 1.01 51 up
122 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 50 MiB 17 GiB 4.7 TiB 67.45 1.01 48 up
127 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 17 MiB 17 GiB 4.7 TiB 67.53 1.01 51 up
130 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 35 MiB 17 GiB 4.7 TiB 67.48 1.01 52 up
135 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 51 MiB 16 GiB 4.7 TiB 67.40 1.01 49 up
138 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.51 1.01 50 up
142 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.51 1.01 50 up
143 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 16 GiB 4.7 TiB 67.67 1.01 52 up
150 hdd 14.55269 1.00000 15 TiB 9.8 TiB 9.8 TiB 17 MiB 14 GiB 4.8 TiB 67.26 1.01 51 up
151 hdd 14.55269 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 14 GiB 4.7 TiB 67.46 1.01 49 up
46 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.5 GiB 650 MiB 1.7 TiB 0.91 0.01 30 up
50 ssd 1.74699 1.00000 1.7 TiB 29 GiB 14 GiB 14 GiB 679 MiB 1.7 TiB 1.63 0.02 30 up
54 ssd 1.74699 1.00000 1.7 TiB 29 GiB 14 GiB 14 GiB 718 MiB 1.7 TiB 1.63 0.02 30 up
58 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.3 GiB 695 MiB 1.7 TiB 0.90 0.01 30 up
2 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 31 MiB 29 GiB 4.7 TiB 67.60 1.01 52 up
4 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 52 MiB 29 GiB 4.7 TiB 67.70 1.02 53 up
8 hdd 14.55299 1.00000 15 TiB 9.9 TiB 9.8 TiB 21 MiB 29 GiB 4.7 TiB 67.73 1.02 53 up
12 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 24 MiB 29 GiB 4.7 TiB 67.75 1.02 53 up
17 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 20 MiB 29 GiB 4.7 TiB 67.39 1.01 51 up
22 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 40 MiB 28 GiB 4.7 TiB 67.69 1.02 53 up
25 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 28 GiB 4.7 TiB 67.61 1.01 51 up
30 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 31 MiB 30 GiB 4.7 TiB 67.78 1.02 51 up
33 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 44 MiB 28 GiB 4.7 TiB 67.60 1.01 50 up
38 hdd 14.55298 1.00000 15 TiB 10 TiB 10 TiB 20 MiB 30 GiB 4.5 TiB 69.07 1.04 50 up
42 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 32 MiB 29 GiB 4.7 TiB 67.37 1.01 49 up
63 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 46 MiB 16 GiB 4.7 TiB 67.42 1.01 52 up
67 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.46 1.01 52 up
71 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 22 MiB 16 GiB 4.7 TiB 67.64 1.01 53 up
76 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 37 MiB 16 GiB 4.7 TiB 67.66 1.01 53 up
80 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.66 1.01 53 up
85 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 17 GiB 4.7 TiB 67.60 1.01 53 up
88 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.63 1.01 53 up
91 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.48 1.01 52 up
95 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 16 GiB 4.7 TiB 67.60 1.01 53 up
99 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 16 GiB 4.7 TiB 67.47 1.01 52 up
103 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 51 MiB 16 GiB 4.7 TiB 67.48 1.01 49 up
107 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 51 MiB 17 GiB 4.7 TiB 67.41 1.01 49 up
111 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.42 1.01 50 up
115 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.7 TiB 67.51 1.01 51 up
119 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.65 1.01 51 up
123 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 16 GiB 4.7 TiB 67.53 1.01 51 up
126 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 34 MiB 16 GiB 4.7 TiB 67.44 1.01 50 up
131 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 37 MiB 16 GiB 4.7 TiB 67.49 1.01 50 up
134 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 42 MiB 17 GiB 4.7 TiB 67.43 1.01 49 up
137 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 29 MiB 16 GiB 4.7 TiB 67.49 1.01 51 up
144 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 16 GiB 4.7 TiB 67.45 1.01 49 up
145 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 13 MiB 17 GiB 4.8 TiB 67.33 1.01 48 up
152 hdd 14.55269 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 17 GiB 4.7 TiB 67.46 1.01 50 up
153 hdd 14.55269 1.00000 15 TiB 9.8 TiB 9.8 TiB 15 MiB 15 GiB 4.8 TiB 67.33 1.01 50 up
45 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.7 GiB 675 MiB 1.7 TiB 0.92 0.01 31 up
49 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.6 GiB 687 MiB 1.7 TiB 0.91 0.01 30 up
53 ssd 1.74699 1.00000 1.7 TiB 30 GiB 14 GiB 15 GiB 888 MiB 1.7 TiB 1.70 0.03 30 up
57 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.1 GiB 659 MiB 1.7 TiB 0.88 0.01 30 up
3 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 49 MiB 29 GiB 4.7 TiB 67.70 1.02 52 up
7 hdd 14.55299 1.00000 15 TiB 9.9 TiB 9.8 TiB 46 MiB 29 GiB 4.7 TiB 67.70 1.02 53 up
9 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 29 MiB 30 GiB 4.7 TiB 67.52 1.01 52 up
13 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.9 TiB 38 MiB 29 GiB 4.7 TiB 67.91 1.02 52 up
16 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 20 MiB 28 GiB 4.7 TiB 67.56 1.01 50 up
21 hdd 14.55298 1.00000 15 TiB 10 TiB 10 TiB 25 MiB 30 GiB 4.4 TiB 69.90 1.05 52 up
26 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 24 MiB 29 GiB 4.7 TiB 67.68 1.02 51 up
28 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 56 MiB 29 GiB 4.7 TiB 67.56 1.01 48 up
32 hdd 14.55298 1.00000 15 TiB 9.9 TiB 9.8 TiB 81 MiB 28 GiB 4.7 TiB 67.69 1.02 52 up
36 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 27 MiB 29 GiB 4.7 TiB 67.56 1.01 51 up
40 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 23 MiB 17 GiB 4.7 TiB 67.48 1.01 51 up
62 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.66 1.01 52 up
66 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 21 MiB 16 GiB 4.7 TiB 67.45 1.01 52 up
70 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.61 1.01 52 up
74 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 26 MiB 16 GiB 4.7 TiB 67.49 1.01 51 up
78 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 29 MiB 16 GiB 4.7 TiB 67.66 1.01 53 up
82 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 25 MiB 16 GiB 4.7 TiB 67.44 1.01 52 up
86 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 35 MiB 16 GiB 4.7 TiB 67.68 1.02 52 up
93 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 45 MiB 17 GiB 4.7 TiB 67.67 1.01 52 up
96 hdd 14.55299 1.00000 15 TiB 9.8 TiB 9.8 TiB 20 MiB 16 GiB 4.7 TiB 67.45 1.01 50 up
101 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 45 MiB 17 GiB 4.7 TiB 67.50 1.01 50 up
105 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 16 MiB 16 GiB 4.7 TiB 67.49 1.01 50 up
109 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 17 MiB 17 GiB 4.8 TiB 67.30 1.01 49 up
113 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 17 MiB 17 GiB 4.7 TiB 67.50 1.01 50 up
117 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 16 MiB 17 GiB 4.7 TiB 67.52 1.01 50 up
121 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 62 MiB 17 GiB 4.7 TiB 67.50 1.01 51 up
125 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 33 MiB 16 GiB 4.7 TiB 67.42 1.01 50 up
129 hdd 14.55298 1.00000 15 TiB 9.6 TiB 9.6 TiB 26 MiB 16 GiB 5.0 TiB 65.95 0.99 49 up
133 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 18 MiB 15 GiB 4.8 TiB 67.33 1.01 48 up
136 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 37 MiB 16 GiB 4.7 TiB 67.49 1.01 50 up
139 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 12 MiB 16 GiB 4.8 TiB 67.28 1.01 49 up
146 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 17 MiB 17 GiB 4.8 TiB 67.31 1.01 49 up
147 hdd 14.55298 1.00000 15 TiB 9.8 TiB 9.8 TiB 17 MiB 16 GiB 4.8 TiB 67.31 1.01 49 up
154 hdd 14.55269 1.00000 15 TiB 9.6 TiB 9.6 TiB 37 MiB 14 GiB 5.0 TiB 65.93 0.99 49 up
155 hdd 14.55269 1.00000 15 TiB 9.6 TiB 9.6 TiB 18 MiB 14 GiB 5.0 TiB 65.78 0.99 48 up
44 ssd 1.74698 1.00000 1.7 TiB 30 GiB 14 GiB 15 GiB 948 MiB 1.7 TiB 1.67 0.03 27 up
48 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.2 GiB 694 MiB 1.7 TiB 0.89 0.01 30 up
52 ssd 1.74699 1.00000 1.7 TiB 17 GiB 14 GiB 1.9 GiB 1.2 GiB 1.7 TiB 0.96 0.01 31 up
56 ssd 1.74699 1.00000 1.7 TiB 16 GiB 14 GiB 1.5 GiB 710 MiB 1.7 TiB 0.91 0.01 30 up
TOTAL 2.0 PiB 1.3 PiB 1.3 PiB 97 GiB 2.7 TiB 688 TiB 66.67
MIN/MAX VAR: 0.01/1.22 STDDEV: 21.04
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
