Hi everyone, we run a cluster for our customer, ubuntu 16.04, ceph
luminous 12.2.4 - its use is exclusively for cephFS now. We use multiple
cephFS(i'm aware it's an experimental feature, but it works fine so far)
for our storage purposes. The data pools for all the cephFS filesystems
are erasure coded(metadata pools are replicated and in the ssd root).
The nodes vary in their weight/disk count/disk size, the ceph osd tree
currently looks like this (the orphaned osds at the end have been moved
recently)
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF
-11 0.75995 root ssd
-12 0.18999 host ceph-s1-ssd
60 hdd 0.09499 osd.60 up 1.00000 1.00000
61 hdd 0.09499 osd.61 up 1.00000 1.00000
-13 0.18999 host ceph-s2-ssd
62 hdd 0.09499 osd.62 up 1.00000 1.00000
63 hdd 0.09499 osd.63 up 1.00000 1.00000
-14 0.18999 host ceph-s3-ssd
64 hdd 0.09499 osd.64 up 1.00000 1.00000
65 hdd 0.09499 osd.65 up 1.00000 1.00000
-15 0.18999 host ceph-s4-ssd
66 hdd 0.09499 osd.66 up 1.00000 1.00000
67 hdd 0.09499 osd.67 up 1.00000 1.00000
-1 563.05499 root default
-3 36.38373 host ceph-s1
0 hdd 1.81898 osd.0 up 1.00000 1.00000
1 hdd 1.81898 osd.1 up 1.00000 1.00000
2 hdd 1.81898 osd.2 up 1.00000 1.00000
3 hdd 1.81898 osd.3 up 1.00000 1.00000
4 hdd 1.81898 osd.4 up 1.00000 1.00000
5 hdd 1.81898 osd.5 up 1.00000 1.00000
38 hdd 5.45798 osd.38 up 1.00000 1.00000
113 hdd 7.27698 osd.113 up 1.00000 1.00000
117 hdd 7.27698 osd.117 up 1.00000 1.00000
118 hdd 5.45789 osd.118 up 1.00000 1.00000
-29 34.56670 host ceph-s10
86 hdd 1.81929 osd.86 up 1.00000 1.00000
87 hdd 1.81929 osd.87 up 1.00000 1.00000
88 hdd 1.81929 osd.88 up 1.00000 1.00000
89 hdd 1.81929 osd.89 up 1.00000 1.00000
90 hdd 1.81929 osd.90 up 1.00000 1.00000
91 hdd 1.81929 osd.91 up 1.00000 1.00000
115 hdd 5.45789 osd.115 up 1.00000 1.00000
124 hdd 7.27730 osd.124 up 1.00000 1.00000
125 hdd 5.45789 osd.125 up 1.00000 1.00000
154 hdd 5.45789 osd.154 up 1.00000 1.00000
-31 50.93839 host ceph-s11
6 hdd 7.27699 osd.6 up 1.00000 1.00000
92 hdd 5.45789 osd.92 up 1.00000 1.00000
93 hdd 1.81929 osd.93 up 1.00000 1.00000
94 hdd 1.81929 osd.94 up 1.00000 1.00000
95 hdd 1.81929 osd.95 up 1.00000 1.00000
100 hdd 7.27730 osd.100 up 1.00000 1.00000
109 hdd 1.81929 osd.109 up 1.00000 1.00000
110 hdd 1.81929 osd.110 up 1.00000 1.00000
143 hdd 10.91399 osd.143 up 1.00000 1.00000
155 hdd 5.45789 osd.155 up 1.00000 1.00000
156 hdd 5.45789 osd.156 up 1.00000 1.00000
-33 37.29559 host ceph-s13
8 hdd 1.81929 osd.8 up 1.00000 1.00000
9 hdd 1.81929 osd.9 up 1.00000 1.00000
23 hdd 5.45799 osd.23 up 1.00000 1.00000
58 hdd 1.81929 osd.58 up 1.00000 1.00000
59 hdd 3.63860 osd.59 up 1.00000 1.00000
80 hdd 1.81929 osd.80 up 1.00000 1.00000
96 hdd 1.81929 osd.96 up 1.00000 1.00000
111 hdd 2.72890 osd.111 up 1.00000 1.00000
126 hdd 5.45789 osd.126 up 1.00000 1.00000
157 hdd 5.45789 osd.157 up 1.00000 1.00000
158 hdd 5.45789 osd.158 up 1.00000 1.00000
-35 43.66319 host ceph-s14
97 hdd 1.81929 osd.97 up 1.00000 1.00000
98 hdd 1.81929 osd.98 up 1.00000 1.00000
99 hdd 1.81929 osd.99 up 1.00000 1.00000
101 hdd 1.81929 osd.101 up 1.00000 1.00000
107 hdd 1.81929 osd.107 up 1.00000 1.00000
112 hdd 1.81929 osd.112 up 1.00000 1.00000
127 hdd 7.27730 osd.127 up 1.00000 1.00000
128 hdd 3.63860 osd.128 up 1.00000 1.00000
129 hdd 3.63860 osd.129 up 1.00000 1.00000
130 hdd 3.63860 osd.130 up 1.00000 1.00000
133 hdd 3.63860 osd.133 up 1.00000 1.00000
159 hdd 5.45789 osd.159 up 1.00000 1.00000
160 hdd 5.45789 osd.160 up 1.00000 1.00000
-37 43.66319 host ceph-s15
22 hdd 5.45799 osd.22 up 1.00000 1.00000
102 hdd 1.81929 osd.102 up 1.00000 1.00000
103 hdd 5.45789 osd.103 up 1.00000 1.00000
104 hdd 1.81929 osd.104 up 1.00000 1.00000
105 hdd 1.81929 osd.105 up 1.00000 1.00000
106 hdd 5.45789 osd.106 up 1.00000 1.00000
131 hdd 3.63860 osd.131 up 1.00000 1.00000
132 hdd 3.63860 osd.132 up 1.00000 1.00000
134 hdd 3.63860 osd.134 up 1.00000 1.00000
161 hdd 5.45789 osd.161 up 1.00000 1.00000
162 hdd 5.45789 osd.162 up 1.00000 1.00000
-39 0 host ceph-s16
-5 29.10687 host ceph-s2
12 hdd 1.81898 osd.12 up 1.00000 1.00000
14 hdd 1.81898 osd.14 up 1.00000 1.00000
15 hdd 1.81898 osd.15 up 1.00000 1.00000
16 hdd 1.81898 osd.16 up 1.00000 1.00000
17 hdd 1.81898 osd.17 up 1.00000 1.00000
21 hdd 7.27699 osd.21 up 1.00000 1.00000
53 hdd 5.45798 osd.53 up 1.00000 1.00000
119 hdd 7.27698 osd.119 up 1.00000 1.00000
-7 49.11778 host ceph-s3
24 hdd 1.81898 osd.24 up 1.00000 1.00000
25 hdd 1.81898 osd.25 up 1.00000 1.00000
26 hdd 1.81898 osd.26 up 1.00000 1.00000
27 hdd 1.81898 osd.27 up 1.00000 1.00000
28 hdd 1.81898 osd.28 up 1.00000 1.00000
29 hdd 1.81898 osd.29 up 1.00000 1.00000
30 hdd 1.81898 osd.30 up 1.00000 1.00000
31 hdd 1.81898 osd.31 up 1.00000 1.00000
32 hdd 1.81898 osd.32 up 1.00000 1.00000
33 hdd 1.81898 osd.33 up 1.00000 1.00000
34 hdd 1.81898 osd.34 up 1.00000 1.00000
35 hdd 1.81898 osd.35 up 1.00000 1.00000
36 hdd 5.45799 osd.36 up 1.00000 1.00000
37 hdd 5.45799 osd.37 up 1.00000 1.00000
39 hdd 5.45799 osd.39 up 1.00000 1.00000
40 hdd 5.45799 osd.40 up 1.00000 1.00000
41 hdd 5.45799 osd.41 up 1.00000 1.00000
-9 43.66083 host ceph-s4
42 hdd 1.81898 osd.42 up 1.00000 1.00000
43 hdd 1.81898 osd.43 up 1.00000 1.00000
44 hdd 1.81898 osd.44 up 1.00000 1.00000
45 hdd 1.81898 osd.45 up 1.00000 1.00000
46 hdd 1.81898 osd.46 up 1.00000 1.00000
47 hdd 1.81898 osd.47 up 1.00000 1.00000
48 hdd 1.81898 osd.48 up 1.00000 1.00000
49 hdd 1.81898 osd.49 up 1.00000 1.00000
50 hdd 1.81898 osd.50 up 1.00000 1.00000
51 hdd 5.45799 osd.51 up 1.00000 1.00000
52 hdd 5.45799 osd.52 up 1.00000 1.00000
54 hdd 5.45799 osd.54 up 1.00000 1.00000
55 hdd 5.45799 osd.55 up 1.00000 1.00000
56 hdd 5.45799 osd.56 up 1.00000 1.00000
-21 36.38551 host ceph-s5
7 hdd 7.27699 osd.7 up 1.00000 1.00000
13 hdd 1.81929 osd.13 up 1.00000 1.00000
18 hdd 7.27699 osd.18 up 1.00000 1.00000
57 hdd 1.81929 osd.57 up 1.00000 1.00000
68 hdd 3.63860 osd.68 up 1.00000 1.00000
69 hdd 1.81929 osd.69 up 1.00000 1.00000
70 hdd 1.81929 osd.70 up 0.95000 1.00000
120 hdd 5.45789 osd.120 up 1.00000 1.00000
147 hdd 5.45789 osd.147 up 1.00000 1.00000
-23 45.48241 host ceph-s6
11 hdd 5.45799 osd.11 up 1.00000 1.00000
20 hdd 7.27699 osd.20 up 1.00000 1.00000
71 hdd 1.81929 osd.71 up 1.00000 1.00000
72 hdd 1.81929 osd.72 up 1.00000 1.00000
73 hdd 3.63860 osd.73 up 1.00000 1.00000
74 hdd 1.81929 osd.74 up 1.00000 1.00000
75 hdd 1.81929 osd.75 up 1.00000 1.00000
116 hdd 7.27730 osd.116 up 1.00000 1.00000
121 hdd 3.63860 osd.121 up 1.00000 1.00000
148 hdd 5.45789 osd.148 up 1.00000 1.00000
149 hdd 5.45789 osd.149 up 1.00000 1.00000
-25 41.84180 host ceph-s7
19 hdd 7.27699 osd.19 up 1.00000 1.00000
76 hdd 1.81929 osd.76 up 1.00000 1.00000
77 hdd 1.81929 osd.77 up 0.95000 1.00000
78 hdd 1.81929 osd.78 up 1.00000 1.00000
79 hdd 3.63860 osd.79 up 1.00000 1.00000
81 hdd 1.81929 osd.81 up 1.00000 1.00000
108 hdd 1.81929 osd.108 up 1.00000 1.00000
140 hdd 10.91399 osd.140 up 1.00000 1.00000
150 hdd 5.45789 osd.150 up 1.00000 1.00000
151 hdd 5.45789 osd.151 up 1.00000 1.00000
-41 27.28761 host ceph-s8
122 hdd 1.81929 osd.122 up 1.00000 1.00000
135 hdd 1.81929 osd.135 up 1.00000 1.00000
136 hdd 1.81929 osd.136 up 1.00000 1.00000
137 hdd 1.81929 osd.137 up 1.00000 1.00000
138 hdd 1.81929 osd.138 up 1.00000 1.00000
139 hdd 1.81929 osd.139 up 1.00000 1.00000
141 hdd 10.91399 osd.141 up 1.00000 1.00000
152 hdd 5.45789 osd.152 up 1.00000 1.00000
-27 43.66139 host ceph-s9
10 hdd 5.45799 osd.10 up 1.00000 1.00000
82 hdd 5.45789 osd.82 up 1.00000 1.00000
83 hdd 1.81929 osd.83 up 1.00000 1.00000
84 hdd 1.81929 osd.84 up 1.00000 1.00000
85 hdd 1.81929 osd.85 up 1.00000 1.00000
114 hdd 5.45789 osd.114 up 1.00000 1.00000
123 hdd 5.45789 osd.123 up 1.00000 1.00000
142 hdd 10.91399 osd.142 up 1.00000 1.00000
153 hdd 5.45789 osd.153 up 1.00000 1.00000
144 hdd 0 osd.144 up 1.00000 1.00000
145 hdd 0 osd.145 up 1.00000 1.00000
146 hdd 0 osd.146 up 1.00000 1.00000
our issue lies in very uneven distribution data, where some OSD's have
93% usage and others have 50-60%. I understand that ceph has to
replicate and redistribute so that a failure of one node is not a
problem, but it still seems quite a bit extreme to me. Due to this, i
also find it very hard to calculate how much free space(after
replication/erasure coding and all ceph overhead) the cluster has. My
question is - is there a way to adjust the replication/erasure coding so
our redistribution isn't that skewed? Also, how do i figure out the free
space/overhead in this setup? I'm not sure, whether our issue lies in
our disk distribution or some of our settings. The ceph osd df output
follows:
ID CLASS WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR PGS
60 hdd 0.09499 1.00000 10240M 2052M 8187M 20.04 0.34 0
61 hdd 0.09499 1.00000 10240M 2214M 8025M 21.63 0.36 0
62 hdd 0.09499 1.00000 10240M 2078M 8161M 20.30 0.34 0
63 hdd 0.09499 1.00000 10240M 2074M 8165M 20.26 0.34 0
64 hdd 0.09499 1.00000 10240M 1646M 8593M 16.08 0.27 0
65 hdd 0.09499 1.00000 10240M 2024M 8215M 19.77 0.33 0
66 hdd 0.09499 1.00000 10240M 2158M 8081M 21.08 0.35 0
67 hdd 0.09499 1.00000 10240M 2022M 8217M 19.75 0.33 0
0 hdd 1.81898 1.00000 1862G 1178G 684G 63.28 1.06 47
1 hdd 1.81898 1.00000 1862G 1228G 634G 65.96 1.10 47
2 hdd 1.81898 1.00000 1862G 1150G 712G 61.74 1.03 47
3 hdd 1.81898 1.00000 1862G 1076G 786G 57.81 0.97 42
4 hdd 1.81898 1.00000 1862G 1027G 835G 55.15 0.92 38
5 hdd 1.81898 1.00000 1862G 1409G 452G 75.69 1.27 58
38 hdd 5.45798 1.00000 5588G 3763G 1825G 67.33 1.13 148
113 hdd 7.27698 1.00000 7451G 5070G 2381G 68.04 1.14 208
117 hdd 7.27698 1.00000 7451G 4795G 2656G 64.35 1.08 196
118 hdd 5.45789 1.00000 5588G 3631G 1957G 64.98 1.09 143
86 hdd 1.81929 1.00000 1862G 1157G 705G 62.14 1.04 45
87 hdd 1.81929 1.00000 1862G 1379G 483G 74.07 1.24 54
88 hdd 1.81929 1.00000 1862G 1295G 567G 69.56 1.16 54
89 hdd 1.81929 1.00000 1862G 1405G 457G 75.47 1.26 56
90 hdd 1.81929 1.00000 1862G 1399G 463G 75.13 1.26 53
91 hdd 1.81929 1.00000 1862G 1188G 674G 63.79 1.07 49
115 hdd 5.45789 1.00000 5588G 3750G 1838G 67.10 1.12 151
124 hdd 7.27730 1.00000 7451G 5369G 2082G 72.05 1.20 213
125 hdd 5.45789 1.00000 5588G 3924G 1664G 70.21 1.17 158
154 hdd 5.45789 1.00000 5588G 891G 4697G 15.95 0.27 17
6 hdd 7.27699 1.00000 7451G 5190G 2261G 69.65 1.16 210
92 hdd 5.45789 1.00000 5588G 3718G 1870G 66.54 1.11 153
93 hdd 1.81929 1.00000 1862G 1011G 850G 54.32 0.91 40
94 hdd 1.81929 1.00000 1862G 1348G 514G 72.38 1.21 55
95 hdd 1.81929 1.00000 1862G 949G 913G 50.97 0.85 36
100 hdd 7.27730 1.00000 7451G 4271G 3179G 57.33 0.96 171
109 hdd 1.81929 1.00000 1862G 1559G 303G 83.72 1.40 57
110 hdd 1.81929 1.00000 1862G 1096G 766G 58.86 0.98 43
143 hdd 10.91399 1.00000 11175G 7705G 3470G 68.94 1.15 231
155 hdd 5.45789 1.00000 5588G 961G 4627G 17.20 0.29 12
156 hdd 5.45789 1.00000 5588G 819G 4769G 14.66 0.25 10
8 hdd 1.81929 1.00000 1862G 1600G 262G 85.91 1.44 62
9 hdd 1.81929 1.00000 1862G 1656G 206G 88.90 1.49 64
23 hdd 5.45799 1.00000 5588G 5045G 543G 90.27 1.51 169
58 hdd 1.81929 1.00000 1862G 1592G 270G 85.49 1.43 64
59 hdd 3.63860 1.00000 3725G 3034G 691G 81.44 1.36 117
80 hdd 1.81929 1.00000 1862G 1684G 178G 90.43 1.51 62
96 hdd 1.81929 1.00000 1862G 1418G 444G 76.16 1.27 56
111 hdd 2.72890 1.00000 2794G 2037G 756G 72.92 1.22 79
126 hdd 5.45789 1.00000 5588G 4891G 697G 87.52 1.46 192
157 hdd 5.45789 1.00000 5588G 929G 4659G 16.63 0.28 10
158 hdd 5.45789 1.00000 5588G 1078G 4510G 19.30 0.32 12
97 hdd 1.81929 1.00000 1862G 1219G 643G 65.47 1.09 50
98 hdd 1.81929 1.00000 1862G 1289G 573G 69.21 1.16 50
99 hdd 1.81929 1.00000 1862G 1489G 373G 79.93 1.34 59
101 hdd 1.81929 1.00000 1862G 1498G 364G 80.46 1.35 59
107 hdd 1.81929 1.00000 1862G 1666G 196G 89.44 1.50 62
112 hdd 1.81929 1.00000 1862G 1607G 255G 86.27 1.44 68
127 hdd 7.27730 1.00000 7451G 5542G 1909G 74.37 1.24 222
128 hdd 3.63860 1.00000 3725G 2724G 1001G 73.13 1.22 103
129 hdd 3.63860 1.00000 3725G 3278G 447G 88.00 1.47 129
130 hdd 3.63860 1.00000 3725G 2818G 907G 75.64 1.26 113
133 hdd 3.63860 1.00000 3725G 3413G 312G 91.60 1.53 128
159 hdd 5.45789 1.00000 5588G 886G 4702G 15.86 0.27 13
160 hdd 5.45789 1.00000 5588G 868G 4720G 15.54 0.26 10
22 hdd 5.45799 1.00000 5588G 4227G 1361G 75.64 1.27 166
102 hdd 1.81929 1.00000 1862G 1438G 424G 77.20 1.29 55
103 hdd 5.45789 1.00000 5588G 4773G 815G 85.40 1.43 184
104 hdd 1.81929 1.00000 1862G 1476G 385G 79.28 1.33 58
105 hdd 1.81929 1.00000 1862G 1649G 213G 88.53 1.48 63
106 hdd 5.45789 1.00000 5588G 4870G 718G 87.14 1.46 172
131 hdd 3.63860 1.00000 3725G 2884G 841G 77.41 1.29 110
132 hdd 3.63860 1.00000 3725G 2937G 787G 78.85 1.32 113
134 hdd 3.63860 1.00000 3725G 3421G 304G 91.84 1.54 116
161 hdd 5.45789 1.00000 5588G 741G 4847G 13.26 0.22 13
162 hdd 5.45789 1.00000 5588G 922G 4666G 16.50 0.28 16
12 hdd 1.81898 1.00000 1862G 1049G 813G 56.35 0.94 41
14 hdd 1.81898 1.00000 1862G 1568G 294G 84.19 1.41 63
15 hdd 1.81898 1.00000 1862G 1654G 208G 88.80 1.49 66
16 hdd 1.81898 1.00000 1862G 1210G 652G 64.97 1.09 49
17 hdd 1.81898 1.00000 1862G 1360G 502G 73.03 1.22 53
21 hdd 7.27699 1.00000 7451G 5414G 2037G 72.66 1.22 189
53 hdd 5.45798 1.00000 5588G 4083G 1505G 73.06 1.22 167
119 hdd 7.27698 1.00000 7451G 5557G 1894G 74.57 1.25 224
24 hdd 1.81898 1.00000 1862G 847G 1015G 45.47 0.76 35
25 hdd 1.81898 1.00000 1862G 960G 902G 51.53 0.86 39
26 hdd 1.81898 1.00000 1862G 916G 946G 49.22 0.82 38
27 hdd 1.81898 1.00000 1862G 1117G 745G 60.00 1.00 47
28 hdd 1.81898 1.00000 1862G 1266G 596G 68.00 1.14 52
29 hdd 1.81898 1.00000 1862G 849G 1013G 45.60 0.76 33
30 hdd 1.81898 1.00000 1862G 1159G 703G 62.25 1.04 46
31 hdd 1.81898 1.00000 1862G 990G 872G 53.18 0.89 41
32 hdd 1.81898 1.00000 1862G 1086G 776G 58.31 0.98 43
33 hdd 1.81898 1.00000 1862G 1027G 835G 55.13 0.92 41
34 hdd 1.81898 1.00000 1862G 1075G 787G 57.75 0.97 45
35 hdd 1.81898 1.00000 1862G 895G 967G 48.08 0.80 37
36 hdd 5.45799 1.00000 5588G 2789G 2799G 49.92 0.83 106
37 hdd 5.45799 1.00000 5588G 2963G 2625G 53.02 0.89 120
39 hdd 5.45799 1.00000 5588G 3271G 2317G 58.54 0.98 129
40 hdd 5.45799 1.00000 5588G 3640G 1948G 65.13 1.09 148
41 hdd 5.45799 1.00000 5588G 3099G 2489G 55.45 0.93 130
42 hdd 1.81898 1.00000 1862G 1093G 769G 58.71 0.98 46
43 hdd 1.81898 1.00000 1862G 896G 966G 48.14 0.81 34
44 hdd 1.81898 1.00000 1862G 1226G 636G 65.85 1.10 50
45 hdd 1.81898 1.00000 1862G 982G 880G 52.73 0.88 37
46 hdd 1.81898 1.00000 1862G 998G 864G 53.60 0.90 39
47 hdd 1.81898 1.00000 1862G 1234G 628G 66.28 1.11 48
48 hdd 1.81898 1.00000 1862G 963G 899G 51.74 0.87 41
49 hdd 1.81898 1.00000 1862G 1404G 458G 75.38 1.26 57
50 hdd 1.81898 1.00000 1862G 1232G 630G 66.15 1.11 50
51 hdd 5.45799 1.00000 5588G 3110G 2478G 55.66 0.93 127
52 hdd 5.45799 1.00000 5588G 3058G 2530G 54.73 0.92 120
54 hdd 5.45799 1.00000 5588G 3293G 2295G 58.92 0.99 130
55 hdd 5.45799 1.00000 5588G 3407G 2181G 60.97 1.02 136
56 hdd 5.45799 1.00000 5588G 3304G 2284G 59.12 0.99 133
7 hdd 7.27699 1.00000 7451G 5820G 1631G 78.11 1.31 222
13 hdd 1.81929 1.00000 1862G 1433G 429G 76.95 1.29 56
18 hdd 7.27699 1.00000 7451G 5001G 2450G 67.11 1.12 165
57 hdd 1.81929 1.00000 1862G 1269G 593G 68.15 1.14 51
68 hdd 3.63860 1.00000 3725G 2906G 819G 78.01 1.30 119
69 hdd 1.81929 1.00000 1862G 1316G 546G 70.66 1.18 53
70 hdd 1.81929 0.95000 1862G 1224G 638G 65.73 1.10 49
120 hdd 5.45789 1.00000 5588G 3900G 1687G 69.80 1.17 151
147 hdd 5.45789 1.00000 5588G 869G 4719G 15.56 0.26 8
11 hdd 5.45799 1.00000 5588G 4174G 1414G 74.70 1.25 162
20 hdd 7.27699 1.00000 7451G 5430G 2021G 72.88 1.22 221
71 hdd 1.81929 1.00000 1862G 1300G 562G 69.83 1.17 55
72 hdd 1.81929 1.00000 1862G 1093G 769G 58.70 0.98 44
73 hdd 3.63860 1.00000 3725G 2706G 1019G 72.63 1.21 112
74 hdd 1.81929 1.00000 1862G 1295G 567G 69.54 1.16 50
75 hdd 1.81929 1.00000 1862G 1127G 735G 60.53 1.01 45
116 hdd 7.27730 1.00000 7451G 4775G 2676G 64.09 1.07 181
121 hdd 3.63860 1.00000 3725G 2163G 1562G 58.06 0.97 84
148 hdd 5.45789 1.00000 5588G 832G 4756G 14.90 0.25 14
149 hdd 5.45789 1.00000 5588G 776G 4812G 13.89 0.23 13
19 hdd 7.27699 1.00000 7451G 5664G 1787G 76.01 1.27 206
76 hdd 1.81929 1.00000 1862G 1476G 386G 79.26 1.33 59
77 hdd 1.81929 0.95000 1862G 1513G 349G 81.24 1.36 60
78 hdd 1.81929 1.00000 1862G 1503G 359G 80.70 1.35 65
79 hdd 3.63860 1.00000 3725G 2705G 1020G 72.62 1.21 104
81 hdd 1.81929 1.00000 1862G 1315G 547G 70.63 1.18 50
108 hdd 1.81929 1.00000 1862G 1706G 156G 91.59 1.53 61
140 hdd 10.91399 1.00000 11175G 8090G 3085G 72.39 1.21 313
150 hdd 5.45789 1.00000 5588G 939G 4649G 16.81 0.28 16
151 hdd 5.45789 1.00000 5588G 900G 4688G 16.10 0.27 12
122 hdd 1.81929 1.00000 1862G 1731G 131G 92.93 1.55 73
135 hdd 1.81929 1.00000 1862G 1605G 256G 86.21 1.44 65
136 hdd 1.81929 1.00000 1862G 1441G 421G 77.36 1.29 58
137 hdd 1.81929 1.00000 1862G 1693G 169G 90.93 1.52 70
138 hdd 1.81929 1.00000 1862G 1275G 587G 68.46 1.14 49
139 hdd 1.81929 1.00000 1862G 1705G 157G 91.54 1.53 66
141 hdd 10.91399 1.00000 11175G 8657G 2518G 77.47 1.30 299
152 hdd 5.45789 1.00000 5588G 999G 4589G 17.88 0.30 11
10 hdd 5.45799 1.00000 5588G 3825G 1763G 68.45 1.14 156
82 hdd 5.45789 1.00000 5588G 3839G 1749G 68.69 1.15 152
83 hdd 1.81929 1.00000 1862G 1231G 631G 66.11 1.11 49
84 hdd 1.81929 1.00000 1862G 1273G 589G 68.37 1.14 49
85 hdd 1.81929 1.00000 1862G 1429G 432G 76.76 1.28 59
114 hdd 5.45789 1.00000 5588G 3455G 2133G 61.83 1.03 138
123 hdd 5.45789 1.00000 5588G 3678G 1910G 65.82 1.10 146
142 hdd 10.91399 1.00000 11175G 7359G 3816G 65.85 1.10 298
153 hdd 5.45789 1.00000 5588G 986G 4602G 17.64 0.30 17
144 hdd 0 1.00000 5588G 1454M 5587G 0.03 0 0
145 hdd 0 1.00000 5588G 1446M 5587G 0.03 0 0
146 hdd 0 1.00000 5588G 1455M 5587G 0.03 0 0
TOTAL 579T 346T 232T 59.80
MIN/MAX VAR: 0/1.55 STDDEV: 23.04
THanks in advance for any help, i find it very hard to wrap my head
around this.
Josef Zelenka
Cloudevelops
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
