Mandi! Janne Johansson
In chel di` si favelave...
> It is a slight mistake in reporting it in the same way as an error, even if it looks to the
> cluster just as if it was in error and needs fixing.
I think i'm hit a similar situation, and also i'm feeling that
something have to be 'fixed'. I seek an explanation...
I'm adding a node (blackpanther, 4 OSDs, done) and removing a
node (vedovanera[1], 4 OSDs, to be done).
I've added a new node, added slowly 4 new OSD, but in the meantime an
OSD (not the new, not the node to remove) died. My situation now is:
root@blackpanther:~# ceph osd df tree
ID WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR TYPE NAME
-1 21.41985 - 5586G 2511G 3074G 0 0 root default
-2 5.45996 - 5586G 2371G 3214G 42.45 0.93 host capitanamerica
0 1.81999 1.00000 1862G 739G 1122G 39.70 0.87 osd.0
1 1.81999 1.00000 1862G 856G 1005G 46.00 1.00 osd.1
10 0.90999 1.00000 931G 381G 549G 40.95 0.89 osd.10
11 0.90999 1.00000 931G 394G 536G 42.35 0.92 osd.11
-3 5.03996 - 5586G 2615G 2970G 46.82 1.02 host vedovanera
2 1.39999 1.00000 1862G 684G 1177G 36.78 0.80 osd.2
3 1.81999 1.00000 1862G 1081G 780G 58.08 1.27 osd.3
4 0.90999 1.00000 931G 412G 518G 44.34 0.97 osd.4
5 0.90999 1.00000 931G 436G 494G 46.86 1.02 osd.5
-4 5.45996 - 931G 583G 347G 0 0 host deadpool
6 1.81999 1.00000 1862G 898G 963G 48.26 1.05 osd.6
7 1.81999 1.00000 1862G 839G 1022G 45.07 0.98 osd.7
8 0.90999 0 0 0 0 0 0 osd.8
9 0.90999 1.00000 931G 583G 347G 62.64 1.37 osd.9
-5 5.45996 - 5586G 2511G 3074G 44.96 0.98 host blackpanther
12 1.81999 1.00000 1862G 828G 1033G 44.51 0.97 osd.12
13 1.81999 1.00000 1862G 753G 1108G 40.47 0.88 osd.13
14 0.90999 1.00000 931G 382G 548G 41.11 0.90 osd.14
15 0.90999 1.00000 931G 546G 384G 58.66 1.28 osd.15
TOTAL 21413G 9819G 11594G 45.85
MIN/MAX VAR: 0/1.37 STDDEV: 7.37
Perfectly healthy. But i've tried to, slowly, remove an OSD from
'vedovanera', and so i've tried with:
ceph osd crush reweight osd.2 <weight>
as you can see, i'm arrived to weight 1.4 (from 1.81999), but if i go
lower than that i catch:
cluster 8794c124-c2ec-4e81-8631-742992159bd6
health HEALTH_WARN
6 pgs backfill
1 pgs backfilling
7 pgs stuck unclean
recovery 2/2556513 objects degraded (0.000%)
recovery 7721/2556513 objects misplaced (0.302%)
monmap e6: 6 mons at {0=10.27.251.7:6789/0,1=10.27.251.8:6789/0,2=10.27.251.11:6789/0,3=10.27.251.12:6789/0,4=10.27.251.9:6789/0,blackpanther=10.27.251.2:6789/0}
election epoch 2780, quorum 0,1,2,3,4,5 blackpanther,0,1,4,2,3
osdmap e9302: 16 osds: 15 up, 15 in; 7 remapped pgs
pgmap v54971897: 768 pgs, 3 pools, 3300 GB data, 830 kobjects
9911 GB used, 11502 GB / 21413 GB avail
2/2556513 objects degraded (0.000%)
7721/2556513 objects misplaced (0.302%)
761 active+clean
6 active+remapped+wait_backfill
1 active+remapped+backfilling
client io 9725 kB/s rd, 772 kB/s wr, 153 op/s
eg, 2 object 'degraded'. This really puzzled me.
Why?! Thanks.
[1] some Marvel Comics heros got translated in Italian, so 'vedovanera'
is 'black widow' and 'capitanamerica' clearly 'Captain America'.
--
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/
Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN)
marco.gaiarin(at)lanostrafamiglia.it t +39-0434-842711 f +39-0434-842797
Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000
(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
