I don't know what can i do to solve this.
I try force create pg.
I try deactivate osd.
I add new disks.
And nothing do this scenario change.
# ceph health detail
HEALTH_WARN 1 pgs down; 6 pgs incomplete; 6 pgs stuck inactive; 70 pgs stuck unclean; 7 requests are blocked > 32 sec; 3 osds have slow requests; recovery 2/574000 objects degraded (0.000%); recovery 4/574000 objects misplaced (0.001%)
pg 0.3 is stuck inactive since forever, current state incomplete, last acting [5,4,8]
pg 0.38 is stuck inactive for 292873.404372, current state incomplete, last acting [1,4,8]
pg 0.43 is stuck inactive for 292705.585643, current state incomplete, last acting [2,1,4]
pg 0.78 is stuck inactive since forever, current state down+incomplete, last acting [6,4,3]
pg 0.27 is stuck inactive for 292722.377338, current state incomplete, last acting [2,7,5]
pg 0.67 is stuck inactive for 292722.377344, current state incomplete, last acting [2,1,3]
pg 1.23 is stuck unclean for 6418.582518, current state active+remapped, last acting [8,2]
pg 1.20 is stuck unclean for 6418.713623, current state active+remapped, last acting [2,5]
pg 1.21 is stuck unclean for 5805.674814, current state active+remapped, last acting [2,5]
pg 1.1e is stuck unclean for 6418.801677, current state active+remapped, last acting [8,2]
pg 1.1f is stuck unclean for 6418.973932, current state active+remapped, last acting [8,2]
pg 1.1c is stuck unclean for 6418.565988, current state active+remapped, last acting [8,2]
pg 1.1d is stuck unclean for 5805.686500, current state active+remapped, last acting [8,2]
pg 1.1a is stuck unclean for 6418.860193, current state active+remapped, last acting [2,4]
pg 1.1b is stuck unclean for 5805.510934, current state active+remapped, last acting [2,3]
pg 1.18 is stuck unclean for 5805.667627, current state active+remapped, last acting [2,4]
pg 1.19 is stuck unclean for 6418.358465, current state active+remapped, last acting [8,2]
pg 0.78 is stuck unclean since forever, current state down+incomplete, last acting [6,4,3]
pg 1.16 is stuck unclean for 6418.850241, current state active+remapped, last acting [2,4]
pg 1.17 is stuck unclean for 5805.511008, current state active+remapped, last acting [8,2]
pg 1.14 is stuck unclean for 6418.566994, current state active+remapped, last acting [2,1]
pg 1.15 is stuck unclean for 6418.195558, current state active+remapped, last acting [8,2]
pg 1.12 is stuck unclean for 5805.669319, current state active+remapped, last acting [2,7]
pg 1.13 is stuck unclean for 5805.679161, current state active+remapped, last acting [2,1]
pg 1.10 is stuck unclean for 5805.675267, current state active+remapped, last acting [2,5]
pg 1.11 is stuck unclean for 5805.679200, current state active+remapped, last acting [2,1]
pg 1.e is stuck unclean for 5805.669306, current state active+remapped, last acting [2,1]
pg 1.f is stuck unclean for 5805.669406, current state active+remapped, last acting [2,4]
pg 1.c is stuck unclean for 5805.679299, current state active+remapped, last acting [8,2]
pg 1.d is stuck unclean for 5805.669460, current state active+remapped, last acting [2,6]
pg 1.a is stuck unclean for 6418.329215, current state active+remapped, last acting [2,3]
pg 1.b is stuck unclean for 6418.561476, current state active+remapped, last acting [2,1]
pg 1.8 is stuck unclean for 6418.406537, current state active+remapped, last acting [2,4]
pg 1.9 is stuck unclean for 5805.669603, current state active+remapped, last acting [8,2]
pg 1.6 is stuck unclean for 6418.273455, current state active+remapped, last acting [2,1]
pg 0.67 is stuck unclean for 293107.340137, current state incomplete, last acting [2,1,3]
pg 1.7 is stuck unclean for 5805.669690, current state active+remapped, last acting [8,2]
pg 1.4 is stuck unclean for 6418.446173, current state active+remapped, last acting [2,3]
pg 1.5 is stuck unclean for 6418.375788, current state active+remapped, last acting [2,1]
pg 1.2 is stuck unclean for 5805.683492, current state active+remapped, last acting [2,1]
pg 0.3 is stuck unclean since forever, current state incomplete, last acting [5,4,8]
pg 1.3 is stuck unclean for 6418.463264, current state active+remapped, last acting [8,2]
pg 1.0 is stuck unclean for 5805.683303, current state active+remapped, last acting [8,2]
pg 1.1 is stuck unclean for 5805.506588, current state active+remapped, last acting [2,3]
pg 0.43 is stuck unclean for 292705.586031, current state incomplete, last acting [2,1,4]
pg 1.3e is stuck unclean for 6418.317627, current state active+remapped, last acting [2,1]
pg 1.3f is stuck unclean for 6418.724621, current state active+remapped, last acting [2,4]
pg 1.3c is stuck unclean for 6418.664822, current state active+remapped, last acting [2,1]
pg 1.3d is stuck unclean for 5805.676951, current state active+remapped, last acting [2,5]
pg 1.3a is stuck unclean for 5805.497688, current state active+remapped, last acting [2,4]
pg 1.3b is stuck unclean for 5805.677027, current state active+remapped, last acting [8,2]
pg 1.38 is stuck unclean for 5805.497725, current state active+remapped, last acting [8,2]
pg 0.38 is stuck unclean for 292873.404814, current state incomplete, last acting [1,4,8]
pg 1.39 is stuck unclean for 6418.680542, current state active+remapped, last acting [2,4]
pg 1.36 is stuck unclean for 5805.677083, current state active+remapped, last acting [2,5]
pg 1.37 is stuck unclean for 6418.309163, current state active+remapped, last acting [8,2]
pg 1.34 is stuck unclean for 5805.508778, current state active+remapped, last acting [2,3]
pg 1.35 is stuck unclean for 5805.508841, current state active+remapped, last acting [2,3]
pg 1.32 is stuck unclean for 6418.555610, current state active+remapped, last acting [8,2]
pg 1.33 is stuck unclean for 5805.508928, current state active+remapped, last acting [2,3]
pg 1.30 is stuck unclean for 5805.684678, current state active+remapped, last acting [2,1]
pg 1.31 is stuck unclean for 6418.526243, current state active+remapped, last acting [2,3]
pg 1.2e is stuck unclean for 6418.692727, current state active+remapped, last acting [8,2]
pg 1.2f is stuck unclean for 5805.677361, current state active+remapped, last acting [8,2]
pg 1.2c is stuck unclean for 5805.671127, current state active+remapped, last acting [2,7]
pg 1.2d is stuck unclean for 5805.671193, current state active+remapped, last acting [2,6]
pg 1.2a is stuck unclean for 6418.576690, current state active+remapped, last acting [2,3]
pg 1.2b is stuck unclean for 6418.566350, current state active+remapped, last acting [8,2]
pg 1.28 is stuck unclean for 5805.671315, current state active+remapped, last acting [2,1]
pg 1.29 is stuck unclean for 6418.571029, current state active+remapped, last acting [2,3]
pg 1.26 is stuck unclean for 6418.560121, current state active+remapped, last acting [2,1]
pg 0.27 is stuck unclean for 293107.340347, current state incomplete, last acting [2,7,5]
pg 1.27 is stuck unclean for 6418.887716, current state active+remapped, last acting [2,4]
pg 1.24 is stuck unclean for 6418.565877, current state active+remapped, last acting [8,2]
pg 1.25 is stuck unclean for 5805.686565, current state active+remapped, last acting [2,1]
pg 1.22 is stuck unclean for 5805.675053, current state active+remapped, last acting [2,5]
pg 0.27 is incomplete, acting [2,7,5]
pg 0.3 is incomplete, acting [5,4,8]
pg 0.78 is down+incomplete, acting [6,4,3]
pg 0.67 is incomplete, acting [2,1,3]
pg 0.43 is incomplete, acting [2,1,4]
pg 0.38 is incomplete, acting [1,4,8]
4 ops are blocked > 16777.2 sec
3 ops are blocked > 8388.61 sec
1 ops are blocked > 16777.2 sec on osd.1
2 ops are blocked > 8388.61 sec on osd.1
3 ops are blocked > 16777.2 sec on osd.2
1 ops are blocked > 8388.61 sec on osd.5
3 osds have slow requests
recovery 2/574000 objects degraded (0.000%)
recovery 4/574000 objects misplaced (0.001%)
root@pmx00node04:~# ceph osd tree
ID WEIGHT TYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY
-9 4.00000 root ssd
8 4.00000 osd.8 up 1.00000 1.00000
-1 3.96997 root default
-3 1.09000 host pmx00node03
1 0.53999 osd.1 up 1.00000 1.00000
5 0.54999 osd.5 up 1.00000 1.00000
-5 0.73999 host pmx00node04
2 0.53000 osd.2 up 1.00000 1.00000
8 0.20999 osd.8 up 1.00000 1.00000
-6 1.07999 host pmx00node01
6 0.53999 osd.6 up 1.00000 1.00000
7 0.53999 osd.7 up 1.00000 1.00000
-7 0.53000 host pmx00node02
3 0.53000 osd.3 up 1.00000 1.00000
-8 0.53000 host pmx00node05
4 0.53000 osd.4 up 1.00000 1.00000
0 0 osd.0 down 0 1.00000
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
