Hi Mehmet,
It won't let me adjust the PGs because there are "creating" tasks not done yet.
---
[root@avatar0-ceph0 ~]# !157
ceph osd pool set rbd pgp_num 300
Error EBUSY: currently creating pgs, wait
[root@avatar0-ceph0 ~]#
---
ᐧ
On Thu, Nov 3, 2016 at 2:16 PM, Mehmet <mt@xxxxxxxxxx> wrote:
I would try to Set pgp for your pool equal to 300
#Ceph osd pool yourpool set pgp 300
...not sure about the command...
If that did not help try to restart osd 7 and 15
Hth
- MehmetAm 2. November 2016 14:15:09 MEZ, schrieb Vlad Blando <vblando@xxxxxxxxxxxxx>:I have a 3 Cluster Giant setup with 8 OSD each, during the installation I had to redo a cluster but it looks like the info is still on crush map (based on my readings). How do I fix this?[root@avatar0-ceph1 ~]# ceph -scluster 2f0d1928-2ee5-4731-a259-64c0dc16110a health HEALTH_WARN 139 pgs stuck inactive; 139 pgs stuck unclean; 2 requests are blocked > 32 sec; pool rbd pg_num 300 > pgp_num 64monmap e1: 3 mons at {avatar0-ceph0=172.40.40.100:6789/0,avatar0-ceph1=172.40. }, election epoch 56, quorum 0,1,2 avatar0-ceph0,avatar0-ceph1,40.101:6789/0,avatar0-ceph2= 172.40.40.102:6789/0 avatar0-ceph2 osdmap e557: 24 osds: 24 up, 24 inpgmap v1807359: 1500 pgs, 5 pools, 358 GB data, 48728 objects737 GB used, 88630 GB / 89368 GB avail139 creating1361 active+cleanclient io 44391 B/s wr, 19 op/s[root@avatar0-ceph1 ~]#[root@avatar0-ceph0 current]# ceph health detailHEALTH_WARN 139 pgs stuck inactive; 139 pgs stuck unclean; 2 requests are blocked > 32 sec; 2 osds have slow requests; pool rbd pg_num 300 > pgp_num 64pg 0.f4 is stuck inactive since forever, current state creating, last acting [7,9]pg 0.f2 is stuck inactive since forever, current state creating, last acting [16,14]pg 0.ef is stuck inactive since forever, current state creating, last acting [13,0]pg 0.ee is stuck inactive since forever, current state creating, last acting [19,0]pg 0.ec is stuck inactive since forever, current state creating, last acting [12,20]pg 0.ea is stuck inactive since forever, current state creating, last acting [11,3]pg 0.e9 is stuck inactive since forever, current state creating, last acting [9,21]pg 0.e3 is stuck inactive since forever, current state creating, last acting [3,8]pg 0.e2 is stuck inactive since forever, current state creating, last acting [8,5]pg 0.e0 is stuck inactive since forever, current state creating, last acting [7,18]pg 0.dd is stuck inactive since forever, current state creating, last acting [5,17]pg 0.dc is stuck inactive since forever, current state creating, last acting [3,13]pg 0.db is stuck inactive since forever, current state creating, last acting [4,10]pg 0.da is stuck inactive since forever, current state creating, last acting [6,18]pg 0.d9 is stuck inactive since forever, current state creating, last acting [23,12]pg 0.d5 is stuck inactive since forever, current state creating, last acting [22,11]pg 0.d3 is stuck inactive since forever, current state creating, last acting [3,15]pg 0.d2 is stuck inactive since forever, current state creating, last acting [1,9]pg 0.d1 is stuck inactive since forever, current state creating, last acting [0,13]pg 0.ce is stuck inactive since forever, current state creating, last acting [19,7]pg 0.cd is stuck inactive since forever, current state creating, last acting [13,3]pg 0.cc is stuck inactive since forever, current state creating, last acting [0,15]pg 0.cb is stuck inactive since forever, current state creating, last acting [17,3]pg 0.ca is stuck inactive since forever, current state creating, last acting [15,7]pg 0.c9 is stuck inactive since forever, current state creating, last acting [18,6]pg 0.c8 is stuck inactive since forever, current state creating, last acting [3,10]pg 0.c5 is stuck inactive since forever, current state creating, last acting [10,22]pg 0.c4 is stuck inactive since forever, current state creating, last acting [0,12]pg 0.c1 is stuck inactive since forever, current state creating, last acting [2,13]pg 0.c0 is stuck inactive since forever, current state creating, last acting [17,4]pg 0.bf is stuck inactive since forever, current state creating, last acting [18,12]pg 0.be is stuck inactive since forever, current state creating, last acting [13,21]pg 0.bd is stuck inactive since forever, current state creating, last acting [23,14]pg 0.bb is stuck inactive since forever, current state creating, last acting [23,8]pg 0.ba is stuck inactive since forever, current state creating, last acting [17,9]pg 0.b9 is stuck inactive since forever, current state creating, last acting [0,16]pg 0.b7 is stuck inactive since forever, current state creating, last acting [1,21]pg 0.b6 is stuck inactive since forever, current state creating, last acting [0,8]pg 0.b4 is stuck inactive since forever, current state creating, last acting [7,9]pg 0.b2 is stuck inactive since forever, current state creating, last acting [16,14]pg 0.af is stuck inactive since forever, current state creating, last acting [13,0]pg 0.ae is stuck inactive since forever, current state creating, last acting [19,0]pg 0.ac is stuck inactive since forever, current state creating, last acting [12,20]pg 0.aa is stuck inactive since forever, current state creating, last acting [11,3]pg 0.a9 is stuck inactive since forever, current state creating, last acting [9,21]pg 0.a3 is stuck inactive since forever, current state creating, last acting [3,8]pg 0.a2 is stuck inactive since forever, current state creating, last acting [8,5]pg 0.a0 is stuck inactive since forever, current state creating, last acting [7,18]pg 0.9d is stuck inactive since forever, current state creating, last acting [5,17]pg 0.9c is stuck inactive since forever, current state creating, last acting [3,13]pg 0.9b is stuck inactive since forever, current state creating, last acting [4,10]pg 0.9a is stuck inactive since forever, current state creating, last acting [6,18]pg 0.99 is stuck inactive since forever, current state creating, last acting [23,12]pg 0.95 is stuck inactive since forever, current state creating, last acting [22,11]pg 0.93 is stuck inactive since forever, current state creating, last acting [3,15]pg 0.92 is stuck inactive since forever, current state creating, last acting [1,9]pg 0.91 is stuck inactive since forever, current state creating, last acting [0,13]pg 0.8e is stuck inactive since forever, current state creating, last acting [19,7]pg 0.8d is stuck inactive since forever, current state creating, last acting [13,3]pg 0.8c is stuck inactive since forever, current state creating, last acting [0,15]pg 0.8b is stuck inactive since forever, current state creating, last acting [17,3]pg 0.8a is stuck inactive since forever, current state creating, last acting [15,7]pg 0.89 is stuck inactive since forever, current state creating, last acting [18,6]pg 0.88 is stuck inactive since forever, current state creating, last acting [3,10]pg 0.85 is stuck inactive since forever, current state creating, last acting [10,22]pg 0.84 is stuck inactive since forever, current state creating, last acting [0,12]pg 0.81 is stuck inactive since forever, current state creating, last acting [2,13]pg 0.80 is stuck inactive since forever, current state creating, last acting [17,4]pg 0.7f is stuck inactive since forever, current state creating, last acting [18,12]pg 0.7e is stuck inactive since forever, current state creating, last acting [13,21]pg 0.7d is stuck inactive since forever, current state creating, last acting [23,14]pg 0.7b is stuck inactive since forever, current state creating, last acting [23,8]pg 0.7a is stuck inactive since forever, current state creating, last acting [17,9]pg 0.79 is stuck inactive since forever, current state creating, last acting [0,16]pg 0.77 is stuck inactive since forever, current state creating, last acting [1,21]pg 0.76 is stuck inactive since forever, current state creating, last acting [0,8]pg 0.74 is stuck inactive since forever, current state creating, last acting [7,9]pg 0.72 is stuck inactive since forever, current state creating, last acting [16,14]pg 0.6f is stuck inactive since forever, current state creating, last acting [13,0]pg 0.6e is stuck inactive since forever, current state creating, last acting [19,0]pg 0.6c is stuck inactive since forever, current state creating, last acting [12,20]pg 0.6a is stuck inactive since forever, current state creating, last acting [11,3]pg 0.69 is stuck inactive since forever, current state creating, last acting [9,21]pg 0.63 is stuck inactive since forever, current state creating, last acting [3,8]pg 0.12a is stuck inactive since forever, current state creating, last acting [11,3]pg 0.62 is stuck inactive since forever, current state creating, last acting [8,5]pg 0.129 is stuck inactive since forever, current state creating, last acting [9,21]pg 0.60 is stuck inactive since forever, current state creating, last acting [7,18]pg 0.5d is stuck inactive since forever, current state creating, last acting [5,17]pg 0.5c is stuck inactive since forever, current state creating, last acting [3,13]pg 0.123 is stuck inactive since forever, current state creating, last acting [3,8]pg 0.5b is stuck inactive since forever, current state creating, last acting [4,10]pg 0.122 is stuck inactive since forever, current state creating, last acting [8,5]pg 0.5a is stuck inactive since forever, current state creating, last acting [6,18]pg 0.59 is stuck inactive since forever, current state creating, last acting [23,12]pg 0.120 is stuck inactive since forever, current state creating, last acting [7,18]pg 0.11d is stuck inactive since forever, current state creating, last acting [5,17]pg 0.55 is stuck inactive since forever, current state creating, last acting [22,11]pg 0.11c is stuck inactive since forever, current state creating, last acting [3,13]pg 0.11b is stuck inactive since forever, current state creating, last acting [4,10]pg 0.53 is stuck inactive since forever, current state creating, last acting [3,15]pg 0.11a is stuck inactive since forever, current state creating, last acting [6,18]pg 0.52 is stuck inactive since forever, current state creating, last acting [1,9]pg 0.119 is stuck inactive since forever, current state creating, last acting [23,12]pg 0.51 is stuck inactive since forever, current state creating, last acting [0,13]pg 0.4e is stuck inactive since forever, current state creating, last acting [19,7]pg 0.115 is stuck inactive since forever, current state creating, last acting [22,11]pg 0.4d is stuck inactive since forever, current state creating, last acting [13,3]pg 0.4c is stuck inactive since forever, current state creating, last acting [0,15]pg 0.113 is stuck inactive since forever, current state creating, last acting [3,15]pg 0.4b is stuck inactive since forever, current state creating, last acting [17,3]pg 0.112 is stuck inactive since forever, current state creating, last acting [1,9]pg 0.4a is stuck inactive since forever, current state creating, last acting [15,7]pg 0.111 is stuck inactive since forever, current state creating, last acting [0,13]pg 0.49 is stuck inactive since forever, current state creating, last acting [18,6]pg 0.48 is stuck inactive since forever, current state creating, last acting [3,10]pg 0.10e is stuck inactive since forever, current state creating, last acting [19,7]pg 0.10d is stuck inactive since forever, current state creating, last acting [13,3]pg 0.45 is stuck inactive since forever, current state creating, last acting [10,22]pg 0.10c is stuck inactive since forever, current state creating, last acting [0,15]pg 0.44 is stuck inactive since forever, current state creating, last acting [0,12]pg 0.10b is stuck inactive since forever, current state creating, last acting [17,3]pg 0.10a is stuck inactive since forever, current state creating, last acting [15,7]pg 0.109 is stuck inactive since forever, current state creating, last acting [18,6]pg 0.41 is stuck inactive since forever, current state creating, last acting [2,13]pg 0.108 is stuck inactive since forever, current state creating, last acting [3,10]pg 0.40 is stuck inactive since forever, current state creating, last acting [17,4]pg 0.105 is stuck inactive since forever, current state creating, last acting [10,22]pg 0.104 is stuck inactive since forever, current state creating, last acting [0,12]pg 0.101 is stuck inactive since forever, current state creating, last acting [2,13]pg 0.100 is stuck inactive since forever, current state creating, last acting [17,4]pg 0.ff is stuck inactive since forever, current state creating, last acting [18,12]pg 0.fe is stuck inactive since forever, current state creating, last acting [13,21]pg 0.fd is stuck inactive since forever, current state creating, last acting [23,14]pg 0.fb is stuck inactive since forever, current state creating, last acting [23,8]pg 0.fa is stuck inactive since forever, current state creating, last acting [17,9]pg 0.f9 is stuck inactive since forever, current state creating, last acting [0,16]pg 0.f7 is stuck inactive since forever, current state creating, last acting [1,21]pg 0.f6 is stuck inactive since forever, current state creating, last acting [0,8]pg 0.f4 is stuck unclean since forever, current state creating, last acting [7,9]pg 0.f2 is stuck unclean since forever, current state creating, last acting [16,14]pg 0.ef is stuck unclean since forever, current state creating, last acting [13,0]pg 0.ee is stuck unclean since forever, current state creating, last acting [19,0]pg 0.ec is stuck unclean since forever, current state creating, last acting [12,20]pg 0.ea is stuck unclean since forever, current state creating, last acting [11,3]pg 0.e9 is stuck unclean since forever, current state creating, last acting [9,21]pg 0.e3 is stuck unclean since forever, current state creating, last acting [3,8]pg 0.e2 is stuck unclean since forever, current state creating, last acting [8,5]pg 0.e0 is stuck unclean since forever, current state creating, last acting [7,18]pg 0.dd is stuck unclean since forever, current state creating, last acting [5,17]pg 0.dc is stuck unclean since forever, current state creating, last acting [3,13]pg 0.db is stuck unclean since forever, current state creating, last acting [4,10]pg 0.da is stuck unclean since forever, current state creating, last acting [6,18]pg 0.d9 is stuck unclean since forever, current state creating, last acting [23,12]pg 0.d5 is stuck unclean since forever, current state creating, last acting [22,11]pg 0.d3 is stuck unclean since forever, current state creating, last acting [3,15]pg 0.d2 is stuck unclean since forever, current state creating, last acting [1,9]pg 0.d1 is stuck unclean since forever, current state creating, last acting [0,13]pg 0.ce is stuck unclean since forever, current state creating, last acting [19,7]pg 0.cd is stuck unclean since forever, current state creating, last acting [13,3]pg 0.cc is stuck unclean since forever, current state creating, last acting [0,15]pg 0.cb is stuck unclean since forever, current state creating, last acting [17,3]pg 0.ca is stuck unclean since forever, current state creating, last acting [15,7]pg 0.c9 is stuck unclean since forever, current state creating, last acting [18,6]pg 0.c8 is stuck unclean since forever, current state creating, last acting [3,10]pg 0.c5 is stuck unclean since forever, current state creating, last acting [10,22]pg 0.c4 is stuck unclean since forever, current state creating, last acting [0,12]pg 0.c1 is stuck unclean since forever, current state creating, last acting [2,13]pg 0.c0 is stuck unclean since forever, current state creating, last acting [17,4]pg 0.bf is stuck unclean since forever, current state creating, last acting [18,12]pg 0.be is stuck unclean since forever, current state creating, last acting [13,21]pg 0.bd is stuck unclean since forever, current state creating, last acting [23,14]pg 0.bb is stuck unclean since forever, current state creating, last acting [23,8]pg 0.ba is stuck unclean since forever, current state creating, last acting [17,9]pg 0.b9 is stuck unclean since forever, current state creating, last acting [0,16]pg 0.b7 is stuck unclean since forever, current state creating, last acting [1,21]pg 0.b6 is stuck unclean since forever, current state creating, last acting [0,8]pg 0.b4 is stuck unclean since forever, current state creating, last acting [7,9]pg 0.b2 is stuck unclean since forever, current state creating, last acting [16,14]pg 0.af is stuck unclean since forever, current state creating, last acting [13,0]pg 0.ae is stuck unclean since forever, current state creating, last acting [19,0]pg 0.ac is stuck unclean since forever, current state creating, last acting [12,20]pg 0.aa is stuck unclean since forever, current state creating, last acting [11,3]pg 0.a9 is stuck unclean since forever, current state creating, last acting [9,21]pg 0.a3 is stuck unclean since forever, current state creating, last acting [3,8]pg 0.a2 is stuck unclean since forever, current state creating, last acting [8,5]pg 0.a0 is stuck unclean since forever, current state creating, last acting [7,18]pg 0.9d is stuck unclean since forever, current state creating, last acting [5,17]pg 0.9c is stuck unclean since forever, current state creating, last acting [3,13]pg 0.9b is stuck unclean since forever, current state creating, last acting [4,10]pg 0.9a is stuck unclean since forever, current state creating, last acting [6,18]pg 0.99 is stuck unclean since forever, current state creating, last acting [23,12]pg 0.95 is stuck unclean since forever, current state creating, last acting [22,11]pg 0.93 is stuck unclean since forever, current state creating, last acting [3,15]pg 0.92 is stuck unclean since forever, current state creating, last acting [1,9]pg 0.91 is stuck unclean since forever, current state creating, last acting [0,13]pg 0.8e is stuck unclean since forever, current state creating, last acting [19,7]pg 0.8d is stuck unclean since forever, current state creating, last acting [13,3]pg 0.8c is stuck unclean since forever, current state creating, last acting [0,15]pg 0.8b is stuck unclean since forever, current state creating, last acting [17,3]pg 0.8a is stuck unclean since forever, current state creating, last acting [15,7]pg 0.89 is stuck unclean since forever, current state creating, last acting [18,6]pg 0.88 is stuck unclean since forever, current state creating, last acting [3,10]pg 0.85 is stuck unclean since forever, current state creating, last acting [10,22]pg 0.84 is stuck unclean since forever, current state creating, last acting [0,12]pg 0.81 is stuck unclean since forever, current state creating, last acting [2,13]pg 0.80 is stuck unclean since forever, current state creating, last acting [17,4]pg 0.7f is stuck unclean since forever, current state creating, last acting [18,12]pg 0.7e is stuck unclean since forever, current state creating, last acting [13,21]pg 0.7d is stuck unclean since forever, current state creating, last acting [23,14]pg 0.7b is stuck unclean since forever, current state creating, last acting [23,8]pg 0.7a is stuck unclean since forever, current state creating, last acting [17,9]pg 0.79 is stuck unclean since forever, current state creating, last acting [0,16]pg 0.77 is stuck unclean since forever, current state creating, last acting [1,21]pg 0.76 is stuck unclean since forever, current state creating, last acting [0,8]pg 0.74 is stuck unclean since forever, current state creating, last acting [7,9]pg 0.72 is stuck unclean since forever, current state creating, last acting [16,14]pg 0.6f is stuck unclean since forever, current state creating, last acting [13,0]pg 0.6e is stuck unclean since forever, current state creating, last acting [19,0]pg 0.6c is stuck unclean since forever, current state creating, last acting [12,20]pg 0.6a is stuck unclean since forever, current state creating, last acting [11,3]pg 0.69 is stuck unclean since forever, current state creating, last acting [9,21]pg 0.63 is stuck unclean since forever, current state creating, last acting [3,8]pg 0.12a is stuck unclean since forever, current state creating, last acting [11,3]pg 0.62 is stuck unclean since forever, current state creating, last acting [8,5]pg 0.129 is stuck unclean since forever, current state creating, last acting [9,21]pg 0.60 is stuck unclean since forever, current state creating, last acting [7,18]pg 0.5d is stuck unclean since forever, current state creating, last acting [5,17]pg 0.5c is stuck unclean since forever, current state creating, last acting [3,13]pg 0.123 is stuck unclean since forever, current state creating, last acting [3,8]pg 0.5b is stuck unclean since forever, current state creating, last acting [4,10]pg 0.122 is stuck unclean since forever, current state creating, last acting [8,5]pg 0.5a is stuck unclean since forever, current state creating, last acting [6,18]pg 0.59 is stuck unclean since forever, current state creating, last acting [23,12]pg 0.120 is stuck unclean since forever, current state creating, last acting [7,18]pg 0.11d is stuck unclean since forever, current state creating, last acting [5,17]pg 0.55 is stuck unclean since forever, current state creating, last acting [22,11]pg 0.11c is stuck unclean since forever, current state creating, last acting [3,13]pg 0.11b is stuck unclean since forever, current state creating, last acting [4,10]pg 0.53 is stuck unclean since forever, current state creating, last acting [3,15]pg 0.11a is stuck unclean since forever, current state creating, last acting [6,18]pg 0.52 is stuck unclean since forever, current state creating, last acting [1,9]pg 0.119 is stuck unclean since forever, current state creating, last acting [23,12]pg 0.51 is stuck unclean since forever, current state creating, last acting [0,13]pg 0.4e is stuck unclean since forever, current state creating, last acting [19,7]pg 0.115 is stuck unclean since forever, current state creating, last acting [22,11]pg 0.4d is stuck unclean since forever, current state creating, last acting [13,3]pg 0.4c is stuck unclean since forever, current state creating, last acting [0,15]pg 0.113 is stuck unclean since forever, current state creating, last acting [3,15]pg 0.4b is stuck unclean since forever, current state creating, last acting [17,3]pg 0.112 is stuck unclean since forever, current state creating, last acting [1,9]pg 0.4a is stuck unclean since forever, current state creating, last acting [15,7]pg 0.111 is stuck unclean since forever, current state creating, last acting [0,13]pg 0.49 is stuck unclean since forever, current state creating, last acting [18,6]pg 0.48 is stuck unclean since forever, current state creating, last acting [3,10]pg 0.10e is stuck unclean since forever, current state creating, last acting [19,7]pg 0.10d is stuck unclean since forever, current state creating, last acting [13,3]pg 0.45 is stuck unclean since forever, current state creating, last acting [10,22]pg 0.10c is stuck unclean since forever, current state creating, last acting [0,15]pg 0.44 is stuck unclean since forever, current state creating, last acting [0,12]pg 0.10b is stuck unclean since forever, current state creating, last acting [17,3]pg 0.10a is stuck unclean since forever, current state creating, last acting [15,7]pg 0.109 is stuck unclean since forever, current state creating, last acting [18,6]pg 0.41 is stuck unclean since forever, current state creating, last acting [2,13]pg 0.108 is stuck unclean since forever, current state creating, last acting [3,10]pg 0.40 is stuck unclean since forever, current state creating, last acting [17,4]pg 0.105 is stuck unclean since forever, current state creating, last acting [10,22]pg 0.104 is stuck unclean since forever, current state creating, last acting [0,12]pg 0.101 is stuck unclean since forever, current state creating, last acting [2,13]pg 0.100 is stuck unclean since forever, current state creating, last acting [17,4]pg 0.ff is stuck unclean since forever, current state creating, last acting [18,12]pg 0.fe is stuck unclean since forever, current state creating, last acting [13,21]pg 0.fd is stuck unclean since forever, current state creating, last acting [23,14]pg 0.fb is stuck unclean since forever, current state creating, last acting [23,8]pg 0.fa is stuck unclean since forever, current state creating, last acting [17,9]pg 0.f9 is stuck unclean since forever, current state creating, last acting [0,16]pg 0.f7 is stuck unclean since forever, current state creating, last acting [1,21]pg 0.f6 is stuck unclean since forever, current state creating, last acting [0,8]2 ops are blocked > 2097.15 sec1 ops are blocked > 2097.15 sec on osd.71 ops are blocked > 2097.15 sec on osd.152 osds have slow requestspool rbd pg_num 300 > pgp_num 64[root@avatar0-ceph0 current]#querying a pg gives me this[root@avatar0-ceph0 current]# ceph pg 0.f6 queryError ENOENT: i don't have pgid 0.f6[root@avatar0-ceph0 current]#recreating the PG manually says it is already creating[root@avatar0-ceph0 ~]# ceph pg force_create_pg 0.f6pg 0.f6 already creating[root@avatar0-ceph0 ~]#then nothing happens./Vladᐧ
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph. com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
