Re: Luminous scrub catch-22

Roger Brown <rogerpbrown@xxxxxxxxx> · Thu, 03 Aug 2017 20:03:03 +0000

Thank you. That was it. They were installed, but hadn't been restarted since upgrading. Solved with: sudo systemctl restart ceph-mgr.target

On Thu, Aug 3, 2017 at 1:56 PM Gregory Farnum <gfarnum@xxxxxxxxxx> wrote:
I believe that command should still work, but it looks like it requires a working manager daemon. Did you set one up yet?

On Thu, Aug 3, 2017 at 7:31 AM Roger Brown <rogerpbrown@xxxxxxxxx> wrote:
I'm running Luminous 12.1.2 and I seem to be in a catch-22. I've got pgs that report they need to be scrubbed, however the command to scrub them seems to have gone away. The flapping OSD is an issue for another thread. Please advise.
Example:

roger@desktop:~$ ceph --version
ceph version 12.1.2 (b661348f156f148d764b998b65b90451f096cb27) luminous (rc)

roger@desktop:~$ ceph health detail
HEALTH_WARN 1 osds down; 1 host (1 osds) down; Degraded data redundancy: 54278/162834 objects degraded (33.333%), 372 pgs unclean, 372 pgs degraded, 372 pgs undersized; 119 pgs not deep-scrubbed for 86400; 128 pgs not scrubbed for 86400; 10 slow requests are blocked > 32 sec
OSD_DOWN 1 osds down
    osd.0 (root=default,host=osd3) is down
OSD_HOST_DOWN 1 host (1 osds) down
    host osd3 (root=default) (1 osds) is down
PG_DEGRADED Degraded data redundancy: 54278/162834 objects degraded (33.333%), 372 pgs unclean, 372 pgs degraded, 372 pgs undersized
    pg 103.cd is stuck unclean for 1351336.704366, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.ce is stuck undersized for 155.107291, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.cf is stuck undersized for 155.107098, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.d0 is stuck undersized for 155.106886, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.d1 is stuck undersized for 155.106692, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.d2 is stuck undersized for 155.106511, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.d3 is stuck undersized for 155.106333, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.d4 is stuck undersized for 155.107740, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.d5 is stuck undersized for 155.122380, current state active+undersized+degraded, last acting [3,2147483647,4]
    pg 103.d6 is stuck undersized for 155.122118, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.d7 is stuck undersized for 155.122251, current state active+undersized+degraded, last acting [3,4,2147483647]
    pg 103.d8 is stuck undersized for 155.121991, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.d9 is stuck undersized for 155.121842, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.da is stuck undersized for 155.126263, current state active+undersized+degraded, last acting [3,2147483647,4]
    pg 103.db is stuck undersized for 155.107793, current state active+undersized+degraded, last acting [3,4,2147483647]
    pg 103.dc is stuck undersized for 155.105822, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.dd is stuck undersized for 155.105619, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.de is stuck undersized for 155.095456, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.df is stuck undersized for 155.121684, current state active+undersized+degraded, last acting [3,4,2147483647]
    pg 103.e0 is stuck undersized for 155.115082, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.e1 is stuck undersized for 155.100069, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.e2 is stuck undersized for 155.095089, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.e3 is stuck undersized for 155.100056, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.e4 is stuck undersized for 155.100750, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.e5 is stuck undersized for 155.117161, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.e6 is stuck undersized for 155.101932, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.e7 is stuck undersized for 155.115349, current state active+undersized+degraded, last acting [3,4,2147483647]
    pg 103.e8 is stuck undersized for 155.099699, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.e9 is stuck undersized for 155.114433, current state active+undersized+degraded, last acting [3,2147483647,4]
    pg 103.ea is stuck undersized for 155.099736, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.eb is stuck undersized for 155.106121, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.ec is stuck undersized for 155.091681, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.ed is stuck undersized for 155.115500, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.ee is stuck undersized for 155.114273, current state active+undersized+degraded, last acting [3,2147483647,4]
    pg 103.ef is stuck undersized for 155.120039, current state active+undersized+degraded, last acting [3,4,2147483647]
    pg 103.f0 is stuck undersized for 155.105798, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.f1 is stuck undersized for 155.105631, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.f2 is stuck undersized for 155.103506, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.f3 is stuck undersized for 155.103298, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.f4 is stuck undersized for 155.100579, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.f5 is stuck undersized for 155.102359, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.f6 is stuck undersized for 155.114456, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.f7 is stuck undersized for 155.101137, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.f8 is stuck undersized for 155.117346, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.f9 is stuck undersized for 155.117501, current state active+undersized+degraded, last acting [3,4,2147483647]
    pg 103.fa is stuck undersized for 155.105177, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.fb is stuck undersized for 155.125665, current state active+undersized+degraded, last acting [2147483647,3,4]
    pg 103.fc is stuck undersized for 155.104536, current state active+undersized+degraded, last acting [2147483647,4,3]
    pg 103.fd is stuck undersized for 155.104954, current state active+undersized+degraded, last acting [4,2147483647,3]
    pg 103.fe is stuck undersized for 155.104974, current state active+undersized+degraded, last acting [4,3,2147483647]
    pg 103.ff is stuck undersized for 155.103408, current state active+undersized+degraded, last acting [4,3,2147483647]
PG_NOT_DEEP_SCRUBBED 119 pgs not deep-scrubbed for 86400
    pg 103.fc not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.fb not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.fa not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.f7 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.f6 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.f2 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.f1 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.e8 not deep-scrubbed since 2017-07-19 18:41:29.266030
    pg 103.e5 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.e0 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.de not deep-scrubbed since 2017-07-19 17:32:06.003763
    pg 103.dd not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.d9 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.d8 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.d6 not deep-scrubbed since 2017-07-20 01:15:26.709257
    pg 103.cd not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.c9 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.c7 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.c6 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.c5 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.c3 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.c2 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.ba not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.b8 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.b7 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.b6 not deep-scrubbed since 2017-07-19 19:34:48.698372
    pg 103.b4 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.b3 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.b2 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.ae not deep-scrubbed since 2017-07-19 15:13:00.136559
    pg 103.ad not deep-scrubbed since 2017-07-26 17:07:27.418812
    pg 103.ab not deep-scrubbed since 2017-07-19 18:18:35.252592
    pg 103.a6 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.9f not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.9d not deep-scrubbed since 2017-07-26 14:45:19.583048
    pg 103.9c not deep-scrubbed since 2017-07-26 16:01:17.334495
    pg 103.9b not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.99 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.97 not deep-scrubbed since 2017-07-19 20:57:56.864689
    pg 103.95 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.90 not deep-scrubbed since 2017-07-26 20:07:30.302163
    pg 103.8b not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.89 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.85 not deep-scrubbed since 2017-07-19 21:07:59.231818
    pg 103.82 not deep-scrubbed since 2017-07-26 15:42:10.945662
    pg 103.81 not deep-scrubbed since 2017-07-26 16:43:47.674733
    pg 103.80 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.7e not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.7a not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.78 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.77 not deep-scrubbed since 2017-07-26 18:42:07.575458
    pg 103.76 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.71 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.6b not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.68 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.62 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.61 not deep-scrubbed since 2017-07-26 15:51:43.367939
    pg 103.5f not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.5e not deep-scrubbed since 2017-07-19 22:55:43.183685
    pg 103.5d not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.5c not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.5b not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.57 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.56 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.52 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 97.2 not deep-scrubbed since 2017-07-20 02:42:16.743627
    pg 99.0 not deep-scrubbed since 2017-07-18 18:11:28.048273
    pg 101.7 not deep-scrubbed since 2017-07-18 08:24:03.332885
    pg 97.1 not deep-scrubbed since 2017-07-18 06:24:20.317393
    pg 98.2 not deep-scrubbed since 2017-07-17 01:00:35.441152
    pg 85.1 not deep-scrubbed since 2017-07-18 22:14:01.161735
    pg 83.6 not deep-scrubbed since 2017-07-13 15:20:33.052086
    pg 83.3 not deep-scrubbed since 2017-07-19 18:18:13.173705
    pg 70.2 not deep-scrubbed since 2017-07-26 15:13:46.791163
    pg 70.1 not deep-scrubbed since 2017-07-18 02:45:43.885917
    pg 103.20 not deep-scrubbed since 2017-07-19 20:15:36.304167
    pg 85.7 not deep-scrubbed since 2017-07-17 14:44:43.923020
    pg 83.1 not deep-scrubbed since 2017-07-15 06:34:17.541635
    pg 87.5 not deep-scrubbed since 2017-07-18 20:37:33.018362
    pg 103.21 not deep-scrubbed since 2017-07-19 14:33:59.608611
    pg 83.2 not deep-scrubbed since 2017-07-13 06:47:47.636347
    pg 86.7 not deep-scrubbed since 2017-07-26 19:24:46.184968
    pg 86.5 not deep-scrubbed since 2017-07-26 17:12:15.974232
    pg 85.2 not deep-scrubbed since 2017-07-21 16:10:37.553993
    pg 86.0 not deep-scrubbed since 2017-07-16 02:30:03.823444
    pg 87.1 not deep-scrubbed since 2017-07-20 08:11:10.424247
    pg 93.5 not deep-scrubbed since 2017-07-17 07:59:04.773412
    pg 92.4 not deep-scrubbed since 2017-07-26 16:43:44.722722
    pg 93.4 not deep-scrubbed since 2017-07-13 10:26:57.987240
    pg 90.3 not deep-scrubbed since 2017-07-19 20:21:45.967126
    pg 89.0 not deep-scrubbed since 2017-07-26 18:42:05.747042
    pg 93.7 not deep-scrubbed since 2017-07-17 04:31:15.198184
    pg 92.6 not deep-scrubbed since 2017-07-20 01:05:50.810348
    pg 91.1 not deep-scrubbed since 2017-07-26 19:15:18.087714
    pg 88.2 not deep-scrubbed since 2017-07-16 00:07:15.345390
    pg 89.5 not deep-scrubbed since 2017-07-14 16:01:13.322117
    pg 103.3a not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 90.4 not deep-scrubbed since 2017-07-19 23:11:40.057162
    pg 88.6 not deep-scrubbed since 2017-07-19 03:55:56.975671
    pg 90.5 not deep-scrubbed since 2017-07-17 09:04:01.677202
    pg 103.3 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 100.1 not deep-scrubbed since 2017-07-18 02:39:16.075351
    pg 100.2 not deep-scrubbed since 2017-07-26 18:51:31.819549
    pg 103.d not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.10 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.11 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.14 not deep-scrubbed since 2017-07-26 16:24:56.643212
    pg 103.16 not deep-scrubbed since 2017-07-26 18:13:47.668512
    pg 103.17 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.18 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.1e not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.27 not deep-scrubbed since 2017-07-26 15:08:58.651967
    pg 103.28 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.2c not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.40 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.41 not deep-scrubbed since 2017-07-19 23:50:31.432316
    pg 103.48 not deep-scrubbed since 2017-07-18 13:59:58.952184
    pg 103.4e not deep-scrubbed since 2017-07-26 18:04:22.684629
    pg 103.51 not deep-scrubbed since 2017-07-18 13:59:58.952184
PG_NOT_SCRUBBED 128 pgs not scrubbed for 86400
    pg 103.fc not scrubbed since 2017-07-19 22:50:29.494994
    pg 103.fb not scrubbed since 2017-07-19 18:07:50.174479
    pg 103.fa not scrubbed since 2017-07-19 18:30:15.790827
    pg 103.f8 not scrubbed since 2017-08-02 05:43:10.187560
    pg 103.f7 not scrubbed since 2017-07-19 23:37:29.372106
    pg 103.f6 not scrubbed since 2017-07-19 20:35:05.215729
    pg 103.f2 not scrubbed since 2017-07-19 21:44:13.616468
    pg 103.f1 not scrubbed since 2017-07-19 21:50:02.633207
    pg 103.ed not scrubbed since 2017-08-01 20:19:32.840788
    pg 103.ec not scrubbed since 2017-07-31 16:27:16.373255
    pg 103.e8 not scrubbed since 2017-07-21 06:13:10.840374
    pg 103.e5 not scrubbed since 2017-07-19 16:14:32.471127
    pg 103.e0 not scrubbed since 2017-07-20 00:15:57.047062
    pg 103.de not scrubbed since 2017-07-19 17:32:06.003763
    pg 103.dd not scrubbed since 2017-07-20 00:13:40.604889
    pg 103.d9 not scrubbed since 2017-07-19 17:26:07.422173
    pg 103.d8 not scrubbed since 2017-07-19 20:43:20.230503
    pg 103.d6 not scrubbed since 2017-07-20 01:15:26.709257
    pg 103.d1 not scrubbed since 2017-07-31 23:56:51.498418
    pg 103.cd not scrubbed since 2017-07-19 18:24:53.832416
    pg 103.c9 not scrubbed since 2017-07-19 19:48:27.897883
    pg 103.c7 not scrubbed since 2017-07-19 17:56:15.130112
    pg 103.c6 not scrubbed since 2017-07-19 20:47:22.241724
    pg 103.c5 not scrubbed since 2017-07-19 20:55:53.344401
    pg 103.c3 not scrubbed since 2017-07-19 16:36:17.657195
    pg 103.c2 not scrubbed since 2017-07-19 22:51:53.078804
    pg 103.ba not scrubbed since 2017-07-19 17:54:16.592039
    pg 103.b8 not scrubbed since 2017-07-19 18:16:59.264825
    pg 103.b7 not scrubbed since 2017-07-19 19:54:07.324717
    pg 103.b6 not scrubbed since 2017-07-19 19:34:48.698372
    pg 103.b4 not scrubbed since 2017-07-19 19:04:39.535780
    pg 103.b3 not scrubbed since 2017-07-19 18:38:14.377182
    pg 103.b2 not scrubbed since 2017-07-19 21:14:10.488558
    pg 103.ae not scrubbed since 2017-07-22 19:55:41.022736
    pg 103.ab not scrubbed since 2017-07-19 18:18:35.252592
    pg 103.a6 not scrubbed since 2017-07-19 21:32:13.540091
    pg 103.9f not scrubbed since 2017-07-19 23:50:28.450717
    pg 103.9b not scrubbed since 2017-07-20 01:37:35.175900
    pg 103.99 not scrubbed since 2017-07-19 20:23:22.100084
    pg 103.97 not scrubbed since 2017-07-19 20:57:56.864689
    pg 103.95 not scrubbed since 2017-07-19 20:09:05.409785
    pg 103.8b not scrubbed since 2017-07-20 01:30:31.116688
    pg 103.89 not scrubbed since 2017-07-19 20:46:07.678331
    pg 103.85 not scrubbed since 2017-07-19 21:07:59.231818
    pg 103.80 not scrubbed since 2017-07-20 01:47:30.206297
    pg 103.7f not scrubbed since 2017-08-01 11:28:38.740129
    pg 103.7e not scrubbed since 2017-07-19 23:30:22.302661
    pg 103.7a not scrubbed since 2017-07-19 20:30:19.570360
    pg 103.79 not scrubbed since 2017-07-31 02:01:36.959330
    pg 103.78 not scrubbed since 2017-07-20 00:49:48.335373
    pg 103.76 not scrubbed since 2017-07-19 21:31:11.550089
    pg 103.71 not scrubbed since 2017-07-19 17:16:44.819586
    pg 103.6b not scrubbed since 2017-07-19 19:19:46.141450
    pg 103.69 not scrubbed since 2017-07-31 23:05:15.232368
    pg 103.68 not scrubbed since 2017-07-19 16:44:46.113125
    pg 103.62 not scrubbed since 2017-07-20 01:30:51.101066
    pg 103.5f not scrubbed since 2017-07-19 15:05:07.015911
    pg 103.5e not scrubbed since 2017-07-19 22:55:43.183685
    pg 103.5d not scrubbed since 2017-07-19 17:43:23.037582
    pg 103.5c not scrubbed since 2017-07-19 19:20:47.720113
    pg 103.5b not scrubbed since 2017-07-19 15:46:08.428220
    pg 103.57 not scrubbed since 2017-07-19 15:41:26.216554
    pg 103.56 not scrubbed since 2017-07-19 22:01:57.785947
    pg 103.52 not scrubbed since 2017-07-20 00:37:08.746572
    pg 97.2 not scrubbed since 2017-07-20 02:42:16.743627
    pg 99.0 not scrubbed since 2017-07-20 02:42:14.743124
    pg 101.7 not scrubbed since 2017-07-19 18:37:40.256002
    pg 103.5 not scrubbed since 2017-08-01 18:25:01.819087
    pg 97.1 not scrubbed since 2017-07-19 15:52:24.155676
    pg 98.2 not scrubbed since 2017-07-19 13:51:42.365278
    pg 85.1 not scrubbed since 2017-07-20 04:44:44.542471
    pg 86.2 not scrubbed since 2017-07-31 09:58:04.350717
    pg 85.0 not scrubbed since 2017-07-31 04:16:52.171842
    pg 83.6 not scrubbed since 2017-07-20 04:44:45.544570
    pg 70.3 not scrubbed since 2017-08-02 00:35:49.008610
    pg 83.3 not scrubbed since 2017-07-19 18:18:13.173705
    pg 87.7 not scrubbed since 2017-07-31 22:41:02.079673
    pg 70.1 not scrubbed since 2017-07-21 18:41:59.592983
    pg 103.20 not scrubbed since 2017-07-19 20:15:36.304167
    pg 85.7 not scrubbed since 2017-07-20 02:18:07.281765
    pg 83.1 not scrubbed since 2017-07-20 12:17:00.152602
    pg 87.5 not scrubbed since 2017-07-20 01:52:29.113717
    pg 70.0 not scrubbed since 2017-07-31 07:52:26.384856
    pg 103.21 not scrubbed since 2017-07-19 14:33:59.608611
    pg 83.2 not scrubbed since 2017-07-20 02:10:15.230638
    pg 87.6 not scrubbed since 2017-07-28 17:49:16.358308
    pg 85.2 not scrubbed since 2017-07-21 16:10:37.553993
    pg 86.0 not scrubbed since 2017-07-19 18:57:03.384449
    pg 87.1 not scrubbed since 2017-07-20 08:11:10.424247
    pg 93.5 not scrubbed since 2017-07-19 17:29:53.806442
    pg 93.4 not scrubbed since 2017-07-19 21:58:29.580467
    pg 91.2 not scrubbed since 2017-08-02 06:02:34.770737
    pg 90.3 not scrubbed since 2017-07-19 20:21:45.967126
    pg 93.7 not scrubbed since 2017-07-18 15:19:30.869748
    pg 92.6 not scrubbed since 2017-07-20 01:05:50.810348
    pg 88.2 not scrubbed since 2017-07-19 12:53:55.985845
    pg 93.6 not scrubbed since 2017-08-01 02:12:33.560620
    pg 95.3 not scrubbed since 2017-07-31 20:06:15.047864
    pg 92.0 not scrubbed since 2017-07-29 05:31:23.510424
    pg 89.5 not scrubbed since 2017-07-19 14:11:36.501281
    pg 91.6 not scrubbed since 2017-07-31 06:04:31.027424
    pg 88.5 not scrubbed since 2017-08-01 10:55:59.839715
    pg 103.3a not scrubbed since 2017-07-19 18:21:50.318306
    pg 95.1 not scrubbed since 2017-07-29 02:53:54.835026
    pg 90.4 not scrubbed since 2017-07-19 23:11:40.057162
    pg 88.6 not scrubbed since 2017-07-21 23:25:09.134990
    pg 90.5 not scrubbed since 2017-07-20 02:35:49.658931
    pg 89.6 not scrubbed since 2017-08-02 04:26:56.748026
    pg 103.3 not scrubbed since 2017-07-20 01:39:27.202375
    pg 100.1 not scrubbed since 2017-07-19 08:41:15.747050
    pg 103.2 not scrubbed since 2017-08-01 05:31:13.315468
    pg 103.1 not scrubbed since 2017-07-30 23:56:46.392350
    pg 103.c not scrubbed since 2017-08-01 20:00:06.018021
    pg 103.d not scrubbed since 2017-07-19 22:02:35.782597
    pg 103.10 not scrubbed since 2017-07-19 19:23:36.684976
    pg 103.11 not scrubbed since 2017-07-19 15:38:20.216858
    pg 103.13 not scrubbed since 2017-08-02 06:20:14.917089
    pg 103.17 not scrubbed since 2017-07-19 15:40:27.195770
    pg 103.18 not scrubbed since 2017-07-20 00:57:45.949213
    pg 103.19 not scrubbed since 2017-08-02 03:35:01.591583
    pg 103.1e not scrubbed since 2017-07-20 01:31:21.086157
    pg 103.1f not scrubbed since 2017-07-31 22:52:19.109775
    pg 103.28 not scrubbed since 2017-07-19 17:42:01.049219
    pg 103.2c not scrubbed since 2017-07-19 17:45:11.057699
    pg 103.40 not scrubbed since 2017-07-19 23:11:11.206635
    pg 103.41 not scrubbed since 2017-07-19 23:50:31.432316
    pg 103.48 not scrubbed since 2017-07-19 22:31:33.908909
    pg 103.51 not scrubbed since 2017-07-19 15:21:47.129684
REQUEST_SLOW 10 slow requests are blocked > 32 sec
    4 ops are blocked > 262.144 sec
    6 ops are blocked > 131.072 sec
    osd.0 have blocked requests > 262.144 sec

roger@desktop:~$ ceph pg scrub 103.51
no valid command found; 10 closest matches:
pg set_nearfull_ratio <float[0.0-1.0]>
pg map <pgid>
pg force_create_pg <pgid>
pg set_full_ratio <float[0.0-1.0]>
Error EINVAL: invalid command

_______________________________________________

ceph-users mailing list

ceph-users@xxxxxxxxxxxxxx

http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com