Re: pg deep-scrub issue

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

please share more details about your cluster like

ceph -s
ceph osd df tree
ceph pg ls-by-pool <pool_id_4> | head

If the client load is not too high you could increase the osd_max_scrubs config from 1 to 3 and see if anything improves (what is the current value?). If the client load is high during working hours but low at night you could set the osd_scrub_begin_hour and osd_scrub_end_hour to evening/night times. There are plenty of options.

Regards,
Eugen

Zitat von Peter <petersun@xxxxxxxxxxxx>:

Dear all,

I am writing to seek your assistance in resolving an issue with my Ceph cluster.

Currently, the cluster is experiencing a problem where the number of Placement Groups (PGs) that need to undergo deepscrub and regular scrub cannot be completed in a timely manner. I have noticed that these PGs appear to be concentrated on a single OSD. I am seeking your guidance on how to address this issue and would appreciate any insights or suggestions you may have.

Please find attached the Ceph health detail output for your reference.
HEALTH_WARN 13 pgs not deep-scrubbed in time; 7 pgs not scrubbed in time
[WRN] PG_NOT_DEEP_SCRUBBED: 13 pgs not deep-scrubbed in time
    pg 4.426 not deep-scrubbed since 2023-04-22T10:00:21.529716+0800
    pg 4.f0 not deep-scrubbed since 2023-04-22T04:55:17.868881+0800
    pg 4.b9 not deep-scrubbed since 2023-04-22T16:47:25.219603+0800
    pg 4.87 not deep-scrubbed since 2023-04-22T20:01:02.508600+0800
    pg 4.31 not deep-scrubbed since 2023-04-23T00:27:39.299893+0800
    pg 4.5b9 not deep-scrubbed since 2023-04-19T21:03:47.041934+0800
    pg 4.68a not deep-scrubbed since 2023-04-21T19:52:39.251293+0800
    pg 4.6a4 not deep-scrubbed since 2023-04-22T16:20:51.078431+0800
    pg 4.6ec not deep-scrubbed since 2023-04-21T11:20:33.661595+0800
    pg 4.7a4 not deep-scrubbed since 2023-04-20T22:30:44.506420+0800
    pg 4.7a2 not deep-scrubbed since 2023-04-16T12:05:56.586205+0800
    pg 4.7b4 not deep-scrubbed since 2023-04-17T15:50:10.595292+0800
    pg 4.7c8 not deep-scrubbed since 2023-04-19T15:10:12.673655+0800
[WRN] PG_NOT_SCRUBBED: 7 pgs not scrubbed in time
    pg 4.31e not scrubbed since 2023-04-24T13:34:26.103257+0800
    pg 4.5b9 not scrubbed since 2023-04-24T07:20:53.891175+0800
    pg 4.68a not scrubbed since 2023-04-24T03:37:58.070854+0800
    pg 4.7a4 not scrubbed since 2023-04-24T02:55:25.912789+0800
    pg 4.7b4 not scrubbed since 2023-04-24T10:04:46.889422+0800
    pg 4.7c8 not scrubbed since 2023-04-24T13:36:07.284271+0800
pg 4.7d2 not scrubbed since 2023-04-24T14:47:19.365551+0800

Peter

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux