Re: Ceph Cluster Taking An Awful Long Time To Rebalance

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks for that - I'll disable the autoscaler on all 5 pools and see what happens

Cheers

Matthew J

On 16/03/2021 13:53, ashley@xxxxxxxxxxxxxx wrote:
I think your issue is you also have the PG scaler trying to change to 1PG.

Due to the size of the OSD/no data it thinks you only need 1PG, I would suggest disabling the PG Auto Scaler on small test clusters.

Thanks
On 16 Mar 2021, 10:50 +0800, duluxoz <duluxoz@xxxxxxxxx>, wrote:

    Hi Guys,


    Is the below "ceph -s" normal?


    This is a brand new cluster with (at the moment) a single Monitor
    and 7

    OSDs (each 6 GiB) that has no data in it (yet), and yet its taking

    almost a day to "heal itself" from adding in the 2nd OSD.


    ~~~


      cluster:

        id:     [REDACTED]

        health: HEALTH_WARN

                Reduced data availability: 256 pgs inactive, 256 pgs
    incomplete

                Degraded data redundancy: 12 pgs undersized


      services:

        mon: 1 daemons, quorum [REDACTED] (age 22h)

        mgr: [REDACTED](active, since 22h)

        osd: 7 osds: 7 up (since 21h), 7 in (since 21h); 32 remapped pgs


      data:

        pools:   5 pools, 288 pgs

        objects: 7 objects, 0 B

        usage:   7.1 GiB used, 38 TiB / 38 TiB avail

        pgs:     88.889% pgs not active

                 6/21 objects misplaced (28.571%)

                 256 creating+incomplete

                 18  active+clean

                 12  active+undersized+remapped

                 2   active+clean+remapped


      progress:

        Rebalancing after osd.1 marked in (22h)

          [............................]

        PG autoscaler decreasing pool 1 PGs from 32 to 1 (19h)

          [............................]


    ~~~


    Thanks in advance


    Matthew J


    --

    Peregrine IT Signature


    *Matthew J BLACK*

      M.Inf.Tech.(Data Comms)

      MBA

      B.Sc.

      MACS (Snr), CP, IP3P


    When you want it done /right/ ‒ the first time!


    Phone: +61 4 0411 0089

    Email: matthew@xxxxxxxxxxxxxxx <mailto:matthew@xxxxxxxxxxxxxxx>

    Web: www.peregrineit.net <http://www.peregrineit.net>


    View Matthew J BLACK's profile on LinkedIn

    <http://au.linkedin.com/in/mjblack>


    This Email is intended only for the addressee.  Its use is limited to

    that intended by the author at the time and it is not to be
    distributed

    without the author’s consent.  You must not use or disclose the
    contents

    of this Email, or add the sender’s Email address to any database, list

    or mailing list unless you are expressly authorised to do so.  Unless

    otherwise stated, Peregrine I.T. Pty Ltd accepts no liability for the

    contents of this Email except where subsequently confirmed in

    writing.  The opinions expressed in this Email are those of the author

    and do not necessarily represent the views of Peregrine I.T. Pty

    Ltd.  This Email is confidential and may be subject to a claim of
    legal

    privilege.


    If you have received this Email in error, please notify the author and

    delete this message immediately.


    _______________________________________________

    ceph-users mailing list -- ceph-users@xxxxxxx

    To unsubscribe send an email to ceph-users-leave@xxxxxxx

--
Peregrine IT Signature

*Matthew J BLACK*
  M.Inf.Tech.(Data Comms)
  MBA
  B.Sc.
  MACS (Snr), CP, IP3P

When you want it done /right/ ‒ the first time!

Phone: 	+61 4 0411 0089
Email: 	matthew@xxxxxxxxxxxxxxx <mailto:matthew@xxxxxxxxxxxxxxx>
Web: 	www.peregrineit.net <http://www.peregrineit.net>

View Matthew J BLACK's profile on LinkedIn <http://au.linkedin.com/in/mjblack>

This Email is intended only for the addressee.  Its use is limited to that intended by the author at the time and it is not to be distributed without the author’s consent.  You must not use or disclose the contents of this Email, or add the sender’s Email address to any database, list or mailing list unless you are expressly authorised to do so.  Unless otherwise stated, Peregrine I.T. Pty Ltd accepts no liability for the contents of this Email except where subsequently confirmed in writing.  The opinions expressed in this Email are those of the author and do not necessarily represent the views of Peregrine I.T. Pty Ltd.  This Email is confidential and may be subject to a claim of legal privilege.

If you have received this Email in error, please notify the author and delete this message immediately.

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux