Re: What is a pgmap?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Unfortunately, my e-mail client does not collect threads properly.

Think I got my answer.

Form Janne Johansson:
> Since using computer time and date is fraught with peril, having the whole
> cluster just bump that single number every second (and writing it to the PG
> on each write) would allow a mostly idle PG that comes back after an hour
> of unexpected downtime to easily know if it needs no recovery, a little bit
> of delta to get up-to-date or a full copy from the primary in order to
> become a part of the replica set for that PG.

So an increase every second is expected.

Thanks and best regards,
=================
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14

________________________________________
From: Frank Schilder <frans@xxxxxx>
Sent: 14 May 2020 12:37
To: Nghia Viet Tran; Bryan Henderson; Ceph users mailing list
Subject:  Re: What is a pgmap?

Hi, I also observe an increase in pgmap version every second or so, see snippet below. I run mimic 13.2.8 without any PG scaling/upmapping. Why does the version increase so often?

May 14 12:33:50 ceph-03 journal: cluster 2020-05-14 12:33:48.521546 mgr.ceph-02 mgr.27460080 192.168.32.66:0/63 114833 : cluster [DBG] pgmap v114860: 2545 pgs: 2 active+clean+scrubbing+deep, 2543 active+clean; 195 TiB data, 249 TiB used, 1.5 PiB / 1.8 PiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.48 kop/s

May 14 12:33:50 ceph-02 journal: 2020-05-14 12:33:50.543 7fdb57c5b700  0 log_channel(cluster) log [DBG] : pgmap v114861: 2545 pgs: 2 active+clean+scrubbing+deep, 2543 active+clean; 195 TiB data, 249 TiB used, 1.5 PiB / 1.8 PiB avail; 5.6 MiB/s rd, 11 MiB/s wr, 1.21 kop/s

May 14 12:33:52 ceph-02 journal: 2020-05-14 12:33:52.565 7fdb57c5b700  0 log_channel(cluster) log [DBG] : pgmap v114862: 2545 pgs: 2 active+clean+scrubbing+deep, 2543 active+clean; 195 TiB data, 249 TiB used, 1.5 PiB / 1.8 PiB avail; 8.9 MiB/s rd, 16 MiB/s wr, 1.59 kop/s

The version increases every second, here from pgmap v114860 to  pgmap v114862. Current cluster status:

[root@gnosis]# ceph status
  cluster:
    id:     ---
    health: HEALTH_OK

  services:
    mon: 3 daemons, quorum ceph-01,ceph-02,ceph-03
    mgr: ceph-02(active), standbys: ceph-01, ceph-03
    mds: con-fs2-1/1/1 up  {0=ceph-08=up:active}, 1 up:standby-replay
    osd: 288 osds: 268 up, 268 in

  data:
    pools:   10 pools, 2545 pgs
    objects: 80.80 M objects, 195 TiB
    usage:   249 TiB used, 1.5 PiB / 1.8 PiB avail
    pgs:     2543 active+clean
             2    active+clean+scrubbing+deep

  io:
    client:   20 MiB/s rd, 21 MiB/s wr, 578 op/s rd, 1.08 kop/s wr

Thanks for any info!
=================
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14

________________________________________
From: Nghia Viet Tran <Nghia.Viet.Tran@xxxxxxxxxx>
Sent: 14 May 2020 03:49:38
To: Bryan Henderson; Ceph users mailing list
Subject:  Re: What is a pgmap?

If your Ceph cluster are running on the latest version of Ceph then the the pg_autoscaler probably  is the reason. After the period of time, Ceph will check the cluster status and increase/decrease the number of PG in the cluster if needed.

On 5/14/20, 03:37, "Bryan Henderson" <bryanh@xxxxxxxxxxxxxxxx> wrote:

    I'm surprised I couldn't find this explained anywhere (I did look), but ...

    What is the pgmap and why does it get updated every few seconds on a tiny
    cluster that's mostly idle?

    I do know what a placement group (PG) is and that when documentation talks
    about placement group maps, it is talking about something else -- mapping of
    PGs to OSDs by CRUSH and OSD maps.

    --
    Bryan Henderson                                   San Jose, California
    _______________________________________________
    ceph-users mailing list -- ceph-users@xxxxxxx
    To unsubscribe send an email to ceph-users-leave@xxxxxxx

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux