Hello everyone,
After upgrading the monitors and mgrs to octopus (15.2.16) the system told me that some pools did not have the correct pg_nums, some of them above the optimum and one of them the busiest below 256 of 1024 required.
[root@cephmon01 ~]# ceph versions
{
"mon": {
"ceph version 15.2.16 (d46a73d6d0a67a79558054a3a5a72cb561724974) octopus (stable)": 3
},
"mgr": {
"ceph version 15.2.16 (d46a73d6d0a67a79558054a3a5a72cb561724974) octopus (stable)": 3
},
"osd": {
"ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)": 144
},
"mds": {
"ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)": 2
},
"rgw": {
"ceph version 14.2.22 (ca74598065096e6fcbd843333c8779a2be0c889351) nautilus (stable)": 2
},
"overall": {
"ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)": 148,
"ceph version 15.2.16 (d46a73d6d0a67a79558054a3a5a72cb561724974) octopus (stable)": 6
}
I corrected the values, and configured them according to the recommendations except for the one that had to be increased from 256 to 512.
The thing is that since 2 days ago of the change and the system appears as healthy, but continuously with pgs in remapping. The curious thing is that when it reaches 5% of objects mispaced, this value changes again (usually from 40 pgs to 45-48):
data:
pools: 42 pools, 2879 pgs
objects: 35.10M objects, 132 TiB
usage: 401 TiB used, 1.1 PiB / 1.5 PiB avail
pgs: 5427890/105310536 objects misplaced (5.154%).
2834 active+clean
35 active+remapped+backfill_wait
7 active+remapped+backfilling
3 active+clean+scrubbing+deep
What is curious is that if we see the number of pgs assigned to the pools and do the sum :
ceph df| awk {'print $3'} > num_pgs
32 512 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 32 32 32 32 32 32 32 256 64 32 32 32 32 1
the total sum is 2880, but right now the system shows 2879 pgs.
I have to wait for the process to finish, or there is something wrong with the configuration that needs to be fixed.
Any Advise is welcomed,
--
=====================================================
Ibán Cabrillo Bartolomé
Instituto de Fisica de Cantabria (IFCA-CSIC)
Santander, Spain
Tel: +34942200969/+34669930421
Responsable del Servicio de Computación Avanzada
======================================================
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
