Hi, Thanks again for your input. The value of mon_max_pool_pg_num was at its default. It turns out I had missed a few steps in my earlier effort: After I removed the old default settings for osd_pool_default_pg_num and osd_pool_default_pgp_num from ceph.conf on *all* nodes, and restarted all ceph services on all nodes, I finally got rid of the error. The error appears to return when setting osd_pool_default_pgp_num to anything else but 0. Even with osd_pool_default_pg_num = 32 osd_pool_default_pgp_num = 32 the error returns: Error ERANGE: 'pgp_num' must be greater than 0 and lower or equal than 'pg_num', which in this case is 1 Not sure whether this is intended behavior (to my understanding pg_num and pgp_num should be equal), but at least I can get rid of the error now by not putting these settings in ceph.conf anymore. Cheers, Geert On Tue, 2023-03-21 at 08:03 +0000, Eugen Block wrote: > External email: Use caution opening links or attachments > > > Sorry, hit send too early. It seems I could reproduce it by reducing > the value to 1: > > host1:~ # ceph config set mon mon_max_pool_pg_num 1 > host1:~ # ceph config get mon mon_max_pool_pg_num > 1 > host1:~ # ceph osd pool create pool3 > Error ERANGE: 'pg_num' must be greater than 0 and less than or equal > to 1 (you may adjust 'mon max pool pg num' for higher values) > > The default is 65536. Can you verify if this is your issue? > > Zitat von Eugen Block <eblock@xxxxxx>: > > > Did you ever adjust mon_max_pool_pg_num? Can you check what your > > current config value is? > > > > host1:~ # ceph config get mon mon_max_pool_pg_num > > 65536 > > > > Zitat von Geert Kloosterman <gkloosterman@xxxxxxxxxx>: > > > > > Hi, > > > > > > Thanks Eugen for checking this. I get the same default values as > > > you when I remove the entries from my ceph.conf: > > > > > > [root@gjk-ceph ~]# ceph-conf -D | grep default_pg > > > osd_pool_default_pg_autoscale_mode = on > > > osd_pool_default_pg_num = 32 > > > osd_pool_default_pgp_num = 0 > > > > > > However, in my case, the pool creation error remains: > > > > > > [root@gjk-ceph ~]# ceph osd pool create asdf > > > Error ERANGE: 'pgp_num' must be greater than 0 and lower or > > > equal > > > than 'pg_num', which in this case is 1 > > > > > > But I can create the pool when passing the same pg_num and > > > pgp_num > > > values explicity: > > > > > > [root@gjk-ceph ~]# ceph osd pool create asdf 32 0 > > > pool 'asdf' created > > > > > > Does anyone have an idea how I can debug this further? > > > > > > I'm running Ceph on a virtualized Rocky 8.7 test cluster, with > > > Ceph > > > rpms installed from > > > https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdownload.ceph.com%2Frpm-quincy%2Fel8%2F&data=05%7C01%7Cgkloosterman%40nvidia.com%7C7433da6078a54827d52508db29e2fdfb%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0%7C638149827139745086%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=a6%2FwrNWvlcb57AW14JVNfJnUI8ryDfAXfirXzuBwl58%3D&reserved=0 > > > > > > Best regards, > > > Geert Kloosterman > > > > > > > > > On Wed, 2023-03-15 at 13:42 +0000, Eugen Block wrote: > > > > External email: Use caution opening links or attachments > > > > > > > > > > > > Hi, > > > > > > > > I could not confirm this in a virtual lab cluster, also on > > > > 17.2.5: > > > > > > > > host1:~ # ceph osd pool create asdf > > > > pool 'asdf' created > > > > > > > > host1:~ # ceph-conf -D | grep 'osd_pool_default_pg' > > > > osd_pool_default_pg_autoscale_mode = on > > > > osd_pool_default_pg_num = 32 > > > > osd_pool_default_pgp_num = 0 > > > > > > > > So it looks quite similar except the pgp_num value (I can't > > > > remember > > > > having that modified). This is an upgraded Nautilus cluster. > > > > > > > > Zitat von Geert Kloosterman <gkloosterman@xxxxxxxxxx>: > > > > > > > > > Hi all, > > > > > > > > > > I'm trying out Ceph Quincy (17.2.5) for the first time and > > > > > I'm > > > > > running into unexpected behavior of "ceph osd pool create". > > > > > > > > > > When not passing any pg_num and pgp_num values, I get the > > > > > following > > > > > error with Quincy: > > > > > > > > > > [root@gjk-ceph ~]# ceph osd pool create asdf > > > > > Error ERANGE: 'pgp_num' must be greater than 0 and lower > > > > > or > > > > > equal than 'pg_num', which in this case is 1 > > > > > > > > > > I checked with Ceph Pacific (16.2.11) and there the extra > > > > > arguments > > > > > are not needed. > > > > > > > > > > I expected it would use osd_pool_default_pg_num and > > > > > osd_pool_default_pgp_num as defined in my ceph.conf: > > > > > > > > > > [root@gjk-ceph ~]# ceph-conf -D | grep > > > > > 'osd_pool_default_pg' > > > > > osd_pool_default_pg_autoscale_mode = on > > > > > osd_pool_default_pg_num = 8 > > > > > osd_pool_default_pgp_num = 8 > > > > > > > > > > At least, this is what appears to be used with Pacific. > > > > > > > > > > Is this an intended change of behavior? I could not find > > > > > anything > > > > > related in the release notes. > > > > > > > > > > Best regards, > > > > > Geert Kloosterman > > > > > _______________________________________________ > > > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > > > > > > > > > _______________________________________________ > > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > > > _______________________________________________ > > > ceph-users mailing list -- ceph-users@xxxxxxx > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |