I understand that I should update something. The question is what I have to update to reach desired result? All ceph related stuff on rbd-clients is same version as ceph cluster itself: $ dpkg -l | grep ceph ii ceph-common 12.2.13-1~bpo90+1 amd64 common utilities to mount and interact with a ceph storage cluster ii libcephfs2 12.2.13-1~bpo90+1 amd64 Ceph distributed file system client library ii python-cephfs 12.2.13-1~bpo90+1 amd64 Python 2 libraries for the Ceph libcephfs library > Hi, > > By first you need update your clients with feature set 0x40106b84a842a52 and 0x40107b86a842ada - because this client is't support upmap > > > k > > > On 7 Dec 2021, at 17:54, Kamil Kuramshin <kamil.kuramshin@xxxxxxxx> wrote: > > > > Have a question about feature set used by rbdmap when it is used to map an RBD image. > > I have a problem with mounted RBD-images, because that images are showed up as mapped using features from "Jewel" release, but installed ceph packages versions 12.2.12 (Luminous) and linux kernel 4.19. > > > > $ ceph versions > > { > > "mon": { > > "ceph version 12.2.12 (1436006594665279fe734b4c15d7e08c13ebd777) luminous (stable)": 3 > > }, > > "mgr": { > > "ceph version 12.2.12 (1436006594665279fe734b4c15d7e08c13ebd777) luminous (stable)": 3 > > }, > > "osd": { > > "ceph version 12.2.12 (1436006594665279fe734b4c15d7e08c13ebd777) luminous (stable)": 437 > > }, > > "mds": {}, > > "overall": { > > "ceph version 12.2.12 (1436006594665279fe734b4c15d7e08c13ebd777) luminous (stable)": 443 > > } > > } > > > > $ ceph features > > { > > "mon": { > > "group": { > > "features": "0x3ffddff8eeacfffb", > > "release": "luminous", > > "num": 3 > > } > > }, > > "osd": { > > "group": { > > "features": "0x3ffddff8eeacfffb", > > "release": "luminous", > > "num": 437 > > } > > }, > > "client": { > > "group": { > > "features": "0x40106b84a842a52", > > "release": "jewel", > > "num": 3 > > }, > > "group": { > > "features": "0x40107b86a842ada", > > "release": "jewel", > > "num": 10 > > }, > > "group": { > > "features": "0x27018fb86aa42ada", > > "release": "jewel", > > "num": 1 > > }, > > "group": { > > "features": "0x3ffddff8eeacfffb", > > "release": "luminous", > > "num": 4 > > } > > } > > } > > > > MonSession(unknown.0 client-ip:0/3098420358 is open allow profile rbd, features 0x27018fb86aa42ada (jewel)) - > > > > I have to enable "upmap" balancer because of some osd disks getting "near full" warnings but Jewel clients does not allowing me to set > > $ ceph osd set-require-min-compat-client luminous > > Error EPERM: cannot set require_min_compat_client to luminous: 3 connected client(s) look like jewel (missing 0xa00000000200000); 10 connected client(s) look like jewel (missing 0xa00000000200000); 1 connected client(s) look like jewel (missing 0x800000000000000); add --yes-i-really-mean-it to do it anyway > > > > How to force this clients to user "Luminous" feature set? > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx