I did have "allow_ec_overwrites" set, which is why I was stumped. The
resolution in my case was editing my client.libvirt user adding to the
mon caps, and allowing the erasure coded pool on the osd caps:
ceph auth caps client.libvirt mon 'allow r, allow command "osd
blacklist", allow command "osd blocklist", allow command "blacklistop",
allow command "blocklistop"' osd 'allow class-read object_prefix
rbd_children, allow rwx pool=libvirt-pool, allow rwx pool=images, allow
rwx pool=libvirt-pool-ec'
On 2024-09-13 15:56, Bogdan Adrian Velica wrote:
Hi,
Can you run "ceph osd pool get <<your_ec_pool_here>>
allow_ec_overwrites"? What is the output of that?
Thank you,
Bogdan Velica
On Fri, Sep 13, 2024 at 8:46 PM <andre@xxxxxxxxxx> wrote:
I have a Ceph instance I'm wherein I'm trying to use erasure coding
with
RBD (and libvirt). I've followed
https://docs.ceph.com/en/latest/rados/operations/erasure-code/#erasure-coding-with-overwrites
and enabled overwrites so that RBD can be used. In doing so, I've
set
the data_pool to the erasure coded pool, with set to the replicated
pool.
I have the following in ceph.conf:
rbd_default_data_pool = libvirt-pool-ec
Here's an rbd info on the image I've created (notice the "data_pool"
config):
rbd image 'xxxxxxx':
size 500 GiB in 128000 objects
order 22 (4 MiB objects)
snapshot_count: 0
id: 7e37e442592b
data_pool: libvirt-pool-ec
block_name_prefix: rbd_data.6.7e37e442592b
format: 2
features: layering, exclusive-lock, object-map, fast-diff,
deep-flatten, data-pool
op_features:
flags:
create_timestamp: Fri Sep 13 16:34:06 2024
access_timestamp: Fri Sep 13 16:34:06 2024
modify_timestamp: Fri Sep 13 16:34:06 2024
The problem, when I attach this rbd image to a VM, I cannot write to
it
at all, I get an I/O error. But, when I create and rbd image without
the
"rbd_default_data_pool = libvirt-pool-ec" setting, I can write fine.
Wanted to see if anyone has any ideas, maybe I'm missing something
simple. Thanks in advance!
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
