osd encryption is failing due to device-mapper

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hallo folks,

i am deploying a quincy ceph cluster 17.2.0 on openstack vm with ubuntu
22.04 minimal with cephadm.
I was able too boostrap the cluster and add the hosts and the mons, but
when i apply the osd spec with the encryption option enabled, it fails
```
    service_type: osd
    service_id: osd_spec
    placement:
       host_pattern: "*"
    spec:
       data_devices:
         paths: ['/dev/sdb', '/dev/sdc']
       db_devices:
         paths: ['/dev/sdd']
       filter_logic: AND
       objectstore: bluestore
       block_db_size: 20G
       encrypted: true

```

The logs of cephadm are showing the following:
```
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/bin/ceph-authtool --gen-print-key
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --batch-mode --key-size 512
--key-file - luksFormat /dev/ceph-2fe55820-3869-42c5-8dcf-2bf56d7c3d67/o
sd-block-fb93d350-106b-4627-9b90-d2340a990350
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --key-size 512 --key-file -
--allow-discards luksOpen /dev/ceph-2fe55820-3869-42c5-8dcf-2bf56d7c3d67
/osd-block-fb93d350-106b-4627-9b90-d2340a990350
2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
stderr: device-mapper: reload ioctl on
2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh (253:4) failed: Invalid argument
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --batch-mode --key-size 512
--key-file - luksFormat /dev/ceph-921b0645-88f4-42a9-a711-0a10d96c308e/o
sd-db-80b42d32-3ba6-4d24-8887-e2da568a7cc8
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --key-size 512 --key-file -
--allow-discards luksOpen /dev/ceph-921b0645-88f4-42a9-a711-0a10d96c308e
/osd-db-80b42d32-3ba6-4d24-8887-e2da568a7cc8
fcfI01-vCFV-0Uxb-ulEf-4BDZ-KWFZ-Lu31BE
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
stderr: device-mapper: reload ioctl on
fcfI01-vCFV-0Uxb-ulEf-4BDZ-KWFZ-Lu31BE (253:4) failed: Invalid argument
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-4
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/bin/chown -R ceph:ceph
/dev/mapper/2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
stderr: chown: cannot access
'/dev/mapper/2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh': No such file or
directory
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr -->
Was unable to complete a new OSD, will rollback changes
```

Seems to be an issue with the device-mapper.
Without the encryption option, the osds are being deployed.

Anybody has an idea, how to resolve it ? Is any package missing?

Thanks in advance,
Ali Akil

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux