Hi, We had a problem to start the OSD because the startup script doesn't know where find the key. The default directory is /etc/ceph/dmcrypt-keys. we left it by default and it worked. I haven't tried, but may be it can be solved using /etc/crypttab. Regards Le 22/01/2016 21:35, Reno Rainz a écrit : > Hi guys, > > I'm trying to setup a cluster with encryption on osd data and journal. > To do that I use ceph-deploy with this 2 options --dmcrypt > --dmcrypt-key-dir on /dev/sdc disk. > > Disk state before the prepare ceph-deploy command : > > root@ceph-osd-1:~$ lsblk > NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT > sda 8:0 0 40G 0 disk > └─sda1 8:1 0 40G 0 part / > sdb 8:16 0 16G 0 disk > sdc 8:32 0 16G 0 disk > sdd 8:48 0 16G 0 disk > > The prepare command run fine : > > ceph-deploy osd prepare ceph-osd-1:/dev/sdc --dmcrypt --dmcrypt-key-dir > /root/keydir > > ceph_deploy.conf][DEBUG ] found configuration file at: > /home/cephuser/.cephdeploy.conf > [ceph_deploy.cli][INFO ] Invoked (1.5.31): ../ceph-deploy osd prepare > ceph-osd-1:/dev/sdc --dmcrypt --dmcrypt-key-dir /root/keydir > . > . > . > [ceph-osd-1][INFO ] Running command: sudo ceph --cluster=ceph osd stat > --format=json > [ceph_deploy.osd][DEBUG ] Host ceph-osd-1 is now ready for osd use. > > So far, so good. > > root@ceph-osd-1:~# lsblk > NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT > sda 8:0 0 40G 0 disk > └─sda1 8:1 0 40G 0 part / > sdb 8:16 0 16G 0 disk > sdc 8:32 0 16G 0 disk > ├─sdc1 8:33 0 11G 0 part > └─sdc2 8:34 0 5G 0 part > sdd 8:48 0 16G 0 disk > > Unfortunately when I try to activate this osd it does not work ... > > ceph-deploy osd activate ceph-osd-1:/dev/sdc1:/dev/sdc2 > > [ceph_deploy.conf][DEBUG ] found configuration file at: > /home/cephuser/.cephdeploy.conf > [ceph_deploy.cli][INFO ] Invoked (1.5.31): ../ceph-deploy osd activate > ceph-osd-1:/dev/sdc1:/dev/sdc2 > . > . > . > . > [ceph-osd-1][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t > crypto_LUKS -o -- /dev/sdc1 /var/lib/ceph/tmp/mnt.C0wSgD > [ceph-osd-1][WARNIN] mount: unknown filesystem type 'crypto_LUKS' > [ceph-osd-1][WARNIN] ceph-disk: Mounting filesystem failed: Command > '['/bin/mount', '-t', 'crypto_LUKS', '-o', '', '--', '/dev/sdc1', > '/var/lib/ceph/tmp/mnt.C0wSgD']' returned non-zero exit status 32 > [ceph-osd-1][ERROR ] RuntimeError: command returned non-zero exit status: 1 > [ceph_deploy][ERROR ] RuntimeError: Failed to execute command: ceph-disk > -v activate --mark-init upstart --mount /dev/sdc1 > > I can provide all the log. > > Do you guys have idea ? > > Thanks. > > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > -- ---------------------------------------------- Pierre BLONDEAU Administrateur Systèmes & réseaux Université de Caen Normandie Laboratoire GREYC, Département d'informatique tel : 02 31 56 75 42 bureau : Campus 2, Science 3, 406 ----------------------------------------------
Attachment:
smime.p7s
Description: Signature cryptographique S/MIME
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
