Thanks a lot, Jens. Do I have to have cephx authentication enabled? Did you enable it? Which user from the node that contains cinder-api or glance-api are you
using to create volumes and images? The documentation at http://ceph.com/docs/master/rbd/rbd-openstack/ mentions creating new users client.volumes and client.images for cinder and glance
respectively. Did you do that? Thanks again! Narendra From: Jens-Christian Fischer [mailto:jens-christian.fischer@xxxxxxxxx]
Hi Narendra rbd for cinder and glance are according to the ceph documentation here: http://ceph.com/docs/master/rbd/rbd-openstack/ rbd for VM images configured like so: https://review.openstack.org/#/c/36042/ config sample (nova.conf): --- cut --- volume_driver=nova.volume.driver.RBDDriver rbd_pool=volumes rbd_user=volumes rbd_secret_uuid=xxxx-yyyy-zzzz libvirt_images_type=rbd # the RADOS pool in which rbd volumes are stored (string value) libvirt_images_rbd_pool=volumes # path to the ceph configuration file to use (string value) libvirt_images_rbd_ceph_conf=/etc/ceph/ceph.conf # dont inject stuff into partions, RBD backed partitions don't work that way libvirt_inject_partition = -2 --- cut --- and finally, used the following files from this repository: https://github.com/jdurgin/nova/tree/havana-ephemeral-rbd image/glance.py virt/images.py virt/libvirt/driver.py virt/libvirt/imagebackend.py virt/libvirt/utils.py good luck :) cheers jc -- On 22.11.2013, at 17:41, "Trivedi, Narendra" <Narendra.Trivedi@xxxxxxxxxx> wrote:
Hi Jean, Could you please tell me which link you followed to install RBD etc. for Havana? Thanks! Narendra From: ceph-users-bounces@xxxxxxxxxxxxxx [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On
Behalf Of Jens-Christian Fischer Hi all I'm playing with the boot from volume options in Havana and have run into problems: (Openstack Havana, Ceph Dumpling (0.67.4), rbd for glance, cinder and experimental ephemeral disk support) The following things do work: - glance images are in rbd - cinder volumes are in rbd - creating a VM from an image works - creating a VM from a snapshot works However, the booting from volume fails: Steps to reproduce: Boot from image Create snapshot from running instance Create volume from this snapshot Start a new instance with "boot from volume" and the volume just created: The boot process hangs after around 3 seconds, and the console.log of the instance shows this: [ 0.000000] Linux version 3.11.0-12-generic (buildd@allspice) (gcc version 4.8.1 (Ubuntu/Linaro 4.8.1-10ubuntu7) ) #19-Ubuntu SMP Wed Oct 9 16:20:46 UTC 2013 (Ubuntu 3.11.0-12.19-generic 3.11.3) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.11.0-12-generic root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0 ... [ 0.098221] Brought up 1 CPUs [ 0.098964] smpboot: Total of 1 processors activated (4588.94 BogoMIPS) [ 0.100408] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.102667] devtmpfs: initialized … [ 0.560202] Linux agpgart interface v0.103 [ 0.562276] brd: module loaded [ 0.563599] loop: module loaded [ 0.565315] vda: vda1 [ 0.568386] scsi0 : ata_piix [ 0.569217] scsi1 : ata_piix [ 0.569972] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0a0 irq 14 [ 0.571289] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0a8 irq 15 … [ 0.742082] Freeing unused kernel memory: 1040K (ffff8800016fc000 - ffff880001800000) [ 0.746153] Freeing unused kernel memory: 836K (ffff880001b2f000 - ffff880001c00000) Loading, please wait... [ 0.764177] systemd-udevd[95]: starting version 204 [ 0.787913] floppy: module verification failed: signature and/or required key missing - tainting kernel [ 0.825174] FDC 0 is a S82078B … [ 1.448178] tsc: Refined TSC clocksource calibration: 2294.376 MHz error: unexpectedly disconnected from boot status daemon Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. [ 2.384452] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null) Begin: Running /scripts/local-bottom ... done. done. Begin: Running /scripts/init-bottom ... done. [ 3.021268] init: mountall main process (193) killed by FPE signal General error mounting filesystems. A maintenance shell will now be started. CONTROL-D will terminate this shell and reboot the system. root@box-web1:~# The console is stuck, I can't get to the rescue shell I can "rbd map" the volume and mount it from a physical host - the filesystem etc all is in good order. Any ideas? cheers jc --
This message contains information which may be confidential and/or privileged. Unless you are the intended recipient (or authorized to receive for the intended recipient), you may not read, use, copy or disclose to anyone the message or any information contained in the message. If you have received the message in error, please advise the sender by reply e-mail and delete the message and any attachment(s) thereto without retaining any copies. |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com