Oh hi,
Turns out I solved it, It works with libvirt directly via CloudStack. The only major modification is to ensure you don't accidentally use client.user for authentication and just use user.
My guess is the error I had was related to testing with virsh.
Thanks for the reply.
From: "Josh Durgin" <josh.durgin@xxxxxxxxxxx>
To: "Kelcey Jamison Damage" <kelcey@xxxxxxxxxxxxxxxxxxxxxx>, ceph-users@xxxxxxxx
Sent: Monday, October 21, 2013 6:19:29 PM
Subject: Re: CloudStack + KVM(Ubuntu 12.04, Libvirt 1.0.2) + Ceph [Seeking Help]
On 10/16/2013 04:25 PM, Kelcey Jamison Damage wrote:
> Hi,
>
> I have gotten so close to have Ceph work in my cloud but I have reached
> a roadblock. Any help would be greatly appreciated.
>
> I receive the following error when trying to get KVM to run a VM with an
> RBD volume:
>
> Libvirtd.log:
>
> 2013-10-16 22 <callto:2013-10-16%2022>:05:15.516+0000: 9814: error :
> qemuProcessReadLogOutput:1477 : internal error Process exited while
> reading console log output:
> char device redirected to /dev/pts/3
> kvm: -drive
> file=rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host=
>
> 10.0.1.83\:6789,if=none,id=drive-ide0-0-1: error connecting
> kvm: -drive
> file=rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host=
>
> 10.0.1.83\:6789,if=none,id=drive-ide0-0-1: could not open disk image
> rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh
> /gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host=10.0.1.83\:6789:
> Invalid argument
This looks correct, there could be a firewall or something else
preventing the connection from working. Could you share the output of:
qemu-img -f raw info
'rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host==10.0.1.83\\:6789:debug_ms=1'
> Ceph Pool showing test volume exists:
>
> root@ubuntu-test-KVM-RBD:/opt# rbd -p libvirt-pool ls
> new-libvirt-image
>
> Ceph Auth:
>
> client.libvirt
> key: AQBx+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==
> caps: [mon] allow r
> caps: [osd] allow class-read object_prefix rbd_children, allow rwx
> pool=libvirt-pool
>
> KVM Drive Support:
>
> root@ubuntu-test-KVM-RBD:/opt# kvm --drive
> format=?ibvirt-image:id=libvirt:key=+F5Sc
> Supported formats: vvfat vpc vmdk vdi sheepdog rbd raw host_cdrom
> host_floppy host_device file qed qcow2 qcow parallels nbd dmg tftp ftps ft
> p https http cow cloop bochs blkverify blkdebug
These settings all look fine too.
Josh
To: "Kelcey Jamison Damage" <kelcey@xxxxxxxxxxxxxxxxxxxxxx>, ceph-users@xxxxxxxx
Sent: Monday, October 21, 2013 6:19:29 PM
Subject: Re: CloudStack + KVM(Ubuntu 12.04, Libvirt 1.0.2) + Ceph [Seeking Help]
> Hi,
>
> I have gotten so close to have Ceph work in my cloud but I have reached
> a roadblock. Any help would be greatly appreciated.
>
> I receive the following error when trying to get KVM to run a VM with an
> RBD volume:
>
> Libvirtd.log:
>
> 2013-10-16 22 <callto:2013-10-16%2022>:05:15.516+0000: 9814: error :
> qemuProcessReadLogOutput:1477 : internal error Process exited while
> reading console log output:
> char device redirected to /dev/pts/3
> kvm: -drive
> file=rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host=
>
> 10.0.1.83\:6789,if=none,id=drive-ide0-0-1: error connecting
> kvm: -drive
> file=rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host=
>
> 10.0.1.83\:6789,if=none,id=drive-ide0-0-1: could not open disk image
> rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh
> /gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host=10.0.1.83\:6789:
> Invalid argument
preventing the connection from working. Could you share the output of:
'rbd:libvirt-pool/new-libvirt-image:id=libvirt:key=+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==:auth_supported=cephx\;none:mon_host==10.0.1.83\\:6789:debug_ms=1'
>
> root@ubuntu-test-KVM-RBD:/opt# rbd -p libvirt-pool ls
> new-libvirt-image
>
> Ceph Auth:
>
> client.libvirt
> key: AQBx+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==
> caps: [mon] allow r
> caps: [osd] allow class-read object_prefix rbd_children, allow rwx
> pool=libvirt-pool
>
> KVM Drive Support:
>
> root@ubuntu-test-KVM-RBD:/opt# kvm --drive
> format=?ibvirt-image:id=libvirt:key=+F5Sc
> Supported formats: vvfat vpc vmdk vdi sheepdog rbd raw host_cdrom
> host_floppy host_device file qed qcow2 qcow parallels nbd dmg tftp ftps ft
> p https http cow cloop bochs blkverify blkdebug
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
