I managed to figure out the issues.
One i was trying to use qcow format instead of raw. Second adding the following fixed all the issues with file injection not supported in nova.conf: libvirt_inject_password=false libvirt_inject_key=false libvirt_inject_partition=-2 libvirt_images_type=rbd libvirt_images_rbd_pool=nova libvirt_images_rbd_ceph_conf= /etc/ceph/ceph.conf > Date: Tue, 31 Dec 2013 09:51:48 +0800 > Subject: Re: Ceph and cinder bootable volume not working > From: haomaiwang@xxxxxxxxx > To: u29236@xxxxxxxxxxx > CC: ceph-users@xxxxxxxxxxxxxx > > It seemed that your nova secret uuid is incorrect. Maybe you can paste > your nova.conf > > On Tue, Dec 31, 2013 at 5:12 AM, ed l <u29236@xxxxxxxxxxx> wrote: > > Sorry I thought i pasted a important log file on first email. This is from > > nova compute logs. file injection into a boot volume instance is not > > supported seems to be a weird error that i dont know what to do next. Any > > ideas? > > > > 2013-12-30 05:54:40.625 1469 ERROR nova.virt.libvirt.driver [-] [instance: > > 74abd3e2-f020-4612-9ba7-219d42afefec] During wait destroy, instance > > disappeared. > > 2013-12-30 05:54:40.730 1469 ERROR nova.virt.libvirt.driver [-] [instance: > > 3899a5bb-6737-412d-be57-a76a31744e9b] During wait destroy, instance > > disappeared. > > 2013-12-30 05:54:40.758 1469 ERROR nova.virt.libvirt.driver [-] [instance: > > 1a4c61af-c767-4839-b8e0-4e5c225a6be2] During wait destroy, instance > > disappeared. > > 2013-12-30 05:54:40.788 1469 ERROR nova.virt.libvirt.driver [-] [instance: > > bc698cd9-582a-4da1-a2c9-f1967f15567a] During wait destroy, instance > > disappeared. > > 2013-12-30 05:55:00.028 1469 WARNING nova.virt.libvirt.driver > > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File injection into a boot from volume > > instance is not supported > > 2013-12-30 05:55:00.231 1469 ERROR nova.compute.manager > > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Instance failed to spawn > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Traceback (most recent call last): > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, in > > _spawn > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] block_device_info) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2067, > > in spawn > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] write_to_disk=True) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3061, > > in to_xml > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] xml = conf.to_xml() > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, in > > to_xml > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] root = self.format_dom() > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1138, > > in format_dom > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] self._format_devices(root) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1115, > > in _format_devices > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] devices.append(dev.format_dom()) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 521, in > > format_dom > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] uuid=self.auth_secret_uuid)) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "lxml.etree.pyx", line 2809, in > > lxml.etree.Element (src/lxml/lxml.etree.c:61393) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 123, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 111, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 264, in > > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 1342, in > > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] TypeError: Argument must be bytes or > > unicode, got 'NoneType' > > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] > > 2013-12-30 05:55:00.807 1469 ERROR nova.virt.libvirt.driver [-] [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] During wait destroy, instance > > disappeared. > > 2013-12-30 05:55:01.904 1469 ERROR nova.compute.manager > > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Error: Argument must be bytes or > > unicode, got 'NoneType' > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Traceback (most recent call last): > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1037, in > > _build_instance > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] set_access_ip=set_access_ip) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1420, in > > _spawn > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] LOG.exception(_('Instance failed > > to spawn'), instance=instance) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, in > > _spawn > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] block_device_info) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2067, > > in spawn > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] write_to_disk=True) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3061, > > in to_xml > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] xml = conf.to_xml() > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, in > > to_xml > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] root = self.format_dom() > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1138, > > in format_dom > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] self._format_devices(root) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1115, > > in _format_devices > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] devices.append(dev.format_dom()) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 521, in > > format_dom > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] uuid=self.auth_secret_uuid)) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "lxml.etree.pyx", line 2809, in > > lxml.etree.Element (src/lxml/lxml.etree.c:61393) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 123, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 111, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 264, in > > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 1342, in > > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] TypeError: Argument must be bytes or > > unicode, got 'NoneType' > > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] > > 2013-12-30 05:58:53.646 1469 WARNING nova.virt.libvirt.driver > > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File injection into a boot from volume > > instance is not supported > > 2013-12-30 05:58:53.863 1469 ERROR nova.compute.manager > > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Instance failed to spawn > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Traceback (most recent call last): > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, in > > _spawn > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] block_device_info) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2067, > > in spawn > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] write_to_disk=True) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3061, > > in to_xml > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] xml = conf.to_xml() > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, in > > to_xml > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] root = self.format_dom() > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1138, > > in format_dom > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] self._format_devices(root) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1115, > > in _format_devices > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] devices.append(dev.format_dom()) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 521, in > > format_dom > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] uuid=self.auth_secret_uuid)) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "lxml.etree.pyx", line 2809, in > > lxml.etree.Element (src/lxml/lxml.etree.c:61393) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 123, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 111, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 264, in > > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 1342, in > > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] TypeError: Argument must be bytes or > > unicode, got 'NoneType' > > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] > > 2013-12-30 05:58:54.490 1469 ERROR nova.virt.libvirt.driver [-] [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] During wait destroy, instance > > disappeared. > > 2013-12-30 05:58:55.388 1469 ERROR nova.compute.manager > > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Error: Argument must be bytes or > > unicode, got 'NoneType' > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Traceback (most recent call last): > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1037, in > > _build_instance > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] set_access_ip=set_access_ip) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1420, in > > _spawn > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] LOG.exception(_('Instance failed > > to spawn'), instance=instance) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, in > > _spawn > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] block_device_info) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2067, > > in spawn > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] write_to_disk=True) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3061, > > in to_xml > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] xml = conf.to_xml() > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, in > > to_xml > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] root = self.format_dom() > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1138, > > in format_dom > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] self._format_devices(root) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1115, > > in _format_devices > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] devices.append(dev.format_dom()) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 521, in > > format_dom > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] uuid=self.auth_secret_uuid)) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "lxml.etree.pyx", line 2809, in > > lxml.etree.Element (src/lxml/lxml.etree.c:61393) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 123, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 111, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 264, in > > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 1342, in > > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] TypeError: Argument must be bytes or > > unicode, got 'NoneType' > > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] > > 2013-12-30 06:01:45.881 1469 WARNING nova.virt.libvirt.imagecache [-] > > Unknown base file: > > /var/lib/nova/instances/_base/794190f80db7cd72b8373524fe891b21fb47902a > > 2013-12-30 06:02:01.860 1469 WARNING nova.compute.manager [-] Found 2 in the > > database and 0 on the hypervisor. > > > > ________________________________ > > From: u29236@xxxxxxxxxxx > > To: ceph-users@xxxxxxxxxxxxxx > > Subject: Ceph and cinder bootable volume not working > > Date: Mon, 30 Dec 2013 15:03:09 -0600 > > > > > > Hello all, > > > > I'm hoping someone can help me out on a ceph and openstack cinder. I > > followed the documentation on ceph to add cinder and glance on openstack. > > Glance is working fine. Cinder appears to work when creating a volume. I > > see in the ceph server the volume that is created, however when I create a > > bootable volume it errors out when creating the instance. Creating the > > bootable volume is fine, but when i create the instance this is when it > > errors out. I can confirm that the virsh secret is correct by using the > > nova with ceph is working fine. I checked on someone elses cinder.conf that > > somone posted on another thread and added the extra config he added. This is > > my cinder.conf: > > > > [DEFAULT] > > rpc_backend = cinder.openstack.common.rpc.impl_qpid > > qpid_hostname = 10.192.100.65 > > volume_driver = cinder.volume.drivers.rbd.RBDDriver > > rbd_pool = nova > > rbd_ceph_conf = /etc/ceph/ceph.conf > > rbd_flatten_volume_from_snapshot = false > > rbd_max_clone_depth = 5 > > glance_api_version = 2 > > rbd_user = cinder > > api_paste_confg = /etc/cinder/api-paste.ini > > iscsi_helper = tgtadm > > volume_name_template = volume-%s > > volume_group = cinder-volumes > > > > verbose = True > > state_path = /var/lib/cinder > > lock_path = /var/lock/cinder > > volumes_dir = /var/lib/cinder/volumes > > auth_strategy=keystone > > [database] > > connection = mysql://cinder:notcinder@localhost/cinder > > > > I started tgtd service > > I do NOT have any dir or PV, or VG called cinder-volumes - not sure if i > > need to > > I added include /etc/cinder/volumes/* to /etc/tgt/targets.conf > > > > I see nothing alarming in the cinder logs > > I do see errors in nova compute: > > File injection into a boot from volume instance is not supported > > 2013-12-30 05:58:53.863 1469 ERROR nova.compute.manager > > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Instance failed to spawn > > > > nova-scheduler logs show: > > > > 2013-12-30 05:55:01.919 845 WARNING nova.scheduler.driver > > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Setting instance to ERROR state. > > 2013-12-30 05:58:55.368 845 ERROR nova.scheduler.filter_scheduler > > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb 0889af39b0dd4837815540dc9f7c9e3e > > 9ca58e5c52ad41efae313a5a0b477b22] [instance: > > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Error from last host: > > controller.ed.com (node controller.ed.com): [u'Traceback (most recent call > > last):\n', u' File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1037, in > > _build_instance\n set_access_ip=set_access_ip)\n', u' File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1420, in > > _spawn\n LOG.exception(_(\'Instance failed to spawn\'), > > instance=instance)\n', u' File > > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, in > > _spawn\n block_device_info)\n', u' File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2067, > > in spawn\n write_to_disk=True)\n', u' File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3061, > > in to_xml\n xml = conf.to_xml()\n', u' File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, in > > to_xml\n root = self.format_dom()\n', u' File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1138, > > in format_dom\n self._format_devices(root)\n', u' File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 1115, > > in _format_devices\n devices.append(dev.format_dom())\n', u' File > > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 521, in > > format_dom\n uuid=self.auth_secret_uuid))\n', u' File "lxml.etree.pyx", > > line 2809, in lxml.etree.Element (src/lxml/lxml.etree.c:61393)\n', u' File > > "apihelpers.pxi", line 123, in lxml.etree._makeElement > > (src/lxml/lxml.etree.c:13824)\n', u' File "apihelpers.pxi", line 111, in > > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698)\n', u' File > > "apihelpers.pxi", line 264, in lxml.etree._initNodeAttributes > > (src/lxml/lxml.etree.c:15356)\n', u' File "apihelpers.pxi", line 1342, in > > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770)\n', u"TypeError: Argument > > must be bytes or unicode, got 'NoneType'\n"] > > > > Thanks in advance!! > > > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users@xxxxxxxxxxxxxx > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > > > -- > Best Regards, > > Wheat |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com