Oh, this bug is registed at https://bugs.launchpad.net/nova/+bug/1257674 On Wed, Jan 1, 2014 at 2:21 AM, ed l <u29236@xxxxxxxxxxx> wrote: > I managed to figure out the issues. > > One i was trying to use qcow format instead of raw. > Second adding the following fixed all the issues with file injection not > supported > in nova.conf: > libvirt_inject_password=false > libvirt_inject_key=false > libvirt_inject_partition=-2 > libvirt_images_type=rbd > libvirt_images_rbd_pool=nova > libvirt_images_rbd_ceph_conf= /etc/ceph/ceph.conf > >> Date: Tue, 31 Dec 2013 09:51:48 +0800 >> Subject: Re: Ceph and cinder bootable volume not working >> From: haomaiwang@xxxxxxxxx >> To: u29236@xxxxxxxxxxx >> CC: ceph-users@xxxxxxxxxxxxxx > >> >> It seemed that your nova secret uuid is incorrect. Maybe you can paste >> your nova.conf >> >> On Tue, Dec 31, 2013 at 5:12 AM, ed l <u29236@xxxxxxxxxxx> wrote: >> > Sorry I thought i pasted a important log file on first email. This is >> > from >> > nova compute logs. file injection into a boot volume instance is not >> > supported seems to be a weird error that i dont know what to do next. >> > Any >> > ideas? >> > >> > 2013-12-30 05:54:40.625 1469 ERROR nova.virt.libvirt.driver [-] >> > [instance: >> > 74abd3e2-f020-4612-9ba7-219d42afefec] During wait destroy, instance >> > disappeared. >> > 2013-12-30 05:54:40.730 1469 ERROR nova.virt.libvirt.driver [-] >> > [instance: >> > 3899a5bb-6737-412d-be57-a76a31744e9b] During wait destroy, instance >> > disappeared. >> > 2013-12-30 05:54:40.758 1469 ERROR nova.virt.libvirt.driver [-] >> > [instance: >> > 1a4c61af-c767-4839-b8e0-4e5c225a6be2] During wait destroy, instance >> > disappeared. >> > 2013-12-30 05:54:40.788 1469 ERROR nova.virt.libvirt.driver [-] >> > [instance: >> > bc698cd9-582a-4da1-a2c9-f1967f15567a] During wait destroy, instance >> > disappeared. >> > 2013-12-30 05:55:00.028 1469 WARNING nova.virt.libvirt.driver >> > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File injection into a boot from >> > volume >> > instance is not supported >> > 2013-12-30 05:55:00.231 1469 ERROR nova.compute.manager >> > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Instance failed to spawn >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Traceback (most recent call last): >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, >> > in >> > _spawn >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] block_device_info) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 2067, >> > in spawn >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] write_to_disk=True) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 3061, >> > in to_xml >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] xml = conf.to_xml() >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, >> > in >> > to_xml >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] root = self.format_dom() >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1138, >> > in format_dom >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] self._format_devices(root) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1115, >> > in _format_devices >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] devices.append(dev.format_dom()) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 521, in >> > format_dom >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] uuid=self.auth_secret_uuid)) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "lxml.etree.pyx", line 2809, >> > in >> > lxml.etree.Element (src/lxml/lxml.etree.c:61393) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 123, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 111, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 264, >> > in >> > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 1342, >> > in >> > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] TypeError: Argument must be bytes >> > or >> > unicode, got 'NoneType' >> > 2013-12-30 05:55:00.231 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] >> > 2013-12-30 05:55:00.807 1469 ERROR nova.virt.libvirt.driver [-] >> > [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] During wait destroy, instance >> > disappeared. >> > 2013-12-30 05:55:01.904 1469 ERROR nova.compute.manager >> > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Error: Argument must be bytes or >> > unicode, got 'NoneType' >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Traceback (most recent call last): >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1037, >> > in >> > _build_instance >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] set_access_ip=set_access_ip) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1420, >> > in >> > _spawn >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] LOG.exception(_('Instance failed >> > to spawn'), instance=instance) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, >> > in >> > _spawn >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] block_device_info) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 2067, >> > in spawn >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] write_to_disk=True) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 3061, >> > in to_xml >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] xml = conf.to_xml() >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, >> > in >> > to_xml >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] root = self.format_dom() >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1138, >> > in format_dom >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] self._format_devices(root) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1115, >> > in _format_devices >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] devices.append(dev.format_dom()) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 521, in >> > format_dom >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] uuid=self.auth_secret_uuid)) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "lxml.etree.pyx", line 2809, >> > in >> > lxml.etree.Element (src/lxml/lxml.etree.c:61393) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 123, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 111, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 264, >> > in >> > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] File "apihelpers.pxi", line 1342, >> > in >> > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] TypeError: Argument must be bytes >> > or >> > unicode, got 'NoneType' >> > 2013-12-30 05:55:01.904 1469 TRACE nova.compute.manager [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] >> > 2013-12-30 05:58:53.646 1469 WARNING nova.virt.libvirt.driver >> > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File injection into a boot from >> > volume >> > instance is not supported >> > 2013-12-30 05:58:53.863 1469 ERROR nova.compute.manager >> > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Instance failed to spawn >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Traceback (most recent call last): >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, >> > in >> > _spawn >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] block_device_info) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 2067, >> > in spawn >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] write_to_disk=True) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 3061, >> > in to_xml >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] xml = conf.to_xml() >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, >> > in >> > to_xml >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] root = self.format_dom() >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1138, >> > in format_dom >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] self._format_devices(root) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1115, >> > in _format_devices >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] devices.append(dev.format_dom()) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 521, in >> > format_dom >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] uuid=self.auth_secret_uuid)) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "lxml.etree.pyx", line 2809, >> > in >> > lxml.etree.Element (src/lxml/lxml.etree.c:61393) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 123, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 111, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 264, >> > in >> > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 1342, >> > in >> > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] TypeError: Argument must be bytes >> > or >> > unicode, got 'NoneType' >> > 2013-12-30 05:58:53.863 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] >> > 2013-12-30 05:58:54.490 1469 ERROR nova.virt.libvirt.driver [-] >> > [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] During wait destroy, instance >> > disappeared. >> > 2013-12-30 05:58:55.388 1469 ERROR nova.compute.manager >> > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Error: Argument must be bytes or >> > unicode, got 'NoneType' >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Traceback (most recent call last): >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1037, >> > in >> > _build_instance >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] set_access_ip=set_access_ip) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1420, >> > in >> > _spawn >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] LOG.exception(_('Instance failed >> > to spawn'), instance=instance) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, >> > in >> > _spawn >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] block_device_info) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 2067, >> > in spawn >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] write_to_disk=True) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 3061, >> > in to_xml >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] xml = conf.to_xml() >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, >> > in >> > to_xml >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] root = self.format_dom() >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1138, >> > in format_dom >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] self._format_devices(root) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1115, >> > in _format_devices >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] devices.append(dev.format_dom()) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 521, in >> > format_dom >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] uuid=self.auth_secret_uuid)) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "lxml.etree.pyx", line 2809, >> > in >> > lxml.etree.Element (src/lxml/lxml.etree.c:61393) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 123, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13824) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 111, >> > in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 264, >> > in >> > lxml.etree._initNodeAttributes (src/lxml/lxml.etree.c:15356) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] File "apihelpers.pxi", line 1342, >> > in >> > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770) >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] TypeError: Argument must be bytes >> > or >> > unicode, got 'NoneType' >> > 2013-12-30 05:58:55.388 1469 TRACE nova.compute.manager [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] >> > 2013-12-30 06:01:45.881 1469 WARNING nova.virt.libvirt.imagecache [-] >> > Unknown base file: >> > /var/lib/nova/instances/_base/794190f80db7cd72b8373524fe891b21fb47902a >> > 2013-12-30 06:02:01.860 1469 WARNING nova.compute.manager [-] Found 2 in >> > the >> > database and 0 on the hypervisor. >> > >> > ________________________________ >> > From: u29236@xxxxxxxxxxx >> > To: ceph-users@xxxxxxxxxxxxxx >> > Subject: Ceph and cinder bootable volume not working >> > Date: Mon, 30 Dec 2013 15:03:09 -0600 >> > >> > >> > Hello all, >> > >> > I'm hoping someone can help me out on a ceph and openstack cinder. I >> > followed the documentation on ceph to add cinder and glance on >> > openstack. >> > Glance is working fine. Cinder appears to work when creating a volume. I >> > see in the ceph server the volume that is created, however when I create >> > a >> > bootable volume it errors out when creating the instance. Creating the >> > bootable volume is fine, but when i create the instance this is when it >> > errors out. I can confirm that the virsh secret is correct by using the >> > nova with ceph is working fine. I checked on someone elses cinder.conf >> > that >> > somone posted on another thread and added the extra config he added. >> > This is >> > my cinder.conf: >> > >> > [DEFAULT] >> > rpc_backend = cinder.openstack.common.rpc.impl_qpid >> > qpid_hostname = 10.192.100.65 >> > volume_driver = cinder.volume.drivers.rbd.RBDDriver >> > rbd_pool = nova >> > rbd_ceph_conf = /etc/ceph/ceph.conf >> > rbd_flatten_volume_from_snapshot = false >> > rbd_max_clone_depth = 5 >> > glance_api_version = 2 >> > rbd_user = cinder >> > api_paste_confg = /etc/cinder/api-paste.ini >> > iscsi_helper = tgtadm >> > volume_name_template = volume-%s >> > volume_group = cinder-volumes >> > >> > verbose = True >> > state_path = /var/lib/cinder >> > lock_path = /var/lock/cinder >> > volumes_dir = /var/lib/cinder/volumes >> > auth_strategy=keystone >> > [database] >> > connection = mysql://cinder:notcinder@localhost/cinder >> > >> > I started tgtd service >> > I do NOT have any dir or PV, or VG called cinder-volumes - not sure if i >> > need to >> > I added include /etc/cinder/volumes/* to /etc/tgt/targets.conf >> > >> > I see nothing alarming in the cinder logs >> > I do see errors in nova compute: >> > File injection into a boot from volume instance is not supported >> > 2013-12-30 05:58:53.863 1469 ERROR nova.compute.manager >> > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Instance failed to spawn >> > >> > nova-scheduler logs show: >> > >> > 2013-12-30 05:55:01.919 845 WARNING nova.scheduler.driver >> > [req-97d23860-e6d5-4be6-b12b-713a4627b8b3 >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 1a28dd9e-d199-43cb-b858-a3c7c2909767] Setting instance to ERROR state. >> > 2013-12-30 05:58:55.368 845 ERROR nova.scheduler.filter_scheduler >> > [req-0e8e9f67-5d6c-4d8c-b94c-6030054b69eb >> > 0889af39b0dd4837815540dc9f7c9e3e >> > 9ca58e5c52ad41efae313a5a0b477b22] [instance: >> > 9d53ab2e-52d6-4a2e-811f-7426631a1caf] Error from last host: >> > controller.ed.com (node controller.ed.com): [u'Traceback (most recent >> > call >> > last):\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1037, >> > in >> > _build_instance\n set_access_ip=set_access_ip)\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1420, >> > in >> > _spawn\n LOG.exception(_(\'Instance failed to spawn\'), >> > instance=instance)\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1417, >> > in >> > _spawn\n block_device_info)\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 2067, >> > in spawn\n write_to_disk=True)\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line >> > 3061, >> > in to_xml\n xml = conf.to_xml()\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line 68, >> > in >> > to_xml\n root = self.format_dom()\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1138, >> > in format_dom\n self._format_devices(root)\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 1115, >> > in _format_devices\n devices.append(dev.format_dom())\n', u' File >> > "/usr/lib/python2.7/site-packages/nova/virt/libvirt/config.py", line >> > 521, in >> > format_dom\n uuid=self.auth_secret_uuid))\n', u' File "lxml.etree.pyx", >> > line 2809, in lxml.etree.Element (src/lxml/lxml.etree.c:61393)\n', u' >> > File >> > "apihelpers.pxi", line 123, in lxml.etree._makeElement >> > (src/lxml/lxml.etree.c:13824)\n', u' File "apihelpers.pxi", line 111, in >> > lxml.etree._makeElement (src/lxml/lxml.etree.c:13698)\n', u' File >> > "apihelpers.pxi", line 264, in lxml.etree._initNodeAttributes >> > (src/lxml/lxml.etree.c:15356)\n', u' File "apihelpers.pxi", line 1342, >> > in >> > lxml.etree._utf8 (src/lxml/lxml.etree.c:24770)\n', u"TypeError: Argument >> > must be bytes or unicode, got 'NoneType'\n"] >> > >> > Thanks in advance!! >> > >> > >> > _______________________________________________ >> > ceph-users mailing list >> > ceph-users@xxxxxxxxxxxxxx >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > >> >> >> >> -- >> Best Regards, >> >> Wheat -- Best Regards, Wheat _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com