I guys, First of all congratulations on Firefly Release! IMHO I think that this release is a huge step for Ceph Project! Just for fun, this morning I upgraded one my staging Ceph cluster used by an OpenStack Havana installation (Canonical cloud archive, Kernel 3.11, Ubuntu 12.04) I had one issue during volume attach, the below log from libvirt. With the same environment and Emperor I don?t have any issue (so there aren?t any network issue) Do you think that it is my fault during upgrade procedure or a bug? I tried to use Admin keyring and I got a ?open disk image file failed?. Thanks a lot, Regards, Federico 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] Traceback (most recent call last): 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3689, in _attach_volume 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] encryption=encryption) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1117, in attach_volume 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] disk_dev) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1104, in attach_volume 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] virt_dom.attachDeviceFlags(conf.to_xml(), flags) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] result = proxy_call(self._autowrap, f, *args, **kwargs) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] rv = execute(f,*args,**kwargs) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] rv = meth(*args,**kwargs) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] File "/usr/lib/python2.7/dist-packages/libvirt.py", line 439, in attachDeviceFlags 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] if ret == -1: raise libvirtError ('virDomainAttachDeviceFlags() failed', dom=self) 2014-05-08 14:13:49.001 31631 TRACE nova.compute.manager [instance: 2e5991bf-b76b-48b1-b271-cf13406e9825] libvirtError: Timed out during operation: cannot acquire state change lock <disk type="network" device="disk"> <driver name="qemu" type="raw" cache="writeback"/> <source protocol="rbd" name="volumes/volume-b0e83c5b-f76f-4fc3-9f2c-2d76e911e027"> <host name="10.18.24.127" port="6789"/> </source> <auth username="admin"> <secret type="ceph" uuid="2b73ca1d-d3f5-4fe0-adc6-00495def883d"/> </auth> <target bus="virtio" dev="vdb"/> <serial>3f154149-5f9e-4c21-81d5-1cd92f50ac9f</serial> </disk> client.admin key: AQDzWlhTMMrVKhAAMLLh5xI4ePu7KPRpflq7HA== caps: [mds] allow caps: [mon] allow * caps: [osd] allow * client.bootstrap-mds key: AQD0WlhTYJPKABAAbOe0hXplhW+mFDFGLo4BTw== caps: [mon] allow profile bootstrap-mds client.bootstrap-osd key: AQDzWlhTIGepMxAABsXDFUJMbjJZUODbtUr+CA== caps: [mon] allow profile bootstrap-osd client.cinder key: AQAwW1hTMBHVAhAAMi7XUYgZvgSdM3Q31DtDhw== caps: [mon] allow r caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=volumes, allow rx pool=images client.glance key: AQAwW1hT+O3ONhAAbjhWZmlJIU+Zom0gWSB4oA== caps: [mon] allow r caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=images federico iezzi | cloud engineer fiezzi at enter.it | +39 02 25514828 | +39 338 6311085 | fax +39 02 25514 303 [cid:f94cf43aa3384ecdb67db645b5857ae0] enter | internet service provider via stefanardo da vimercate 28 | 20128 Milano tel +39 02 25514 300 [Cloudup]<https://www.openstack.org/summit/openstack-summit-atlanta-2014/> -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140508/5fb0b38a/attachment.htm> -------------- next part -------------- A non-text attachment was scrubbed... Name: logo enter2010-120x40 per web bassa risol.jpg Type: image/jpeg Size: 15828 bytes Desc: logo enter2010-120x40 per web bassa risol.jpg URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140508/5fb0b38a/attachment.jpg> -------------- next part -------------- A non-text attachment was scrubbed... Name: 553x65_atlanta.gif Type: image/gif Size: 6857 bytes Desc: 553x65_atlanta.gif URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140508/5fb0b38a/attachment.gif>