Re: Problem with multiple hosts RBD + Cinder

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

No this must always be the same UUID. You can only specify one in cinder.conf.

Btw nova does the attachment this is why it needs the uuid and secret.

The first secret import generates an UUID, then always re-use the same one for all your compute node, do something like:

<secret ephemeral='no' private='no'>
   <uuid>9e4c7795-0681-cd4f-cf36-8cb8aef3c47f</uuid>
   <usage type='ceph'>
     <name>client.volumes secret</name>
   </usage>
</secret>


Cheers.

––––
Sébastien Han
Cloud Engineer

"Always give 100%. Unless you're giving blood."









Phone : +33 (0)1 49 70 99 72 – Mobile : +33 (0)6 52 84 44 70
Email : sebastien.han@xxxxxxxxxxxx – Skype : han.sbastien
Address : 10, rue de la Victoire – 75009 Paris
Web : www.enovance.com – Twitter : @enovance

On Jun 20, 2013, at 12:23 PM, Igor Laskovy <igor.laskovy@xxxxxxxxx> wrote:

Hello list!

I am trying deploy Ceph RBD + OpenStack Cinder.
Basically, my question related to this section in documentation:

cat > secret.xml <<EOF
<secret ephemeral='no' private='no'>
  <usage type='ceph'>
    <name>client.volumes secret</name>
  </usage>
</secret>
EOF
sudo virsh secret-define --file secret.xml
<uuid of secret is output here> 
sudo virsh secret-set-value --secret {uuid of secret} --base64 $(cat client.volumes.key) && rm client.volumes.key secret.xml

Do I need tie libvirt secrets logic with ceph client.volumes user on each cinder-volume hosts? So it will be separate "uuid of secret" for each host but they all will use single user cinder.volumes, right?

Asking this because I have strange error in nova-scheduler.log on controller host:

2013-06-20 13:10:01.270 ERROR nova.scheduler.filter_scheduler [req-b173d765-9528-43af-a3d1-bd811df8710d fd860a2737f94ff0bc7decec5783017b 3f47be9a0c2348faac4deec2a988acd8] [instance: d8dd40d4-61de-498d-a54f-12f4d9e9c594] Error from last host: node03 (node node03.ceph.labspace.studiogrizzly.com): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 848, in _run_instance\n    set_access_ip=set_access_ip)\n', u'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1107, in _spawn\n    LOG.exception(_(\'Instance failed to spawn\'), instance=instance)\n', u'  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n    self.gen.next()\n', u'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1103, in _spawn\n    block_device_info)\n', u'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1527, in spawn\n    block_device_info)\n', u'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2443, in _create_domain_and_network\n    domain = self._create_domain(xml, instance=instance)\n', u'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2404, in _create_domain\n    domain.createWithFlags(launch_flags)\n', u'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', u'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in proxy_call\n    rv = execute(f,*args,**kwargs)\n', u'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in tworker\n    rv = meth(*args,**kwargs)\n', u'  File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in createWithFlags\n    if ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self)\n', u"libvirtError: internal error rbd username 'volumes' specified but secret not found\n"]

--
Igor Laskovy
facebook.com/igor.laskovy
studiogrizzly.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux