Hi John, Could you try without the cat'ing and such? Could you also try this: $ virsh secret define secret.xml $ virsh secret-set-value <uuid> <secret> $ virsh pool-create ceph.xml Could you post both XML files and not use any Xen commands like 'xe'? I want to verify where this problem is. Wido On 07/11/2013 10:34 PM, John Shen wrote:
Wido, Thanks! I tried again with your command syntax but the result is the same. [root@xen02 ~]# virsh secret-set-value $(cat uuid) $(cat client.admin.key) Secret value set [root@xen02 ~]# xe sr-create type=libvirt name-label=ceph device-config:xml-filename=ceph.xml Error code: libvirt Error parameters: libvirt: VIR_ERR_65: VIR_FROM_30: Invalid secret: virSecretFree [root@xen02 ~]# virsh pool-create ceph.xml error: Failed to create pool from ceph.xml error: Invalid secret: virSecretFree [root@xen02 ~]# On Thu, Jul 11, 2013 at 1:14 PM, Wido den Hollander <wido@xxxxxxxx <mailto:wido@xxxxxxxx>> wrote: Hi. So, the problem here is a couple of things. First: libvirt doesn't handle RBD storage pools without auth. That's my bad, but I never resolved that bug: http://tracker.ceph.com/__issues/3493 <http://tracker.ceph.com/issues/3493> For now, make sure cephx is enabled. Also, the commands you are using don't seem to be right. It should be: $ virsh secret-set-value $(cat uuid) <base64 secret key> Could you try again with cephx enabled and setting the secret value like mentioned above? Wido On 07/11/2013 06:00 PM, John Shen wrote: Hi Dave, Thank you so much for getting back to me. the command returns the same errors: [root@xen02 ~]# virsh pool-create ceph.xml error: Failed to create pool from ceph.xml error: Invalid secret: virSecretFree [root@xen02 ~]# the secret was precreated for the user admin that I use elsewhere with no issues (rbd mount, cephfs etc.), and per the ceph documentation, i just set the secret value with this command virsh secret-set-value $(cat uuid) --base64 $(cat client.admin.key) where the key is obtained from ceph auth list and uuid is generated by virsh secret-define --file secret.xml # cat secret.xml <secret ephemeral='no' private='no'> <usage type='ceph'> <name>client.admin $(cat client.admin.key)</name> </usage> </secret> On Thu, Jul 11, 2013 at 7:22 AM, Dave Scott <Dave.Scott@xxxxxxxxxxxxx <mailto:Dave.Scott@xxxxxxxxxxxxx> <mailto:Dave.Scott@eu.citrix.__com <mailto:Dave.Scott@xxxxxxxxxxxxx>>> wrote: [sorry I didn't manage to reply to the original message; I only just joined this list. Sorry if this breaks your threading!] On 10 Jul 2013 at 16:01 John Shen wrote: > I was following the tech preview of libvirt/ceph integration in xenserver, but ran > into an issue with ceph auth in setting up the SR. any help would be greatly > appreciated. I must confess that I've disabled auth in my test environment. Clearly I should go back and enable it again :-) > uuid was generated per: http://eu.ceph.com/docs/wip-__dump/rbd/libvirt/ <http://eu.ceph.com/docs/wip-dump/rbd/libvirt/> > > according to inktank, storage pool auth syntax differs slightly from block device > attachment. I tried both format but got the same error. > > Ref: > > http://xenserver.org/blog/__entry/tech-preview-of-__xenserver-libvirt-ceph.html <http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html> > > [root <at> xen01 ~]# xe sr-create type=libvirt name-label=ceph device-config:xml-filename=__ceph.xml > Error code: libvirt > Error parameters: libvirt: VIR_ERR_65: VIR_FROM_30: Invalid secret: virSecretFree The "xe sr-create" call is handled by "xapi" which calls "xapi-libvirt-storage" which uses the libvirt API directly to create the pool. It _should_ do the same as running virsh pool-create ceph.xml Could you try the "virsh pool-create" and see if that works? If it does, then we need to figure out what the "virsh" CLI is doing that my Pool.create function call isn't. If it doesn't then there might be some other missing step. Did you have to pre-create a secret (is that "virsh secret-create"?) Cheers, Dave Scott -- --John Shen _________________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx> http://lists.ceph.com/__listinfo.cgi/ceph-users-ceph.__com <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> -- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902 <tel:%2B31%20%280%2920%20700%209902> Skype: contact42on _________________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx> http://lists.ceph.com/__listinfo.cgi/ceph-users-ceph.__com <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com> -- --John Shen
-- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902 Skype: contact42on _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
