> It's important to disable the rbd cache on tgtd host. Set in /etc/ceph/ceph.conf: Should this be done on the iscsi target server? I have a default option to enable rbd caching as it speeds things up on the vms. Thanks Andrei ----- Original Message ----- From: "Vlad Gorbunov" <vadikgo@xxxxxxxxx> To: "Sergey Malinin" <hell at newmail.com> Cc: "Andrei Mikhailovsky" <andrei at arhont.com>, ceph-users at lists.ceph.com Sent: Wednesday, 7 May, 2014 2:23:52 PM Subject: Re: NFS over CEPH - best practice It's easy to install tgtd with ceph support. ubuntu 12.04 for example: Connect ceph-extras repo: echo deb http://ceph.com/packages/ceph-extras/debian $(lsb_release -sc) main | sudo tee /etc/apt/sources.list.d/ceph-extras.list Install tgtd with rbd support: apt-get update apt-get install tgt It's important to disable the rbd cache on tgtd host. Set in /etc/ceph/ceph.conf: [client] rbd_cache = false Define permanent export rbd with iscsi in /etc/tgt/targets.conf: <target iqn.2014-04.rbdstore.example.com:volume512> driver iscsi bs-type rbd backing-store iscsi/volume512 initiator-address 10.166.18.87 </target service tgt reload Or use commands: tgtadm --lld iscsi --mode logicalunit --op new --tid 1 --lun 1 --backing-store iscsi/volume512 --bstype rbd tgtadm -C 0 --lld iscsi --op bind --mode target --tid 1 -I 10.166.18.87 tgt-admin -s show current iscsi settings and sessions. You can install tgtd on multiple osd/monitor hosts and connect iscsi initiator to this servers with multipath enabled. Iscsi proxy servers not needed with tgtd. On Thu, May 8, 2014 at 12:20 AM, Sergey Malinin< hell at newmail.com >, wrote: http://www.hastexo.com/resources/hints-and-kinks/turning-ceph-rbd-images-san-storage-devices On Wednesday, May 7, 2014 at 15:06, Andrei Mikhailovsky wrote: <blockquote> Vlad, is there a howto somewhere describing the steps on how to setup iscsi multipathing over ceph? It looks like a good alternative to nfs Thanks From: "Vlad Gorbunov" < vadikgo@xxxxxxxxx > To: "Andrei Mikhailovsky" < andrei at arhont.com > Cc: ceph-users at lists.ceph.com Sent: Wednesday, 7 May, 2014 12:02:09 PM Subject: Re: NFS over CEPH - best practice For XenServer or VMware is better to use iscsi client to tgtd with ceph support. You can install tgtd on osd or monitor server and use multipath for failover. On Wed, May 7, 2014 at 9:47 PM, Andrei Mikhailovsky < andrei at arhont.com > wrote: <blockquote> Hello guys, I would like to offer NFS service to the XenServer and VMWare hypervisors for storing vm images. I am currently running ceph rbd with kvm, which is working reasonably well. What would be the best way of running NFS services over CEPH, so that the XenServer and VMWare's vm disk images are stored in ceph storage over NFS? Many thanks Andrei _______________________________________________ ceph-users mailing list ceph-users at lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com </blockquote> </blockquote> -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140507/e0a59a5a/attachment.htm>
 |