Re: rbd iscsi gateway question

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



JFYI: Today we get totaly stable setup Ceph + ESXi "without hacks" and
this pass stress tests.

1. Don't try pass RBD directly to LIO, this setup are unstable
2. Instead of that, use Qemu + KVM (i use proxmox for that create VM)
3. Attach RBD to VM as VIRTIO-SCSI disk (must be exported by target_core_iblock)
4. Make a LIO Target in VM
4.1 Sync Iniciator (ESXi) and target (LIO) options (best change Target options)
4.2 You can enable almost all VAAI (also emulate_tpu=1, emulate_tpws=1)
4.3 For performance reason use noop on RBD disk in VM and set
is_nonrot=1 (disable ESXi sheduller)
5. ESXi are "stupid" and have a problem with CAS on LIO (and some
other storage vendors (google for info)), so for stable working
without disconects of LUN set VMFS3.UseATSForHBOnVMFS5 to ZERO on All
ESXi that use this lun.
6. Don't try make Target HA (not tested but i think you will catch
problems with VMFS), you must do something like VM HA for that.

This setup tested with latest ESXi and VMFS6.

Thanks.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux