Re: Problems with tgt with ceph support

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Dan, thanks for your reply

Yes, as you has said:

"RBD Device /dev/rbd/rbd/iscsi-image-part1 exported with tgt" is kernel block device and "the TGT-RBD connector" is stgt/tgtd.

My tests was been done exporting it with tgt without multipath. It seems that are no very big difference in this tests. The real problem is not that.

I want to use tgt to connect the storage to an ESX but it presents a few problems.

With kernel block device, i can't use multipath (it turns inestable and turns a corrupted data) With stgt/tgtd rbd implementation i can use multipath but the performance is very poor.

To imaginate the difference, Deploy a VM with 1st (3min) but with 2nd option (83min).

I hope your understand me. I'm newbie with this concepts.

A lot of thanks

On 16/07/13 04:23, Dan Mick wrote:
Apologies; I don't really understand the results. They're labeled "RBD Device /dev/rbd/rbd/iscsi-image-part1 exported with tgt" and "TGT-RBD connector". Is the former nothing to do with tgt (i.e., just the kernel block device), and the latter is stgt/tgtd?

Do you interpret them to say the first run gave avg 258MB/s, and the second run 198MB/s?

On 07/15/2013 02:41 AM, Toni F. [ackstorm] wrote:
Here's my results.

The performance test was seq write

On 15/07/13 10:12, Toni F. [ackstorm] wrote:
I'm going to do a performance test with fio to see the difference.

Regards

On 12/07/13 18:15, Dan Mick wrote:

Ceph performance is a very very complicated subject. How does that
compare to other access methods?  Say, rbd import/export for an easy
test?

On Jul 12, 2013 8:22 AM, "Toni F. [ackstorm]"
<toni.fuentes@xxxxxxxxxxx <mailto:toni.fuentes@xxxxxxxxxxx>> wrote:

    It works, but the performance is very poor. 100MB/s or less

    Which are your performance experience?

    Regards

    On 12/07/13 13:56, Toni F. [ackstorm] wrote:

        It works!

        Thanks for all

        On 12/07/13 11:23, Toni F. [ackstorm] wrote:

            Yes! it seems that i wasn't compiled the rbd support.

            System:
                State: ready
                debug: off
            LLDs:
                iscsi: ready
            Backing stores:
                bsg
                sg
                null
                ssc
                aio
                rdwr (bsoflags sync:direct)
            Device types:
                disk
                cd/dvd
                osd
                controller
                changer
                tape
                passthrough
            iSNS:
                iSNS=Off
                iSNSServerIP=
                iSNSServerPort=3205
                iSNSAccessControl=Off

            I'm going to recompile it
            Thanks a lot!

            On 11/07/13 07:45, Dan Mick wrote:



                On 07/10/2013 04:12 AM, Toni F. [ackstorm] wrote:

                    Hi all,

                    I have installed the v0.37 of tgt.

                    To test this feature i follow the
http://ceph.com/dev-notes/adding-support-for-rbd-to-stgt/
                    guide

                    When i launch the command:

                    tgtadm --lld iscsi --mode logicalunit --op new
                    --tid 1 --lun 0
                    --backing-store iscsi-image --bstype rbd

                    fails

                    First i think that lun cannot be 0 because lun 0
                    is used by the
                    controller (previous command)


                This worked when I first wrote the backend, but tgt
                may have changed; I'll investigate and change the
                blog entry if so.  Thanks.


                    If i launch the correct command with lun 1 i have
                    this error:

                    tgtadm: invalid request

                    In syslog:

                    Jul 10 12:54:03 datastore-lnx001 tgtd:
                    device_mgmt(245) sz:28
                    params:path=iscsi-image,bstype=rbd
                    Jul 10 12:54:03 datastore-lnx001 tgtd:
                    tgt_device_create(532) failed to
                    find bstype, rbd

                    What's wrong? not supported?



                Where did you get your tgtd?  Was it built with rbd
                support (CEPH_RBD defined
                in the environment for make)?

                sudo ./tgtadm --lld iscsi --op show --mode system

                should tell you.

                How did you set up access to ceph.conf?








    --

    Toni Fuentes Rico
    toni.fuentes@xxxxxxxxxxx <mailto:toni.fuentes@xxxxxxxxxxx>
    Administración de Sistemas

    Oficina central: 902 888 345

    ACK STORM, S.L.
    ISO 9001:2008 (Cert.nº. 536932)
    http://ackstorm.es

    Este mensaje electrónico contiene información de ACK STORM, S.L.
    que es privada y confidencial, siendo para el uso exclusivo de la
    persona(s) o entidades arriba  mencionadas. Si usted no es el
    destinatario señalado, le informamos que cualquier divulgación,
    copia, distribución o uso de los contenidos está prohibida. Si
    usted ha recibido este mensaje por error, por favor borre su
    contenido y comuníquenoslo en la dirección ackstorm@xxxxxxxxxxx
<mailto:ackstorm@xxxxxxxxxxx>


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--

Toni Fuentes Rico
toni.fuentes@xxxxxxxxxxx
Administración de Sistemas

Oficina central: 902 888 345

ACK STORM, S.L.
ISO 9001:2008 (Cert.nº. 536932)
http://ackstorm.es

Este mensaje electrónico contiene información de ACK STORM, S.L. que es privada y confidencial, siendo para el uso exclusivo de la persona(s) o entidades arriba mencionadas. Si usted no es el destinatario señalado, le informamos que cualquier divulgación, copia, distribución o uso de los contenidos está prohibida. Si usted ha recibido este mensaje por error, por favor borre su contenido y comuníquenoslo en la direcciónackstorm@xxxxxxxxxxx



_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--

Toni Fuentes Rico
toni.fuentes@xxxxxxxxxxx
Administración de Sistemas

Oficina central: 902 888 345

ACK STORM, S.L.
ISO 9001:2008 (Cert.nº. 536932)
http://ackstorm.es

Este mensaje electrónico contiene información de ACK STORM, S.L. que es privada y confidencial, siendo para el uso exclusivo de la persona(s) o entidades arriba mencionadas. Si usted no es el destinatario señalado, le informamos que cualquier divulgación, copia, distribución o uso de los contenidos está prohibida. Si usted ha recibido este mensaje por error, por favor borre su contenido y comuníquenoslo en la direcciónackstorm@xxxxxxxxxxx




--

Toni Fuentes Rico
toni.fuentes@xxxxxxxxxxx
Administración de Sistemas

Oficina central: 902 888 345

ACK STORM, S.L.
ISO 9001:2008 (Cert.nº. 536932)
http://ackstorm.es

Este mensaje electrónico contiene información de ACK STORM, S.L. que es privada y confidencial, siendo para el uso exclusivo de la persona(s) o entidades arriba  mencionadas. Si usted no es el destinatario señalado, le informamos que cualquier divulgación, copia, distribución o uso de los contenidos está prohibida. Si usted ha recibido este mensaje por error, por favor borre su contenido y comuníquenoslo en la dirección ackstorm@xxxxxxxxxxx

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux