Re: struggling to achieve high bandwidth on Ceph dev cluster - HELP

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



> I am interested in benchmarking the cluster.

dstat is great, but can you send and example of this command on your
osd machine: iostat -mtxy 1

This will also show some basic CPU info and more detailed analysis of
the I/O pattern.

What kind of drives are you using?  Random access can be very slow on
spinning drives, especially if you have to do log structured merging
(double writes).

Mark


On Wed, Feb 10, 2021 at 1:31 AM Bobby <italienisch1987@xxxxxxxxx> wrote:
>
> Hi,
>
> Hello I am using rados bench tool. Currently I am using this tool  on the
> development cluster after running vstart.sh script. It is working fine and
> I am interested in benchmarking the cluster. However I am struggling to
> achieve a good bandwidth i.e. bandwidth (MB/sec).  My target throughput is
> at least 50 MB/sec and more. But mostly I am achieving is around 15-20
> MB/sec. So, very poor.
>
> I am quite sure I am missing something. Either I have to change my cluster
> through vstart.sh script or I am not fully utilizing the rados bench tool.
> Or may be both. i.e. not the right cluster and also not using the rados
> bench tool correctly.
>
> Some of the shell examples I have been using to build the cluster are
> bellow:
> MDS=0 RGW=1 ../src/vstart.sh -d -l -n --bluestore
> MDS=0 RGW=1 MON=1 OSD=4../src/vstart.sh -d -l -n --bluestore
>
> While using rados bench tool I have been trying with different block sizes
> 4K, 8K, 16K, 32K, 64K, 128K, 256K, 512K. And I have also been changing the
> -t parameter in the shell to increase concurrent IOs.
>
>
> Looking forward to help.
>
> Bobby
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux