radosgw performance with small files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I am seeing write performance hit with small files (60K) using radosgw. The radosgw is configured to run with 600 threads. Here is the write speed I get with file sizes of 60K


# sudo ceph -s
    cluster e445e46e-4d84-4606-9923-16fff64446dc
     health HEALTH_OK
     monmap e1: 1 mons at {osd187=13.24.0.7:6789/0}, election epoch 1, quorum 0 osd187
     osdmap e205: 28 osds: 22 up, 22 in
      pgmap v17007: 1078 pgs, 9 pools, 154 GB data, 653 kobjects
            292 GB used, 8709 GB / 9002 GB avail
                1078 active+clean
  client io 1117 kB/s rd, 2878 kB/s wr, 2513 op/s
#


If I run the same script with larger file sizes(1MB-3MB), I get a better write speed. 


# sudo ceph -s
    cluster e445e46e-4d84-4606-9923-16fff64446dc
     health HEALTH_OK
     monmap e1: 1 mons at {osd187=13.24.0.79:6789/0}, election epoch 1, quorum 0 osd187
     osdmap e205: 28 osds: 22 up, 22 in
      pgmap v16883: 1078 pgs, 9 pools, 125 GB data, 140 kobjects
            192 GB used, 8809 GB / 9002 GB avail
                1078 active+clean
  client io 105 MB/s wr, 1839 op/s
#

My cluster has 2 OSD hosts running total of 20 osd daemons, 1 mon and 1 radosgw hosts. Is the bottleneck coming from the single radosgw process? If so, is it possible to run radosgw in multi process mode?

Regards
Srikanth

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux