Re: radosgw performance

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Well, that's bad. I guess we're going to have to wait a little longer than we expected... not much of a problem though. AFAIU (poorly) RGW needs to update some index(?) for each write operation and since that index is a single file(?) there is nothing OSD can do about it. That's reasonable at OSD side, not so much at RGW mechanics, sorry if i got things wrong. In the long run IMHO, there should be a way to circumvent it besides faster journal or btrfs. I wish i could be of more help...

Thanks for all the help, you've got a great community here!


On Mon, Feb 18, 2013 at 7:15 PM, Sage Weil <sage@xxxxxxxxxxx> wrote:
On Mon, 18 Feb 2013, Yehuda Sadeh wrote:
> > Here shows osd receiving the request from rgw and almost immediately queuing
> > it. 0.29 secs pass while this operation gets a chance to actually work. It
>
> Yeah, that's the culprit. That's around ~120 leveldb write operations
> per second. Sam, does that number make sense to you?

The problem is actually that it's XFS and so the OSD is doing writeahead
journaling, and the operation is a read/modify/write.  That serializes the
updates with a journal commit.  A faster journal will help, as will using
btrfs...  :/

sage



--
erdem agaoglu
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux