Hi Casey and Xiaoxi, The next challenge to us is to figure out why the performance is so bad with fio-ceph-objectstore. With our initial performance data, the newstore is ~ 9 times worse than raw block device access in terms of IOPS and raw data. As I mentioned , The sync engine is might be the bottleneck. Anything else in your mind will be the bottleneck? Regards, James -----Original Message----- From: Casey Bodley [mailto:cbodley@xxxxxxxxxx] Sent: Wednesday, September 30, 2015 6:57 AM To: Xiaoxi Chen Cc: James (Fei) Liu-SSI; ceph-devel@xxxxxxxxxxxxxxx Subject: Re: Backend ObjectStore engine performance bench with FIO Hi Xiaoxi, I pushed a new branch wip-fio-objectstore to ceph's github. I look forward to seeing James' work! Thanks, Casey ----- Original Message ----- > Hi Casey, > Would it better if we create an integration brunch on > ceph/ceph/wip-fio-objstore to allow more people try and improve it? > Seems James has some patches. > > -Xiaoxi > > > -----Original Message----- > > From: ceph-devel-owner@xxxxxxxxxxxxxxx [mailto:ceph-devel- > > owner@xxxxxxxxxxxxxxx] On Behalf Of Casey Bodley > > Sent: Wednesday, September 30, 2015 4:06 AM > > To: James (Fei) Liu-SSI > > Cc: ceph-devel@xxxxxxxxxxxxxxx > > Subject: Re: Backend ObjectStore engine performance bench with FIO > > > > Hi James/Haomai/Xiaoxi, > > > > I spent some more time on the fio-objectstore branch, and pushed an > > update. > > > > In testing, I realized that it was using the io_unit's start time to > > name the objects, which meant that every write operation was > > creating a separate object. > > In addition to fixing this to use fio's filenames for object names, > > I also added support for the open_file() and close_file() functions. > > It now creates objects of the proper size on startup, so read-only > > jobs will work normally. > > It also removes its objects on exit. > > > > On startup, it no longer calls create_collection() if it already > > exists, so I was able to re-run fio jobs over and over again without > > having to clear the data directory (tested with FileStore and > > KeyValueStore). > > > > Casey > > > > ----- Original Message ----- > > > Great work James! > > > > > > ----- Original Message ----- > > > > From: "James (Fei) Liu-SSI" <james.liu@xxxxxxxxxxxxxxx> > > > > To: "Xiaoxi Chen" <xiaoxi.chen@xxxxxxxxx>, "Casey Bodley" > > > > <cbodley@xxxxxxxxxx> > > > > Cc: "Sage Weil" <sage@xxxxxxxxxxxx>, ceph-devel@xxxxxxxxxxxxxxx > > > > Sent: Friday, September 25, 2015 1:55:29 PM > > > > Subject: Backend ObjectStore engine performance bench with FIO > > > > > > > > Hi Xiaoxi, > > > > > > > > With changing the IO mode from aio to sync, we make fio > > > > against > > newstore > > > > works. Even with sync engine(I am still debugging the aio engine in > > > > newstore with Xiaoxi) in newstore, Newstore still performing the > > > > best > > > > among all of backstore engine with our initial setup(Thoroughly test > > > > will > > > > be run soon). Attachment is the initial data we collected for your > > > > reference. Thanks for great help from Xiaoxi from regarding > > > > to > > Newstore > > > > development to support FIO. > > > > > > > > Hi Casey, > > > > Let me know if you need any help to put fio-ceph-objectstore into > > > > upstream. > > > > After then , I can commit all of mine into upstream. > > > > > > My pull request at https://github.com/ceph/ceph/pull/5943 is still > > > pending. > > > If you have patches that you'd like included, I would be happy to > > > pull them in; just point me to a branch. > > > > > > > > > > > Thanks, > > > > James > > > > > > > > > > Thanks, > > > Casey > > > -- > > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > > > in the body of a message to majordomo@xxxxxxxxxxxxxxx More > > majordomo > > > info at http://vger.kernel.org/majordomo-info.html > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe > > ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > N r y b X ǧv ^ ){.n + z ]z {ay ʇڙ ,j f h z w j > :+v w j m zZ+ ݢj" ��.n��������+%������w��{.n����z��u���ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f
