Hi Xiaoxi, I pushed a new branch wip-fio-objectstore to ceph's github. I look forward to seeing James' work! Thanks, Casey ----- Original Message ----- > Hi Casey, > Would it better if we create an integration brunch on > ceph/ceph/wip-fio-objstore to allow more people try and improve it? > Seems James has some patches. > > -Xiaoxi > > > -----Original Message----- > > From: ceph-devel-owner@xxxxxxxxxxxxxxx [mailto:ceph-devel- > > owner@xxxxxxxxxxxxxxx] On Behalf Of Casey Bodley > > Sent: Wednesday, September 30, 2015 4:06 AM > > To: James (Fei) Liu-SSI > > Cc: ceph-devel@xxxxxxxxxxxxxxx > > Subject: Re: Backend ObjectStore engine performance bench with FIO > > > > Hi James/Haomai/Xiaoxi, > > > > I spent some more time on the fio-objectstore branch, and pushed an > > update. > > > > In testing, I realized that it was using the io_unit's start time to name > > the > > objects, which meant that every write operation was creating a separate > > object. > > In addition to fixing this to use fio's filenames for object names, I also > > added > > support for the open_file() and close_file() functions. It now creates > > objects > > of the proper size on startup, so read-only jobs will work normally. > > It also removes its objects on exit. > > > > On startup, it no longer calls create_collection() if it already exists, so > > I was > > able to re-run fio jobs over and over again without having to clear the > > data > > directory (tested with FileStore and KeyValueStore). > > > > Casey > > > > ----- Original Message ----- > > > Great work James! > > > > > > ----- Original Message ----- > > > > From: "James (Fei) Liu-SSI" <james.liu@xxxxxxxxxxxxxxx> > > > > To: "Xiaoxi Chen" <xiaoxi.chen@xxxxxxxxx>, "Casey Bodley" > > > > <cbodley@xxxxxxxxxx> > > > > Cc: "Sage Weil" <sage@xxxxxxxxxxxx>, ceph-devel@xxxxxxxxxxxxxxx > > > > Sent: Friday, September 25, 2015 1:55:29 PM > > > > Subject: Backend ObjectStore engine performance bench with FIO > > > > > > > > Hi Xiaoxi, > > > > > > > > With changing the IO mode from aio to sync, we make fio against > > newstore > > > > works. Even with sync engine(I am still debugging the aio engine in > > > > newstore with Xiaoxi) in newstore, Newstore still performing the > > > > best > > > > among all of backstore engine with our initial setup(Thoroughly test > > > > will > > > > be run soon). Attachment is the initial data we collected for your > > > > reference. Thanks for great help from Xiaoxi from regarding to > > Newstore > > > > development to support FIO. > > > > > > > > Hi Casey, > > > > Let me know if you need any help to put fio-ceph-objectstore into > > > > upstream. > > > > After then , I can commit all of mine into upstream. > > > > > > My pull request at https://github.com/ceph/ceph/pull/5943 is still > > > pending. > > > If you have patches that you'd like included, I would be happy to pull > > > them in; just point me to a branch. > > > > > > > > > > > Thanks, > > > > James > > > > > > > > > > Thanks, > > > Casey > > > -- > > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > > > in the body of a message to majordomo@xxxxxxxxxxxxxxx More > > majordomo > > > info at http://vger.kernel.org/majordomo-info.html > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > > the > > body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at > > http://vger.kernel.org/majordomo-info.html > N�����r��y���b�X��ǧv�^�){.n�+���z�]z���{ay�ʇڙ�,j��f���h���z��w������j:+v���w�j�m��������zZ+��ݢj"�� -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
