On Wed, Jul 1, 2015 at 1:58 PM, Daniel Gollub <daniel.gollub@xxxxxxxxx> wrote: > Hi Jens, > > as Josh already mentioned the engine would use Ceph internal ObjectStore API > ... which is not stable. > So as Josh proposed, my idea was to build this C++ ObjectStorage engine as > an external FIO engine inside Ceph (optionally). > > We just need to keep fio working with for external C++ engines - so this > external engine can exists. > That was the intend when I did push various "build"-fixes for C++ fio > headers, to get the external ObjectStorage fio engine building, because it's > written in C++. > > I am no longer with DT, so I don't have a Ceph cluster right now to test > things. But I'm happy to help to get the ObjectStorage fio engine upstream > into Ceph. Josh, Casey do you need any help on this? I guess > https://github.com/linuxbox2/linuxbox-ceph/tree/fio-objectstore is good > base to continue. Casey, thank you for cleaning things up ;) > Cool, do you have plan to do this recently? If not, I'm willing to help :-) > > Best Regards, > Daniel > > > On Wed, Jul 1, 2015 at 12:57 AM, Jens Axboe <axboe@xxxxxxxxx> wrote: >> >> I'd be more than happy to include it. Daniel has contributed to fio >> before. >> >> Daniel (CC'ed), was it your intent to get this upstream? How do we make >> this happen? >> >> >> On 06/30/2015 04:38 PM, Mark Nelson wrote: >>> >>> It would be fantastic if folks decided to work on this and got it pushed >>> upstream into fio proper. :D >>> >>> Mark >>> >>> On 06/30/2015 04:19 PM, James (Fei) Liu-SSI wrote: >>>> >>>> Hi Casey, >>>> >>>> Thanks a lot. >>>> >>>> Regards, >>>> James >>>> >>>> -----Original Message----- >>>> From: Casey Bodley [mailto:cbodley@xxxxxxxxx] >>>> Sent: Tuesday, June 30, 2015 2:16 PM >>>> To: James (Fei) Liu-SSI >>>> Cc: Haomai Wang; ceph-devel@xxxxxxxxxxxxxxx >>>> Subject: Re: About Fio backend with ObjectStore API >>>> >>>> Hi, >>>> >>>> When Danny Al-Gaaf & Daniel Gollub published "Ceph Performance >>>> Analysis: fio and RBD" at >>>> >>>> https://telekomcloud.github.io/ceph/2014/02/26/ceph-performance-analysis_fio_rbd.html, >>>> >>>> they also mentioned a fio engine that linked directly into ceph's >>>> FileStore. I was able to find Daniel's branch on github at >>>> https://github.com/gollub/ceph/tree/fio_filestore_v2, and did some >>>> more work on it at the time. >>>> >>>> I just rebased that work onto the latest ceph master branch, and >>>> pushed to our github at >>>> https://github.com/linuxbox2/linuxbox-ceph/tree/fio-objectstore. You >>>> can find the source in src/test/fio_ceph_filestore.cc, and run fio >>>> with the provided example fio job file in src/test/filestore.fio. >>>> >>>> I didn't have a chance to confirm that it builds with automake, but >>>> the cmake version built for me. I'm happy to help if you run into >>>> problems, Casey >>>> >>>> On Tue, Jun 30, 2015 at 2:31 PM, James (Fei) Liu-SSI >>>> <james.liu@xxxxxxxxxxxxxxx> wrote: >>>>> >>>>> Hi Haomai, >>>>> What are you trying to ask is to benchmark local objectstore(like >>>>> kvstore/filestore/newstore) locally with FIO(ObjectStore engine)? You >>>>> want to purely compare the performance locally for these >>>>> objectstores, right? >>>>> >>>>> Regards, >>>>> James >>>>> >>>>> -----Original Message----- >>>>> From: ceph-devel-owner@xxxxxxxxxxxxxxx >>>>> [mailto:ceph-devel-owner@xxxxxxxxxxxxxxx] On Behalf Of Haomai Wang >>>>> Sent: Tuesday, June 30, 2015 9:06 AM >>>>> To: ceph-devel@xxxxxxxxxxxxxxx >>>>> Subject: About Fio backend with ObjectStore API >>>>> >>>>> Hi all, >>>>> >>>>> Long long ago, is there someone said about fio backend with Ceph >>>>> ObjectStore API? So we could use the existing mature fio facility to >>>>> benchmark ceph objectstore. >>>>> >>>>> -- >>>>> Best Regards, >>>>> >>>>> Wheat >>>>> -- >>>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" >>>>> in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo >>>>> info at http://vger.kernel.org/majordomo-info.html >>>> >>>> N�����r��y���b�X��ǧv�^�){.n�+���z�]z���{ay� ʇڙ�,j ��f���h���z� �w��� >>>> ���j:+v���w�j�m���� ����zZ+�����ݢj"��!tml= >>>> >>>> >> >> >> -- >> Jens Axboe >> > -- Best Regards, Wheat -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
