Hi Daniel and Haomai, Let me know if you need any help in terms of development and testing. Regards, James -----Original Message----- From: Haomai Wang [mailto:haomaiwang@xxxxxxxxx] Sent: Tuesday, July 07, 2015 1:18 AM To: Daniel Gollub Cc: Jens Axboe; Josh Durgin; Mark Nelson; James (Fei) Liu-SSI; Casey Bodley; ceph-devel@xxxxxxxxxxxxxxx; Danny Al-Gaaf Subject: Re: About Fio backend with ObjectStore API On Wed, Jul 1, 2015 at 1:58 PM, Daniel Gollub <daniel.gollub@xxxxxxxxx> wrote: > Hi Jens, > > as Josh already mentioned the engine would use Ceph internal > ObjectStore API ... which is not stable. > So as Josh proposed, my idea was to build this C++ ObjectStorage > engine as an external FIO engine inside Ceph (optionally). > > We just need to keep fio working with for external C++ engines - so > this external engine can exists. > That was the intend when I did push various "build"-fixes for C++ fio > headers, to get the external ObjectStorage fio engine building, > because it's written in C++. > > I am no longer with DT, so I don't have a Ceph cluster right now to > test things. But I'm happy to help to get the ObjectStorage fio engine > upstream into Ceph. Josh, Casey do you need any help on this? I guess > https://github.com/linuxbox2/linuxbox-ceph/tree/fio-objectstore is > good base to continue. Casey, thank you for cleaning things up ;) > Cool, do you have plan to do this recently? If not, I'm willing to help :-) > > Best Regards, > Daniel > > > On Wed, Jul 1, 2015 at 12:57 AM, Jens Axboe <axboe@xxxxxxxxx> wrote: >> >> I'd be more than happy to include it. Daniel has contributed to fio >> before. >> >> Daniel (CC'ed), was it your intent to get this upstream? How do we >> make this happen? >> >> >> On 06/30/2015 04:38 PM, Mark Nelson wrote: >>> >>> It would be fantastic if folks decided to work on this and got it >>> pushed upstream into fio proper. :D >>> >>> Mark >>> >>> On 06/30/2015 04:19 PM, James (Fei) Liu-SSI wrote: >>>> >>>> Hi Casey, >>>> >>>> Thanks a lot. >>>> >>>> Regards, >>>> James >>>> >>>> -----Original Message----- >>>> From: Casey Bodley [mailto:cbodley@xxxxxxxxx] >>>> Sent: Tuesday, June 30, 2015 2:16 PM >>>> To: James (Fei) Liu-SSI >>>> Cc: Haomai Wang; ceph-devel@xxxxxxxxxxxxxxx >>>> Subject: Re: About Fio backend with ObjectStore API >>>> >>>> Hi, >>>> >>>> When Danny Al-Gaaf & Daniel Gollub published "Ceph Performance >>>> Analysis: fio and RBD" at >>>> >>>> https://telekomcloud.github.io/ceph/2014/02/26/ceph-performance-ana >>>> lysis_fio_rbd.html, >>>> >>>> they also mentioned a fio engine that linked directly into ceph's >>>> FileStore. I was able to find Daniel's branch on github at >>>> https://github.com/gollub/ceph/tree/fio_filestore_v2, and did some >>>> more work on it at the time. >>>> >>>> I just rebased that work onto the latest ceph master branch, and >>>> pushed to our github at >>>> https://github.com/linuxbox2/linuxbox-ceph/tree/fio-objectstore. >>>> You can find the source in src/test/fio_ceph_filestore.cc, and run >>>> fio with the provided example fio job file in src/test/filestore.fio. >>>> >>>> I didn't have a chance to confirm that it builds with automake, but >>>> the cmake version built for me. I'm happy to help if you run into >>>> problems, Casey >>>> >>>> On Tue, Jun 30, 2015 at 2:31 PM, James (Fei) Liu-SSI >>>> <james.liu@xxxxxxxxxxxxxxx> wrote: >>>>> >>>>> Hi Haomai, >>>>> What are you trying to ask is to benchmark local >>>>> objectstore(like >>>>> kvstore/filestore/newstore) locally with FIO(ObjectStore engine)? >>>>> You want to purely compare the performance locally for these >>>>> objectstores, right? >>>>> >>>>> Regards, >>>>> James >>>>> >>>>> -----Original Message----- >>>>> From: ceph-devel-owner@xxxxxxxxxxxxxxx >>>>> [mailto:ceph-devel-owner@xxxxxxxxxxxxxxx] On Behalf Of Haomai Wang >>>>> Sent: Tuesday, June 30, 2015 9:06 AM >>>>> To: ceph-devel@xxxxxxxxxxxxxxx >>>>> Subject: About Fio backend with ObjectStore API >>>>> >>>>> Hi all, >>>>> >>>>> Long long ago, is there someone said about fio backend with Ceph >>>>> ObjectStore API? So we could use the existing mature fio facility >>>>> to benchmark ceph objectstore. >>>>> >>>>> -- >>>>> Best Regards, >>>>> >>>>> Wheat >>>>> -- >>>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" >>>>> in the body of a message to majordomo@xxxxxxxxxxxxxxx More >>>>> majordomo info at http://vger.kernel.org/majordomo-info.html >>>> >>>> N r y b X ǧv ^ ){.n + z ]z {ay ʇڙ ,j f h z >>>> w j:+v w j m zZ+ ݢj" !tml= >>>> >>>> >> >> >> -- >> Jens Axboe >> > -- Best Regards, Wheat ��.n��������+%������w��{.n����z��u���ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f
