Sage, Here is the multi kv sync code for your review. https://github.com/somnathr/ceph/tree/wip-bluestore-multi-kv-sync-thread It is giving ZS significant performance boost but we believe we can optimize shim further. We are working on that. BTW, I have coded on top of your allocator changes (https://github.com/ceph/ceph/pull/12343) Thanks & Regards Somnath -----Original Message----- From: Somnath Roy Sent: Tuesday, December 06, 2016 7:56 AM To: 'Mark Nelson' Cc: ceph-devel Subject: RE: Bluestore with ZS No Problem , take your time..Hopefully, by then we can give you stable multi_kv version. -----Original Message----- From: Mark Nelson [mailto:mnelson@xxxxxxxxxx] Sent: Tuesday, December 06, 2016 7:54 AM To: Somnath Roy Cc: ceph-devel Subject: Re: Bluestore with ZS Excellent Somnath! I will attempt to test this today, though I also am going to be looking at the new RBD erasure coding stuff so it might be a day or two. Mark On 12/06/2016 02:33 AM, Somnath Roy wrote: > Mark, > Please find the Bluestore + ZS integrated code synced with today's master in the following location. > > https://github.com/somnathr/ceph/tree/wip-bluestore-zs > > As discussed in the standup , this is with single kv_sync_thread. > I am still cleaning up multi kv_sync_thread version and will send out a pull request for Sage to review hopefully by tomorrow. > > Here is the steps you need to follow to use this. > > 1. ./do_cmake.sh -DWITH_ZS=1 > > 2. make and make install > > 3. In the ceph.conf , use the following option. > > enable experimental unrecoverable data corrupting features = bluestore > zs rocksdb bluestore_sync_submit_transaction = false > bluestore_kvbackend=zs > > With smaller volumes you will be seeing rocks outperforming ZS , but, for bigger volumes ZS is catching up fast. > The code (shim layer and thus BlueStore) is no way optimally using ZS yet and we are in process of optimizing it further (with multi kv_sync, more batching etc. etc.). > Will keep community posted on this. > > Thanks & Regards > Somnath > > > > PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
