RE: Adding compression/checksum support for bluestore.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



> -----Original Message-----
> From: Igor Fedotov [mailto:ifedotov@xxxxxxxxxxxx]
> Sent: Monday, April 04, 2016 5:14 AM
> To: Allen Samuels <Allen.Samuels@xxxxxxxxxxx>; Sage Weil
> <sage@xxxxxxxxxxxx>
> Cc: ceph-devel <ceph-devel@xxxxxxxxxxxxxxx>
> Subject: Re: Adding compression/checksum support for bluestore.
> 
> 
> 
> On 31.03.2016 21:38, Allen Samuels wrote:
> >> Another thing to consider is an ability to use introduced checksums
> >> for scrubbing. One can probably extend objectstore interface to be
> >> able to validate stored data without data sending back.
> >> I don't see such an option at the moment. Please correct me if I missed
> that.
> > No need for that option. Just read the data check the return code (good or
> checksum failure) then discard the data. This is essentially exactly the same
> code-path as a "please validate the checksum" specialized opcode.
> >
> I'd rather disagree.
> In fact one can perform object verification more effectively when using
> specific op:
> 
> - No need for decompression that's present in the read data-path

Yes, I missed this. I agree this is important to optimize.

> - No need to select proper read  buffer size. Verify operation can run over
> blob map instead of lextent one and read data by pextents.

With some careful structuring, this will just "fall out" of the code. In other words, you'll implement the code as the standard interface that takes in logical offsets and uses the lextent table to convert them into the correct set/subset of pextents. Then a second interface that operates in pextents. This also helps localize the checksum code.


> - Verify can be done via single op call.
> - IMHO code is more elegant and readable having specific op handler. In your
> option one has to Implement  "sub data-path" for read handler to discard
> data and do other optimizations if any... More flags, if statements, etc...
> 

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux