Re: What is the state of filestore sloppy CRC?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, 25 Nov 2014, Tomasz Kuzemko wrote:
> Hello,
> as far as I can tell, Ceph does not make any guarantee that reads from an
> object return what was actually written to it. In other words, it does not
> check data integrity (except doing deep-scrub once every few days).
> Considering the fact that BTRFS is not production-ready, not many people use
> Ceph on top of ZFS, then the only option to have some sort of guarantee of
> integrity is to enable "filestore sloppy crc" option. Unfortunately the docs
> aren't too clear about this matter and "filestore sloppy crc" is not even
> documented, which is weird considering it's merged since Emperor.
> 
> Getting back to my actual question - what is the state of "filestore sloppy
> crc"? Does someone actually use it in production? Are there any
> considerations one should make before enabling it? Is it safe to enable it
> on an existing cluster?

We enable it in our automated QA, but do not know of anyone using it in 
production and have not recommended it for that.  It is not intended to be 
particularly fast and we didn't thoroughly analyze the xattr size 
implications on the file systems people may run on.  Also note that it 
simply fails (crashes) the OSD when it detects an error and has no 
integration with scrub, which makes it not particularly friendly.

Note that I am working on a related patch set that will keep a persistent 
checksum of the entire object that will interact directly with deep 
scrubs.  It will not be as fine-grained but is intended for production 
use and will cover the bulk of data that sits unmodified at rest for 
extended periods.

sage
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux