Hi folks, Second version of the buffer verifier series. The initial read verifier infrastructure patch set and overview is described here: http://oss.sgi.com/archives/xfs/2012-10/msg00146.html This version of the patch set introduces write verifiers and fixes lots of bugs in the read verifiers. The write verifiers also pointed out a bug in the allocation btree block/freelist handling where we are writing back freed buffers that are still on the AGF freelist (and hence failing verification). I haven't yet folded the recent review comments into the series - I figured that I'd finish testing this version of the code before I broke it again, so apart from bug fixes the read veridier part of the series is identical to the original series. Still to implement are: - log recovery read/write verifiers - uncached buffer write verifiers - potentially separate some of the write verify patches; maybe the directory/attr modifications shoul dbein a separate patch as they are somewhat more complicated than just adding a callback to a buffer once it has been read/built. These will be implemented for version 3 along with all the review comments from the first version that have come in.... This version passes xfstests without regressions, works on 500TB filesystems, complete various stress tests and benchmark runs, etc, so is much more robust than the first version. Cheers, Dave. -- Changes in Version 2: - fixed use of xfs_dir2_db_t instead of xfs_dablk_t in directory and attr read functions (found when testing xfstests --large-fs on a 500TB fs and attribute block numbers went beyond 32 bits). This mistake was copy-n-pasted several times. - fixed use of "int map_type" instead of "xfs_daddr_t mappedbno" in directory and attr read functions. - fixed incorrect logic in xfs_dir2_block_verify where a failed block check would not clear the block_ok flag correctly - invalidate allocbt->freelist buffers so they don't get written after being freed and while still on the freelist - added initial suppor for write verifiers. Write verifiers are similar to read verifiers, the are simply called just prior to issuing the IO on the buffer. The buffer is locked at this point, so we are guaranteed an unchanging buffer to work from. The initial write verifiers are simply the same as the read verifiers, except they don't have the ioend processing in them. A failure of the write verifier will cause the filesystem to shut down as writing invalid metadata to disk is a bad thing. The write verifier for the alloc btree blocks was what discovered the writing of freed allocbt blocks to disk from the free list. Eventually, the metadata CRC will be calculated in the write verifier after validating that the buffer contents are valid. _______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs
