Re: [ANN] oscheck: wrapper for fstests check.sh - tracking and working with baselines

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



The other thing I forgot to mention is annotations for failure rates.

For now I'll just indicate it as a ratio ratio as as part of the ending
comment for an expunge entry. For instance I just ran into a failure
with a set of stable patches for generic/475, however after re-running
the test it succeeded. So the test does not fail always. I'd like to
annotate this.

I now have to go and re-test with the oscheck/naggy-check.sh a few
times as follows:

./naggy-check.sh -s xfs_nocrc_512 -f generic/475

This will run the test in a loop until it fails, and I can use this
as an initial failure rate hint to the tester. If I wanted to get
more accurate I could use an average of few runs with naggy-check.sh.

In practice I typically am only sure a test succeeds if it passes at
least 1000 times (one can use -c 1000 on naggy-check.sh).

I will also then have to go back to the stable kernel without patches
and verify at least one failure was visible before. This will confirm
this is indeed not a regression. Likewise I'll have to test this also
with the other sections and see if this is also observed there.

  Luis
--
To unsubscribe from this list: send the line "unsubscribe linux-xfs" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [XFS Filesystem Development (older mail)]     [Linux Filesystem Development]     [Linux Audio Users]     [Yosemite Trails]     [Linux Kernel]     [Linux RAID]     [Linux SCSI]


  Powered by Linux