On Thu, Jan 25, 2024 at 11:24:58PM +0000, Matthew Wilcox wrote: > On Thu, Jan 25, 2024 at 02:10:37PM -0800, Luis Chamberlain wrote: > > The kdevops test runner has supported a custom SOAK_DURATION for > > fstests, however we were not providing any guidance. This means folks > > likely disable this. Throw a bone and provide some basic guidance and > > use 2.5 hours as the default value. There are about 46 tests today > > which use soak duration, this means if you are testing serially it > > increase total test time by about 5 days than the previously known > > total test time. > > Do you have any stats on how much more effective it is to soak for 1 > hour vs 5 hours vs 24 hours? Heh no, we just went for the high value of 2.5 hours for our LBS testing. Note that the soaking is *per* test and hence the summation of *all* 46 tests need to be considered. Unless of course we run 46 guests all running each respective soak test separately. > Presumably there's some kind of > exponential dropoff, like 20 bugs found at 1 hour, an extra five found > by four hours and three more at 24 hours? I suspect you might be right. We *may* be able to experiment more with this once resource scaling can be done automatically for us, ie with something like k8. Luis
