On Thu, May 24, 2018 at 09:08:06PM +0200, Greg Kroah-Hartman wrote: > On Thu, May 24, 2018 at 01:06:52PM -0500, Dan Rue wrote: > > On Thu, May 24, 2018 at 11:37:37AM +0200, Greg Kroah-Hartman wrote: > > > This is the start of the stable review cycle for the 4.4.133 release. > > > There are 92 patches in this series, all will be posted as a response > > > to this one. If anyone has any issues with these being applied, please > > > let me know. > > > > > > Responses should be made by Sat May 26 09:31:28 UTC 2018. > > > Anything received after that time might be too late. > > > > Results from Linaro’s test farm. > > No regressions on arm64, arm and x86_64. > > > > Summary > > ------------------------------------------------------------------------ > > > > kernel: 4.4.133-rc1 > > git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git > > git branch: linux-4.4.y > > git commit: 915a3d7cdea9daa9e9fb6b855f10c1312e6910c4 > > git describe: v4.4.132-93-g915a3d7cdea9 > > Test details: https://qa-reports.linaro.org/lkft/linux-stable-rc-4.4-oe/build/v4.4.132-93-g915a3d7cdea9 > > > > > > No regressions (compared to build v4.4.132-71-g180635995c36) > > It should have gotten better, as there was a fix in here for at least 2 > LTP tests that we previously were not passing. I don't know why you all > were not reporting that in the past, it took someone else randomly > deciding to run LTP to report it to me... > > Why did an improvement in results not show up? Our normal process for failing tests is to skip them and then fix/report/etc separately until they're fixed, at which time we re-enable them. Otherwise, we would have to wade through too many failures in every result set, and we could miss actual regressions. We've never really reported things as they've been fixed - just immediate regressions. However! We are working on 'known issue' support in qa-reports (SQUAD), so that we can run failing tests and the system will mark them as a known failure. This will allow us to keep our baseline 'green', and also let us run the failing tests so that we can see in realtime as issues get fixed. Once we have that, the only tests that we'll carry on our skiplists are those that cause boards to crash or reboot. If you have the test cases in mind, I can check them. Otherwise, I can run our full set of tests in staging (without a skiplist) tomorrow and see if any are now passing. Dan
