On Sat, 11 May 2019 at 16:51, Kees Cook <keescook@xxxxxxxxxxxx> wrote: > > On Sat, May 11, 2019 at 10:14:57AM +0000, ci_notify@xxxxxxxxxx wrote: > > Summary > > ------------------------------------------------------------------------ > > kernel: 5.1.0 > > git repo: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git > > git branch: master > > git commit: a802303934b3bd4df6e2fc8bf2e4ebced1c37556 > > git describe: next-20190510 > > Test details: https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190510 > > > > Regressions (compared to build next-20190509) > > ------------------------------------------------------------------------ > > No regressions > > > > Fixes (compared to build next-20190509) > > ------------------------------------------------------------------------ > > No fixes > > > > In total: > > ------------------------------------------------------------------------ > > Ran 12 total tests in the following environments and test suites. > > pass 11 > > fail 1 > > xfail 0 > > skip 0 > > > > Environments > > -------------- > > - dragonboard-410c - arm64 > > - hi6220-hikey - arm64 > > - i386 > > - juno-r2 - arm64 > > - qemu_arm > > - qemu_arm64 > > - qemu_i386 > > - qemu_x86_64 > > - x15 - arm > > - x86_64 > > > > Test Suites > > ----------- > > * boot-lkft-kselftests-master-519 > > What counts as a "pass" for this? I looked at the x86_64 log, and there are lots of kselftest failures, but the dashboard counts it as a "pass"? The boot is passed when the auto-login-action in suite 'lava' is passed [1]. There's is two issues: 1. We had a way that changed the run_kselftest.sh file in order to skip tests that hanged (that results in no test output from the run) various boards. Since the new change to kselftest, the patch to run_kselftest.sh got added that breaks our way to skip the tests and kernel hangs. 2. The way we parse the output doesn't match the new output format. We will turn off the "next-* kselftest restults" until we have resolved this issue. Cheers, Anders > > $ wget https://qa-reports.linaro.org/lkft/linux-next-oe/build/next-20190510/testrun/716064/log > $ grep '^ok ' log | wc -l > 60 > $ grep '^not ok' log | grep -iv '# SKIP' | wc -l > 30 > $ grep -i '^not ok.*# SKIP' log | wc -l > 18 > > 60 pass, 30 fail, 18 skip > [1] https://lkft.validation.linaro.org/results/testcase/141157606
