next/pending-fixes baseline: 169 runs, 30 regressions (v6.4-12294-g066a64c121be) Regressions Summary ------------------- platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ acer-R721T-grunt | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 acer-cb317-1h-c3z6-dedede | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 asus-C436FA-Flip-hatch | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 asus-CM1400CXA-dalboz | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 asus-cx9400-volteer | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 dell-latitude...4305U-sarien | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 dell-latitude...8665U-sarien | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 hp-11A-G6-EE-grunt | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 hp-14-db0003na-grunt | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 hp-x360-14-G1-sona | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 hp-x360-14a-cb0001xx-zork | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 k3-am625-sk | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 k3-am625-sk | arm64 | lab-baylibre | gcc-10 | defconfig+CON...OMIZE_BASE=y | 1 lenovo-TPad-C13-Yoga-zork | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 meson-g12a-sei510 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 meson-g12b-a311d-khadas-vim3 | arm64 | lab-collabora | gcc-10 | defconfig+kselftest | 1 meson-g12b-odroid-n2 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 meson-gxbb-p200 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 meson-gxl-s905d-p230 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 meson-gxl-s905x-libretech-cc | arm64 | lab-broonie | gcc-10 | defconfig+kselftest | 1 meson-sm1-sei610 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+debug | 1 qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+debug | 1 rk3399-rock-pi-4b | arm64 | lab-collabora | gcc-10 | defconfig+kselftest | 1 sun50i-a64-pine64-plus | arm64 | lab-baylibre | gcc-10 | defconfig+CON...OMIZE_BASE=y | 1 sun50i-a64-pine64-plus | arm64 | lab-broonie | gcc-10 | defconfig+kselftest | 1 sun50i-a64-pine64-plus | arm64 | lab-broonie | gcc-10 | defconfig+CON...OMIZE_BASE=y | 1 sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-broonie | gcc-10 | defconfig+kselftest | 1 zynqmp-zcu102 | arm64 | lab-cip | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.4-12294-g066a64c121be/plan/baseline/ Test: baseline Tree: next Branch: pending-fixes Describe: v6.4-12294-g066a64c121be URL: https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git SHA: 066a64c121be85ce2c5ec794bc3def83454f2ddb Test Regressions ---------------- platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ acer-R721T-grunt | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75be1538b35f4a0bb2a76 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75be1538b35f4a0bb2a77 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ acer-cb317-1h-c3z6-dedede | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75ba65f755270edbb2a8d Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-acer-cb317-1h-c3z6-dedede.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-acer-cb317-1h-c3z6-dedede.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75ba65f755270edbb2a8e failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ asus-C436FA-Flip-hatch | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75ba3af76fd5919bb2a77 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75ba3af76fd5919bb2a78 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ asus-CM1400CXA-dalboz | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75b9a5f755270edbb2a7d Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75b9a5f755270edbb2a7e failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ asus-cx9400-volteer | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75abf73e799ea05bb2a78 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75abf73e799ea05bb2a79 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ dell-latitude...4305U-sarien | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75c146688f08f59bb2a99 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-dell-latitude-5400-4305U-sarien.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-dell-latitude-5400-4305U-sarien.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75c146688f08f59bb2a9a failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ dell-latitude...8665U-sarien | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75d360ec80da156bb2a7b Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-dell-latitude-5400-8665U-sarien.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-dell-latitude-5400-8665U-sarien.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75d360ec80da156bb2a7c failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-11A-G6-EE-grunt | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75ba55f755270edbb2a84 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75ba55f755270edbb2a85 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-14-db0003na-grunt | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75c4651f33630a7bb2a83 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75c4651f33630a7bb2a84 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75b746541facfeebb2a97 Results: 6 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64a75b746541facfeebb2a9c failing since 97 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b) 2023-07-07T00:25:12.038222 + set +x 2023-07-07T00:25:12.044929 <8>[ 13.352771] <LAVA_SIGNAL_ENDRUN 0_dmesg 11032024_1.4.2.3.1> 2023-07-07T00:25:12.149532 / # # 2023-07-07T00:25:12.250158 export SHELL=/bin/sh 2023-07-07T00:25:12.250351 # 2023-07-07T00:25:12.350900 / # export SHELL=/bin/sh. /lava-11032024/environment 2023-07-07T00:25:12.351135 2023-07-07T00:25:12.451668 / # . /lava-11032024/environment/lava-11032024/bin/lava-test-runner /lava-11032024/1 2023-07-07T00:25:12.451979 2023-07-07T00:25:12.456763 / # /lava-11032024/bin/lava-test-runner /lava-11032024/1 ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-x360-14-G1-sona | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75aac0a39d16bf5bb2a79 Results: 6 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64a75aac0a39d16bf5bb2a7e failing since 97 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b) 2023-07-07T00:22:22.340794 + set<8>[ 13.572183] <LAVA_SIGNAL_ENDRUN 0_dmesg 11032010_1.4.2.3.1> 2023-07-07T00:22:22.340879 +x 2023-07-07T00:22:22.442613 2023-07-07T00:22:22.543222 / # #export SHELL=/bin/sh 2023-07-07T00:22:22.543411 2023-07-07T00:22:22.643942 / # export SHELL=/bin/sh. /lava-11032010/environment 2023-07-07T00:22:22.644156 2023-07-07T00:22:22.744674 / # . /lava-11032010/environment/lava-11032010/bin/lava-test-runner /lava-11032010/1 2023-07-07T00:22:22.745066 2023-07-07T00:22:22.749677 / # /lava-11032010/bin/lava-test-runner /lava-11032010/1 ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-x360-14a-cb0001xx-zork | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75ab787d4200866bb2ac0 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75ab787d4200866bb2ac1 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ k3-am625-sk | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75976c10742aadebb2a79 Results: 5 PASS, 1 FAIL, 1 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-k3-am625-sk.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-k3-am625-sk.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64a75976c10742aadebb2a7e failing since 71 days (last pass: v6.3-rc7-226-gf05a2341f2478, first fail: v6.3-5614-gbe56a31d3d65) 2023-07-07T00:16:46.422247 + set +x 2023-07-07T00:16:46.425899 <8>[ 14.155915] <LAVA_SIGNAL_ENDRUN 0_dmesg 3714307_1.5.2.4.1> 2023-07-07T00:16:46.535641 / # # 2023-07-07T00:16:46.639103 export SHELL=/bin/sh 2023-07-07T00:16:46.640202 # 2023-07-07T00:16:46.742703 / # export SHELL=/bin/sh. /lava-3714307/environment 2023-07-07T00:16:46.743828 2023-07-07T00:16:46.846292 / # . /lava-3714307/environment/lava-3714307/bin/lava-test-runner /lava-3714307/1 2023-07-07T00:16:46.848136 2023-07-07T00:16:46.889652 / # /lava-3714307/bin/lava-test-runner /lava-3714307/1 ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ k3-am625-sk | arm64 | lab-baylibre | gcc-10 | defconfig+CON...OMIZE_BASE=y | 1 Details: https://kernelci.org/test/plan/id/64a75a6954303bb13bbb2aa1 Results: 5 PASS, 1 FAIL, 1 SKIP Full config: defconfig+CONFIG_RANDOMIZE_BASE=y Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-k3-am625-sk.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-k3-am625-sk.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64a75a6954303bb13bbb2aa6 failing since 71 days (last pass: v6.3-rc7-147-g6ba2ee0e9acd, first fail: v6.3-5614-gbe56a31d3d65) 2023-07-07T00:20:44.212127 <8>[ 7.845687] <LAVA_SIGNAL_ENDRUN 0_dmesg 3714330_1.5.2.4.1> 2023-07-07T00:20:44.315893 / # 2023-07-07T00:20:44.417690 # #export SHELL=/bin/sh 2023-07-07T00:20:44.418084 2023-07-07T00:20:44.519230 / # export SHELL=/bin/sh. /lava-3714330/environment 2023-07-07T00:20:44.519618 2023-07-07T00:20:44.620824 / # . /lava-3714330/environment/lava-3714330/bin/lava-test-runner /lava-3714330/1 2023-07-07T00:20:44.621476 2023-07-07T00:20:44.665030 / # /lava-3714330/bin/lava-test-runner /lava-3714330/1 2023-07-07T00:20:44.676099 + export 'TESTRUN_ID=1_bootrr' ... (11 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ lenovo-TPad-C13-Yoga-zork | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...ok+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75b9a6541facfeebb2b06 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: x86_64_defconfig+x86-chromebook+kselftest Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75b9a6541facfeebb2b07 failing since 7 days (last pass: v6.4-rc7-318-gd779731ecfed, first fail: v6.4-4938-g5c1c4e99720d8) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-g12a-sei510 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a48ab820484babb2aa3 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a48ab820484babb2aa4 failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-g12b-a311d-khadas-vim3 | arm64 | lab-collabora | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75b6c4c02d65d6abb2a98 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75b6c4c02d65d6abb2a99 failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-g12b-odroid-n2 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a49163c676755bb2a7a Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a49163c676755bb2a7b failing since 137 days (last pass: v6.2-rc8-150-g30cd52e17d48, first fail: v6.2-rc8-211-g05def2d212c6) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-gxbb-p200 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75d1d0ec80da156bb2a76 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-p200.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-p200.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75d1d0ec80da156bb2a77 failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-gxl-s905d-p230 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a66f13c07e32dbb2b44 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a66f13c07e32dbb2b45 failing since 149 days (last pass: v6.2-rc6-351-gf42837eac380f, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-gxl-s905x-libretech-cc | arm64 | lab-broonie | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75af4a9ccb67bb1bb2afc Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75af4a9ccb67bb1bb2afd failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ meson-sm1-sei610 | arm64 | lab-baylibre | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a4aab820484babb2aa9 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a4aab820484babb2aaa failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+debug | 1 Details: https://kernelci.org/test/plan/id/64a7589209bcdd72a8bb2ad7 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+debug Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a7589209bcdd72a8bb2ad8 failing since 15 days (last pass: v6.4-rc7-164-g1f02f25057f7, first fail: v6.4-rc7-214-g00072f89e53f9) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+debug | 1 Details: https://kernelci.org/test/plan/id/64a7586a336649ad6fbb2a75 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+debug Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a7586a336649ad6fbb2a76 failing since 15 days (last pass: v6.4-rc7-164-g1f02f25057f7, first fail: v6.4-rc7-214-g00072f89e53f9) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ rk3399-rock-pi-4b | arm64 | lab-collabora | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a5e163c676755bb2aad Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a5e163c676755bb2aae failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ sun50i-a64-pine64-plus | arm64 | lab-baylibre | gcc-10 | defconfig+CON...OMIZE_BASE=y | 1 Details: https://kernelci.org/test/plan/id/64a75e356c76e14dd1bb2a7e Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+CONFIG_RANDOMIZE_BASE=y Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-sun50i-a64-pine64-plus.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-sun50i-a64-pine64-plus.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75e356c76e14dd1bb2a7f failing since 6 days (last pass: v6.4-1651-gf52dd2890422, first fail: v6.4-8718-g6b8b1f7dba504) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ sun50i-a64-pine64-plus | arm64 | lab-broonie | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a90c33979baffbb2ab9 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a90c33979baffbb2aba failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ sun50i-a64-pine64-plus | arm64 | lab-broonie | gcc-10 | defconfig+CON...OMIZE_BASE=y | 1 Details: https://kernelci.org/test/plan/id/64a75be6538b35f4a0bb2a85 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+CONFIG_RANDOMIZE_BASE=y Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75be6538b35f4a0bb2a86 failing since 6 days (last pass: v6.4-1651-gf52dd2890422, first fail: v6.4-8718-g6b8b1f7dba504) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-broonie | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a7cb17440b974bb2a95 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a7cb17440b974bb2a96 failing since 149 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-157-ga82755b498dd) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ zynqmp-zcu102 | arm64 | lab-cip | gcc-10 | defconfig+kselftest | 1 Details: https://kernelci.org/test/plan/id/64a75a51163c676755bb2a80 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+kselftest Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt HTML log: https://storage.kernelci.org//next/pending-fixes/v6.4-12294-g066a64c121be/arm64/defconfig+kselftest/gcc-10/lab-cip/baseline-zynqmp-zcu102.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64a75a51163c676755bb2a81 failing since 6 days (last pass: v6.4-rc7-235-g8d8d57edb1481, first fail: v6.4-8718-g6b8b1f7dba504)