stable-rc/queue/4.19 baseline: 142 runs, 31 regressions (v4.19.283-112-g8c8b7703c4422) Regressions Summary ------------------- platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ at91sam9g20ek | arm | lab-broonie | gcc-10 | multi_v5_defconfig | 1 beaglebone-black | arm | lab-broonie | gcc-10 | omap2plus_defconfig | 1 cubietruck | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 hip07-d05 | arm64 | lab-collabora | gcc-10 | defconfig | 1 meson-gxbb-nanopi-k2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 rk3399-gru-kevin | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 2 Details: https://kernelci.org/test/job/stable-rc/branch/queue%2F4.19/kernel/v4.19.283-112-g8c8b7703c4422/plan/baseline/ Test: baseline Tree: stable-rc Branch: queue/4.19 Describe: v4.19.283-112-g8c8b7703c4422 URL: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git SHA: 8c8b7703c44228082b7e3d5827974a49710db49b Test Regressions ---------------- platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ at91sam9g20ek | arm | lab-broonie | gcc-10 | multi_v5_defconfig | 1 Details: https://kernelci.org/test/plan/id/64731a40fcefccec0e2e85ea Results: 42 PASS, 9 FAIL, 1 SKIP Full config: multi_v5_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/armel/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64731a40fcefccec0e2e861c failing since 2 days (last pass: v4.19.283-85-gca9071c143dc, first fail: v4.19.283-102-g2fb8378e58cf) 2023-05-28T09:08:57.778930 + set +x 2023-05-28T09:08:57.784205 <8><LAVA_SIGNAL_ENDRUN 0_dmesg 524284_1.5.2.4.1> 2023-05-28T09:08:57.897384 / # # 2023-05-28T09:08:58.000253 export SHELL=/bin/sh 2023-05-28T09:08:58.001023 # 2023-05-28T09:08:58.102960 / # export SHELL=/bin/sh. /lava-524284/environment 2023-05-28T09:08:58.103779 2023-05-28T09:08:58.205712 / # . /lava-524284/environment/lava-524284/bin/lava-test-runner /lava-524284/1 2023-05-28T09:08:58.207020 2023-05-28T09:08:58.213470 / # /lava-524284/bin/lava-test-runner /lava-524284/1 ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ beaglebone-black | arm | lab-broonie | gcc-10 | omap2plus_defconfig | 1 Details: https://kernelci.org/test/plan/id/647319b565499617232e85eb Results: 41 PASS, 10 FAIL, 1 SKIP Full config: omap2plus_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm/omap2plus_defconfig/gcc-10/lab-broonie/baseline-beaglebone-black.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm/omap2plus_defconfig/gcc-10/lab-broonie/baseline-beaglebone-black.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/armel/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/647319b565499617232e861d new failure (last pass: v4.19.283-108-g3ae5a16f9ea28) 2023-05-28T09:06:41.163982 + set +x<8>[ 19.193251] <LAVA_SIGNAL_ENDRUN 0_dmesg 524319_1.5.2.4.1> 2023-05-28T09:06:41.164591 2023-05-28T09:06:41.277728 / # # 2023-05-28T09:06:41.380874 export SHELL=/bin/sh 2023-05-28T09:06:41.381803 # 2023-05-28T09:06:41.484055 / # export SHELL=/bin/sh. /lava-524319/environment 2023-05-28T09:06:41.485035 2023-05-28T09:06:41.587183 / # . /lava-524319/environment/lava-524319/bin/lava-test-runner /lava-524319/1 2023-05-28T09:06:41.588627 2023-05-28T09:06:41.593232 / # /lava-524319/bin/lava-test-runner /lava-524319/1 ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ cubietruck | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 Details: https://kernelci.org/test/plan/id/64731bb5e0ac2ff9e82e85f3 Results: 5 PASS, 1 FAIL, 1 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/armel/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64731bb5e0ac2ff9e82e85f8 failing since 131 days (last pass: v4.19.269-9-gce7b59ec9d48, first fail: v4.19.269-521-g305d312d039a) 2023-05-28T09:15:14.712202 + set +x<8>[ 7.291249] <LAVA_SIGNAL_ENDRUN 0_dmesg 3625620_1.5.2.4.1> 2023-05-28T09:15:14.712887 2023-05-28T09:15:14.822508 / # # 2023-05-28T09:15:14.926243 export SHELL=/bin/sh 2023-05-28T09:15:14.927177 # 2023-05-28T09:15:15.029487 / # export SHELL=/bin/sh. /lava-3625620/environment 2023-05-28T09:15:15.030588 2023-05-28T09:15:15.133021 / # . /lava-3625620/environment/lava-3625620/bin/lava-test-runner /lava-3625620/1 2023-05-28T09:15:15.134755 2023-05-28T09:15:15.139497 / # /lava-3625620/bin/lava-test-runner /lava-3625620/1 ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ hip07-d05 | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b85d93bd7dfec2e8604 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-hip07-d05.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-hip07-d05.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b85d93bd7dfec2e8605 new failure (last pass: v4.19.283-108-g3ae5a16f9ea28) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ meson-gxbb-nanopi-k2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731a70340d664ab02e85ef Results: 5 PASS, 1 FAIL, 1 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64731a70340d664ab02e85f4 new failure (last pass: v4.19.283-108-g3ae5a16f9ea28) 2023-05-28T09:09:44.586700 + set +x<8>[ 16.257554] <LAVA_SIGNAL_ENDRUN 0_dmesg 3625601_1.5.2.4.1> 2023-05-28T09:09:44.586992 2023-05-28T09:09:44.692599 / # # 2023-05-28T09:09:44.794542 export SHELL=/bin/sh 2023-05-28T09:09:44.795062 # 2023-05-28T09:09:44.896524 / # export SHELL=/bin/sh. /lava-3625601/environment 2023-05-28T09:09:44.897001 2023-05-28T09:09:44.998479 / # . /lava-3625601/environment/lava-3625601/bin/lava-test-runner /lava-3625601/1 2023-05-28T09:09:44.999172 2023-05-28T09:09:45.017531 / # /lava-3625601/bin/lava-test-runner /lava-3625601/1 ... (18 line(s) more) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b78d93bd7dfec2e85f2 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b78d93bd7dfec2e85f3 failing since 383 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c5209e15fef4f2e85f2 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c5209e15fef4f2e85f3 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731c0b4cfdff573c2e860f Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c0b4cfdff573c2e8610 failing since 383 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731d60923f46e7162e8628 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731d60923f46e7162e8629 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b852b521486f42e85e8 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b852b521486f42e85e9 failing since 383 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c657c8ea467902e8663 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c657c8ea467902e8664 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b75d93bd7dfec2e85eb Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b75d93bd7dfec2e85ec failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c5309e15fef4f2e85f8 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c5309e15fef4f2e85f9 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731be39fa81753342e85fd Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731be39fa81753342e85fe failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731d73019c0b2d2b2e8616 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731d73019c0b2d2b2e8617 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b74bca29fd2002e8646 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b74bca29fd2002e8647 failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c787c8ea467902e86a2 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c787c8ea467902e86a3 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b76d93bd7dfec2e85ef Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b76d93bd7dfec2e85f0 failing since 383 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c5109e15fef4f2e85ed Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c5109e15fef4f2e85ee failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731be49fa81753342e8602 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731be49fa81753342e8603 failing since 383 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731d5f923f46e7162e8622 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731d5f923f46e7162e8623 failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b84d93bd7dfec2e8601 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b84d93bd7dfec2e8602 failing since 383 days (last pass: v4.19.241-58-g5e77acf6dbb6, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c4c09e15fef4f2e85e7 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c4c09e15fef4f2e85e8 failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b74652856c4ff2e85e9 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b74652856c4ff2e85ea failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c546a432e88242e8624 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c546a432e88242e8625 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731bbbdf3cef47cf2e862a Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731bbbdf3cef47cf2e862b failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731d878d7339ba7c2e8619 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731d878d7339ba7c2e861a failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/64731b70eda930de472e8616 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731b70eda930de472e8617 failing since 306 days (last pass: v4.19.230-58-gbd840138c177, first fail: v4.19.253-43-g91137b502cfbd) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64731c745d83a73b9c2e8615 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64731c745d83a73b9c2e8616 failing since 383 days (last pass: v4.19.241-58-g8b40d487da7e, first fail: v4.19.241-83-g0ec5709aa1da) platform | arch | lab | compiler | defconfig | regressions ---------------------------+-------+---------------+----------+----------------------------+------------ rk3399-gru-kevin | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 2 Details: https://kernelci.org/test/plan/id/64731c547c8ea467902e85e6 Results: 77 PASS, 5 FAIL, 1 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt HTML log: https://storage.kernelci.org//stable-rc/queue-4.19/v4.19.283-112-g8c8b7703c4422/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.bootrr.rockchip-usb2phy1-probed: https://kernelci.org/test/case/id/64731c547c8ea467902e85ec failing since 74 days (last pass: v4.19.275-252-gcb3c41fc75db9, first fail: v4.19.276-34-ge787294ce440f) 2023-05-28T09:15:06.199153 /lava-10491575/1/../bin/lava-test-case 2023-05-28T09:15:06.207439 <8>[ 37.252859] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-usb2phy1-probed RESULT=fail> * baseline.bootrr.rockchip-usb2phy0-probed: https://kernelci.org/test/case/id/64731c547c8ea467902e85ed failing since 74 days (last pass: v4.19.275-252-gcb3c41fc75db9, first fail: v4.19.276-34-ge787294ce440f) 2023-05-28T09:15:05.174725 /lava-10491575/1/../bin/lava-test-case 2023-05-28T09:15:05.183056 <8>[ 36.228663] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-usb2phy0-probed RESULT=fail>
