stable-rc/queue/5.4 baseline: 167 runs, 30 regressions (v5.4.243-131-ge7068990c0540) Regressions Summary ------------------- platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ cubietruck | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 hifive-unleashed-a00 | riscv | lab-baylibre | gcc-10 | defconfig | 1 hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...6-chromebook | 1 hp-x360-14-G1-sona | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...6-chromebook | 1 odroid-xu3 | arm | lab-collabora | gcc-10 | exynos_defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 sun8i-h3-libretech-all-h3-cc | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 Details: https://kernelci.org/test/job/stable-rc/branch/queue%2F5.4/kernel/v5.4.243-131-ge7068990c0540/plan/baseline/ Test: baseline Tree: stable-rc Branch: queue/5.4 Describe: v5.4.243-131-ge7068990c0540 URL: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git SHA: e7068990c05400e5355be5c1e9334b767cfcc425 Test Regressions ---------------- platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ cubietruck | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 Details: https://kernelci.org/test/plan/id/647139484704a150c52e85e9 Results: 5 PASS, 1 FAIL, 1 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/armel/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/647139484704a150c52e85ee failing since 116 days (last pass: v5.4.230-81-g2ad0dc06d587, first fail: v5.4.230-108-g761a8268d868) 2023-05-26T22:56:44.976237 <8>[ 9.910144] <LAVA_SIGNAL_ENDRUN 0_dmesg 3621546_1.5.2.4.1> 2023-05-26T22:56:45.087401 2023-05-26T22:56:45.189828 / # #export SHELL=/bin/sh 2023-05-26T22:56:45.190736 2023-05-26T22:56:45.292638 / # export SHELL=/bin/sh. /lava-3621546/environment 2023-05-26T22:56:45.293488 2023-05-26T22:56:45.395510 / # . /lava-3621546/environment/lava-3621546/bin/lava-test-runner /lava-3621546/1 2023-05-26T22:56:45.397026 2023-05-26T22:56:45.401492 / # /lava-3621546/bin/lava-test-runner /lava-3621546/1 2023-05-26T22:56:45.464954 <3>[ 10.399872] Bluetooth: hci0: command 0xfc18 tx timeout ... (12 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hifive-unleashed-a00 | riscv | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/6471373c92b39c37a02e86c4 Results: 3 PASS, 2 FAIL, 2 SKIP Full config: defconfig Compiler: gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/riscv/rootfs.cpio.gz * baseline.dmesg.crit: https://kernelci.org/test/case/id/6471373c92b39c37a02e86cd failing since 219 days (last pass: v5.4.219-270-gde284a6cd1e4, first fail: v5.4.219-266-g5eb28a6c7901) 3 lines 2023-05-26T22:48:06.115964 / # 2023-05-26T22:48:06.116844 2023-05-26T22:48:08.180730 / # # 2023-05-26T22:48:08.181604 # 2023-05-26T22:48:10.193641 / # export SHELL=/bin/sh 2023-05-26T22:48:10.194094 export SHELL=/bin/sh 2023-05-26T22:48:12.209242 / # . /lava-3621469/environment 2023-05-26T22:48:12.209659 . /lava-3621469/environment 2023-05-26T22:48:14.225211 / # /lava-3621469/bin/lava-test-runner /lava-3621469/0 2023-05-26T22:48:14.227252 /lava-3621469/bin/lava-test-runner /lava-3621469/0 ... (9 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...6-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713d132d6dc6ff5c2e867f Results: 5 PASS, 1 FAIL, 1 SKIP Full config: x86_64_defconfig+x86-chromebook Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/x86/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64713d132d6dc6ff5c2e8684 failing since 59 days (last pass: v5.4.238-29-g39c31e43e3b2b, first fail: v5.4.238-60-gcf51829325af) 2023-05-26T23:13:06.016392 + set<8>[ 11.358981] <LAVA_SIGNAL_ENDRUN 0_dmesg 10474461_1.4.2.3.1> 2023-05-26T23:13:06.016483 +x 2023-05-26T23:13:06.118183 # 2023-05-26T23:13:06.118485 2023-05-26T23:13:06.219103 / # #export SHELL=/bin/sh 2023-05-26T23:13:06.219329 2023-05-26T23:13:06.319954 / # export SHELL=/bin/sh. /lava-10474461/environment 2023-05-26T23:13:06.320179 2023-05-26T23:13:06.420755 / # . /lava-10474461/environment/lava-10474461/bin/lava-test-runner /lava-10474461/1 2023-05-26T23:13:06.421060 ... (13 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ hp-x360-14-G1-sona | x86_64 | lab-collabora | gcc-10 | x86_64_defcon...6-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713bd49cecace15f2e85f3 Results: 5 PASS, 1 FAIL, 1 SKIP Full config: x86_64_defconfig+x86-chromebook Compiler: gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/x86/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64713bd49cecace15f2e85f8 failing since 59 days (last pass: v5.4.238-29-g39c31e43e3b2b, first fail: v5.4.238-60-gcf51829325af) 2023-05-26T23:07:44.384454 <8>[ 12.685593] <LAVA_SIGNAL_ENDRUN 0_dmesg 10474484_1.4.2.3.1> 2023-05-26T23:07:44.387779 + set +x 2023-05-26T23:07:44.489802 # 2023-05-26T23:07:44.491414 2023-05-26T23:07:44.593842 / # #export SHELL=/bin/sh 2023-05-26T23:07:44.594734 2023-05-26T23:07:44.696321 / # export SHELL=/bin/sh. /lava-10474484/environment 2023-05-26T23:07:44.697244 2023-05-26T23:07:44.798922 / # . /lava-10474484/environment/lava-10474484/bin/lava-test-runner /lava-10474484/1 2023-05-26T23:07:44.799490 ... (13 line(s) more) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ odroid-xu3 | arm | lab-collabora | gcc-10 | exynos_defconfig | 1 Details: https://kernelci.org/test/plan/id/647136fc3de13091092e862e Results: 0 PASS, 1 FAIL, 0 SKIP Full config: exynos_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm/exynos_defconfig/gcc-10/lab-collabora/baseline-odroid-xu3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm/exynos_defconfig/gcc-10/lab-collabora/baseline-odroid-xu3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/armel/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647136fc3de13091092e862f new failure (last pass: v5.4.243-123-gaa637985c9f5) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138be6bf497079c2e8603 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138be6bf497079c2e8604 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713ba5c70ec03b472e863d Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713ba5c70ec03b472e863e failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138c60c6e4918432e85f6 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138c60c6e4918432e85f7 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713d2520b3e2d1e32e85fb Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713d2520b3e2d1e32e85fc failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138b355a508e8802e862f Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138b355a508e8802e8630 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713b95c70ec03b472e85ea Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713b95c70ec03b472e85eb failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138aa3e2ae5175b2e8621 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138aa3e2ae5175b2e8622 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713ba4c70ec03b472e863a Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713ba4c70ec03b472e863b failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138c579c78e60142e85e8 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138c579c78e60142e85e9 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713ce9461e8ab60e2e86b6 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713ce9461e8ab60e2e86b7 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/6471389fb851cd80e92e8673 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/6471389fb851cd80e92e8674 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv2-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713b9470f40e3f782e85e6 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713b9470f40e3f782e85e7 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138c00c6e4918432e85f0 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138c00c6e4918432e85f1 failing since 381 days (last pass: v5.4.191-77-g1a3b249e415b, first fail: v5.4.191-125-g5917d1547e6e) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713ba6c70ec03b472e8640 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713ba6c70ec03b472e8641 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138ed00f0f31de12e863c Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138ed00f0f31de12e863d failing since 381 days (last pass: v5.4.191-77-g1a3b249e415b, first fail: v5.4.191-125-g5917d1547e6e) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713d4d3430dab92e2e86c2 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713d4d3430dab92e2e86c3 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138c7510a3bd53f2e85e8 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138c7510a3bd53f2e85e9 failing since 381 days (last pass: v5.4.191-77-g1a3b249e415b, first fail: v5.4.191-125-g5917d1547e6e) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3 | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713b98c70ec03b472e85f3 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713b98c70ec03b472e85f4 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138bf6bf497079c2e8606 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138bf6bf497079c2e8607 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-baylibre | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713ba2c70ec03b472e8637 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713ba2c70ec03b472e8638 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138d9510a3bd53f2e85f2 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138d9510a3bd53f2e85f3 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-broonie | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713bbd67d12355dc2e8626 Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713bbd67d12355dc2e8627 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig | 1 Details: https://kernelci.org/test/plan/id/647138b46bf497079c2e85eb Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/647138b46bf497079c2e85ec failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ qemu_arm64-virt-gicv3-uefi | arm64 | lab-collabora | gcc-10 | defconfig+arm64-chromebook | 1 Details: https://kernelci.org/test/plan/id/64713b93dd0bba33e92e85ef Results: 0 PASS, 1 FAIL, 0 SKIP Full config: defconfig+arm64-chromebook Compiler: gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/arm64/rootfs.cpio.gz * baseline.login: https://kernelci.org/test/case/id/64713b93dd0bba33e92e85f0 failing since 304 days (last pass: v5.4.180-77-g7de29e82b9db, first fail: v5.4.207-73-ga2480f1b1dda1) platform | arch | lab | compiler | defconfig | regressions -----------------------------+--------+---------------+----------+------------------------------+------------ sun8i-h3-libretech-all-h3-cc | arm | lab-baylibre | gcc-10 | multi_v7_defconfig | 1 Details: https://kernelci.org/test/plan/id/64713896b851cd80e92e8653 Results: 5 PASS, 1 FAIL, 1 SKIP Full config: multi_v7_defconfig Compiler: gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110) Plain log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.txt HTML log: https://storage.kernelci.org//stable-rc/queue-5.4/v5.4.243-131-ge7068990c0540/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.html Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230519.0/armel/rootfs.cpio.gz * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64713896b851cd80e92e8658 failing since 114 days (last pass: v5.4.230-108-g761a8268d868, first fail: v5.4.230-109-g0a6085bff265) 2023-05-26T22:54:04.160759 / # # 2023-05-26T22:54:04.262694 export SHELL=/bin/sh 2023-05-26T22:54:04.263109 # 2023-05-26T22:54:04.364451 / # export SHELL=/bin/sh. /lava-3621550/environment 2023-05-26T22:54:04.365007 2023-05-26T22:54:04.466379 / # . /lava-3621550/environment/lava-3621550/bin/lava-test-runner /lava-3621550/1 2023-05-26T22:54:04.467113 2023-05-26T22:54:04.472510 / # /lava-3621550/bin/lava-test-runner /lava-3621550/1 2023-05-26T22:54:04.559365 + export 'TESTRUN_ID=1_bootrr' 2023-05-26T22:54:04.559673 + cd /lava-3621550/1/tests/1_bootrr ... (10 line(s) more)
