Em Tue, 18 Dec 2018 07:31:23 -0800 (PST) "kernelci.org bot" <bot@xxxxxxxxxxxx> escreveu: > Test results for: > Tree: media > Branch: master > Kernel: v4.20-rc5-281-gd2b4387f3bdf > URL: https://git.linuxtv.org/media_tree.git > Commit: d2b4387f3bdf016e266d23cf657465f557721488 > Test plans: v4l2 > > Summary > ------- > 4 test groups results > > 1 | v4l2 | rk3399-gru-kevin | arm64 | 49 total: 17 PASS 6 FAIL 26 SKIP > 2 | v4l2 | rk3288-veyron-jaq | arm | 49 total: 17 PASS 6 FAIL 26 SKIP > 3 | v4l2 | qemu | arm64 | 115 total: 77 PASS 7 FAIL 31 SKIP > 4 | v4l2 | qemu | arm | 115 total: 77 PASS 7 FAIL 31 SKIP Please add, at linuxtv.org's wiki page, what each test actually means... > > --- > 1 | v4l2 | rk3399-gru-kevin | arm64 | 49 total: 17 PASS 6 FAIL 26 SKIP > > Config: defconfig > Lab Name: lab-collabora > Date: 2018-12-14 19:51:24.841000 > TXT log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm64/defconfig/lab-collabora/v4l2-rk3399-gru-kevin.txt > HTML log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm64/defconfig/lab-collabora/v4l2-rk3399-gru-kevin.html > Rootfs: http://storage.kernelci.org/images/rootfs/debian/stretch-v4l2/20181207.0/arm64/rootfs.cpio.gz > Test Git: git://linuxtv.org/v4l-utils.git > Test Commit: 7a118f166609c0d05c6447cc79484af37875d6fc > > > Output-ioctls - 5 tests: 0 PASS, 0 FAIL, 5 SKIP > > Buffer-ioctls-Input-0 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Required-ioctls - 2 tests: 2 PASS, 0 FAIL, 0 SKIP > > Input/Output-configuration-ioctls - 4 tests: 0 PASS, 0 FAIL, 4 SKIP > > Control-ioctls-Input-0 - 6 tests: 3 PASS, 2 FAIL, 1 SKIP > * VIDIOC_G/S/TRY_EXT_CTRLS: FAIL > * VIDIOC_QUERY_EXT_CTRL/QUERYMENU: FAIL ... for example, in this specific case, I have no idea what driver failed. Ok, one could open the log txt file, look on it and discover that this specific test was against the uvcvideo driver, but it is doubtful to expect that everybody would do that. The best would be to also c/c the developer of the specific driver, if listed at MAINTAINERS, as he is the one that should come up with a fix. I also think that the patch subject should be changed to reflect the actual problems that was got, e. g., something like: [KernelCI] v4l2-compliance: uvcvideo: 6 failures, driver_foo: 8 failures > > Codec-ioctls-Input-0 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Debug-ioctls - 2 tests: 0 PASS, 0 FAIL, 2 SKIP > > Format-ioctls-Input-0 - 10 tests: 4 PASS, 1 FAIL, 5 SKIP > * VIDIOC_G/S_PARM: FAIL > > Streaming-ioctls_Test-input-0 - 4 tests: 1 PASS, 2 FAIL, 1 SKIP > * USERPTR: FAIL > * MMAP: FAIL > > Input-ioctls - 6 tests: 1 PASS, 0 FAIL, 5 SKIP > > Allow-for-multiple-opens - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > 2 | v4l2 | rk3288-veyron-jaq | arm | 49 total: 17 PASS 6 FAIL 26 SKIP > > Config: multi_v7_defconfig > Lab Name: lab-collabora > Date: 2018-12-14 19:51:35.774000 > TXT log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm/multi_v7_defconfig/lab-collabora/v4l2-rk3288-veyron-jaq.txt > HTML log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm/multi_v7_defconfig/lab-collabora/v4l2-rk3288-veyron-jaq.html > Rootfs: http://storage.kernelci.org/images/rootfs/debian/stretch-v4l2/20181207.0/armhf/rootfs.cpio.gz > Test Git: git://linuxtv.org/v4l-utils.git > Test Commit: 7a118f166609c0d05c6447cc79484af37875d6fc > > > Output-ioctls - 5 tests: 0 PASS, 0 FAIL, 5 SKIP > > Buffer-ioctls-Input-0 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Required-ioctls - 2 tests: 2 PASS, 0 FAIL, 0 SKIP > > Input/Output-configuration-ioctls - 4 tests: 0 PASS, 0 FAIL, 4 SKIP > > Control-ioctls-Input-0 - 6 tests: 3 PASS, 2 FAIL, 1 SKIP > * VIDIOC_G/S/TRY_EXT_CTRLS: FAIL > * VIDIOC_QUERY_EXT_CTRL/QUERYMENU: FAIL > > Codec-ioctls-Input-0 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Debug-ioctls - 2 tests: 0 PASS, 0 FAIL, 2 SKIP > > Format-ioctls-Input-0 - 10 tests: 4 PASS, 1 FAIL, 5 SKIP > * VIDIOC_G/S_PARM: FAIL > > Streaming-ioctls_Test-input-0 - 4 tests: 1 PASS, 2 FAIL, 1 SKIP > * USERPTR: FAIL > * MMAP: FAIL > > Input-ioctls - 6 tests: 1 PASS, 0 FAIL, 5 SKIP > > Allow-for-multiple-opens - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > 3 | v4l2 | qemu | arm64 | 115 total: 77 PASS 7 FAIL 31 SKIP > > Config: defconfig+virtualvideo > Lab Name: lab-collabora > Date: 2018-12-14 20:04:54.451000 > TXT log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm64/defconfig+virtualvideo/lab-collabora/v4l2-qemu.txt > HTML log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm64/defconfig+virtualvideo/lab-collabora/v4l2-qemu.html > Rootfs: http://storage.kernelci.org/images/rootfs/debian/stretch-v4l2/20181207.0/arm64/rootfs.cpio.gz > Test Git: git://linuxtv.org/v4l-utils.git > Test Commit: 7a118f166609c0d05c6447cc79484af37875d6fc > > > Buffer-ioctls-Input-3 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Buffer-ioctls-Input-2 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Buffer-ioctls-Input-1 - 3 tests: 1 PASS, 2 FAIL, 0 SKIP > * Requests: FAIL > * VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: FAIL > > Buffer-ioctls-Input-0 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Control-ioctls-Input-3 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Control-ioctls-Input-2 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Control-ioctls-Input-1 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Control-ioctls-Input-0 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Debug-ioctls - 2 tests: 1 PASS, 0 FAIL, 1 SKIP > > Format-ioctls-Input-2 - 10 tests: 9 PASS, 0 FAIL, 1 SKIP > > Format-ioctls-Input-3 - 10 tests: 9 PASS, 0 FAIL, 1 SKIP > > Format-ioctls-Input-0 - 10 tests: 6 PASS, 0 FAIL, 4 SKIP > > Format-ioctls-Input-1 - 10 tests: 5 PASS, 2 FAIL, 3 SKIP > * Scaling: FAIL > * VIDIOC_S_FMT: FAIL > > Required-ioctls - 2 tests: 2 PASS, 0 FAIL, 0 SKIP > > Input/Output-configuration-ioctls - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > Codec-ioctls-Input-2 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Codec-ioctls-Input-3 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Codec-ioctls-Input-0 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Codec-ioctls-Input-1 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Output-ioctls - 5 tests: 1 PASS, 0 FAIL, 4 SKIP > > Streaming-ioctls_Test-input-0 - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > Input-ioctls - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Allow-for-multiple-opens - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > 4 | v4l2 | qemu | arm | 115 total: 77 PASS 7 FAIL 31 SKIP > > Config: multi_v7_defconfig+virtualvideo > Lab Name: lab-collabora > Date: 2018-12-14 20:10:05.962000 > TXT log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm/multi_v7_defconfig+virtualvideo/lab-collabora/v4l2-qemu.txt > HTML log: https://storage.kernelci.org//media/master/v4.20-rc5-281-gd2b4387f3bdf/arm/multi_v7_defconfig+virtualvideo/lab-collabora/v4l2-qemu.html > Rootfs: http://storage.kernelci.org/images/rootfs/debian/stretch-v4l2/20181207.0/armhf/rootfs.cpio.gz > Test Git: git://linuxtv.org/v4l-utils.git > Test Commit: 7a118f166609c0d05c6447cc79484af37875d6fc > > > Buffer-ioctls-Input-3 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Buffer-ioctls-Input-2 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Buffer-ioctls-Input-1 - 3 tests: 1 PASS, 2 FAIL, 0 SKIP > * Requests: FAIL > * VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: FAIL > > Buffer-ioctls-Input-0 - 3 tests: 2 PASS, 1 FAIL, 0 SKIP > * Requests: FAIL > > Control-ioctls-Input-3 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Control-ioctls-Input-2 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Control-ioctls-Input-1 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Control-ioctls-Input-0 - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Debug-ioctls - 2 tests: 1 PASS, 0 FAIL, 1 SKIP > > Format-ioctls-Input-2 - 10 tests: 9 PASS, 0 FAIL, 1 SKIP > > Format-ioctls-Input-3 - 10 tests: 9 PASS, 0 FAIL, 1 SKIP > > Format-ioctls-Input-0 - 10 tests: 6 PASS, 0 FAIL, 4 SKIP > > Format-ioctls-Input-1 - 10 tests: 5 PASS, 2 FAIL, 3 SKIP > * Scaling: FAIL > * VIDIOC_S_FMT: FAIL > > Required-ioctls - 2 tests: 2 PASS, 0 FAIL, 0 SKIP > > Input/Output-configuration-ioctls - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > Codec-ioctls-Input-2 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Codec-ioctls-Input-3 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Codec-ioctls-Input-0 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Codec-ioctls-Input-1 - 3 tests: 0 PASS, 0 FAIL, 3 SKIP > > Output-ioctls - 5 tests: 1 PASS, 0 FAIL, 4 SKIP > > Streaming-ioctls_Test-input-0 - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > > Input-ioctls - 6 tests: 5 PASS, 0 FAIL, 1 SKIP > > Allow-for-multiple-opens - 4 tests: 4 PASS, 0 FAIL, 0 SKIP > Again, I would simplify the report, printing only a summary of the failures. You can store a less summarized report at the KernelCI storage server. Thanks, Mauro
