On Mon, Jul 08, 2019 at 02:23:36PM -0400, Rachel Sibley wrote: > Hello, > > We're seeing xfstests fail on multiple upstream kernels, most likely related > to a test harness issue, we are currently > investigating and will temporarily move it to the waived state to prevent > future failures while we debug. It's a testcase problem. xfstests upsteam renamed 2 testcases we run. I'll remove them from our hard coded stable testcase list. And do a sanity check of testcase availability before run them. Sorry for the noise. Thanks, Xiong > > Thanks, > Rachel > > On 7/8/19 2:05 PM, CKI Project wrote: > > Hello, > > > > We ran automated tests on a patchset that was proposed for merging into this > > kernel tree. The patches were applied to: > > > > Kernel repo: git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git > > Commit: 8584aaf1c326 - Linux 5.1.16 > > > > The results of these automated tests are provided below. > > > > Overall result: FAILED (see details below) > > Merge: OK > > Compile: OK > > Tests: FAILED > > > > > > > > One or more kernel tests failed: > > > > aarch64: > > ❌ xfstests: xfs > > > > ppc64le: > > ❌ xfstests: xfs > > > > x86_64: > > ❌ xfstests: xfs > > > > We hope that these logs can help you find the problem quickly. For the full > > detail on our testing procedures, please scroll to the bottom of this message. > > > > Please reply to this email if you have any questions about the tests that we > > ran or if you have any suggestions on how to make future tests more effective. > > > > ,-. ,-. > > ( C ) ( K ) Continuous > > `-',-.`-' Kernel > > ( I ) Integration > > `-' > > ______________________________________________________________________________ > > > > Merge testing > > ------------- > > > > We cloned this repository and checked out the following commit: > > > > Repo: git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git > > Commit: 8584aaf1c326 - Linux 5.1.16 > > > > > > We grabbed the e8dcb4c0c161 commit of the stable queue repository. > > > > We then merged the patchset with `git am`: > > > > bluetooth-fix-faulty-expression-for-minimum-encryption-key-size-check.patch > > signal-remove-the-wrong-signal_pending-check-in-restore_user_sigmask.patch > > netfilter-nf_flow_table-ignore-df-bit-setting.patch > > netfilter-nft_flow_offload-set-liberal-tracking-mode-for-tcp.patch > > netfilter-nft_flow_offload-don-t-offload-when-sequence-numbers-need-adjustment.patch > > netfilter-nft_flow_offload-ipcb-is-only-valid-for-ipv4-family.patch > > idr-fix-idr_get_next-race-with-idr_remove.patch > > hid-i2c-hid-add-iball-aer3-to-descriptor-override.patch > > asoc-cs4265-readable-register-too-low.patch > > asoc-ak4458-add-return-value-for-ak4458_probe.patch > > asoc-soc-pcm-be-dai-needs-prepare-when-pause-release.patch > > asoc-ak4458-rstn_control-return-a-non-zero-on-error-.patch > > spi-bitbang-fix-null-pointer-dereference-in-spi_unre.patch > > asoc-core-lock-client_mutex-while-removing-link-comp.patch > > iommu-vt-d-set-the-right-field-for-page-walk-snoop.patch > > hid-a4tech-fix-horizontal-scrolling.patch > > asoc-intel-baytrail-add-quirk-for-aegex-10-ru2-table.patch > > asoc-hda-fix-unbalanced-codec-dev-refcount-for-hda_d.patch > > drm-mediatek-fix-unbind-functions.patch > > drm-mediatek-unbind-components-in-mtk_drm_unbind.patch > > drm-mediatek-call-drm_atomic_helper_shutdown-when-un.patch > > drm-mediatek-clear-num_pipes-when-unbind-driver.patch > > drm-mediatek-call-mtk_dsi_stop-after-mtk_drm_crtc_at.patch > > asoc-max98090-remove-24-bit-format-support-if-rj-is-.patch > > asoc-sun4i-i2s-fix-sun8i-tx-channel-offset-mask.patch > > asoc-sun4i-i2s-add-offset-to-rx-channel-select.patch > > x86-cpu-add-more-icelake-model-numbers.patch > > usb-gadget-fusb300_udc-fix-memory-leak-of-fusb300-ep.patch > > usb-gadget-udc-lpc32xx-allocate-descriptor-with-gfp_.patch > > usb-gadget-dwc2-fix-zlp-handling.patch > > asoc-intel-cht_bsw_max98090-fix-kernel-oops-with-pla.patch > > asoc-intel-bytcht_es8316-fix-kernel-oops-with-platfo.patch > > asoc-intel-cht_bsw_nau8824-fix-kernel-oops-with-plat.patch > > asoc-intel-cht_bsw_rt5672-fix-kernel-oops-with-platf.patch > > asoc-core-move-dai-pre-links-initiation-to-snd_soc_i.patch > > alsa-hdac-fix-memory-release-for-sst-and-sof-drivers.patch > > soc-rt274-fix-internal-jack-assignment-in-set_jack-c.patch > > scsi-hpsa-correct-ioaccel2-chaining.patch > > gpio-pca953x-hack-to-fix-24-bit-gpio-expanders.patch > > drm-panel-orientation-quirks-add-quirk-for-gpd-pocke.patch > > drm-panel-orientation-quirks-add-quirk-for-gpd-micro.patch > > asoc-core-fix-deadlock-in-snd_soc_instantiate_card.patch > > asoc-intel-sst-fix-kmalloc-call-with-wrong-flags.patch > > platform-x86-asus-wmi-only-tell-ec-the-os-will-handl.patch > > platform-x86-intel-vbtn-report-switch-events-when-ev.patch > > platform-x86-mlx-platform-fix-parent-device-in-i2c-m.patch > > platform-mellanox-mlxreg-hotplug-add-devm_free_irq-c.patch > > i2c-pca-platform-fix-gpio-lookup-code.patch > > arm64-tlbflush-ensure-start-end-of-address-range-are.patch > > cpuset-restore-sanity-to-cpuset_cpus_allowed_fallbac.patch > > scripts-decode_stacktrace.sh-prefix-addr2line-with-c.patch > > mm-mlock.c-change-count_mm_mlocked_page_nr-return-ty.patch > > tracing-avoid-build-warning-with-have_nop_mcount.patch > > module-fix-livepatch-ftrace-module-text-permissions-.patch > > ftrace-fix-null-pointer-dereference-in-free_ftrace_f.patch > > ptrace-fix-ptracer_cred-handling-for-ptrace_traceme.patch > > crypto-user-prevent-operating-on-larval-algorithms.patch > > crypto-cryptd-fix-skcipher-instance-memory-leak.patch > > alsa-seq-fix-incorrect-order-of-dest_client-dest_ports-arguments.patch > > alsa-firewire-lib-fireworks-fix-miss-detection-of-received-midi-messages.patch > > alsa-line6-fix-write-on-zero-sized-buffer.patch > > alsa-usb-audio-fix-sign-unintended-sign-extension-on-left-shifts.patch > > alsa-hda-realtek-add-quirks-for-several-clevo-notebook-barebones.patch > > alsa-hda-realtek-change-front-mic-location-for-lenovo-m710q.patch > > dax-fix-xarray-entry-association-for-mixed-mappings.patch > > lib-mpi-fix-karactx-leak-in-mpi_powm.patch > > fs-userfaultfd.c-disable-irqs-for-fault_pending-and-event-locks.patch > > swap_readpage-avoid-blk_wake_io_task-if-synchronous.patch > > tracing-snapshot-resize-spare-buffer-if-size-changed.patch > > arm-dts-armada-xp-98dx3236-switch-to-armada-38x-uart-serial-node.patch > > arm64-kaslr-keep-modules-inside-module-region-when-kasan-is-enabled.patch > > drm-i915-ringbuffer-emit_invalidate-before-switch-context.patch > > drm-amd-powerplay-use-hardware-fan-control-if-no-powerplay-fan-table.patch > > drm-amdgpu-don-t-skip-display-settings-in-hwmgr_resume.patch > > drm-amdgpu-gfx9-use-reset-default-for-pa_sc_fifo_size.patch > > drm-virtio-move-drm_connector_update_edid_property-call.patch > > drm-etnaviv-add-missing-failure-path-to-destroy-suballoc.patch > > drm-imx-notify-drm-core-before-sending-event-during-crtc-disable.patch > > drm-imx-only-send-event-on-crtc-disable-if-kept-disabled.patch > > ftrace-x86-remove-possible-deadlock-between-register_kprobe-and-ftrace_run_update_code.patch > > mm-vmscan.c-prevent-useless-kswapd-loops.patch > > btrfs-ensure-replaced-device-doesn-t-have-pending-chunk-allocation.patch > > tty-rocket-fix-incorrect-forward-declaration-of-rp_i.patch > > s390-mm-fix-pxd_bad-with-folded-page-tables.patch > > kvm-x86-degrade-warn-to-pr_warn_ratelimited.patch > > kvm-lapic-fix-pending-interrupt-in-irr-blocked-by-software-disable-lapic.patch > > nfsd-fix-overflow-causing-non-working-mounts-on-1-tb-machines.patch > > svcrdma-ignore-source-port-when-computing-drc-hash.patch > > mips-fix-bounds-check-virt_addr_valid.patch > > mips-add-missing-ehb-in-mtc0-mfc0-sequence.patch > > mips-have-plain-make-calls-build-dtbs-for-selected-platforms.patch > > dmaengine-qcom-bam_dma-fix-completed-descriptors-count.patch > > dmaengine-imx-sdma-remove-bd_intr-for-channel0.patch > > dmaengine-jz4780-fix-an-endian-bug-in-irq-handler.patch > > fs-validate_fs_parser-should-default-to-n.patch > > > > Compile testing > > --------------- > > > > We compiled the kernel for 4 architectures: > > > > aarch64: > > build options: -j20 INSTALL_MOD_STRIP=1 targz-pkg > > configuration: https://artifacts.cki-project.org/builds/aarch64/kernel-stable_queue_5.1-aarch64-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.config > > kernel build: https://artifacts.cki-project.org/builds/aarch64/kernel-stable_queue_5.1-aarch64-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.tar.gz > > > > ppc64le: > > build options: -j20 INSTALL_MOD_STRIP=1 targz-pkg > > configuration: https://artifacts.cki-project.org/builds/ppc64le/kernel-stable_queue_5.1-ppc64le-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.config > > kernel build: https://artifacts.cki-project.org/builds/ppc64le/kernel-stable_queue_5.1-ppc64le-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.tar.gz > > > > s390x: > > build options: -j20 INSTALL_MOD_STRIP=1 targz-pkg > > configuration: https://artifacts.cki-project.org/builds/s390x/kernel-stable_queue_5.1-s390x-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.config > > kernel build: https://artifacts.cki-project.org/builds/s390x/kernel-stable_queue_5.1-s390x-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.tar.gz > > > > x86_64: > > build options: -j20 INSTALL_MOD_STRIP=1 targz-pkg > > configuration: https://artifacts.cki-project.org/builds/x86_64/kernel-stable_queue_5.1-x86_64-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.config > > kernel build: https://artifacts.cki-project.org/builds/x86_64/kernel-stable_queue_5.1-x86_64-609a7e57e3842f22eca1e7cac592f19c7cd69c8b.tar.gz > > > > > > Hardware testing > > ---------------- > > > > We booted each kernel and ran the following tests: > > > > aarch64: > > Host 1: > > ✅ Boot test [0] > > ❌ xfstests: xfs [1] > > 🚧 ✅ selinux-policy: serge-testsuite [2] > > > > Host 2: > > ✅ Boot test [0] > > ✅ LTP lite [3] > > ✅ Loopdev Sanity [4] > > ✅ AMTU (Abstract Machine Test Utility) [5] > > ✅ LTP: openposix test suite [6] > > ✅ audit: audit testsuite test [7] > > ✅ httpd: mod_ssl smoke sanity [8] > > ✅ iotop: sanity [9] > > ✅ Usex - version 1.9-29 [10] > > 🚧 ✅ Networking socket: fuzz [11] > > 🚧 ✅ tuned: tune-processes-through-perf [12] > > 🚧 ✅ storage: SCSI VPD [13] > > 🚧 ✅ stress: stress-ng [14] > > > > > > ppc64le: > > Host 1: > > ✅ Boot test [0] > > ✅ LTP lite [3] > > ✅ Loopdev Sanity [4] > > ✅ AMTU (Abstract Machine Test Utility) [5] > > ✅ LTP: openposix test suite [6] > > ✅ audit: audit testsuite test [7] > > ✅ httpd: mod_ssl smoke sanity [8] > > ✅ iotop: sanity [9] > > ✅ Usex - version 1.9-29 [10] > > 🚧 ✅ Networking socket: fuzz [11] > > 🚧 ✅ tuned: tune-processes-through-perf [12] > > > > Host 2: > > ✅ Boot test [0] > > ❌ xfstests: xfs [1] > > 🚧 ✅ selinux-policy: serge-testsuite [2] > > > > > > s390x: > > Host 1: > > ✅ Boot test [0] > > 🚧 ✅ selinux-policy: serge-testsuite [2] > > > > Host 2: > > ✅ Boot test [0] > > ✅ LTP lite [3] > > ✅ Loopdev Sanity [4] > > ✅ LTP: openposix test suite [6] > > ✅ audit: audit testsuite test [7] > > ✅ httpd: mod_ssl smoke sanity [8] > > ✅ iotop: sanity [9] > > 🚧 ✅ Networking socket: fuzz [11] > > 🚧 ✅ tuned: tune-processes-through-perf [12] > > 🚧 ✅ stress: stress-ng [14] > > > > > > x86_64: > > Host 1: > > ✅ Boot test [0] > > ✅ LTP lite [3] > > ✅ Loopdev Sanity [4] > > ✅ AMTU (Abstract Machine Test Utility) [5] > > ✅ LTP: openposix test suite [6] > > ✅ audit: audit testsuite test [7] > > ✅ httpd: mod_ssl smoke sanity [8] > > ✅ iotop: sanity [9] > > ✅ Usex - version 1.9-29 [10] > > 🚧 ✅ Networking socket: fuzz [11] > > 🚧 ✅ tuned: tune-processes-through-perf [12] > > 🚧 ✅ storage: SCSI VPD [13] > > 🚧 ✅ stress: stress-ng [14] > > > > Host 2: > > ✅ Boot test [0] > > ❌ xfstests: xfs [1] > > 🚧 ✅ selinux-policy: serge-testsuite [2] > > > > > > Test source: > > 💚 Pull requests are welcome for new tests or improvements to existing tests! > > [0]: https://github.com/CKI-project/tests-beaker/archive/master.zip#distribution/kpkginstall > > [1]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/filesystems/xfs/xfstests > > [2]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/packages/selinux-policy/serge-testsuite > > [3]: https://github.com/CKI-project/tests-beaker/archive/master.zip#distribution/ltp/lite > > [4]: https://github.com/CKI-project/tests-beaker/archive/master.zip#filesystems/loopdev/sanity > > [5]: https://github.com/CKI-project/tests-beaker/archive/master.zip#misc/amtu > > [6]: https://github.com/CKI-project/tests-beaker/archive/master.zip#distribution/ltp/openposix_testsuite > > [7]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/audit/audit-testsuite > > [8]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/httpd/mod_ssl-smoke > > [9]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/iotop/sanity > > [10]: https://github.com/CKI-project/tests-beaker/archive/master.zip#standards/usex/1.9-29 > > [11]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/networking/socket/fuzz > > [12]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/tuned/tune-processes-through-perf > > [13]: https://github.com/CKI-project/tests-beaker/archive/master.zip#storage/scsi/vpd > > [14]: https://github.com/CKI-project/tests-beaker/archive/master.zip#stress/stress-ng > > > > Waived tests (marked with 🚧) > > ----------------------------- > > This test run included waived tests. Such tests are executed but their results > > are not taken into account. Tests are waived when their results are not > > reliable enough, e.g. when they're just introduced or are being fixed. > > >
