I've been experiencing system freezes that require a hard reset with the power button, starting from v6.8-rc1. The warnings produced suggest a wireless-related issue, and the bisection seems to confirm this. The freezes usually occur right after resuming from S3 (suspend). To reproduce the issue, I just suspend (`sudo systemctl suspend`) and resume (press any key on keyboard) a few times until the freeze happens. It takes 4-5 cycles of this most of the time, though it varies a lot. The upshot of all of this is that S3 (and S4 as well, see below) are pretty much unusable for me, due to the risk of losing work due to a freeze. Since a hard reset causes the systemd journal to be dropped, I set up [kdumpst](https://gitlab.freedesktop.org/gpiccoli/kdumpst) so that I could record dmesg output at the time of the freeze. I've linked to the crash logs produced by that tool for every bad commit in the bisection (except in cases where I couldn't get the kdump to happen - see the comments in the bisection log below), as well as a crash log triggered by SysRq (Alt+SysRq+c) on a good commit for comparison. I've already submitted this as an Arch Linux bug report: https://gitlab.archlinux.org/archlinux/packaging/packages/linux/-/issues/61 The freezes have also occurred (seemingly) at random times, although this is quite rare. They do seem to be more likely to occur after the system has been hibernated, although I don't really have any way to confirm this. Git bisect log: git bisect start # status: waiting for both good and bad commits # bad: [83a7eefedc9b56fe7bfeff13b6c7356688ffa670] Linux 6.10-rc3 git bisect bad 83a7eefedc9b56fe7bfeff13b6c7356688ffa670 # good: [e8f897f4afef0031fe618a8e94127a0934896aba] Linux 6.8 git bisect good e8f897f4afef0031fe618a8e94127a0934896aba # bad: [445e60303883950161f67e18b9f048b18d7fb706] Merge branch '1GbE' of git://git.kernel.org/pub/scm/linux/kernel/git/tnguy/next-queue git bisect bad 445e60303883950161f67e18b9f048b18d7fb706 # bad: [e5e038b7ae9da96b93974bf072ca1876899a01a3] Merge tag 'fs_for_v6.9-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/jack/linux-fs # this one froze on the first suspend/resume git bisect bad e5e038b7ae9da96b93974bf072ca1876899a01a3 # good: [1f440397665f4241346e4cc6d93f8b73880815d1] Merge tag 'docs-6.9' of git://git.lwn.net/linux git bisect good 1f440397665f4241346e4cc6d93f8b73880815d1 # bad: [a2f24c8a955c8f941d6ac08dd7f401f54eef4627] Merge branch 'mptcp-some-clean-up-patches' git bisect bad a2f24c8a955c8f941d6ac08dd7f401f54eef4627 # bad: [26f4dac11775a1ca24e2605cb30e828d4dbdea93] netfilter: x_tables: Use unsafe_memcpy() for 0-sized destination # This one was very hard to reproduce - it must have taken 25-30 cycles total, and I hibernated the system twice git bisect bad 26f4dac11775a1ca24e2605cb30e828d4dbdea93 # good: [4f5e5092fdbf5cec6bedc19fbe69cce4f5f08372] Merge tag 'net-6.8-rc5' of git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net git bisect good 4f5e5092fdbf5cec6bedc19fbe69cce4f5f08372 # good: [b4e8ae5c8c41355791a99fdf2fcac16deace1e79] net: add napi_busy_loop_rcu() git bisect good b4e8ae5c8c41355791a99fdf2fcac16deace1e79 # bad: [20ea9327c2fd545d6b96e998727bcd724290694d] net: dccp: Simplify the allocation of slab caches in dccp_ackvec_init git bisect bad 20ea9327c2fd545d6b96e998727bcd724290694d # bad: [92046e83c07b064ca65ac4ae7660a540016bdfc1] Merge tag 'for-netdev' of https://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next git bisect bad 92046e83c07b064ca65ac4ae7660a540016bdfc1 # bad: [b54846da45942bbe4e5ebc59d497e4a48525ba5a] Merge tag 'wireless-next-2024-01-25' of git://git.kernel.org/pub/scm/linux/kernel/git/wireless/wireless-next git bisect bad b54846da45942bbe4e5ebc59d497e4a48525ba5a # good: [3832a9c40b356500c5b85a6fdf9577c590fcd637] wifi: rtw89: fw: extend JOIN H2C command to support WiFi 7 chips git bisect good 3832a9c40b356500c5b85a6fdf9577c590fcd637 # bad: [5ba45ba77616637e554d66a57ef0334e5cc2efe4] wifi: rtw89: fix disabling concurrent mode TX hang issue # I see the same kernel warnings here as with the other bad commits. # However, there is no crash after a few suspend/resume cycles - instead # the system simply restarts when I trigger the nth suspend. I'm not # able to trigger a crash with SysRq either (Alt+SysRq+c) - again, the # system restarts. This is the case with all bad commits after this. git bisect bad 5ba45ba77616637e554d66a57ef0334e5cc2efe4 # good: [85da8f71aaa7b83ea7ef0e89182e0cd47e16d465] wifi: brcmfmac: Demote vendor-specific attach/detach messages to info git bisect good 85da8f71aaa7b83ea7ef0e89182e0cd47e16d465 # good: [295304040d9f6f350b68652acd99650c7e16d0a8] wifi: rtw89: 8922a: add TX power related ops git bisect good 295304040d9f6f350b68652acd99650c7e16d0a8 # good: [7cf6b6764b2f665d317ba0f91c247437019a2f4c] wifi: rtw89: Set default CQM config if not present git bisect good 7cf6b6764b2f665d317ba0f91c247437019a2f4c # good: [7e11a2966f51695c0af0b1f976a32d64dee243b2] wifi: rtw89: fix null pointer access when abort scan git bisect good 7e11a2966f51695c0af0b1f976a32d64dee243b2 # bad: [f59a98c82534e986b06615ba94e060aa3129b08b] wifi: rtw89: fix HW scan timeout due to TSF sync issue git bisect bad f59a98c82534e986b06615ba94e060aa3129b08b # bad: [bcbefbd032df6bfe925e6afeca82eb9d2cc0cb23] wifi: rtw89: add wait/completion for abort scan git bisect bad bcbefbd032df6bfe925e6afeca82eb9d2cc0cb23 # first bad commit: [bcbefbd032df6bfe925e6afeca82eb9d2cc0cb23] wifi: rtw89: add wait/completion for abort scan #regzbot introduced: bcbefbd032df6bfe925e6afeca82eb9d2cc0cb23 Logs produced by kdumpst: [kdumpst-e5e038b7ae9da96b93974bf072ca1876899a01a3.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/b925cb5e9c6cfb6b224993c017ba61f5/kdumpst-e5e038b7ae9da96b93974bf072ca1876899a01a3.zip) [kdumpst-b54846da45942bbe4e5ebc59d497e4a48525ba5a.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/e1610c3ae26971a890121d3a5eb8fa9e/kdumpst-b54846da45942bbe4e5ebc59d497e4a48525ba5a.zip) [kdumpst-a2f24c8a955c8f941d6ac08dd7f401f54eef4627.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/34171a87da304987cc8ce5066fc35dd5/kdumpst-a2f24c8a955c8f941d6ac08dd7f401f54eef4627.zip) [kdumpst-92046e83c07b064ca65ac4ae7660a540016bdfc1.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/67d756f963ffafd0b332c88701286a30/kdumpst-92046e83c07b064ca65ac4ae7660a540016bdfc1.zip) [kdumpst-445e60303883950161f67e18b9f048b18d7fb706.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/f75f91d127050a327114bf904f335087/kdumpst-445e60303883950161f67e18b9f048b18d7fb706.zip) [kdumpst-26f4dac11775a1ca24e2605cb30e828d4dbdea93.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/f3d26fc4187c8b8854386fed6f15c972/kdumpst-26f4dac11775a1ca24e2605cb30e828d4dbdea93.zip) [kdumpst-20ea9327c2fd545d6b96e998727bcd724290694d.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/8618207aff0eb92413ce0c2994c7888f/kdumpst-20ea9327c2fd545d6b96e998727bcd724290694d.zip) Good commit: [kdumpst-e8f897f4afef0031fe618a8e94127a0934896aba.zip](https://gitlab.archlinux.org/archlinux/packaging/packages/linux/uploads/b13b3914e50fc85548c77a4163dec383/kdumpst-e8f897f4afef0031fe618a8e94127a0934896aba.zip) --
