Hello Stanislaw! On Mon, Oct 2, 2023 at 2:50 PM Stanislaw Gruszka <stf_xl@xxxxx> wrote: > > Is possible that this is rt2800usb or usb host driver issue. But without > full logs we can not be sure. Okay, I was able to use dmesg -w before it kernel panic'd to grab some additional details, first this is when I plug in th USB WiFi adapter but I have it not automatically connect. In this state, it will not kernel panic: [ 1496.115251] usb 1-3.4: new high-speed USB device number 7 using tegra-xusb [ 1496.333698] usb 1-3.4: New USB device found, idVendor=148f, idProduct=5370, bcdDevice= 1.01 [ 1496.333707] usb 1-3.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 1496.333712] usb 1-3.4: Product: 802.11 n WLAN [ 1496.333716] usb 1-3.4: Manufacturer: Ralink [ 1496.333719] usb 1-3.4: SerialNumber: 1.0 [ 1497.187704] usb 1-3.4: reset high-speed USB device number 7 using tegra-xusb [ 1497.399765] ieee80211 phy0: rt2x00_set_rt: Info - RT chipset 5390, rev 0502 detected [ 1497.574025] ieee80211 phy0: rt2x00_set_rf: Info - RF chipset 5370 detected [ 1497.575366] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht' [ 1497.577940] usbcore: registered new interface driver rt2800usb [ 1497.744748] ieee80211 phy0: rt2x00lib_request_firmware: Info - Loading firmware file 'rt2870.bin' [ 1497.747318] ieee80211 phy0: rt2x00lib_request_firmware: Info - Firmware detected - version: 0.36 Then, I tell it to connect to a local network, and I see a loop of errors over and over before it eventually panics: (I just copied in a few of them since many of these repeated over and over: [ 1541.821783] wlan0: authenticate with 6c:4b:b4:30:9b:04 [ 1542.000817] wlan0: send auth to 6c:4b:b4:30:9b:04 (try 1/3) [ 1542.002490] wlan0: authenticated [ 1542.006241] wlan0: associate with 6c:4b:b4:30:9b:04 (try 1/3) [ 1542.010192] wlan0: RX AssocResp from 6c:4b:b4:30:9b:04 (capab=0x411 status=0 aid=14) [ 1542.050657] wlan0: associated [ 1542.075032] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready [ 1542.091614] wlan0: Limiting TX power to 30 (30 - 0) dBm as advertised by 6c:4b:b4:30:9b:04 [ 1542.242112] BUG: scheduling while atomic: ksoftirqd/3/29/0x00000103 [ 1542.248587] Modules linked in: rt2800usb(E) rt2x00usb(E) rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE) fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E) loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E) snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E) snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E) snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E) input_leds(E) spidev(E) snd_soc_tegra210_adsp(E) snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E) snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E) userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E) tegra210_adma(E) nv_imx219(E) snd_hda_codec(E) [ 1542.248665] snd_hda_core(E) spi_tegra114(E) nvidia(OE) binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd] [ 1542.248686] CPU: 3 PID: 29 Comm: ksoftirqd/3 Tainted: G W OE 5.10.120-tegra #1 [ 1542.248687] Hardware name: Unknown NVIDIA Orin Nano Developer Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023 [ 1542.248690] Call trace: [ 1542.248702] dump_backtrace+0x0/0x1d0 [ 1542.248705] show_stack+0x30/0x40 [ 1542.248712] dump_stack+0xd8/0x138 [ 1542.248717] __schedule_bug+0x78/0x90 [ 1542.248722] __schedule+0x844/0x910 [ 1542.248724] schedule+0x78/0x110 [ 1542.248727] schedule_timeout+0x184/0x340 [ 1542.248731] nvhost_syncpt_wait_timeout+0x450/0x720 [ 1542.248733] nvhost_syncpt_wait_timeout_ext+0xf4/0x120 [ 1542.248738] tegra_se_channel_submit_gather.isra.0+0x160/0x440 [ 1542.248740] tegra_se_ccm_compute_auth+0x2d8/0x650 [ 1542.248743] tegra_se_aes_ccm_encrypt+0x6c/0x150 [ 1542.248746] crypto_aead_encrypt+0x38/0x50 [ 1542.248768] aead_encrypt+0x130/0x180 [mac80211] [ 1542.248782] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211] [ 1542.248793] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211] [ 1542.248803] ieee80211_proberesp_get+0x3ec/0x830 [mac80211] [ 1542.248814] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211] [ 1542.248824] ieee80211_xmit+0xa0/0xd0 [mac80211] [ 1542.248835] __ieee80211_subif_start_xmit+0x780/0xb10 [mac80211] [ 1542.248845] ieee80211_subif_start_xmit+0x5c/0x2f0 [mac80211] [ 1542.248850] dev_hard_start_xmit+0x10c/0x330 [ 1542.248855] sch_direct_xmit+0xf4/0x360 [ 1542.248857] __qdisc_run+0x140/0x730 [ 1542.248859] net_tx_action+0x14c/0x380 [ 1542.248862] __do_softirq+0x140/0x3e8 [ 1542.248865] run_ksoftirqd+0x50/0x60 [ 1542.248868] smpboot_thread_fn+0x1c4/0x280 [ 1542.248870] kthread+0x148/0x170 [ 1542.248872] ret_from_fork+0x10/0x24 [ 1542.248882] ------------[ cut here ]------------ [ 1542.248887] WARNING: CPU: 3 PID: 29 at kernel/rcu/tree_plugin.h:297 rcu_note_context_switch+0x50/0x540 [ 1542.258457] Modules linked in: rt2800usb(E) rt2x00usb(E) rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE) fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E) loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E) snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E) snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E) snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E) input_leds(E) spidev(E) snd_soc_tegra210_adsp(E) snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E) snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E) userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E) tegra210_adma(E) nv_imx219(E) snd_hda_codec(E) [ 1542.258510] snd_hda_core(E) spi_tegra114(E) nvidia(OE) binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd] [ 1542.258524] CPU: 3 PID: 29 Comm: ksoftirqd/3 Tainted: G W OE 5.10.120-tegra #1 [ 1542.258525] Hardware name: Unknown NVIDIA Orin Nano Developer Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023 [ 1542.258529] pstate: 20c00089 (nzCv daIf +PAN +UAO -TCO BTYPE=--) [ 1542.258532] pc : rcu_note_context_switch+0x50/0x540 [ 1542.258535] lr : rcu_note_context_switch+0x28/0x540 [ 1542.258536] sp : ffff8000101e3270 [ 1542.258538] x29: ffff8000101e3270 x28: 0000000000000000 [ 1542.258541] x27: ffffb2b1e4fe7000 x26: ffffb2b1e49fbe00 [ 1542.258544] x25: 0000000000000000 x24: ffffb2b1e41c5858 [ 1542.258548] x23: ffff293a2e827e00 x22: ffff2938c0228ec0 [ 1542.258551] x21: 0000000000000000 x20: ffff2938c0228ec0 [ 1542.258554] x19: ffff293a2e828b00 x18: 0000000000000060 [ 1542.258557] x17: 0000000000018021 x16: ffffb2b1e2fe5220 [ 1542.258560] x15: ffff2938c0229430 x14: ffffffffffffffff [ 1542.258564] x13: ffff8000901e2d75 x12: ffff8000101e2d7e [ 1542.258567] x11: 0101010101010101 x10: ffffffffff7f7f7f [ 1542.258570] x9 : 00000000fffffffe x8 : 343278302f303178 [ 1542.258573] x7 : 302b6b726f665f6d x6 : 0000000000000002 [ 1542.258576] x5 : ffff80001001c000 x4 : ffffb2b1e4ff2000 [ 1542.258579] x3 : ffffb2b1e4ff2dc0 x2 : ffffb2b1e3180d70 [ 1542.258582] x1 : ffff8000101e3270 x0 : 0000000000000002 [ 1542.258585] Call trace: [ 1542.258589] rcu_note_context_switch+0x50/0x540 [ 1542.258592] __schedule+0xc0/0x910 [ 1542.258594] schedule+0x78/0x110 [ 1542.258597] schedule_timeout+0x184/0x340 [ 1542.258600] nvhost_syncpt_wait_timeout+0x450/0x720 [ 1542.258602] nvhost_syncpt_wait_timeout_ext+0xf4/0x120 [ 1542.258605] tegra_se_channel_submit_gather.isra.0+0x160/0x440 [ 1542.258607] tegra_se_ccm_compute_auth+0x2d8/0x650 [ 1542.258610] tegra_se_aes_ccm_encrypt+0x6c/0x150 [ 1542.258612] crypto_aead_encrypt+0x38/0x50 [ 1542.258625] aead_encrypt+0x130/0x180 [mac80211] [ 1542.258636] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211] [ 1542.258648] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211] [ 1542.258660] ieee80211_proberesp_get+0x3ec/0x830 [mac80211] [ 1542.258672] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211] [ 1542.258684] ieee80211_xmit+0xa0/0xd0 [mac80211] [ 1542.258695] __ieee80211_subif_start_xmit+0x780/0xb10 [mac80211] [ 1542.258707] ieee80211_subif_start_xmit+0x5c/0x2f0 [mac80211] [ 1542.258710] dev_hard_start_xmit+0x10c/0x330 [ 1542.258713] sch_direct_xmit+0xf4/0x360 [ 1542.258715] __qdisc_run+0x140/0x730 [ 1542.258718] net_tx_action+0x14c/0x380 [ 1542.258720] __do_softirq+0x140/0x3e8 [ 1542.258723] run_ksoftirqd+0x50/0x60 [ 1542.258726] smpboot_thread_fn+0x1c4/0x280 [ 1542.258728] kthread+0x148/0x170 [ 1542.258730] ret_from_fork+0x10/0x24 [ 1542.258732] ---[ end trace c64fbdc5cc928ac7 ]--- [ 1542.263555] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #280!!! [ 1542.271921] softirq: huh, entered softirq 2 NET_TX 00000000548727ea with preempt_count 00000100, exited with fffffffe? [ 1542.275488] BUG: scheduling while atomic: ksoftirqd/5/39/0x00000103 [ 1542.289407] Modules linked in: rt2800usb(E) rt2x00usb(E) rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE) fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E) loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E) snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E) snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E) snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E) input_leds(E) spidev(E) snd_soc_tegra210_adsp(E) snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E) snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E) userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E) tegra210_adma(E) nv_imx219(E) snd_hda_codec(E) [ 1542.289527] snd_hda_core(E) spi_tegra114(E) nvidia(OE) binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd] [ 1542.289559] CPU: 5 PID: 39 Comm: ksoftirqd/5 Tainted: G W OE 5.10.120-tegra #1 [ 1542.289563] Hardware name: Unknown NVIDIA Orin Nano Developer Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023 [ 1542.289566] Call trace: [ 1542.289578] dump_backtrace+0x0/0x1d0 [ 1542.289585] show_stack+0x30/0x40 [ 1542.289594] dump_stack+0xd8/0x138 [ 1542.289602] __schedule_bug+0x78/0x90 [ 1542.289609] __schedule+0x844/0x910 [ 1542.289613] schedule+0x78/0x110 [ 1542.289619] schedule_timeout+0x184/0x340 [ 1542.289625] nvhost_syncpt_wait_timeout+0x450/0x720 [ 1542.289629] nvhost_syncpt_wait_timeout_ext+0xf4/0x120 [ 1542.289636] tegra_se_channel_submit_gather.isra.0+0x160/0x440 [ 1542.289641] tegra_se_ccm_compute_auth+0x2d8/0x650 [ 1542.289646] tegra_se_aes_ccm_encrypt+0x6c/0x150 [ 1542.289651] crypto_aead_encrypt+0x38/0x50 [ 1542.289685] aead_encrypt+0x130/0x180 [mac80211] [ 1542.289711] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211] [ 1542.289735] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211] [ 1542.289757] ieee80211_proberesp_get+0x3ec/0x830 [mac80211] [ 1542.289779] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211] [ 1542.289801] ieee80211_xmit+0xa0/0xd0 [mac80211] [ 1542.289823] __ieee80211_subif_start_xmit+0x780/0xb10 [mac80211] [ 1542.289845] ieee80211_subif_start_xmit+0x5c/0x2f0 [mac80211] [ 1542.289852] dev_hard_start_xmit+0x10c/0x330 [ 1542.289858] sch_direct_xmit+0xf4/0x360 [ 1542.289862] __qdisc_run+0x140/0x730 [ 1542.289867] net_tx_action+0x14c/0x380 [ 1542.289871] __do_softirq+0x140/0x3e8 [ 1542.289876] run_ksoftirqd+0x50/0x60 [ 1542.289882] smpboot_thread_fn+0x1c4/0x280 [ 1542.289885] kthread+0x148/0x170 [ 1542.289890] ret_from_fork+0x10/0x24 [ 1542.290056] softirq: huh, entered softirq 2 NET_TX 00000000548727ea with preempt_count 00000100, exited with fffffffe? [ 1542.310049] BUG: scheduling while atomic: kworker/u12:0/3307/0x00000201 [ 1542.316883] Modules linked in: rt2800usb(E) rt2x00usb(E) rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE) fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E) loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E) snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E) snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E) snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E) input_leds(E) spidev(E) snd_soc_tegra210_adsp(E) snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E) snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E) userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E) tegra210_adma(E) nv_imx219(E) snd_hda_codec(E) [ 1542.316959] snd_hda_core(E) spi_tegra114(E) nvidia(OE) binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd] [ 1542.316981] CPU: 0 PID: 3307 Comm: kworker/u12:0 Tainted: G W OE 5.10.120-tegra #1 [ 1542.316983] Hardware name: Unknown NVIDIA Orin Nano Developer Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023 [ 1542.317008] Workqueue: phy0 ieee80211_ba_session_work [mac80211] [ 1542.317011] Call trace: [ 1542.317018] dump_backtrace+0x0/0x1d0 [ 1542.317022] show_stack+0x30/0x40 [ 1542.317029] dump_stack+0xd8/0x138 [ 1542.317033] __schedule_bug+0x78/0x90 [ 1542.317038] __schedule+0x844/0x910 [ 1542.317040] schedule+0x78/0x110 [ 1542.317044] schedule_timeout+0x184/0x340 [ 1542.317047] nvhost_syncpt_wait_timeout+0x450/0x720 [ 1542.317050] nvhost_syncpt_wait_timeout_ext+0xf4/0x120 [ 1542.317054] tegra_se_channel_submit_gather.isra.0+0x160/0x440 [ 1542.317057] tegra_se_ccm_compute_auth+0x2d8/0x650 [ 1542.317060] tegra_se_aes_ccm_encrypt+0x6c/0x150 [ 1542.317063] crypto_aead_encrypt+0x38/0x50 [ 1542.317080] aead_encrypt+0x130/0x180 [mac80211] [ 1542.317094] ieee80211_crypto_ccmp_encrypt+0x1f8/0x270 [mac80211] [ 1542.317108] ieee80211_txq_schedule_start+0xae4/0xc10 [mac80211] [ 1542.317121] ieee80211_proberesp_get+0x3ec/0x830 [mac80211] [ 1542.317135] ieee80211_tx_prepare_skb+0x27c/0x2d0 [mac80211] [ 1542.317148] ieee80211_xmit+0xa0/0xd0 [mac80211] [ 1542.317161] __ieee80211_tx_skb_tid_band+0x84/0xb0 [mac80211] [ 1542.317174] ieee80211_start_tx_ba_cb_irqsafe+0x300/0x3c0 [mac80211] [ 1542.317187] ieee80211_tx_ba_session_handle_start+0xec/0x1b0 [mac80211] [ 1542.317200] ieee80211_ba_session_work+0x2a0/0x350 [mac80211] [ 1542.317204] process_one_work+0x1c4/0x4a0 [ 1542.317206] worker_thread+0x54/0x430 [ 1542.317208] kthread+0x148/0x170 [ 1542.317211] ret_from_fork+0x10/0x24 [ 1542.317383] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/3307 last function: ieee80211_ba_session_work [mac80211] The last set of messages: [ 1575.970833] BUG: scheduling while atomic: NetworkManager/593/0xfffffdff [ 1575.977680] Modules linked in: rt2800usb(E) rt2x00usb(E) rt2800lib(E) rt2x00lib(E) mac80211(E) cfg80211(E) nvidia_modeset(OE) fuse(E) lzo_rle(E) lzo_compress(E) zram(E) ramoops(E) reed_solomon(E) loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_arad(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_iqc(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) snd_soc_tegra210_mvc(E) snd_soc_tegra210_afc(E) aes_ce_cipher(E) snd_soc_tegra210_dmic(E) snd_soc_tegra210_adx(E) ghash_ce(E) snd_soc_tegra210_amx(E) sha2_ce(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_mixer(E) snd_soc_tegra210_admaif(E) sha256_arm64(E) snd_soc_tegra210_sfc(E) snd_soc_tegra_pcm(E) hid_ite(E) sha1_ce(E) input_leds(E) spidev(E) snd_soc_tegra210_adsp(E) snd_soc_tegra_machine_driver(E) snd_soc_spdif_tx(E) snd_soc_tegra_utils(E) snd_soc_simple_card_utils(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_ahub(E) nvadsp(E) userspace_alert(E) snd_hda_tegra(E) tegra_bpmp_thermal(E) tegra210_adma(E) nv_imx219(E) snd_hda_codec(E) [ 1575.977790] snd_hda_core(E) spi_tegra114(E) nvidia(OE) binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd] [ 1575.977819] CPU: 4 PID: 593 Comm: NetworkManager Tainted: G W OE 5.10.120-tegra #1 [ 1575.977822] Hardware name: Unknown NVIDIA Orin Nano Developer Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023 [ 1575.977825] Call trace: [ 1575.977834] dump_backtrace+0x0/0x1d0 [ 1575.977840] show_stack+0x30/0x40 [ 1575.977846] dump_stack+0xd8/0x138 [ 1575.977852] __schedule_bug+0x78/0x90 [ 1575.977857] __schedule+0x844/0x910 [ 1575.977861] schedule+0x78/0x110 [ 1575.977867] schedule_hrtimeout_range_clock+0xa0/0x120 [ 1575.977872] schedule_hrtimeout_range+0x3c/0x50 [ 1575.977880] do_sys_poll+0x3d4/0x770 [ 1575.977885] __arm64_sys_ppoll+0xc0/0x100 [ 1575.977891] el0_svc_common.constprop.0+0x80/0x1d0 [ 1575.977896] do_el0_svc+0x38/0xb0 [ 1575.977900] el0_svc+0x1c/0x30 [ 1575.977904] el0_sync_handler+0xa8/0xb0 [ 1575.977908] el0_sync+0x16c/0x180 [ 1587.493670] wlan0: deauthenticating from 6c:4b:b4:30:9b:04 by local choice (Reason: 3=DEAUTH_LEAVING) Then at this point the communications were cut (I was using a wired interface to capture) >From the serial port, once I tell it to connect to the local network, this is all that is output before serial stops [ 533.875985] BUG: scheduling while atomic: ksoftirqd/0/12/0x00000103 [ 533.882790] WARNING: CPU: 0 PID: 12 at kernel/rcu/tree_plugin.h:297 rcu_note_context_switch+0x50/0x540 [ 533.892621] ---[ end trace a78168b0d15c7046 ]--- [ 533.897590] softirq: huh, entered softirq 2 NET_TX 00000000cca7c5d3 with preempt_count 00000100, exited with fffffffe? [ 533.941129] BUG: scheduling while atomic: ksoftirqd/2/24/0x00000103 [ 533.947928] softirq: huh, entered softirq 2 NET_TX 00000000cca7c5d3 with preempt_count 00000100, exited with fffffffe? [ 533.963887] BUG: scheduling while atomic: kworker/u12:3/722/0x00000201 [ 533.971012] BUG: workqueue leaked lock or atomic: kworker/u12:3/0xfffffe00/722 [ 533.971012] last function: ieee80211_ba_session_work [mac80211] [ 533.985079] BUG: workqueue leaked lock or atomic: kworker/u12:3/0xfffffe00/722 [ 533.985079] last function: ieee80211_ibss_leave [mac80211] [ 533.998657] BUG: scheduling while atomic: kworker/u12:3/722/0xfffffe01 [ 534.983931] BUG: scheduling while atomic: kworker/u12:0/7/0x00000102 [ 534.991172] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #02!!! [ 535.007609] softirq: huh, entered softirq 6 TASKLET 0000000048396bde with preempt_count 00000101, exited with 00000000? [ 535.018825] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201 [ 535.026005] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7 [ 535.026005] last function: ieee80211_ba_session_work [mac80211] [ 535.040029] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01 [ 535.056041] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201 [ 535.063242] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7 [ 535.063242] last function: ieee80211_ba_session_work [mac80211] [ 535.077144] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01 [ 535.084030] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #280!!! [ 535.854930] BUG: scheduling while atomic: NetworkManager/625/0x00000203 [ 535.862489] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #2c0!!! [ 535.870814] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #2c0!!! [ 535.887341] WARNING: CPU: 0 PID: 625 at kernel/softirq.c:174 __local_bh_enable_ip+0xac/0xc0 [ 535.896074] ---[ end trace a78168b0d15c7047 ]--- [ 535.900889] BUG: scheduling while atomic: NetworkManager/625/0xfffffdff [ 535.907957] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #2c2!!! [ 535.916279] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #2c2!!! [ 536.103830] BUG: scheduling while atomic: kworker/u12:0/7/0x00000102 [ 536.110787] softirq: huh, entered softirq 6 TASKLET 0000000048396bde with preempt_count 00000101, exited with 00000000? [ 536.121976] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201 [ 536.128931] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7 [ 536.128931] last function: ieee80211_ba_session_work [mac80211] [ 536.142827] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01 [ 536.149562] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #80!!! [ 536.157772] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #80!!! [ 536.187788] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201 [ 536.194783] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7 [ 536.194783] last function: ieee80211_ba_session_work [mac80211] [ 536.208655] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01 [ 536.215394] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #280!!! [ 537.227755] BUG: scheduling while atomic: kworker/u12:3/722/0x00000102 [ 537.234965] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #282!!! [ 537.251488] softirq: huh, entered softirq 6 TASKLET 0000000048396bde with preempt_count 00000101, exited with 00000000? [ 537.262678] BUG: scheduling while atomic: kworker/u12:3/722/0x00000201 [ 537.269960] BUG: workqueue leaked lock or atomic: kworker/u12:3/0xfffffe00/722 [ 537.269960] last function: ieee80211_ba_session_work [mac80211] [ 537.284025] BUG: workqueue leaked lock or atomic: kworker/u12:3/0xfffffe00/722 [ 537.284025] last function: ieee80211_ibss_leave [mac80211] [ 537.297583] BUG: scheduling while atomic: kworker/u12:3/722/0xfffffe01 [ 537.343746] BUG: scheduling while atomic: kworker/u12:3/722/0x00000201 [ 537.351032] BUG: workqueue leaked lock or atomic: kworker/u12:3/0xfffffe00/722 [ 537.351032] last function: ieee80211_ba_session_work [mac80211] [ 537.365115] BUG: scheduling while atomic: kworker/u12:3/722/0xfffffe01 [ 538.375733] BUG: scheduling while atomic: kworker/u12:0/7/0x00000102 [ 538.392605] softirq: huh, entered softirq 6 TASKLET 0000000048396bde with preempt_count 00000101, exited with 00000000? [ 538.403822] BUG: scheduling while atomic: kworker/u12:0/7/0x00000201 [ 538.410984] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7 [ 538.410984] last function: ieee80211_ba_session_work [mac80211] [ 538.424985] BUG: workqueue leaked lock or atomic: kworker/u12:0/0xfffffe00/7 [ 538.424985] last function: ieee80211_ba_session_work [mac80211] [ 538.438865] BUG: scheduling while atomic: kworker/u12:0/7/0xfffffe01 [ 538.460354] BUG: scheduling while atomic: ksoftirqd/0/12/0x00000101 [ 538.467953] softirq: huh, entered softirq 6 TASKLET 0000000048396bde with preempt_count 00000100, exited with 00000000? [ 538.631875] BUG: scheduling while atomic: ksoftirqd/5/39/0x00000103 [ 538.639025] softirq: huh, entered softirq 2 NET_TX 00000000cca7c5d3 with preempt_count 00000100, exited with fffffffe? [ 539.508955] BUG: scheduling while atomic: NetworkManager/625/0x00000403 [ 539.525507] BUG: scheduling while atomic: NetworkManager/625/0xfffffbff [ 542.849869] BUG: scheduling while atomic: NetworkManager/625/0x00000203 [ 542.866840] BUG: scheduling while atomic: NetworkManager/625/0xfffffdff [ 543.508184] BUG: scheduling while atomic: NetworkManager/625/0x00000403 [ 543.523724] BUG: scheduling while atomic: NetworkManager/625/0xfffffbff [ 543.582356] BUG: scheduling while atomic: NetworkManager/625/0x00000403 [ 543.590206] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665 skb_release_head_state+0x10c/0x120 [ 543.599396] ---[ end trace a78168b0d15c7048 ]--- [ 543.604213] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665 skb_release_head_state+0x10c/0x120 [ 543.613516] ---[ end trace a78168b0d15c7049 ]--- [ 543.618313] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665 skb_release_head_state+0x10c/0x120 [ 543.627533] ---[ end trace a78168b0d15c704a ]--- [ 543.632440] WARNING: CPU: 2 PID: 625 at net/core/skbuff.c:665 skb_release_head_state+0x10c/0x120 [ 543.641624] ---[ end trace a78168b0d15c704b ]--- [ 543.646395] BUG: scheduling while atomic: NetworkManager/625/0xfffffbff [ 543.653378] BUG: scheduling while atomic: kworker/2:1/44/0x00000505 [ 543.660273] ------------[ cut here ]------------ [ 543.665037] WARNING: CPU: 2 PID: 44 at kernel/time/timer.c:1420 call_timer_fn+0x1f8/0x200 [ 543.673596] ---[ end trace a78168b0d15c704c ]--- [ 543.687399] BUG: scheduling while atomic: swapper/2/0/0x00000504 [ 543.693876] bad: scheduling from the idle thread! Then unit reboots. If I turn on auto-connect, and boot with the device already attached, I can see the panic, from serial output: [ 23.278662] BUG: scheduling while atomic: NetworkManager/722/0x00000203 [ 23.286079] WARNING: CPU: 1 PID: 722 at kernel/rcu/tree_plugin.h:297 rcu_note_context_switch+0x50/0x540 [ 23.296285] ---[ end trace 60819f07c492dc1c ]--- [ 23.382446] BUG: scheduling while atomic: NetworkManager/722/0x00000505 [ 23.389654] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #202!!! [ 23.397965] NOHZ tick-stop error: Non-RCU local softirq work is pending, handler #202!!! [ 23.406289] WARNING: CPU: 1 PID: 0 at kernel/rcu/tree.c:624 rcu_eqs_enter.isra.0+0x128/0x130 [ 23.415092] ---[ end trace 60819f07c492dc1d ]--- [ 29.410485] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: __schedule+0x910/0x910 [ 29.420717] CPU: 1 PID: 722 Comm: NetworkManager Tainted: G W OE 5.10.120-tegra #1 [ 29.429584] Hardware name: Unknown NVIDIA Orin Nano Developer Kit/NVIDIA Orin Nano Developer Kit, BIOS 4.1-33958178 08/01/2023 [ 29.441313] Call trace: [ 29.443843] dump_backtrace+0x0/0x1d0 [ 29.447614] show_stack+0x30/0x40 [ 29.451025] dump_stack+0xd8/0x138 [ 29.454519] panic+0x17c/0x384 [ 29.457661] __stack_chk_fail+0x30/0x40 [ 29.461608] schedule+0x0/0x110 [ 29.464837] schedule+0x78/0x110 [ 29.468158] __arm_lpae_dma_sync+0x1e0/0x200 [ 29.472550] __arm_lpae_dma_sync+0x14c/0x200 [ 29.476951] __arm_lpae_dma_sync+0x14c/0x200 [ 29.481342] __arm_lpae_dma_sync+0x14c/0x200 [ 29.485735] arm_lpae_dma_sync+0x54/0x80 [ 29.489771] arm_smmu_dma_sync+0x40/0x70 [ 29.493805] __iommu_map+0x138/0x250 [ 29.497479] _iommu_map+0x70/0xd0 [ 29.500892] 0x80 [ 29.502879] SMP: stopping secondary CPUs [ 29.506918] Kernel Offset: 0x2ff010360000 from 0xffff800010000000 [ 29.513177] PHYS_OFFSET: 0xffffb7a9c0000000 [ 29.517465] CPU features: 0x08040006,4a80aa38 [ 29.521933] Memory Limit: none [ 29.536986] ---[ end Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: __schedule+0x910/0x910 ]--- > The rt2800 driver wasn't modified for ages. It's rater stable, but > perhaps there are issues in other involved modules i.e. mac80211. > > Regards > Stanislaw Thanks! Rick