Le Fri, Feb 11, 2022 at 07:03:15PM +0100, Heiner Kallweit a écrit : > On 11.02.2022 11:32, Corentin Labbe wrote: > > Hello > > > > On my tegra124-jetson-tk1, I always got: > > [ 1311.064826] ------------[ cut here ]------------ > > [ 1311.064880] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:477 dev_watchdog+0x2fc/0x300 > > [ 1311.064976] NETDEV WATCHDOG: enp1s0 (r8169): transmit queue 0 timed out > > [ 1311.065011] Modules linked in: > > [ 1311.065074] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.16.7-dirty #7 > > [ 1311.065116] Hardware name: NVIDIA Tegra SoC (Flattened Device Tree) > > [ 1311.065177] [<c01103e4>] (unwind_backtrace) from [<c010ade0>] (show_stack+0x10/0x14) > > [ 1311.065253] [<c010ade0>] (show_stack) from [<c0bbe884>] (dump_stack_lvl+0x40/0x4c) > > [ 1311.065322] [<c0bbe884>] (dump_stack_lvl) from [<c0122d6c>] (__warn+0xd0/0x12c) > > [ 1311.065379] [<c0122d6c>] (__warn) from [<c0bb8c48>] (warn_slowpath_fmt+0x90/0xb4) > > [ 1311.065434] [<c0bb8c48>] (warn_slowpath_fmt) from [<c0a0f0f0>] (dev_watchdog+0x2fc/0x300) > > [ 1311.065493] [<c0a0f0f0>] (dev_watchdog) from [<c01a8ab0>] (call_timer_fn+0x34/0x1a8) > > [ 1311.065554] [<c01a8ab0>] (call_timer_fn) from [<c01a8e50>] (__run_timers.part.0+0x22c/0x328) > > [ 1311.065599] [<c01a8e50>] (__run_timers.part.0) from [<c01a8f84>] (run_timer_softirq+0x38/0x68) > > [ 1311.065648] [<c01a8f84>] (run_timer_softirq) from [<c0101394>] (__do_softirq+0x124/0x3cc) > > [ 1311.065732] [<c0101394>] (__do_softirq) from [<c0129ff4>] (irq_exit+0xa4/0xd4) > > [ 1311.065818] [<c0129ff4>] (irq_exit) from [<c0100b90>] (__irq_svc+0x50/0x80) > > [ 1311.065860] Exception stack(0xc1101ed8 to 0xc1101f20) > > [ 1311.065884] 1ec0: 00000000 00000001 > > [ 1311.065913] 1ee0: c110a800 00000060 00000001 eed889f8 c121eaa0 418a949d 00000001 00000131 > > [ 1311.065940] 1f00: 00000001 00000131 00000000 c1101f28 c08bbe20 c08bbee8 60000113 ffffffff > > [ 1311.065962] [<c0100b90>] (__irq_svc) from [<c08bbee8>] (cpuidle_enter_state+0x270/0x480) > > [ 1311.066031] [<c08bbee8>] (cpuidle_enter_state) from [<c08bc15c>] (cpuidle_enter+0x50/0x54) > > [ 1311.066078] [<c08bc15c>] (cpuidle_enter) from [<c015a658>] (do_idle+0x1e0/0x298) > > [ 1311.066133] [<c015a658>] (do_idle) from [<c015a9e0>] (cpu_startup_entry+0x18/0x1c) > > [ 1311.066174] [<c015a9e0>] (cpu_startup_entry) from [<c1000fc8>] (start_kernel+0x678/0x6bc) > > [ 1311.066242] ---[ end trace 3df1a997f30c7eb8 ]--- > > [ 1311.083269] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [ 2671.118597] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [27521.391461] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [47441.629280] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [49046.691475] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [53081.713430] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [55101.737951] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [59351.771382] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [60491.797371] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [61351.805499] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [69631.911327] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [71246.958267] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [86522.110241] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [88507.174307] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [104612.315286] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > [132797.695339] r8169 0000:01:00.0 enp1s0: rtl_rxtx_empty_cond == 0 (loop: 42, delay: 100). > > > > This happen since at least 5.10. > > Any idea on how to debug this ? > > > For whatever reason the chip locked up what results in the tx timeout and the following > rtl_rxtx_empty_cond == 0 message. However the chip soft reset in the timeout handler > seems to help. > > Typically these timeouts are hard to debug because there's no public datasheets > and errata information. > > Few questions: > - Is this a mainline or a downstream kernel? Hello It is a mainline kernel 5.16.7 (only hack is a patch to print which firmware is loaded). I always used only mainline on it. > - Full dmesg log would help (e.g. to identify exact chip version). I put it down this mail > - Does the issue correlate with specific activity or specific types of traffic? It seems to happen more often when I do some NBD, but not always. This board is used as a LAVA worker so it do lot of network (NBD, tftp, image download), I believed it happend when some network activity is done. > - Is the interface operating in promiscuous mode (e.g. part of a bridge)? No > > At first you could try to disable all hw offloading / ASPM / EEE. > I will try > There's also a small chance that the issue is linked to a specific link partner. > So you could test whether issue persists with another switch in between. > Or with a different link partner. > > Ar you aware of any earlier kernel version where the issue did not happen? > Then you could bisect. The oldest kernel I found on it is 5.1.21, but I dont remember if I hit this problem on it (the board is really used only for one year). Anyway, the problem is too random (aka the need to wait a long time) to be easily bisected. I tried to do some iperf for triggering it faster, but it do not work. Some times it happend straigth on the boot, sometime after days. iThanks for you hints Regards [ 0.000000] Booting Linux on physical CPU 0x0 [ 0.000000] Linux version 5.16.9-dirty (compile@Red) (armv7a-unknown-linux-gnueabihf-gcc (Gentoo 11.2.0 p1) 11.2.0, GNU ld (Gentoo 2.37_p1 p0) 2.37) #8 SMP PREEMPT Fri Feb 11 11:06:53 CET 2022 [ 0.000000] CPU: ARMv7 Processor [413fc0f3] revision 3 (ARMv7), cr=10c5387d [ 0.000000] CPU: div instructions available: patching division code [ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache [ 0.000000] OF: fdt: Machine model: NVIDIA Tegra124 Jetson TK1 [ 0.000000] Memory policy: Data cache writealloc [ 0.000000] cma: Reserved 64 MiB at 0xfbc00000 [ 0.000000] Zone ranges: [ 0.000000] Normal [mem 0x0000000080000000-0x00000000afffffff] [ 0.000000] HighMem [mem 0x00000000b0000000-0x00000000ffefffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000080000000-0x00000000ffefffff] [ 0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000000ffefffff] [ 0.000000] percpu: Embedded 17 pages/cpu s36972 r8192 d24468 u69632 [ 0.000000] pcpu-alloc: s36972 r8192 d24468 u69632 alloc=17*4096 [ 0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 522304 [ 0.000000] Kernel command line: console=ttyS0,115200 root=/dev/ram0 [ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear) [ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.000000] Memory: 1977032K/2096128K available (12288K kernel code, 1541K rwdata, 4592K rodata, 1024K init, 7237K bss, 53560K reserved, 65536K cma-reserved, 1244160K highmem) [ 0.000000] trace event string verifier disabled [ 0.000000] Running RCU self tests [ 0.000000] rcu: Preemptible hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU lockdep checking is enabled. [ 0.000000] Trampoline variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies. [ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16 [ 0.000000] /interrupt-controller@60004000: 160 interrupts forwarded to /interrupt-controller@50041000 [ 0.000000] random: get_random_bytes called from start_kernel+0x538/0x6e8 with crng_init=0 [ 0.000002] sched_clock: 32 bits at 1000kHz, resolution 1000ns, wraps every 2147483647500ns [ 0.000049] clocksource: timer_us: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275 ns [ 0.000099] Switching to timer-based delay loop, resolution 1000ns [ 0.000956] clocksource: tegra_suspend_timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.001822] arch_timer: cp15 timer(s) running at 12.00MHz (virt). [ 0.001855] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2c47f4ee7, max_idle_ns: 440795202497 ns [ 0.001887] sched_clock: 56 bits at 12MHz, resolution 83ns, wraps every 4398046511096ns [ 0.001914] Switching to timer-based delay loop, resolution 83ns [ 0.004212] Console: colour dummy device 80x30 [ 0.004271] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar [ 0.004292] ... MAX_LOCKDEP_SUBCLASSES: 8 [ 0.004313] ... MAX_LOCK_DEPTH: 48 [ 0.004333] ... MAX_LOCKDEP_KEYS: 8192 [ 0.004353] ... CLASSHASH_SIZE: 4096 [ 0.004372] ... MAX_LOCKDEP_ENTRIES: 32768 [ 0.004393] ... MAX_LOCKDEP_CHAINS: 65536 [ 0.004412] ... CHAINHASH_SIZE: 32768 [ 0.004432] memory used by lock dependency info: 4061 kB [ 0.004453] memory used for stack traces: 2112 kB [ 0.004472] per task-struct memory footprint: 1536 bytes [ 0.004585] Calibrating delay loop (skipped), value calculated using timer frequency.. 24.00 BogoMIPS (lpj=120000) [ 0.004625] pid_max: default: 32768 minimum: 301 [ 0.005363] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear) [ 0.005400] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear) [ 0.010406] CPU: Testing write buffer coherency: ok [ 0.010667] CPU0: Spectre v2: using ICIALLU workaround [ 0.012273] /cpus/cpu@0 missing clock-frequency property [ 0.012381] /cpus/cpu@1 missing clock-frequency property [ 0.012487] /cpus/cpu@2 missing clock-frequency property [ 0.012599] /cpus/cpu@3 missing clock-frequency property [ 0.012655] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000 [ 0.016749] Running RCU-tasks wait API self tests [ 0.018313] Setting up static identity map for 0x80100000 - 0x801000ac [ 0.019163] rcu: Hierarchical SRCU implementation. [ 0.021641] Tegra Revision: A01 SKU: 129 CPU Process: 1 SoC Process: 1 [ 0.024462] smp: Bringing up secondary CPUs ... [ 0.030226] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001 [ 0.030245] CPU1: Spectre v2: firmware did not set auxiliary control register IBE bit, system vulnerable [ 0.036611] CPU2: thread -1, cpu 2, socket 0, mpidr 80000002 [ 0.036630] CPU2: Spectre v2: firmware did not set auxiliary control register IBE bit, system vulnerable [ 0.042060] CPU3: thread -1, cpu 3, socket 0, mpidr 80000003 [ 0.042080] CPU3: Spectre v2: firmware did not set auxiliary control register IBE bit, system vulnerable [ 0.042754] smp: Brought up 1 node, 4 CPUs [ 0.042789] SMP: Total of 4 processors activated (96.00 BogoMIPS). [ 0.042821] CPU: All CPU(s) started in SVC mode. [ 0.046561] devtmpfs: initialized [ 0.175914] VFP support v0.3: implementor 41 architecture 4 part 30 variant f rev 0 [ 0.199609] DMA-API: preallocated 65536 debug entries [ 0.199649] DMA-API: debugging enabled by kernel config [ 0.199678] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns [ 0.199761] futex hash table entries: 1024 (order: 4, 65536 bytes, linear) [ 0.201905] pinctrl core: initialized pinctrl subsystem [ 0.207533] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 0.214622] DMA: preallocated 256 KiB pool for atomic coherent allocations [ 0.223466] thermal_sys: Registered thermal governor 'step_wise' [ 0.227650] cpuidle: using governor menu [ 0.233442] Callback from call_rcu_tasks() invoked. [ 0.350750] No ATAGs? [ 0.351337] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4 watchpoint registers. [ 0.351429] hw-breakpoint: maximum watchpoint size is 8 bytes. [ 0.387243] platform 50000000.host1x: Adding to iommu group 0 [ 0.387747] platform 57000000.gpu: Adding to iommu group 1 [ 0.482354] iommu: Default domain type: Translated [ 0.482389] iommu: DMA domain TLB invalidation policy: strict mode [ 0.484129] vgaarb: loaded [ 0.487758] SCSI subsystem initialized [ 0.488614] libata version 3.00 loaded. [ 0.490046] usbcore: registered new interface driver usbfs [ 0.490386] usbcore: registered new interface driver hub [ 0.490638] usbcore: registered new device driver usb [ 0.491247] mc: Linux media interface: v0.10 [ 0.491464] videodev: Linux video capture interface: v2.00 [ 0.491823] pps_core: LinuxPPS API ver. 1 registered [ 0.491852] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx> [ 0.491972] PTP clock support registered [ 0.494230] Advanced Linux Sound Architecture Driver Initialized. [ 0.501683] clocksource: Switched to clocksource arch_sys_counter [ 1.064555] NET: Registered PF_INET protocol family [ 1.065326] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear) [ 1.068893] tcp_listen_portaddr_hash hash table entries: 512 (order: 2, 22528 bytes, linear) [ 1.069511] TCP established hash table entries: 8192 (order: 3, 32768 bytes, linear) [ 1.069834] TCP bind hash table entries: 8192 (order: 6, 327680 bytes, linear) [ 1.072133] TCP: Hash tables configured (established 8192 bind 8192) [ 1.073110] UDP hash table entries: 512 (order: 3, 49152 bytes, linear) [ 1.073493] UDP-Lite hash table entries: 512 (order: 3, 49152 bytes, linear) [ 1.074522] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.077404] RPC: Registered named UNIX socket transport module. [ 1.077497] RPC: Registered udp transport module. [ 1.077527] RPC: Registered tcp transport module. [ 1.077557] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.077592] PCI: CLS 0 bytes, default 64 [ 1.080856] Trying to unpack rootfs image as initramfs... [ 1.092098] hw perfevents: enabled with armv7_cortex_a15 PMU driver, 7 counters available [ 1.099572] Initialise system trusted keyrings [ 1.100320] workingset: timestamp_bits=14 max_order=19 bucket_order=5 [ 1.104161] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 1.106223] NFS: Registering the id_resolver key type [ 1.106374] Key type id_resolver registered [ 1.106468] Key type id_legacy registered [ 1.106554] Installing knfsd (copyright (C) 1996 okir@xxxxxxxxxxxx). [ 1.204436] Key type asymmetric registered [ 1.204538] Asymmetric key parser 'x509' registered [ 1.205487] bounce: pool size: 64 pages [ 1.205789] io scheduler mq-deadline registered [ 1.205823] io scheduler kyber registered [ 1.245302] tegra-apbdma 60020000.dma: Tegra20 APB DMA driver registered 32 channels [ 1.250435] tegra-pmc 7000e400.pmc: emergency thermal reset enabled [ 1.253762] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled [ 1.269652] printk: console [ttyS0] disabled [ 1.270206] 70006300.serial: ttyS0 at MMIO 0x70006300 (irq = 84, base_baud = 25500000) is a Tegra [ 1.970538] Freeing initrd memory: 6508K [ 1.971426] printk: console [ttyS0] enabled [ 2.141847] 70006000.serial: ttyTHS1 at MMIO 0x70006000 (irq = 82, base_baud = 0) is a TEGRA_UART [ 2.153719] 70006040.serial: ttyTHS2 at MMIO 0x70006040 (irq = 83, base_baud = 0) is a TEGRA_UART [ 2.170773] platform 54200000.dc: Adding to iommu group 2 [ 2.179772] platform 54240000.dc: Adding to iommu group 2 [ 2.191903] platform 54340000.vic: Adding to iommu group 2 [ 2.266385] brd: module loaded [ 2.294072] loop: module loaded [ 2.312252] igb: Intel(R) Gigabit Ethernet Network Driver [ 2.317669] igb: Copyright (c) 2007-2014 Intel Corporation. [ 2.323739] pegasus: Pegasus/Pegasus II USB Ethernet driver [ 2.329527] usbcore: registered new interface driver pegasus [ 2.335536] usbcore: registered new interface driver asix [ 2.341131] usbcore: registered new interface driver ax88179_178a [ 2.347493] usbcore: registered new interface driver cdc_ether [ 2.353694] usbcore: registered new interface driver smsc75xx [ 2.359712] usbcore: registered new interface driver smsc95xx [ 2.365729] usbcore: registered new interface driver net1080 [ 2.371652] usbcore: registered new interface driver cdc_subset [ 2.377766] usbcore: registered new interface driver zaurus [ 2.383717] usbcore: registered new interface driver cdc_ncm [ 2.390723] tegra-phy 7d000000.usb-phy: supply vbus not found, using dummy regulator [ 2.400292] tegra-phy 7d004000.usb-phy: supply vbus not found, using dummy regulator [ 2.409454] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.416070] ehci-pci: EHCI PCI platform driver [ 2.421997] usbcore: registered new interface driver cdc_acm [ 2.427671] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters [ 2.435958] usbcore: registered new interface driver cdc_wdm [ 2.441973] usbcore: registered new interface driver usb-storage [ 2.448464] usbcore: registered new interface driver ch341 [ 2.454353] usbserial: USB Serial support registered for ch341-uart [ 2.460880] usbcore: registered new interface driver cp210x [ 2.466784] usbserial: USB Serial support registered for cp210x [ 2.472951] usbcore: registered new interface driver ftdi_sio [ 2.478868] usbserial: USB Serial support registered for FTDI USB Serial Device [ 2.486425] usbcore: registered new interface driver pl2303 [ 2.492217] usbserial: USB Serial support registered for pl2303 [ 2.561321] ci_hdrc ci_hdrc.1: EHCI Host Controller [ 2.566661] ci_hdrc ci_hdrc.1: new USB bus registered, assigned bus number 1 [ 2.601775] ci_hdrc ci_hdrc.1: USB 2.0 started, EHCI 1.10 [ 2.614047] hub 1-0:1.0: USB hub found [ 2.618259] hub 1-0:1.0: 1 port detected [ 2.639005] tegra_rtc 7000e000.rtc: registered as rtc1 [ 2.644279] tegra_rtc 7000e000.rtc: Tegra internal Real Time Clock [ 2.653796] i2c_dev: i2c /dev entries driver [ 2.666308] at24 0-0056: supply vcc not found, using dummy regulator [ 2.676438] at24 0-0056: 256 byte 24c02 EEPROM, writable, 8 bytes/write [ 2.707558] as3722 4-0040: AS3722 with revision 0x1 found [ 2.758609] +VDDIO_SDMMC3: bypassed regulator has no supply! [ 2.764517] as3722-regulator as3722-regulator: regulator 13 register failed -517 [ 2.792203] as3722-rtc as3722-rtc: registered as rtc0 [ 2.797980] as3722-rtc as3722-rtc: setting system clock to 2022-02-11T10:43:54 UTC (1644576234) [ 2.806827] as3722-rtc as3722-rtc: RTC interrupt 133 [ 2.826528] usbcore: registered new interface driver uvcvideo [ 2.832401] gspca_main: v2.14.0 registered [ 2.841054] lm90 0-004c: supply vcc not found, using dummy regulator [ 2.856526] tegra-wdt 60005000.timer: initialized (heartbeat = 120 sec, nowayout = 0) [ 2.869555] sdhci: Secure Digital Host Controller Interface driver [ 2.875827] sdhci: Copyright(c) Pierre Ossman [ 2.880199] VUB300 Driver rom wait states = 1C irqpoll timeout = 0400 [ 2.882388] usbcore: registered new interface driver vub300 [ 2.894509] sdhci-pltfm: SDHCI platform and OF driver helper [ 2.902747] sdhci-tegra 700b0400.mmc: Got CD GPIO [ 2.904701] usbcore: registered new interface driver usbhid [ 2.907649] sdhci-tegra 700b0400.mmc: Got WP GPIO [ 2.913252] usbhid: USB HID core driver [ 2.918259] mmc1: Invalid maximum block size, assuming 512 bytes [ 2.931027] tegra-emc 7001b000.external-memory-controller: 64bit DRAM bus [ 2.940366] tegra-emc 7001b000.external-memory-controller: OPP HW ver. 0x2, current clock rate 924 MHz [ 2.965069] mmc1: SDHCI controller on 700b0600.mmc [700b0600.mmc] using ADMA 64-bit [ 2.990955] input: tegra-hda HDMI/DP,pcm=3 as /devices/soc0/70030000.hda/sound/card0/input0 [ 3.046086] mmc1: new high speed MMC card at address 0001 [ 3.056650] mmcblk1: mmc1:0001 SEM16G 14.7 GiB [ 3.074616] mmcblk1boot0: mmc1:0001 SEM16G 4.00 MiB [ 3.088449] mmcblk1boot1: mmc1:0001 SEM16G 4.00 MiB [ 3.100769] mmcblk1rpmb: mmc1:0001 SEM16G 4.00 MiB, chardev (246:0) [ 3.408386] tegra30-i2s 70301100.i2s: DMA channels sourced from device 70300000.ahub [ 3.450488] input: NVIDIA Tegra Jetson TK1 Headphones Jack as /devices/soc0/sound/sound/card1/input1 [ 3.471562] NET: Registered PF_INET6 protocol family [ 3.482130] Segment Routing with IPv6 [ 3.485926] In-situ OAM (IOAM) with IPv6 [ 3.490377] mip6: Mobile IPv6 [ 3.493743] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver [ 3.507140] NET: Registered PF_PACKET protocol family [ 3.512403] NET: Registered PF_KEY protocol family [ 3.517665] Bridge firewalling registered [ 3.522602] Key type dns_resolver registered [ 3.532022] Registering SWP/SWPB emulation handler [ 3.537626] Loading compiled-in X.509 certificates [ 3.600034] reg-fixed-voltage regulator@11: nonexclusive access to GPIO for regulator@11 [ 3.612432] tegra-pcie 1003000.pcie: host bridge /pcie@1003000 ranges: [ 3.619135] tegra-pcie 1003000.pcie: MEM 0x0001000000..0x0001001fff -> 0x0001000000 [ 3.627447] tegra-pcie 1003000.pcie: IO 0x0012000000..0x001200ffff -> 0x0000000000 [ 3.635958] tegra-pcie 1003000.pcie: MEM 0x0013000000..0x001fffffff -> 0x0013000000 [ 3.644228] tegra-pcie 1003000.pcie: MEM 0x0020000000..0x003fffffff -> 0x0020000000 [ 3.653142] tegra-pcie 1003000.pcie: 2x1, 1x1 configuration [ 3.683308] tegra-hdmi 54280000.hdmi: failed to get PLL regulator: -517 [ 3.706377] ci_hdrc ci_hdrc.2: EHCI Host Controller [ 3.711755] ci_hdrc ci_hdrc.2: new USB bus registered, assigned bus number 2 [ 3.741952] ci_hdrc ci_hdrc.2: USB 2.0 started, EHCI 1.10 [ 3.753585] hub 2-0:1.0: USB hub found [ 3.757745] hub 2-0:1.0: 1 port detected [ 3.761865] random: fast init done [ 3.766834] as3722-regulator as3722-regulator: DMA mask not set [ 3.802562] +VDDIO_SDMMC3: bypassed regulator has no supply! [ 3.831837] sdhci-tegra 700b0400.mmc: Got CD GPIO [ 3.836728] sdhci-tegra 700b0400.mmc: Got WP GPIO [ 3.842399] usb2-0: supply vbus not found, using dummy regulator [ 3.850220] usb2-1: supply vbus not found, using dummy regulator [ 3.858715] mmc0: Invalid maximum block size, assuming 512 bytes [ 3.858984] usb3-0: supply vbus not found, using dummy regulator [ 3.874560] tegra-pcie 1003000.pcie: host bridge /pcie@1003000 ranges: [ 3.881279] tegra-pcie 1003000.pcie: MEM 0x0001000000..0x0001001fff -> 0x0001000000 [ 3.889626] tegra-pcie 1003000.pcie: IO 0x0012000000..0x001200ffff -> 0x0000000000 [ 3.897940] tegra-pcie 1003000.pcie: MEM 0x0013000000..0x001fffffff -> 0x0013000000 [ 3.903824] mmc0: SDHCI controller on 700b0400.mmc [700b0400.mmc] using ADMA 64-bit [ 3.906202] tegra-pcie 1003000.pcie: MEM 0x0020000000..0x003fffffff -> 0x0020000000 [ 3.924314] tegra-pcie 1003000.pcie: 2x1, 1x1 configuration [ 3.939032] tegra-pcie 1003000.pcie: probing port 0, using 2 lanes [ 3.947810] tegra-pcie 1003000.pcie: probing port 1, using 1 lanes [ 3.988295] mmc0: new high speed SDHC card at address 1388 [ 3.998143] mmcblk0: mmc0:1388 NCard 7.32 GiB [ 4.013824] mmcblk0: p1 p2 p3 < p5 > [ 5.184002] tegra-pcie 1003000.pcie: link 0 down, ignoring [ 5.195101] tegra-pcie 1003000.pcie: PCI host bridge to bus 0000:00 [ 5.201409] pci_bus 0000:00: root bus resource [bus 00-ff] [ 5.207046] pci_bus 0000:00: root bus resource [mem 0x01000000-0x01001fff] [ 5.214268] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] [ 5.220493] pci_bus 0000:00: root bus resource [mem 0x13000000-0x1fffffff] [ 5.227506] pci_bus 0000:00: root bus resource [mem 0x20000000-0x3fffffff pref] [ 5.235825] pci 0000:00:02.0: [10de:0e13] type 01 class 0x060400 [ 5.242008] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x4 may corrupt adjacent RW1C bits [ 5.252056] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x4 may corrupt adjacent RW1C bits [ 5.261922] pci 0000:00:02.0: enabling Extended Tags [ 5.266914] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x88 may corrupt adjacent RW1C bits [ 5.276762] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x3e may corrupt adjacent RW1C bits [ 5.287180] pci 0000:00:02.0: PME# supported from D0 D1 D2 D3hot D3cold [ 5.293901] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x4c may corrupt adjacent RW1C bits [ 5.311321] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x3e may corrupt adjacent RW1C bits [ 5.321342] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x4 may corrupt adjacent RW1C bits [ 5.331090] pci_bus 0000:00: 1-byte config write to 0000:00:02.0 offset 0xc may corrupt adjacent RW1C bits [ 5.340825] PCI: bus0: Fast back to back transfers disabled [ 5.346494] pci 0000:00:02.0: bridge configuration invalid ([bus 00-00]), reconfiguring [ 5.354735] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x3e may corrupt adjacent RW1C bits [ 5.364576] pci_bus 0000:00: 2-byte config write to 0000:00:02.0 offset 0x3e may corrupt adjacent RW1C bits [ 5.375274] pci 0000:01:00.0: [10ec:8168] type 00 class 0x020000 [ 5.381361] pci 0000:01:00.0: reg 0x10: [io 0x0000-0x00ff] [ 5.387247] pci 0000:01:00.0: reg 0x18: [mem 0x00000000-0x00000fff 64bit] [ 5.394178] pci 0000:01:00.0: reg 0x20: [mem 0x00000000-0x00003fff 64bit pref] [ 5.401937] pci 0000:01:00.0: supports D1 D2 [ 5.406228] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 5.419641] PCI: bus1: Fast back to back transfers disabled [ 5.425315] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01 [ 5.432246] pci 0000:00:02.0: BAR 8: assigned [mem 0x13000000-0x130fffff] [ 5.439060] pci 0000:00:02.0: BAR 9: assigned [mem 0x20000000-0x200fffff 64bit pref] [ 5.446900] pci 0000:00:02.0: BAR 7: assigned [io 0x1000-0x1fff] [ 5.453120] pci 0000:01:00.0: BAR 4: assigned [mem 0x20000000-0x20003fff 64bit pref] [ 5.460922] pci 0000:01:00.0: BAR 2: assigned [mem 0x13000000-0x13000fff 64bit] [ 5.468360] pci 0000:01:00.0: BAR 0: assigned [io 0x1000-0x10ff] [ 5.474562] pci 0000:00:02.0: PCI bridge to [bus 01] [ 5.479734] pci 0000:00:02.0: bridge window [io 0x1000-0x1fff] [ 5.485938] pci 0000:00:02.0: bridge window [mem 0x13000000-0x130fffff] [ 5.492825] pci 0000:00:02.0: bridge window [mem 0x20000000-0x200fffff 64bit pref] [ 5.500675] pci 0000:00:02.0: nv_msi_ht_cap_quirk didn't locate host bridge [ 5.508377] pcieport 0000:00:02.0: enabling device (0140 -> 0143) [ 5.515546] pcieport 0000:00:02.0: PME: Signaling with IRQ 33 [ 5.523776] r8169 0000:01:00.0: enabling device (0140 -> 0143) [ 5.602683] r8169 0000:01:00.0 eth0: RTL8168g/8111g, 00:04:4b:2f:50:23, XID 4c0, IRQ 153 [ 5.610809] r8169 0000:01:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko] [ 5.782925] drm drm: [drm] Cannot find any crtc or sizes [ 5.790230] drm drm: [drm] Cannot find any crtc or sizes [ 5.801286] [drm] Initialized tegra 1.0.0 20120330 for drm on minor 0 [ 5.809907] tegra-ahci 70027000.sata: supply ahci not found, using dummy regulator [ 5.818442] tegra-ahci 70027000.sata: supply phy not found, using dummy regulator [ 5.827178] tegra-ahci 70027000.sata: supply target not found, using dummy regulator [ 5.840550] tegra-ahci 70027000.sata: AHCI 0001.0301 32 slots 2 ports 3 Gbps 0x1 impl platform mode [ 5.849776] tegra-ahci 70027000.sata: flags: 64bit ncq sntf pm led pmp pio slum part sadm sds apst [ 5.881335] scsi host0: tegra-ahci [ 5.889532] scsi host1: tegra-ahci [ 5.894747] ata1: SATA max UDMA/133 mmio [mem 0x70027000-0x70028fff] port 0x100 irq 94 [ 5.902922] ata2: DUMMY [ 5.914153] firmware_class: Loading firmware: nvidia/tegra124/xusb.bin [ 5.922819] firmware_class: _request_firmware end [ 5.936297] tegra-xusb 70090000.usb: Firmware timestamp: 2014-09-16 02:10:07 UTC [ 5.944058] tegra-xusb 70090000.usb: xHCI Host Controller [ 5.949794] tegra-xusb 70090000.usb: new USB bus registered, assigned bus number 3 [ 5.964878] tegra-xusb 70090000.usb: hcc params 0x0184f525 hci version 0x100 quirks 0x0000000000010010 [ 5.974654] tegra-xusb 70090000.usb: irq 96, io mem 0x70090000 [ 5.986834] hub 3-0:1.0: USB hub found [ 5.991150] hub 3-0:1.0: 6 ports detected [ 6.002635] tegra-xusb 70090000.usb: xHCI Host Controller [ 6.008133] tegra-xusb 70090000.usb: new USB bus registered, assigned bus number 4 [ 6.015920] tegra-xusb 70090000.usb: Host supports USB 3.0 SuperSpeed [ 6.024699] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM. [ 6.037740] hub 4-0:1.0: USB hub found [ 6.041898] hub 4-0:1.0: 2 ports detected [ 6.056307] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 696000 KHz, changing to: 714000 KHz [ 6.070127] input: gpio-keys as /devices/soc0/gpio-keys/input/input2 [ 6.078502] ALSA device list: [ 6.081472] #0: tegra-hda at 0x70038000 irq 95 [ 6.087228] #1: NVIDIA Tegra Jetson TK1 [ 6.236917] ata1: SATA link down (SStatus 0 SControl 300) [ 6.256584] Freeing unused kernel image (initmem) memory: 1024K [ 6.264679] Run /init as init process [ 6.268439] with arguments: [ 6.268457] /init [ 6.268467] with environment: [ 6.268475] HOME=/ [ 6.268483] TERM=linux [ 6.301930] usb 3-3: new high-speed USB device number 2 using tegra-xusb [ 6.537083] hub 3-3:1.0: USB hub found [ 6.541852] hub 3-3:1.0: 4 ports detected [ 6.664286] usb 4-1: new SuperSpeed USB device number 2 using tegra-xusb [ 6.710923] hub 4-1:1.0: USB hub found [ 6.715287] hub 4-1:1.0: 4 ports detected [ 6.912760] usb 3-3.2: new full-speed USB device number 3 using tegra-xusb [ 7.107039] ftdi_sio 3-3.2:1.0: FTDI USB Serial Device converter detected [ 7.114442] usb 3-3.2: Detected FT232RL [ 7.120455] usb 3-3.2: FTDI USB Serial Device converter now attached to ttyUSB0 [ 7.173227] usb 4-1.4: new SuperSpeed USB device number 3 using tegra-xusb [ 7.232027] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 7.240230] ata1.00: ATA-8: OCZ-AGILITY3, 2.22, max UDMA/133 [ 7.241876] hub 4-1.4:1.0: USB hub found [ 7.246051] ata1.00: 234441648 sectors, multi 16: LBA48 NCQ (depth 32) [ 7.250198] hub 4-1.4:1.0: 4 ports detected [ 7.270162] ata1.00: configured for UDMA/133 [ 7.276047] scsi 0:0:0:0: Direct-Access ATA OCZ-AGILITY3 2.22 PQ: 0 ANSI: 5 [ 7.287270] sd 0:0:0:0: Attached scsi generic sg0 type 0 [ 7.287882] sd 0:0:0:0: [sda] 234441648 512-byte logical blocks: (120 GB/112 GiB) [ 7.300304] sd 0:0:0:0: [sda] Write Protect is off [ 7.305173] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 7.305370] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 7.331718] usb 3-3.3: new full-speed USB device number 4 using tegra-xusb [ 7.361488] sda: sda1 [ 7.366534] sd 0:0:0:0: [sda] Attached SCSI disk [ 7.492900] ftdi_sio 3-3.3:1.0: FTDI USB Serial Device converter detected [ 7.500347] usb 3-3.3: Detected FT232RL [ 7.507501] usb 3-3.3: FTDI USB Serial Device converter now attached to ttyUSB1 [ 7.612746] usb 3-3.4: new high-speed USB device number 5 using tegra-xusb [ 7.783228] hub 3-3.4:1.0: USB hub found [ 7.787993] hub 3-3.4:1.0: 4 ports detected [ 8.132258] usb 3-3.4.1: new full-speed USB device number 6 using tegra-xusb [ 8.309411] ftdi_sio 3-3.4.1:1.0: FTDI USB Serial Device converter detected [ 8.316990] usb 3-3.4.1: Detected FT232RL [ 8.322963] usb 3-3.4.1: FTDI USB Serial Device converter now attached to ttyUSB2 [ 8.432139] usb 3-3.4.2: new full-speed USB device number 7 using tegra-xusb [ 8.530617] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: disabled. [ 8.577940] pl2303 3-3.4.2:1.0: pl2303 converter detected [ 8.586935] usb 3-3.4.2: pl2303 converter now attached to ttyUSB3 [ 8.711662] usb 3-3.4.3: new full-speed USB device number 8 using tegra-xusb [ 8.870627] ftdi_sio 3-3.4.3:1.0: FTDI USB Serial Device converter detected [ 8.878468] usb 3-3.4.3: Detected FT232RL [ 8.884807] usb 3-3.4.3: FTDI USB Serial Device converter now attached to ttyUSB4 [ 8.991691] usb 3-3.4.4: new full-speed USB device number 9 using tegra-xusb [ 9.135407] ch341 3-3.4.4:1.0: ch341-uart converter detected [ 9.143248] ch341-uart ttyUSB5: break control not supported, using simulated break [ 9.151257] usb 3-3.4.4: ch341-uart converter now attached to ttyUSB5 [ 9.582588] random: apache2: uninitialized urandom read (8 bytes read) [ 9.589189] random: apache2: uninitialized urandom read (8 bytes read) [ 9.596039] random: apache2: uninitialized urandom read (8 bytes read) [ 18.530530] r8169 0000:01:00.0 enp1s0: renamed from eth0 [ 19.577122] EXT4-fs (sda1): re-mounted. Opts: (null). Quota mode: disabled. [ 26.701844] random: crng init done [ 26.701871] random: 7 urandom warning(s) missed due to ratelimiting [ 36.323390] +USB0_VBUS_SW: disabling [ 38.407574] firmware_class: Loading firmware: rtl_nic/rtl8168g-2.fw [ 38.417338] firmware_class: _request_firmware end [ 38.451897] Generic FE-GE Realtek PHY r8169-0-100:00: attached PHY driver (mii_bus:phy_addr=r8169-0-100:00, irq=MAC) [ 38.735766] r8169 0000:01:00.0 enp1s0: Link is Down [ 41.379219] r8169 0000:01:00.0 enp1s0: Link is Up - 1Gbps/Full - flow control off [ 41.379301] IPv6: ADDRCONF(NETDEV_CHANGE): enp1s0: link becomes ready [ 46.232171] ------------[ cut here ]------------ [ 46.232240] WARNING: CPU: 1 PID: 2144 at kernel/dma/debug.c:1073 check_for_illegal_area+0xec/0x180 [ 46.232255] DMA-API: tegra-ahci 70027000.sata: device driver maps memory from kernel text or rodata [addr=3f4026ed] [len=4096] [ 46.232262] Modules linked in: [ 46.232271] CPU: 1 PID: 2144 Comm: containerd Not tainted 5.16.9-dirty #8 [ 46.232277] Hardware name: NVIDIA Tegra SoC (Flattened Device Tree) [ 46.232283] [<c0110c24>] (unwind_backtrace) from [<c010b4d4>] (show_stack+0x10/0x14) [ 46.232294] [<c010b4d4>] (show_stack) from [<c0ce90b0>] (dump_stack_lvl+0x58/0x70) [ 46.232305] [<c0ce90b0>] (dump_stack_lvl) from [<c0124648>] (__warn+0xd0/0x134) [ 46.232314] [<c0124648>] (__warn) from [<c0ce2b00>] (warn_slowpath_fmt+0x90/0xb4) [ 46.232322] [<c0ce2b00>] (warn_slowpath_fmt) from [<c01cdcd8>] (check_for_illegal_area+0xec/0x180) [ 46.232330] [<c01cdcd8>] (check_for_illegal_area) from [<c01cfab4>] (debug_dma_map_sg+0xa4/0x424) [ 46.232340] [<c01cfab4>] (debug_dma_map_sg) from [<c01ca4d8>] (__dma_map_sg_attrs+0xc4/0x140) [ 46.232349] [<c01ca4d8>] (__dma_map_sg_attrs) from [<c01ca568>] (dma_map_sg_attrs+0x14/0x20) [ 46.232357] [<c01ca568>] (dma_map_sg_attrs) from [<c07cc408>] (ata_qc_issue+0x16c/0x414) [ 46.232366] [<c07cc408>] (ata_qc_issue) from [<c07d64f4>] (__ata_scsi_queuecmd+0x27c/0x4c4) [ 46.232376] [<c07d64f4>] (__ata_scsi_queuecmd) from [<c07d679c>] (ata_scsi_queuecmd+0x60/0x90) [ 46.232385] [<c07d679c>] (ata_scsi_queuecmd) from [<c07b36bc>] (scsi_queue_rq+0x440/0xb98) [ 46.232397] [<c07b36bc>] (scsi_queue_rq) from [<c05808fc>] (blk_mq_dispatch_rq_list+0x1d0/0x87c) [ 46.232406] [<c05808fc>] (blk_mq_dispatch_rq_list) from [<c0586628>] (__blk_mq_do_dispatch_sched+0x14c/0x2dc) [ 46.232415] [<c0586628>] (__blk_mq_do_dispatch_sched) from [<c0586b38>] (__blk_mq_sched_dispatch_requests+0x10c/0x168) [ 46.232423] [<c0586b38>] (__blk_mq_sched_dispatch_requests) from [<c0586c64>] (blk_mq_sched_dispatch_requests+0x34/0x5c) [ 46.232432] [<c0586c64>] (blk_mq_sched_dispatch_requests) from [<c057da8c>] (__blk_mq_run_hw_queue+0x5c/0xcc) [ 46.232442] [<c057da8c>] (__blk_mq_run_hw_queue) from [<c057dc9c>] (__blk_mq_delay_run_hw_queue+0x18c/0x1b4) [ 46.232451] [<c057dc9c>] (__blk_mq_delay_run_hw_queue) from [<c0586f80>] (blk_mq_sched_insert_requests+0xd0/0x320) [ 46.232460] [<c0586f80>] (blk_mq_sched_insert_requests) from [<c0581604>] (blk_mq_flush_plug_list+0x1c4/0x434) [ 46.232468] [<c0581604>] (blk_mq_flush_plug_list) from [<c0573d40>] (blk_flush_plug+0xd4/0x114) [ 46.232475] [<c0573d40>] (blk_flush_plug) from [<c0573f9c>] (blk_finish_plug+0x1c/0x28) [ 46.232482] [<c0573f9c>] (blk_finish_plug) from [<c0285740>] (read_pages+0x190/0x2bc) [ 46.232493] [<c0285740>] (read_pages) from [<c0285c1c>] (page_cache_ra_unbounded+0x164/0x230) [ 46.232501] [<c0285c1c>] (page_cache_ra_unbounded) from [<c027846c>] (filemap_fault+0x6d4/0xd04) [ 46.232509] [<c027846c>] (filemap_fault) from [<c02bacd0>] (__do_fault+0x38/0x104) [ 46.232519] [<c02bacd0>] (__do_fault) from [<c02c0920>] (handle_mm_fault+0xaa0/0xea8) [ 46.232528] [<c02c0920>] (handle_mm_fault) from [<c011563c>] (do_page_fault+0x15c/0x484) [ 46.232537] [<c011563c>] (do_page_fault) from [<c0115b2c>] (do_DataAbort+0x3c/0xb0) [ 46.232544] [<c0115b2c>] (do_DataAbort) from [<c0100e98>] (__dabt_usr+0x58/0x60) [ 46.232552] Exception stack(0xc6bc9fb0 to 0xc6bc9ff8) [ 46.232558] 9fa0: 00000001 bea726d8 014d40e0 01911fb8 [ 46.232563] 9fc0: 00490000 0004cb15 00523858 006f6b68 00000000 b6f0c9c8 b6f0c9c8 bea72724 [ 46.232569] 9fe0: 00000000 bea72678 b6ee2cbc b6ee41ec 200d0010 ffffffff [ 46.232573] irq event stamp: 15628 [ 46.232577] hardirqs last enabled at (15627): [<c01dba64>] ktime_get+0x1a4/0x1c8 [ 46.232585] hardirqs last disabled at (15628): [<c0cfbfb0>] _raw_spin_lock_irqsave+0x68/0x6c [ 46.232594] softirqs last enabled at (15332): [<c01015d8>] __do_softirq+0x328/0x590 [ 46.232600] softirqs last disabled at (15327): [<c012cda8>] __irq_exit_rcu+0x128/0x1a8 [ 46.232607] ---[ end trace 8655230c4b3626fb ]--- [32852.339559] ext2 filesystem being mounted at /boot supports timestamps until 2038 (0x7fffffff)
