Adding linux-pci. One thing that may be slightly unusual about our setup is that we are using CONFIG_PREEMPT=y, which may be allowing more concurrency to come into play. On 2019-06-07 6:28 p.m., Robert Hancock wrote: > I am seeing a boot failure on our iMX6D-based embedded platform running > v5.2-rc3. It seems to stall for about 20 seconds after "random: crng > init done" and then panic with a bunch of RCU stall and soft-lockup > errors. It seems like something is hanging up in the iMX6 PCIe driver. > Boot log is below. > > Suspecting the following patch, I reverted it locally and it seems to > resolve the issue. (Well it gets into userspace at least; it later > oopses in the ksz switch driver, appears unrelated..) > > commit 1b8df7aa78748ddafc6f3b16a6328a3c500087b3 > Author: Lucas Stach <l.stach@xxxxxxxxxxxxxx> > Date: Thu Apr 4 18:45:17 2019 +0200 > > PCI: imx6: Allow asynchronous probing > > Establishing a PCIe link can take a while; allow asynchronous probing so > that link establishment can happen in the background while other devices > are being probed. > > Signed-off-by: Lucas Stach <l.stach@xxxxxxxxxxxxxx> > Signed-off-by: Lorenzo Pieralisi <lorenzo.pieralisi@xxxxxxx> > Signed-off-by: Bjorn Helgaas <bhelgaas@xxxxxxxxxx> > Reviewed-by: Fabio Estevam <festevam@xxxxxxxxx> > > I would say either that patch needs a fix or it should be reverted for now. > > [ 0.000000] Booting Linux on physical CPU 0x0 > [ 0.000000] Linux version 5.2.0-rc3 > (hancock@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 8.3.0 > (Buildroot 2019.02.1-00510-gcc60ea2)) #1 SMP PREEMPT Fri Jun 7 17:44:38 > CST 2019 > [ 0.000000] CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7), > cr=10c5387d > [ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing > instruction cache > [ 0.000000] OF: fdt: Machine model: SED Systems xxx > [ 0.000000] printk: bootconsole [earlycon0] enabled > [ 0.000000] Memory policy: Data cache writealloc > [ 0.000000] cma: Reserved 64 MiB at 0x3c000000 > [ 0.000000] percpu: Embedded 16 pages/cpu s36364 r8192 d20980 u65536 > [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 260608 > [ 0.000000] Kernel command line: console=ttymxc0,115200 earlyprintk > [ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 > bytes) > [ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 > bytes) > [ 0.000000] Memory: 940708K/1048576K available (6144K kernel code, > 304K rwdata, 2036K rodata, 1024K init, 377K bss, 42332K reserved, 65536K > cma-reserved, 262144K highmem) > [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 > [ 0.000000] rcu: Preemptible hierarchical RCU implementation. > [ 0.000000] rcu: RCU event tracing is enabled. > [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=4 to nr_cpu_ids=2. > [ 0.000000] Tasks RCU enabled. > [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay > is 100 jiffies. > [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 > [ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16 > [ 0.000000] L2C-310 errata 752271 769419 enabled > [ 0.000000] L2C-310 enabling early BRESP for Cortex-A9 > [ 0.000000] L2C-310 full line of zeros enabled for Cortex-A9 > [ 0.000000] L2C-310 ID prefetch enabled, offset 16 lines > [ 0.000000] L2C-310 dynamic clock gating enabled, standby mode enabled > [ 0.000000] L2C-310 cache controller enabled, 16 ways, 1024 kB > [ 0.000000] L2C-310: CACHE_ID 0x410000c7, AUX_CTRL 0x76470001 > [ 0.000000] random: get_random_bytes called from > start_kernel+0x2ac/0x434 with crng_init=0 > [ 0.000000] Switching to timer-based delay loop, resolution 333ns > [ 0.000007] sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps > every 715827882841ns > [ 0.008211] clocksource: mxc_timer1: mask: 0xffffffff max_cycles: > 0xffffffff, max_idle_ns: 637086815595 ns > [ 0.019178] Console: colour dummy device 80x30 > [ 0.023670] Calibrating delay loop (skipped), value calculated using > timer frequency.. 6.00 BogoMIPS (lpj=3000) > [ 0.033799] pid_max: default: 32768 minimum: 301 > [ 0.038557] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes) > [ 0.045211] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 > bytes) > [ 0.052846] *** VALIDATE proc *** > [ 0.056285] *** VALIDATE cgroup1 *** > [ 0.059886] *** VALIDATE cgroup2 *** > [ 0.063483] CPU: Testing write buffer coherency: ok > [ 0.068401] CPU0: Spectre v2: using BPIALL workaround > [ 0.073698] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000 > [ 0.085424] Setting up static identity map for 0x10100000 - 0x10100060 > [ 0.093365] rcu: Hierarchical SRCU implementation. > [ 0.103365] smp: Bringing up secondary CPUs ... > [ 0.115623] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001 > [ 0.115630] CPU1: Spectre v2: using BPIALL workaround > [ 0.126488] smp: Brought up 1 node, 2 CPUs > [ 0.130636] SMP: Total of 2 processors activated (12.00 BogoMIPS). > [ 0.136846] CPU: All CPU(s) started in SVC mode. > [ 0.142366] devtmpfs: initialized > [ 0.153902] VFP support v0.3: implementor 41 architecture 3 part 30 > variant 9 rev 4 > [ 0.161920] clocksource: jiffies: mask: 0xffffffff max_cycles: > 0xffffffff, max_idle_ns: 1911260446275000 ns > [ 0.171715] futex hash table entries: 512 (order: 3, 32768 bytes) > [ 0.181088] pinctrl core: initialized pinctrl subsystem > [ 0.187300] NET: Registered protocol family 16 > [ 0.200572] DMA: preallocated 256 KiB pool for atomic coherent > allocations > [ 0.208274] cpuidle: using governor menu > [ 0.212276] CPU identified as i.MX6Q, silicon rev 1.5 > [ 0.224679] vdd1p1: supplied by regulator-dummy > [ 0.229707] vdd3p0: supplied by regulator-dummy > [ 0.234698] vdd2p5: supplied by regulator-dummy > [ 0.251174] No ATAGs? > [ 0.251273] hw-breakpoint: found 5 (+1 reserved) breakpoint and 1 > watchpoint registers. > [ 0.261602] hw-breakpoint: maximum watchpoint size is 4 bytes. > [ 0.268154] imx6q-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver > [ 0.305898] mxs-dma 110000.dma-apbh: initialized > [ 0.311919] SCSI subsystem initialized > [ 0.315876] usbcore: registered new interface driver usbfs > [ 0.321440] usbcore: registered new interface driver hub > [ 0.326854] usbcore: registered new device driver usb > [ 0.333218] i2c i2c-0: IMX I2C adapter registered > [ 0.338665] i2c i2c-1: IMX I2C adapter registered > [ 0.344097] i2c i2c-2: IMX I2C adapter registered > [ 0.348996] pps_core: LinuxPPS API ver. 1 registered > [ 0.353989] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 > Rodolfo Giometti <giometti@xxxxxxxx> > [ 0.363170] PTP clock support registered > [ 0.367981] clocksource: Switched to clocksource mxc_timer1 > [ 0.373841] VFS: Disk quotas dquot_6.6.0 > [ 0.377902] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 > bytes) > [ 0.394255] NET: Registered protocol family 2 > [ 0.399197] tcp_listen_portaddr_hash hash table entries: 512 (order: > 0, 6144 bytes) > [ 0.406932] TCP established hash table entries: 8192 (order: 3, 32768 > bytes) > [ 0.414093] TCP bind hash table entries: 8192 (order: 4, 65536 bytes) > [ 0.420715] TCP: Hash tables configured (established 8192 bind 8192) > [ 0.427291] UDP hash table entries: 512 (order: 2, 16384 bytes) > [ 0.433288] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes) > [ 0.439846] NET: Registered protocol family 1 > [ 0.444268] PCI: CLS 0 bytes, default 64 > [ 0.448405] Trying to unpack rootfs image as initramfs... > [ 13.138778] Freeing initrd memory: 21968K > [ 13.143193] hw perfevents: no interrupt-affinity property for /pmu, > guessing. > [ 13.150628] hw perfevents: enabled with armv7_cortex_a9 PMU driver, 7 > counters available > [ 13.160714] workingset: timestamp_bits=30 max_order=18 bucket_order=0 > [ 13.171611] squashfs: version 4.0 (2009/01/31) Phillip Lougher > [ 13.177956] bounce: pool size: 64 pages > [ 13.181837] io scheduler mq-deadline registered > [ 13.186401] io scheduler kyber registered > [ 13.193578] imx6q-pcie 1ffc000.pcie: host bridge /soc/pcie@1ffc000 > ranges: > [ 13.200635] imx6q-pcie 1ffc000.pcie: IO 0x01f80000..0x01f8ffff -> > 0x00000000 > [ 13.201454] imx-sdma 20ec000.sdma: loaded firmware 3.3 > [ 13.208445] random: fast init done > [ 13.216275] imx-pgc-pd imx-pgc-power-domain.0: DMA mask not set > [ 13.222661] imx-pgc-pd imx-pgc-power-domain.1: DMA mask not set > [ 13.239568] random: crng init done > [ 34.207973] rcu: INFO: rcu_preempt self-detected stall on CPU > [ 34.213742] rcu: 0-...!: (20992 ticks this GP) > idle=94a/1/0x40000004 softirq=72/72 fqs=5 > [ 34.222025] (t=21000 jiffies g=2937 q=7) > [ 34.226048] rcu: rcu_preempt kthread starved for 20964 jiffies! g2937 > f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1 > [ 34.236331] rcu: RCU grace-period kthread stack dump: > [ 34.241392] rcu_preempt R running task 0 10 2 > 0x00000000 > [ 34.248489] [<c06b77e0>] (__schedule) from [<c06b7a50>] > (schedule+0x58/0x104) > [ 34.255652] [<c06b7a50>] (schedule) from [<c06bb51c>] > (schedule_timeout+0x15c/0x270) > [ 34.263427] [<c06bb51c>] (schedule_timeout) from [<c017f104>] > (rcu_gp_kthread+0x548/0xab8) > [ 34.271721] [<c017f104>] (rcu_gp_kthread) from [<c013e78c>] > (kthread+0x144/0x14c) > [ 34.279230] [<c013e78c>] (kthread) from [<c01010e8>] > (ret_from_fork+0x14/0x2c) > [ 34.286469] Exception stack(0xe808bfb0 to 0xe808bff8) > [ 34.291534] bfa0: 00000000 > 00000000 00000000 00000000 > [ 34.299731] bfc0: 00000000 00000000 00000000 00000000 00000000 > 00000000 00000000 00000000 > [ 34.307928] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000 > [ 34.314559] NMI backtrace for cpu 0 > [ 34.318061] CPU: 0 PID: 7 Comm: kworker/u4:0 Not tainted 5.2.0-rc3 #1 > [ 34.324515] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree) > [ 34.331064] Workqueue: events_unbound async_run_entry_fn > [ 34.336404] [<c0110be4>] (unwind_backtrace) from [<c010bac0>] > (show_stack+0x10/0x14) > [ 34.344174] [<c010bac0>] (show_stack) from [<c069f790>] > (dump_stack+0x88/0x9c) > [ 34.351420] [<c069f790>] (dump_stack) from [<c06a5e88>] > (nmi_cpu_backtrace+0x90/0xc4) > [ 34.359275] [<c06a5e88>] (nmi_cpu_backtrace) from [<c06a6020>] > (nmi_trigger_cpumask_backtrace+0x164/0x1a4) > [ 34.368958] [<c06a6020>] (nmi_trigger_cpumask_backtrace) from > [<c01810a4>] (rcu_dump_cpu_stacks+0xa4/0xcc) > [ 34.378640] [<c01810a4>] (rcu_dump_cpu_stacks) from [<c0180224>] > (rcu_sched_clock_irq+0x7c4/0xa40) > [ 34.387630] [<c0180224>] (rcu_sched_clock_irq) from [<c01864b4>] > (update_process_times+0x34/0x6c) > [ 34.396536] [<c01864b4>] (update_process_times) from [<c0197234>] > (tick_sched_timer+0x4c/0xa8) > [ 34.405177] [<c0197234>] (tick_sched_timer) from [<c01876a8>] > (__hrtimer_run_queues+0x154/0x1fc) > [ 34.413987] [<c01876a8>] (__hrtimer_run_queues) from [<c0187a84>] > (hrtimer_interrupt+0x11c/0x2b0) > [ 34.422885] [<c0187a84>] (hrtimer_interrupt) from [<c010fa48>] > (twd_handler+0x30/0x38) > [ 34.430829] [<c010fa48>] (twd_handler) from [<c0172e7c>] > (handle_percpu_devid_irq+0x78/0x138) > [ 34.439379] [<c0172e7c>] (handle_percpu_devid_irq) from [<c016d424>] > (generic_handle_irq+0x24/0x34) > [ 34.448449] [<c016d424>] (generic_handle_irq) from [<c016d9e0>] > (__handle_domain_irq+0x5c/0xb4) > [ 34.457178] [<c016d9e0>] (__handle_domain_irq) from [<c0398cd0>] > (gic_handle_irq+0x3c/0x78) > [ 34.465555] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>] > (__irq_svc+0x6c/0xa8) > [ 34.473052] Exception stack(0xe8081a88 to 0xe8081ad0) > [ 34.478117] 1a80: 2ad3e000 00000000 2ad3e000 > c0a60f00 00000002 00000000 > [ 34.486317] 1aa0: 00000001 ffffe000 e800c000 c0b03080 c0b4eb88 > c0b4e688 04208060 e8081ad8 > [ 34.494513] 1ac0: 04208060 c0102258 60000113 ffffffff > [ 34.499583] [<c0101a8c>] (__irq_svc) from [<c0102258>] > (__do_softirq+0xb0/0x2ac) > [ 34.507004] [<c0102258>] (__do_softirq) from [<c01259c0>] > (irq_exit+0xb0/0xd4) > [ 34.514250] [<c01259c0>] (irq_exit) from [<c016d9e4>] > (__handle_domain_irq+0x60/0xb4) > [ 34.522103] [<c016d9e4>] (__handle_domain_irq) from [<c0398cd0>] > (gic_handle_irq+0x3c/0x78) > [ 34.530477] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>] > (__irq_svc+0x6c/0xa8) > [ 34.537974] Exception stack(0xe8081b68 to 0xe8081bb0) > [ 34.543039] 1b60: 20000193 2ad3e000 00000000 > 20000113 00000001 00000000 > [ 34.551238] 1b80: 00000053 00000000 e8080000 c01149e4 c0b4eb88 > c0b4e688 0000000a e8081bb8 > [ 34.559433] 1ba0: c016ace4 c016acec 20000113 ffffffff > [ 34.564508] [<c0101a8c>] (__irq_svc) from [<c016acec>] > (console_unlock+0x290/0x410) > [ 34.572190] [<c016acec>] (console_unlock) from [<c016c4f8>] > (vprintk_emit+0x170/0x228) > [ 34.580134] [<c016c4f8>] (vprintk_emit) from [<c0429c48>] > (dev_vprintk_emit+0x1d4/0x1f4) > [ 34.588247] [<c0429c48>] (dev_vprintk_emit) from [<c0429c94>] > (dev_printk_emit+0x2c/0x50) > [ 34.596446] [<c0429c94>] (dev_printk_emit) from [<c0429d34>] > (__dev_printk+0x7c/0x90) > [ 34.604297] [<c0429d34>] (__dev_printk) from [<c042a058>] > (_dev_info+0x44/0x68) > [ 34.611636] [<c042a058>] (_dev_info) from [<c03c4154>] > (devm_of_pci_get_host_bridge_resources+0x198/0x298) > [ 34.621322] [<c03c4154>] (devm_of_pci_get_host_bridge_resources) from > [<c03d0a2c>] (dw_pcie_host_init+0xb4/0x544) > [ 34.631611] [<c03d0a2c>] (dw_pcie_host_init) from [<c03d261c>] > (imx6_pcie_probe+0x3a0/0x6b8) > [ 34.640077] [<c03d261c>] (imx6_pcie_probe) from [<c042dd20>] > (platform_drv_probe+0x48/0x98) > [ 34.648454] [<c042dd20>] (platform_drv_probe) from [<c042bfac>] > (really_probe+0xf0/0x2c8) > [ 34.656656] [<c042bfac>] (really_probe) from [<c042c2e4>] > (driver_probe_device+0x60/0x16c) > [ 34.664943] [<c042c2e4>] (driver_probe_device) from [<c042c440>] > (__driver_attach_async_helper+0x50/0x54) > [ 34.674536] [<c042c440>] (__driver_attach_async_helper) from > [<c014188c>] (async_run_entry_fn+0x44/0x118) > [ 34.684136] [<c014188c>] (async_run_entry_fn) from [<c013865c>] > (process_one_work+0x17c/0x390) > [ 34.692775] [<c013865c>] (process_one_work) from [<c01393a0>] > (worker_thread+0x44/0x518) > [ 34.700890] [<c01393a0>] (worker_thread) from [<c013e78c>] > (kthread+0x144/0x14c) > [ 34.708307] [<c013e78c>] (kthread) from [<c01010e8>] > (ret_from_fork+0x14/0x2c) > [ 34.715545] Exception stack(0xe8081fb0 to 0xe8081ff8) > [ 34.720607] 1fa0: 00000000 > 00000000 00000000 00000000 > [ 34.728804] 1fc0: 00000000 00000000 00000000 00000000 00000000 > 00000000 00000000 00000000 > [ 34.737000] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000 > [ 40.259973] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > [migration/1:15] > [ 40.267211] Modules linked in: > [ 40.270279] CPU: 1 PID: 15 Comm: migration/1 Not tainted 5.2.0-rc3 #1 > [ 40.276732] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree) > [ 40.283284] PC is at multi_cpu_stop+0xe0/0x124 > [ 40.287738] LR is at multi_cpu_stop+0x114/0x124 > [ 40.292279] pc : [<c01ae4d8>] lr : [<c01ae50c>] psr: 60000013 > [ 40.298558] sp : e809df10 ip : 00000000 fp : 00000000 > [ 40.303794] r10: 00000000 r9 : a0000013 r8 : 00000000 > [ 40.309030] r7 : 00000001 r6 : e81cbea4 r5 : 00000001 r4 : e81cbeb8 > [ 40.315571] r3 : 00000001 r2 : 00000000 r1 : 00000004 r0 : 00000000 > [ 40.322114] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM > Segment none > [ 40.329266] Control: 10c5387d Table: 1000404a DAC: 00000051 > [ 40.335025] CPU: 1 PID: 15 Comm: migration/1 Not tainted 5.2.0-rc3 #1 > [ 40.341477] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree) > [ 40.348031] [<c0110be4>] (unwind_backtrace) from [<c010bac0>] > (show_stack+0x10/0x14) > [ 40.355799] [<c010bac0>] (show_stack) from [<c069f790>] > (dump_stack+0x88/0x9c) > [ 40.363047] [<c069f790>] (dump_stack) from [<c01af5c0>] > (watchdog_timer_fn+0x244/0x2bc) > [ 40.371080] [<c01af5c0>] (watchdog_timer_fn) from [<c01876a8>] > (__hrtimer_run_queues+0x154/0x1fc) > [ 40.379978] [<c01876a8>] (__hrtimer_run_queues) from [<c0187a84>] > (hrtimer_interrupt+0x11c/0x2b0) > [ 40.388875] [<c0187a84>] (hrtimer_interrupt) from [<c010fa48>] > (twd_handler+0x30/0x38) > [ 40.396818] [<c010fa48>] (twd_handler) from [<c0172e7c>] > (handle_percpu_devid_irq+0x78/0x138) > [ 40.405367] [<c0172e7c>] (handle_percpu_devid_irq) from [<c016d424>] > (generic_handle_irq+0x24/0x34) > [ 40.414434] [<c016d424>] (generic_handle_irq) from [<c016d9e0>] > (__handle_domain_irq+0x5c/0xb4) > [ 40.423159] [<c016d9e0>] (__handle_domain_irq) from [<c0398cd0>] > (gic_handle_irq+0x3c/0x78) > [ 40.431534] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>] > (__irq_svc+0x6c/0xa8) > [ 40.439032] Exception stack(0xe809dec0 to 0xe809df08) > [ 40.444098] dec0: 00000000 00000004 00000000 00000001 e81cbeb8 > 00000001 e81cbea4 00000001 > [ 40.452296] dee0: 00000000 a0000013 00000000 00000000 00000000 > e809df10 c01ae50c c01ae4d8 > [ 40.460490] df00: 60000013 ffffffff > [ 40.463993] [<c0101a8c>] (__irq_svc) from [<c01ae4d8>] > (multi_cpu_stop+0xe0/0x124) > [ 40.471586] [<c01ae4d8>] (multi_cpu_stop) from [<c01ae748>] > (cpu_stopper_thread+0x8c/0x128) > [ 40.479963] [<c01ae748>] (cpu_stopper_thread) from [<c0142330>] > (smpboot_thread_fn+0x150/0x2bc) > [ 40.488687] [<c0142330>] (smpboot_thread_fn) from [<c013e78c>] > (kthread+0x144/0x14c) > [ 40.496450] [<c013e78c>] (kthread) from [<c01010e8>] > (ret_from_fork+0x14/0x2c) > [ 40.503686] Exception stack(0xe809dfb0 to 0xe809dff8) > [ 40.508749] dfa0: 00000000 > 00000000 00000000 00000000 > [ 40.516946] dfc0: 00000000 00000000 00000000 00000000 00000000 > 00000000 00000000 00000000 > [ 40.525142] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000 > [ 40.531771] Kernel panic - not syncing: softlockup: hung tasks > [ 40.537619] CPU: 1 PID: 15 Comm: migration/1 Tainted: G L > 5.2.0-rc3 #1 > [ 40.545464] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree) > [ 40.552012] [<c0110be4>] (unwind_backtrace) from [<c010bac0>] > (show_stack+0x10/0x14) > [ 40.559778] [<c010bac0>] (show_stack) from [<c069f790>] > (dump_stack+0x88/0x9c) > [ 40.567028] [<c069f790>] (dump_stack) from [<c0120ec0>] > (panic+0x114/0x324) > [ 40.574013] [<c0120ec0>] (panic) from [<c01af610>] > (watchdog_timer_fn+0x294/0x2bc) > [ 40.581608] [<c01af610>] (watchdog_timer_fn) from [<c01876a8>] > (__hrtimer_run_queues+0x154/0x1fc) > [ 40.590504] [<c01876a8>] (__hrtimer_run_queues) from [<c0187a84>] > (hrtimer_interrupt+0x11c/0x2b0) > [ 40.599399] [<c0187a84>] (hrtimer_interrupt) from [<c010fa48>] > (twd_handler+0x30/0x38) > [ 40.607338] [<c010fa48>] (twd_handler) from [<c0172e7c>] > (handle_percpu_devid_irq+0x78/0x138) > [ 40.615886] [<c0172e7c>] (handle_percpu_devid_irq) from [<c016d424>] > (generic_handle_irq+0x24/0x34) > [ 40.624953] [<c016d424>] (generic_handle_irq) from [<c016d9e0>] > (__handle_domain_irq+0x5c/0xb4) > [ 40.633676] [<c016d9e0>] (__handle_domain_irq) from [<c0398cd0>] > (gic_handle_irq+0x3c/0x78) > [ 40.642049] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>] > (__irq_svc+0x6c/0xa8) > [ 40.649546] Exception stack(0xe809dec0 to 0xe809df08) > [ 40.654611] dec0: 00000000 00000004 00000000 00000001 e81cbeb8 > 00000001 e81cbea4 00000001 > [ 40.662809] dee0: 00000000 a0000013 00000000 00000000 00000000 > e809df10 c01ae50c c01ae4d8 > [ 40.671003] df00: 60000013 ffffffff > [ 40.674505] [<c0101a8c>] (__irq_svc) from [<c01ae4d8>] > (multi_cpu_stop+0xe0/0x124) > [ 40.682096] [<c01ae4d8>] (multi_cpu_stop) from [<c01ae748>] > (cpu_stopper_thread+0x8c/0x128) > [ 40.690469] [<c01ae748>] (cpu_stopper_thread) from [<c0142330>] > (smpboot_thread_fn+0x150/0x2bc) > [ 40.699191] [<c0142330>] (smpboot_thread_fn) from [<c013e78c>] > (kthread+0x144/0x14c) > [ 40.706954] [<c013e78c>] (kthread) from [<c01010e8>] > (ret_from_fork+0x14/0x2c) > [ 40.714191] Exception stack(0xe809dfb0 to 0xe809dff8) > [ 40.719255] dfa0: 00000000 > 00000000 00000000 00000000 > [ 40.727453] dfc0: 00000000 00000000 00000000 00000000 00000000 > 00000000 00000000 00000000 > [ 40.735650] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000 > [ 40.742284] CPU0: stopping > [ 40.745004] CPU: 0 PID: 7 Comm: kworker/u4:0 Tainted: G L > 5.2.0-rc3 #1 > [ 40.752850] Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree) > [ 40.759397] Workqueue: events_unbound async_run_entry_fn > [ 40.764731] [<c0110be4>] (unwind_backtrace) from [<c010bac0>] > (show_stack+0x10/0x14) > [ 40.772497] [<c010bac0>] (show_stack) from [<c069f790>] > (dump_stack+0x88/0x9c) > [ 40.779741] [<c069f790>] (dump_stack) from [<c010f100>] > (handle_IPI+0x1a8/0x1d4) > [ 40.787159] [<c010f100>] (handle_IPI) from [<c0398d08>] > (gic_handle_irq+0x74/0x78) > [ 40.794749] [<c0398d08>] (gic_handle_irq) from [<c0101a8c>] > (__irq_svc+0x6c/0xa8) > [ 40.802247] Exception stack(0xe8081a88 to 0xe8081ad0) > [ 40.807311] 1a80: 2ad3e000 00000000 2ad3e000 > c0a60f00 00000002 00000000 > [ 40.815510] 1aa0: 00000001 ffffe000 e800c000 c0b03080 c0b4eb88 > c0b4e688 04208060 e8081ad8 > [ 40.823706] 1ac0: 04208060 c0102258 60000113 ffffffff > [ 40.828774] [<c0101a8c>] (__irq_svc) from [<c0102258>] > (__do_softirq+0xb0/0x2ac) > [ 40.836191] [<c0102258>] (__do_softirq) from [<c01259c0>] > (irq_exit+0xb0/0xd4) > [ 40.843432] [<c01259c0>] (irq_exit) from [<c016d9e4>] > (__handle_domain_irq+0x60/0xb4) > [ 40.851283] [<c016d9e4>] (__handle_domain_irq) from [<c0398cd0>] > (gic_handle_irq+0x3c/0x78) > [ 40.859654] [<c0398cd0>] (gic_handle_irq) from [<c0101a8c>] > (__irq_svc+0x6c/0xa8) > [ 40.867151] Exception stack(0xe8081b68 to 0xe8081bb0) > [ 40.872215] 1b60: 20000193 2ad3e000 00000000 > 20000113 00000001 00000000 > [ 40.880414] 1b80: 00000053 00000000 e8080000 c01149e4 c0b4eb88 > c0b4e688 0000000a e8081bb8 > [ 40.888609] 1ba0: c016ace4 c016acec 20000113 ffffffff > [ 40.893680] [<c0101a8c>] (__irq_svc) from [<c016acec>] > (console_unlock+0x290/0x410) > [ 40.901358] [<c016acec>] (console_unlock) from [<c016c4f8>] > (vprintk_emit+0x170/0x228) > [ 40.909300] [<c016c4f8>] (vprintk_emit) from [<c0429c48>] > (dev_vprintk_emit+0x1d4/0x1f4) > [ 40.917410] [<c0429c48>] (dev_vprintk_emit) from [<c0429c94>] > (dev_printk_emit+0x2c/0x50) > [ 40.925608] [<c0429c94>] (dev_printk_emit) from [<c0429d34>] > (__dev_printk+0x7c/0x90) > [ 40.933457] [<c0429d34>] (__dev_printk) from [<c042a058>] > (_dev_info+0x44/0x68) > [ 40.940791] [<c042a058>] (_dev_info) from [<c03c4154>] > (devm_of_pci_get_host_bridge_resources+0x198/0x298) > [ 40.950471] [<c03c4154>] (devm_of_pci_get_host_bridge_resources) from > [<c03d0a2c>] (dw_pcie_host_init+0xb4/0x544) > [ 40.960757] [<c03d0a2c>] (dw_pcie_host_init) from [<c03d261c>] > (imx6_pcie_probe+0x3a0/0x6b8) > [ 40.969220] [<c03d261c>] (imx6_pcie_probe) from [<c042dd20>] > (platform_drv_probe+0x48/0x98) > [ 40.977593] [<c042dd20>] (platform_drv_probe) from [<c042bfac>] > (really_probe+0xf0/0x2c8) > [ 40.985792] [<c042bfac>] (really_probe) from [<c042c2e4>] > (driver_probe_device+0x60/0x16c) > [ 40.994079] [<c042c2e4>] (driver_probe_device) from [<c042c440>] > (__driver_attach_async_helper+0x50/0x54) > [ 41.003671] [<c042c440>] (__driver_attach_async_helper) from > [<c014188c>] (async_run_entry_fn+0x44/0x118) > [ 41.013266] [<c014188c>] (async_run_entry_fn) from [<c013865c>] > (process_one_work+0x17c/0x390) > [ 41.021902] [<c013865c>] (process_one_work) from [<c01393a0>] > (worker_thread+0x44/0x518) > [ 41.030015] [<c01393a0>] (worker_thread) from [<c013e78c>] > (kthread+0x144/0x14c) > [ 41.037430] [<c013e78c>] (kthread) from [<c01010e8>] > (ret_from_fork+0x14/0x2c) > [ 41.044667] Exception stack(0xe8081fb0 to 0xe8081ff8) > [ 41.049730] 1fa0: 00000000 > 00000000 00000000 00000000 > [ 41.057926] 1fc0: 00000000 00000000 00000000 00000000 00000000 > 00000000 00000000 00000000 > [ 41.066123] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000 > [ 41.072758] Rebooting in 30 seconds.. > > -- Robert Hancock Senior Software Developer SED Systems, a division of Calian Ltd. Email: hancock@xxxxxxxxxxxxx