The 6.3-rc1 and later release candidates are hanging during boot on our Dell PowerEdge R620 servers with Intel I350 nics (igb). After bisecting from v6.2 to v6.3-rc1, I isolated the problem to: [6fffbc7ae1373e10b989afe23a9eeb9c49fe15c3] PCI: Honor firmware's device disabled status diff --git a/drivers/pci/probe.c b/drivers/pci/probe.c index 1779582fb500..b1d80c1d7a69 100644 --- a/drivers/pci/probe.c +++ b/drivers/pci/probe.c @@ -1841,6 +1841,8 @@ int pci_setup_device(struct pci_dev *dev) pci_set_of_node(dev); pci_set_acpi_fwnode(dev); + if (dev->dev.fwnode && !fwnode_device_is_available(dev->dev.fwnode)) + return -ENODEV; pci_dev_assign_slot(dev); I have verified that reverting 6fffbc7ae1373e10b989afe23a9eeb9c49fe15c3 resolves the issue on v6.3-rc4. Here's the kernel log from v6.3.0-rc1: igb: Intel(R) Gigabit Ethernet Network Driver igb: Copyright (c) 2007-2014 Intel Corporation. igb 0000:07:00.0: can't derive routing for PCI INT D igb 0000:07:00.0: PCI INT D: no GSI igb 0000:07:00.0 0000:07:00.0 (uninitialized): PCIe link lost ------------[ cut here ]------------ igb: Failed to read reg 0x18! WARNING: CPU: 23 PID: 814 at drivers/net/ethernet/intel/igb/igb_main.c:745 igb_rd32+0x78/0x90 [igb] Modules linked in: igb(+) fjes(-) mei rapl intel_cstate mdio intel_uncore ipmi_si iTCO_wdt intel_pmc_bxt ipmi_devi> CPU: 23 PID: 814 Comm: systemd-udevd Not tainted 6.3.0-rc1 #1 Hardware name: Dell Inc. PowerEdge R620/01W23F, BIOS 2.2.2 01/16/2014 RIP: 0010:igb_rd32+0x78/0x90 [igb] Code: 48 c7 c6 f5 56 d3 c0 e8 96 51 f9 c8 48 8b bb 28 ff ff ff e8 3a 46 b6 c8 84 c0 74 c9 89 ee 48 c7 c7 18 64 d3 > RSP: 0018:ffffab6a07d37b10 EFLAGS: 00010286 RAX: 000000000000001d RBX: ffff900385208f18 RCX: 0000000000000000 RDX: 0000000000000002 RSI: ffffffff8a8ba498 RDI: 00000000ffffffff RBP: 0000000000000018 R08: 0000000000000000 R09: ffffab6a07d379b8 R10: 0000000000000003 R11: ffffffff8b143de8 R12: ffff8ffc4518b0d0 R13: ffff9003852089c0 R14: ffff900385208f18 R15: ffff900385208000 FS: 00007faa81c07b40(0000) GS:ffff900b5fcc0000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007faa811c3594 CR3: 000000010c6c0001 CR4: 00000000001706e0 Call Trace: <TASK> igb_get_invariants_82575+0x92/0xec0 [igb] igb_probe+0x3bd/0x1510 [igb] local_pci_probe+0x41/0x90 pci_device_probe+0xb3/0x220 really_probe+0x1a2/0x400 ? __pfx___driver_attach+0x10/0x10 __driver_probe_device+0x78/0x170 driver_probe_device+0x1f/0x90 __driver_attach+0xce/0x1c0 bus_for_each_dev+0x74/0xb0 bus_add_driver+0x112/0x210 driver_register+0x55/0x100 ? __pfx_init_module+0x10/0x10 [igb] do_one_initcall+0x59/0x230 do_init_module+0x4a/0x210 __do_sys_finit_module+0x93/0xf0 do_syscall_64+0x5b/0x80 ? do_syscall_64+0x67/0x80 ? syscall_exit_to_user_mode_prepare+0x18e/0x1c0 ? syscall_exit_to_user_mode+0x17/0x40 ? do_syscall_64+0x67/0x80 ? syscall_exit_to_user_mode+0x17/0x40 ? do_syscall_64+0x67/0x80 ? __irq_exit_rcu+0x3d/0x140 ? common_interrupt+0x61/0xd0 entry_SYSCALL_64_after_hwframe+0x72/0xdc RIP: 0033:0x7faa81b0b27d Code: 5d c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c > RSP: 002b:00007fff03879908 EFLAGS: 00000246 ORIG_RAX: 0000000000000139 RAX: ffffffffffffffda RBX: 00005594ac692a60 RCX: 00007faa81b0b27d RDX: 0000000000000000 RSI: 00007faa8224d43c RDI: 000000000000000e RBP: 00007faa8224d43c R08: 0000000000000000 R09: 00005594ac758fc0 R10: 000000000000000e R11: 0000000000000246 R12: 0000000000020000 R13: 00005594ac690480 R14: 0000000000000000 R15: 00005594ac693450 </TASK>