Adding Paolo On 4/2/22 12:39 AM, Chris Murphy wrote: > Looks like a regression of some sort in BFQ, but I'm not immediately > aware of a manifestation in user space. I've also found four other > downstream BFQ related call traces with xfs and btrfs joining in. I'll > list those before the trace... > > [ 45.263999] kernel: ------------[ cut here ]------------ > [ 45.264006] kernel: WARNING: CPU: 4 PID: 73 at > block/bfq-iosched.c:602 bfqq_request_over_limit+0x122/0x3a0 > [ 45.264014] kernel: Modules linked in: uinput rfcomm snd_seq_dummy > snd_hrtimer nft_objref nf_conntrack_netbios_ns nf_conntrack_broadcast > nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet > nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat > nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink > qrtr bnep b43 snd_hda_codec_cirrus snd_hda_codec_generic btusb > uvcvideo cordic btrtl ledtrig_audio mac80211 btbcm videobuf2_vmalloc > snd_hda_intel btintel videobuf2_memops snd_intel_dspcfg videobuf2_v4l2 > btmtk snd_intel_sdw_acpi libarc4 videobuf2_common snd_hda_codec > cfg80211 bluetooth intel_rapl_msr videodev intel_rapl_common > snd_hda_core ssb mc x86_pkg_temp_thermal intel_powerclamp coretemp > ecdh_generic snd_hwdep rfkill kvm_intel snd_seq bcm5974 > apple_mfi_fastcharge snd_seq_device i915 joydev snd_pcm kvm snd_timer > irqbypass snd mei_pxp iTCO_wdt mei_hdcp intel_pmc_bxt bcma applesmc > at24 soundcore iTCO_vendor_support mei_me rapl i2c_i801 acpi_als > intel_cstate ttm > [ 45.264066] kernel: mei intel_uncore industrialio_triggered_buffer > i2c_smbus lpc_ich sbs kfifo_buf apple_gmux sbshc industrialio apple_bl > pcspkr zram isofs squashfs crct10dif_pclmul crc32_pclmul crc32c_intel > sdhci_pci cqhci ghash_clmulni_intel hid_appleir firewire_ohci sdhci > tg3 thunderbolt firewire_core mmc_core crc_itu_t hid_apple video uas > usb_storage sunrpc be2iscsi bnx2i cnic uio cxgb4i cxgb4 tls cxgb3i > cxgb3 mdio libcxgbi libcxgb qla4xxx iscsi_boot_sysfs iscsi_tcp > libiscsi_tcp libiscsi scsi_transport_iscsi loop ip6_tables ip_tables > ipmi_devintf ipmi_msghandler fuse > [ 45.264101] kernel: CPU: 4 PID: 73 Comm: kworker/u16:2 Not tainted > 5.17.1-300.fc36.x86_64 #1 > [ 45.264104] kernel: Hardware name: Apple Inc. > MacBookPro8,2/Mac-94245A3940C91C80, BIOS > MBP81.88Z.0050.B00.1804101331 04/10/18 > [ 45.264106] kernel: Workqueue: loop0 loop_workfn [loop] > [ 45.264112] kernel: RIP: 0010:bfqq_request_over_limit+0x122/0x3a0 > [ 45.264115] kernel: Code: 1e 48 8b 5b 60 8d 78 01 48 83 c6 08 48 85 > db 0f 84 0e 02 00 00 89 f8 44 0f b6 63 18 45 84 e4 0f 84 f4 01 00 00 > 44 39 e8 7c d4 <0f> 0b 8d 58 ff 44 39 e8 0f 85 24 02 00 00 83 fb ff 0f > 84 d8 01 00 > [ 45.264118] kernel: RSP: 0018:ffffa8e34034f7b8 EFLAGS: 00010046 > [ 45.264120] kernel: RAX: 0000000000000005 RBX: ffff92914c004098 > RCX: 0000000000000000 > [ 45.264122] kernel: RDX: 0000000000000000 RSI: ffffa8e34034f800 > RDI: 0000000000000005 > [ 45.264123] kernel: RBP: ffff9291435c5680 R08: 0000000000000800 > R09: 0000000000008000 > [ 45.264125] kernel: R10: 0000000000000000 R11: ffffa8e34034f8e0 > R12: 0000000000000001 > [ 45.264126] kernel: R13: 0000000000000005 R14: 0000000000000004 > R15: 0000000000000002 > [ 45.264128] kernel: FS: 0000000000000000(0000) > GS:ffff9293a3b00000(0000) knlGS:0000000000000000 > [ 45.264130] kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 45.264131] kernel: CR2: 00007fa7a5755000 CR3: 000000010a9ec002 > CR4: 00000000000606e0 > [ 45.264133] kernel: Call Trace: > [ 45.264136] kernel: <TASK> > [ 45.264140] kernel: ? mempool_alloc+0x4f/0x170 > [ 45.264145] kernel: ? bvec_alloc+0x62/0xb0 > [ 45.264148] kernel: ? kmem_cache_alloc+0x162/0x2c0 > [ 45.264152] kernel: bfq_limit_depth+0xc3/0x220 > [ 45.264155] kernel: __blk_mq_alloc_requests+0x237/0x2a0 > [ 45.264160] kernel: blk_mq_submit_bio+0x3d3/0x620 > [ 45.264163] kernel: submit_bio_noacct+0x1f3/0x2a0 > [ 45.264165] kernel: mpage_readahead+0x133/0x180 > [ 45.264171] kernel: ? isofs_get_blocks+0x210/0x210 [isofs] > [ 45.264175] kernel: read_pages+0x61/0x2a0 > [ 45.264178] kernel: page_cache_ra_unbounded+0x1a8/0x200 > [ 45.264182] kernel: filemap_get_pages+0x4ab/0x620 > [ 45.264185] kernel: ? copy_page_to_iter+0x2bd/0x410 > [ 45.264189] kernel: filemap_read+0xa8/0x2e0 > [ 45.264192] kernel: ? avc_has_perm+0x7a/0x170 > [ 45.264196] kernel: ? check_preempt_wakeup+0x125/0x2a0 > [ 45.264202] kernel: do_iter_readv_writev+0x149/0x180 > [ 45.264206] kernel: do_iter_read+0xde/0x1d0 > [ 45.264209] kernel: loop_process_work+0x68f/0x8f0 [loop] > [ 45.264214] kernel: process_one_work+0x1c4/0x380 > [ 45.264218] kernel: worker_thread+0x4d/0x380 > [ 45.264221] kernel: ? process_one_work+0x380/0x380 > [ 45.264223] kernel: kthread+0xe6/0x110 > [ 45.264225] kernel: ? kthread_complete_and_exit+0x20/0x20 > [ 45.264227] kernel: ret_from_fork+0x1f/0x30 > [ 45.264233] kernel: </TASK> > [ 45.264234] kernel: ---[ end trace 0000000000000000 ]--- > > > https://bugzilla.redhat.com/show_bug.cgi?id=2068723 > https://bugzilla.redhat.com/show_bug.cgi?id=2049004 > https://bugzilla.redhat.com/show_bug.cgi?id=2066214 > https://bugzilla.redhat.com/show_bug.cgi?id=2064732 > -- Jens Axboe
