Hi, > On 9 Apr 2024, at 04:07, Xiubo Li <xiubli@xxxxxxxxxx> wrote: > > Thanks for reporting this, I generated one patch to fix it. Will send it out after testing is done. Trace from our users, but from mainline kernel. Look like as trace above kernel: ------------[ cut here ]------------ kernel: list_add corruption. next->prev should be prev (ffff8fb9c22139b8), but was ffff8fb9c18910c0. (next=ffff8fb9c18910c0). kernel: WARNING: CPU: 2 PID: 861985 at lib/list_debug.c:29 __list_add_valid_or_report+0x6a/0xa0 kernel: Modules linked in: cbc ceph libceph libcrc32c dns_resolver netfs intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul polyval_clmulni polyval_generic gf128mul ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 cfg80211 aesni_intel crypto_simd cryptd rapl rfkill joydev mousedev psmouse i2c_piix4 pcspkr mac_hid dm_mod fuse loop nfnetlink qemu_fw_cfg ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 virtio_net net_failover virtio_rng failover virtio_scsi virtio_balloon virtio_console hid_generic usbhid sr_mod cdrom serio_raw ata_generic atkbd pata_acpi virtio_pci dr> kernel: CPU: 2 PID: 861985 Comm: kworker/u36:4 Tainted: G D W 6.8.4-arch1-1 #1 7ea0d8fced45b5f098eb034690645970f116c34c kernel: Hardware name: oVirt RHEL, BIOS 1.14.0-1.el8 04/01/2014 kernel: Workqueue: writeback wb_workfn (flush-ceph-1) kernel: RIP: 0010:__list_add_valid_or_report+0x6a/0xa0 kernel: Code: a4 ff 0f 0b 31 c0 c3 cc cc cc cc 48 c7 c7 40 95 a6 8e e8 d9 31 a4 ff 0f 0b eb e9 48 89 c1 48 c7 c7 68 95 a6 8e e8 c6 31 a4 ff <0f> 0b eb d6 48 89 d1 48 89 c6 4c 89 c2 48 c7 c7 b8 95 a6 8e e8 ad kernel: RSP: 0018:ffffafb5c4e03b70 EFLAGS: 00010286 kernel: RAX: 0000000000000000 RBX: ffff8fb9f1f7e820 RCX: 0000000000000027 kernel: RDX: ffff8fbaf7aa19c8 RSI: 0000000000000001 RDI: ffff8fbaf7aa19c0 kernel: RBP: ffff8fb9f1f7ead8 R08: 0000000000000000 R09: ffffafb5c4e03a00 kernel: R10: ffffafb5c4e039f8 R11: 0000000000000003 R12: ffff8fb9f1f7eca0 kernel: R13: ffff8fb9c2213800 R14: ffff8fb9c22139c8 R15: 0000000000000001 kernel: FS: 0000000000000000(0000) GS:ffff8fbaf7a80000(0000) knlGS:0000000000000000 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 kernel: CR2: 00007dcc9182fd08 CR3: 000000010bc78005 CR4: 00000000003706f0 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 kernel: Call Trace: kernel: <TASK> kernel: ? __list_add_valid_or_report+0x6a/0xa0 kernel: ? __warn+0x81/0x130 kernel: ? __list_add_valid_or_report+0x6a/0xa0 kernel: ? report_bug+0x171/0x1a0 kernel: ? console_unlock+0x78/0x120 kernel: ? handle_bug+0x3c/0x80 kernel: ? exc_invalid_op+0x17/0x70 kernel: ? asm_exc_invalid_op+0x1a/0x20 kernel: ? __list_add_valid_or_report+0x6a/0xa0 kernel: ceph_write_inode+0x35b/0x390 [ceph e22e5e8fbb2e717a1d900c81c3b686cc119b9d81] kernel: ? do_writepages+0x1bb/0x1e0 kernel: __writeback_single_inode+0x2a9/0x360 kernel: writeback_sb_inodes+0x1ed/0x4b0 kernel: __writeback_inodes_wb+0x4c/0xf0 kernel: wb_writeback+0x298/0x310 kernel: wb_workfn+0x368/0x510 kernel: process_one_work+0x178/0x350 kernel: worker_thread+0x30f/0x450 kernel: ? __pfx_worker_thread+0x10/0x10 kernel: kthread+0xe5/0x120 kernel: ? __pfx_kthread+0x10/0x10 kernel: ret_from_fork+0x31/0x50 kernel: ? __pfx_kthread+0x10/0x10 kernel: ret_from_fork_asm+0x1b/0x30 kernel: </TASK> kernel: ---[ end trace 0000000000000000 ]--- k _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx