Re: Client kernel crashes on cephfs access

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Konstantin,

We have fixed it, please see https://patchwork.kernel.org/project/ceph-devel/list/?series=842682&archive=both.

- Xiubo

On 4/18/24 00:05, Konstantin Shalygin wrote:
Hi,

On 9 Apr 2024, at 04:07, Xiubo Li <xiubli@xxxxxxxxxx> wrote:

Thanks for reporting this, I generated one patch to fix it. Will send it out after testing is done.
Trace from our users, but from mainline kernel. Look like as trace above


kernel: ------------[ cut here ]------------
kernel: list_add corruption. next->prev should be prev (ffff8fb9c22139b8), but was ffff8fb9c18910c0. (next=ffff8fb9c18910c0).
kernel: WARNING: CPU: 2 PID: 861985 at lib/list_debug.c:29 __list_add_valid_or_report+0x6a/0xa0
kernel: Modules linked in: cbc ceph libceph libcrc32c dns_resolver netfs intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul polyval_clmulni polyval_generic gf128mul ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 cfg80211 aesni_intel crypto_simd cryptd rapl rfkill joydev mousedev psmouse i2c_piix4 pcspkr mac_hid dm_mod fuse loop nfnetlink qemu_fw_cfg ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 virtio_net net_failover virtio_rng failover virtio_scsi virtio_balloon virtio_console hid_generic usbhid sr_mod cdrom serio_raw ata_generic atkbd pata_acpi virtio_pci dr>
kernel: CPU: 2 PID: 861985 Comm: kworker/u36:4 Tainted: G      D W          6.8.4-arch1-1 #1 7ea0d8fced45b5f098eb034690645970f116c34c
kernel: Hardware name: oVirt RHEL, BIOS 1.14.0-1.el8 04/01/2014
kernel: Workqueue: writeback wb_workfn (flush-ceph-1)
kernel: RIP: 0010:__list_add_valid_or_report+0x6a/0xa0
kernel: Code: a4 ff 0f 0b 31 c0 c3 cc cc cc cc 48 c7 c7 40 95 a6 8e e8 d9 31 a4 ff 0f 0b eb e9 48 89 c1 48 c7 c7 68 95 a6 8e e8 c6 31 a4 ff <0f> 0b eb d6 48 89 d1 48 89 c6 4c 89 c2 48 c7 c7 b8 95 a6 8e e8 ad
kernel: RSP: 0018:ffffafb5c4e03b70 EFLAGS: 00010286
kernel: RAX: 0000000000000000 RBX: ffff8fb9f1f7e820 RCX: 0000000000000027
kernel: RDX: ffff8fbaf7aa19c8 RSI: 0000000000000001 RDI: ffff8fbaf7aa19c0
kernel: RBP: ffff8fb9f1f7ead8 R08: 0000000000000000 R09: ffffafb5c4e03a00
kernel: R10: ffffafb5c4e039f8 R11: 0000000000000003 R12: ffff8fb9f1f7eca0
kernel: R13: ffff8fb9c2213800 R14: ffff8fb9c22139c8 R15: 0000000000000001
kernel: FS:  0000000000000000(0000) GS:ffff8fbaf7a80000(0000) knlGS:0000000000000000
kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
kernel: CR2: 00007dcc9182fd08 CR3: 000000010bc78005 CR4: 00000000003706f0
kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
kernel: Call Trace:
kernel:  <TASK>
kernel:  ? __list_add_valid_or_report+0x6a/0xa0
kernel:  ? __warn+0x81/0x130
kernel:  ? __list_add_valid_or_report+0x6a/0xa0
kernel:  ? report_bug+0x171/0x1a0
kernel:  ? console_unlock+0x78/0x120
kernel:  ? handle_bug+0x3c/0x80
kernel:  ? exc_invalid_op+0x17/0x70
kernel:  ? asm_exc_invalid_op+0x1a/0x20
kernel:  ? __list_add_valid_or_report+0x6a/0xa0
kernel:  ceph_write_inode+0x35b/0x390 [ceph e22e5e8fbb2e717a1d900c81c3b686cc119b9d81]
kernel:  ? do_writepages+0x1bb/0x1e0
kernel:  __writeback_single_inode+0x2a9/0x360
kernel:  writeback_sb_inodes+0x1ed/0x4b0
kernel:  __writeback_inodes_wb+0x4c/0xf0
kernel:  wb_writeback+0x298/0x310
kernel:  wb_workfn+0x368/0x510
kernel:  process_one_work+0x178/0x350
kernel:  worker_thread+0x30f/0x450
kernel:  ? __pfx_worker_thread+0x10/0x10
kernel:  kthread+0xe5/0x120
kernel:  ? __pfx_kthread+0x10/0x10
kernel:  ret_from_fork+0x31/0x50
kernel:  ? __pfx_kthread+0x10/0x10
kernel:  ret_from_fork_asm+0x1b/0x30
kernel:  </TASK>
kernel: ---[ end trace 0000000000000000 ]---



k
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux