On 04/18/2013 10:30 PM, Jens Axboe wrote: > On Thu, Apr 18 2013, Wanlong Gao wrote: >> On 04/18/2013 09:35 PM, Jens Axboe wrote: >>> On Thu, Apr 18 2013, Wanlong Gao wrote: >>>>> A bio is always fully initialized, regardless of which internal >>>>> allocator it came from. If people are doing private kmallocs, then they >>>>> better be using bio_init() as well. >>>>> >>>>> Wanlong, would it be possible to get a full dmesg on boot see I can see >>>>> what drivers and file systems are in use? Anything special about your >>>>> setup. >>>> >>>> Sure, attached. >>> >>> Does the below help? >> >> Still got panic with this patch. :-( > > Could you capture the full dump? I'd like to see what rcx was, and that > seems to have scrolled off. > I got the panic message using netconsole: EXT4-fs (sda5): mounted filesystem with ordered data mode. Opts: (null) EXT4-fs (sda8): mounted filesystem with ordered data mode. Opts: (null) EXT4-fs (sda9): warning: maximal mount count reached, running e2fsck is recommended EXT4-fs (sda9): mounted filesystem with ordered data mode. Opts: (null) EXT4-fs (sda10): mounted filesystem with ordered data mode. Opts: (null) SGI XFS with ACLs, security attributes, large block/inode numbers, no debug enabled XFS (sda11): Mounting Filesystem XFS (sda11): Ending clean mount kjournald starting. Commit interval 5 seconds EXT3-fs (sda12): warning: maximal mount count reached, running e2fsck is recommended EXT3-fs (sda12): using internal journal EXT3-fs (sda12): mounted filesystem with ordered data mode XFS (sda13): Mounting Filesystem XFS (sda13): Ending clean mount xor: measuring software checksum speed prefetch64-sse: 7572.000 MB/sec generic_sse: 6300.000 MB/sec xor: using function: prefetch64-sse (7572.000 MB/sec) raid6: sse2x1 4796 MB/s raid6: sse2x2 5449 MB/s raid6: sse2x4 5816 MB/s raid6: using algorithm sse2x4 (5816 MB/s) raid6: using ssse3x2 recovery algorithm Btrfs loaded device fsid 01548710-abce-4290-801d-5f19dde14497 devid 1 transid 131526 /dev/sda14 BUG: unable to handle kernel NULL pointer dereference at 0000000000000001 IP: [<ffffffff812484d3>] ftrace_raw_event_block_bio_complete+0x73/0xf0 PGD 0 Oops: 0000 [#1] SMP Modules linked in: btrfs raid6_pq zlib_deflate xor xfs libcrc32c netconsole ip6table_filter ip6_tables ebtable_nat ebtables nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle iptable_filter ip_tables nfsd lockd nfs_acl auth_rpcgss exportfs autofs4 sunrpc target_core_iblock target_core_file target_core_pscsi target_core_mod configfs bnx2fc cnic uio fcoe libfcoe libfc scsi_transport_fc scsi_tgt 8021q garp ppdev parport_pc parport fuse cpufreq_ondemand cachefiles fscache bridge stp llc ipv6 ext3 jbd dm_mirror dm_region_hash dm_log vhost_net macvtap macvlan tun uinput iTCO_wdt iTCO_vendor_support sg acpi_cpufreq freq_table mperf coretemp kvm_intel kvm crc32c_intel microcode serio_raw pcspkr i2c_i801 lpc_ich mfd_core ioatdma i7core_edac edac_core igb dca i2c_algo_bit i2c_core ptp pps_core dm_mod ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif pata_acpi ata_generic ata_piix CPU 3 Pid: 0, comm: swapper/3 Not tainted 3.9.0-rc7-4-gbb33db7 #1 Lenovo Lenovo WQ TR280 G3/TR350 G7/TB36D RIP: 0010:[<ffffffff812484d3>] [<ffffffff812484d3>] ftrace_raw_event_block_bio_complete+0x73/0xf0 RSP: 0018:ffff8802bfc63bb8 EFLAGS: 00010202 RAX: ffff8802b1e88698 RBX: ffff8802b05f6bc0 RCX: 0000000000000001 RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8802b1e8869c RBP: ffff8802bfc63c08 R08: 000000000000000a R09: 0000000000000000 R10: 000000000000002c R11: 0000000000000000 R12: ffffffff81a95b60 R13: 0000000000000100 R14: ffff8802b1e88694 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8802bfc60000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000001 CR3: 0000000001a0c000 CR4: 00000000000007e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process swapper/3 (pid: 0, threadinfo ffff8802b4598000, task ffff8802b4594a80) Stack: ffff8802b4546c40 0000000000000286 0000000000000100 ffff8802b4546c40 ffff8802bfc63c08 ffff8802b1f82160 ffff8802b05f6bc0 0000000000000000 0000000000001000 0000000000000000 ffff8802bfc63c38 ffffffff811b6c10 Call Trace: <IRQ> [<ffffffff811b6c10>] bio_endio+0x80/0x90 [<ffffffffa0790d26>] btrfs_end_bio+0xf6/0x190 [btrfs] [<ffffffff811b6bcd>] bio_endio+0x3d/0x90 [<ffffffff81249873>] req_bio_endio+0xa3/0xe0 [<ffffffff8124af9f>] blk_update_request+0x10f/0x480 [<ffffffff8124b337>] blk_update_bidi_request+0x27/0xb0 [<ffffffff8124c52f>] blk_end_bidi_request+0x2f/0x80 [<ffffffff8124c5d0>] blk_end_request+0x10/0x20 [<ffffffff8139c1b0>] scsi_end_request+0x40/0xb0 [<ffffffff8139c52f>] scsi_io_completion+0x9f/0x660 [<ffffffff81393899>] scsi_finish_command+0xc9/0x130 [<ffffffff8139cc57>] scsi_softirq_done+0x147/0x170 [<ffffffff81252c52>] blk_done_softirq+0x82/0xa0 [<ffffffff8105f537>] __do_softirq+0xe7/0x250 [<ffffffff8105f7a5>] irq_exit+0xb5/0xc0 [<ffffffff81570966>] do_IRQ+0x66/0xe0 [<ffffffff8156662d>] common_interrupt+0x6d/0x6d <EOI> [<ffffffff81449e30>] ? cpuidle_wrap_enter+0x50/0x90 [<ffffffff81449e29>] ? cpuidle_wrap_enter+0x49/0x90 [<ffffffff81449e80>] cpuidle_enter_tk+0x10/0x20 [<ffffffff81449887>] cpuidle_enter_state+0x17/0x50 [<ffffffff8144a0ca>] cpuidle_idle_call+0xaa/0x110 [<ffffffff8101cd0f>] cpu_idle+0xcf/0x120 [<ffffffff8155aa9a>] start_secondary+0xc8/0xca Code: 8b 4d b8 ba 28 00 00 00 45 89 e8 e8 e8 2c eb ff 48 85 c0 49 89 c6 74 5a 48 89 c7 e8 08 c6 ea ff 48 8b 4b 10 31 d2 48 85 c9 74 02 <8b> 11 89 50 08 48 8b 13 48 8d 78 20 48 89 50 10 8b 53 30 44 89 RIP [<ffffffff812484d3>] ftrace_raw_event_block_bio_complete+0x73/0xf0 RSP <ffff8802bfc63bb8> CR2: 0000000000000001 ---[ end trace b13662c9f1a097d8 ]--- Kernel panic - not syncing: Fatal exception in interrupt Thanks, Wanlong Gao -- dm-devel mailing list dm-devel@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/dm-devel