Hi,
I'm running OpenVZ (OS container) kernel variant of RHEL6 kernel on
several amd64 machines by different manufacturers (HP and Supermicro)
and different RAID cards (HP and Areca).
I've started seeing kernel crashes in October, as per the netconsole
logs attached, on two of the machines (one HP, one Supermicro). The
traces look quite similar, the machine in question cannot write
anything to its own filesystem when this happens so the logs are made
over the network. The XFS filesystem is not root (that's ext4), but
one for data (OS containers), on both machines. When I run xfs_check
and xfs_repair on the filesystem after the kernel crash & reboot, no
issue is ever found.
This may very well have nothing to do with XFS kernel code you wrote
and maintain, but in that case, could you, from looking at the traces,
tell me whether it maybe looks like something issue related to
vm/paging just ending up in XFS related code path?
I'm happy to test any suggestions/fixes for this if it is XFS related.
Thank you,
--
Jan KokoskaGlow Internet s.r.o.
[22755420.758721] ------------[ cut here ]------------ [22755420.758807] kernel BUG at fs/xfs/linux-2.6/xfs_aops.c:86! [22755420.758884] invalid opcode: 0000 [#1] [22755420.758965] last sysfs file: /sys/devices/pci0000:00/0000:00:02.2/0000:02:00.0/host2/uevent [22755420.759108] CPU 2 [22755420.759116] Modules linked in: netconsole configfs btrfs(T) lzo_compress lzo_decompress zlib_deflate vfat msdos fat reiserfs ext3 jbd ext2 vzethdev vznetdev pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vzrst vzcpt vziolimit vzdquota vzmon vzdev xt_state xt_length xt_hl xt_tcpmss xt_TCPMSS xt_multiport xt_ limit xt_dscp ipt_REJECT vzevent nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc ipv6 xfs iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle iptable_filter ip_tables tun fuse snd_pcsp snd_pcm snd_page_alloc snd_timer snd iTCO_wdt soundcore iTCO_vendor_support hpwdt serio_raw hpilo power_ meter ioatdma dca shpchp ext4 jbd2 mbcache sr_mod cdrom ata_generic sd_mod crc_t10dif sg pata_acpi usb_storage ata_piix hpsa tg3 be2net [last unloaded: scsi_wait_scan] [22755420.760384] [22755420.760455] Pid: 100, comm: kswapd0 veid: 0 Tainted: G C --------------- T 2.6.32-openvz-amd64 #1 042stab084_20 HP ProLiant DL380p Gen8 [22755420.760605] RIP: 0010:[<ffffffffa0275b8d>] [<ffffffffa0275b8d>] xfs_count_page_state+0x5d/0x70 [xfs] [22755420.760786] RSP: 0018:ffff88043c3fb700 EFLAGS: 00010246 [22755420.760860] RAX: 0040000000060009 RBX: ffff88043c3d4db0 RCX: 0000000000000000 [22755420.760997] RDX: ffff88043c3fb798 RSI: ffff88043c3fb79c RDI: ffffea000ae30300 [22755420.761135] RBP: ffff88043c3fb700 R08: 0000000000000040 R09: 0000000000000000 [22755420.761274] R10: 0000000000000000 R11: 7fffffffffffffff R12: 0000000000000000 [22755420.762756] R13: ffffea000ae30300 R14: ffffea000ae30300 R15: 0000000000000000 [22755420.762890] FS: 0000000000000000(0000) GS:ffff880039480000(0000) knlGS:0000000000000000 [22755420.763025] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [22755420.763099] CR2: 00000000190e6000 CR3: 00000003c7751000 CR4: 00000000000407e0 [22755420.763232] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [22755420.763369] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [22755420.763508] Process kswapd0 (pid: 100, veid: 0, threadinfo ffff88043c3fa000, task ffff88043c3d4db0) [22755420.763651] Stack: [22755420.763720] ffff88043c3fb7d0 ffffffffa0277322 0000000000000008 0000000000000001 [22755420.763813] <d> 0000000100000001 ffffea0004d08d00 0000000000000001 0000000040000000 [22755420.763974] <d> ffff88043c3fb7e0 0000000000001000 ffff8800ae51f880 0000000381147328 [22755420.764198] Call Trace: [22755420.764290] [<ffffffffa0277322>] xfs_vm_writepage+0x72/0x590 [xfs] [22755420.764368] [<ffffffff8114c3fb>] T.1175+0x12b/0x300 [22755420.764443] [<ffffffff8114d388>] T.1174+0x698/0xa80 [22755420.764518] [<ffffffff8114bbf8>] ? isolate_lru_pages+0x118/0x1f0 [22755420.764594] [<ffffffff8114dae7>] shrink_inactive_list+0x377/0x9f0 [22755420.764669] [<ffffffff81149b06>] ? __pagevec_release+0x26/0x40 [22755420.764745] [<ffffffff8114b8f8>] ? move_active_pages_to_lru+0x1a8/0x1f0 [22755420.764821] [<ffffffff8114c093>] ? shrink_active_list+0x2c3/0x390 [22755420.764898] [<ffffffff8114579a>] ? determine_dirtyable_memory+0x1a/0x30 [22755420.764973] [<ffffffff8114e580>] shrink_lruvec+0x420/0x600 [22755420.765048] [<ffffffff8114e937>] shrink_zone+0x1d7/0x400 [22755420.765122] [<ffffffff8114f913>] balance_pgdat+0x9e3/0xb60 [22755420.765199] [<ffffffff8115ab00>] ? refresh_zone_stat_thresholds+0x0/0xc0 [22755420.765275] [<ffffffff8114fc0f>] kswapd+0x17f/0x400 [22755420.765354] [<ffffffff8109da90>] ? autoremove_wake_function+0x0/0x40 [22755420.765430] [<ffffffff8114fa90>] ? kswapd+0x0/0x400 [22755420.765504] [<ffffffff8109d4b6>] kthread+0x96/0xa0 [22755420.765580] [<ffffffff8100c1aa>] child_rip+0xa/0x20 [22755420.765655] [<ffffffff8109d420>] ? kthread+0x0/0xa0 [22755420.765727] [<ffffffff8100c1a0>] ? child_rip+0x0/0x20 [22755420.765800] Code: <0f> [22755420.766305] RIP [<ffffffffa0275b8d>] xfs_count_page_state+0x5d/0x70 [xfs] [22755420.766404] RSP <ffff88043c3fb700> [22755420.766862] ---[ end trace bfe0a03275972909 ]--- [22755420.766986] Kernel panic - not syncing: Fatal exception [22755420.767110] Pid: 100, comm: kswapd0 veid: 0 Tainted: G D C --------------- T 2.6.32-openvz-amd64 #1 [22755420.767299] Call Trace: [22755420.767423] [<ffffffff815182cd>] ? panic+0xa7/0x16f [22755420.767548] [<ffffffff8151cc84>] ? oops_end+0xe4/0x100 [22755420.767673] [<ffffffff8100f29b>] ? die+0x5b/0x90 [22755420.767797] [<ffffffff8151c4a4>] ? do_trap+0xc4/0x170 [22755420.767922] [<ffffffff8100cea5>] ? do_invalid_op+0x95/0xb0 [22755420.768066] [<ffffffffa0275b8d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [22755420.768196] [<ffffffff812660f3>] ? submit_bio+0xf3/0x1a0 [22755420.768320] [<ffffffff8100bf3b>] ? invalid_op+0x1b/0x20 [22755420.768462] [<ffffffffa0275b8d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [22755420.768604] [<ffffffffa0277322>] ? xfs_vm_writepage+0x72/0x590 [xfs] [22755420.768732] [<ffffffff8114c3fb>] ? T.1175+0x12b/0x300 [22755420.768857] [<ffffffff8114d388>] ? T.1174+0x698/0xa80 [22755420.768979] [<ffffffff8114bbf8>] ? isolate_lru_pages+0x118/0x1f0 [22755420.769103] [<ffffffff8114dae7>] ? shrink_inactive_list+0x377/0x9f0 [22755420.769226] [<ffffffff81149b06>] ? __pagevec_release+0x26/0x40 [22755420.769349] [<ffffffff8114b8f8>] ? move_active_pages_to_lru+0x1a8/0x1f0 [22755420.769477] [<ffffffff8114c093>] ? shrink_active_list+0x2c3/0x390 [22755420.769604] [<ffffffff8114579a>] ? determine_dirtyable_memory+0x1a/0x30 [22755420.769729] [<ffffffff8114e580>] ? shrink_lruvec+0x420/0x600 [22755420.769852] [<ffffffff8114e937>] ? shrink_zone+0x1d7/0x400 [22755420.769976] [<ffffffff8114f913>] ? balance_pgdat+0x9e3/0xb60 [22755420.770105] [<ffffffff8115ab00>] ? refresh_zone_stat_thresholds+0x0/0xc0 [22755420.770229] [<ffffffff8114fc0f>] ? kswapd+0x17f/0x400 [22755420.770355] [<ffffffff8109da90>] ? autoremove_wake_function+0x0/0x40 [22755420.770476] [<ffffffff8114fa90>] ? kswapd+0x0/0x400 [22755420.770598] [<ffffffff8109d4b6>] ? kthread+0x96/0xa0 [22755420.770720] [<ffffffff8100c1aa>] ? child_rip+0xa/0x20 [22755420.770843] [<ffffffff8109d420>] ? kthread+0x0/0xa0 [22755420.770962] [<ffffffff8100c1a0>] ? child_rip+0x0/0x20 [22755420.771136] ------------[ cut here ]------------ [22755420.771257] WARNING: at arch/x86/kernel/smp.c:117 native_smp_send_reschedule+0x5c/0x60() (Tainted: G D C --------------- T) [22755420.771441] Hardware name: ProLiant DL380p Gen8 [22755420.771558] Modules linked in: netconsole configfs btrfs(T) lzo_compress lzo_decompress zlib_deflate vfat msdos fat reiserfs ext3 jbd ext2 vzethdev vznetdev pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vzrst vzcpt vziolimit vzdquota vzmon vzdev xt_state xt_length xt_hl xt_tcpmss xt_TCPMSS xt_multiport xt_limit xt_dscp ipt_REJECT vzevent nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc ipv6 xfs iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle iptable_filter ip_tables tun fuse snd_pcsp snd_pcm snd_page_alloc snd_timer snd iTCO_wdt soundcore iTCO_vendor_support hpwdt serio_raw hpilo power_meter ioatdma dca shpchp ext4 jbd2 mbcache sr_mod cdrom ata_generic sd_mod crc_t10dif sg pata_acpi usb_storage ata_piix hpsa tg3 be2net [last unloaded: scsi_wait_scan] [22755420.777298] Pid: 100, comm: kswapd0 veid: 0 Tainted: G D C --------------- T 2.6.32-openvz-amd64 #1 [22755420.777491] Call Trace: [22755420.777611] <IRQ> [<ffffffff810719b8>] ? warn_slowpath_common+0x88/0xc0 [22755420.777796] [<ffffffff81071a0a>] ? warn_slowpath_null+0x1a/0x20 [22755420.777922] [<ffffffff8102e41c>] ? native_smp_send_reschedule+0x5c/0x60 [22755420.778051] [<ffffffff8105bea0>] ? scheduler_tick+0x210/0x270 [22755420.778177] [<ffffffff810aefc0>] ? tick_sched_timer+0x0/0xc0 [22755420.778303] [<ffffffff81084c6e>] ? update_process_times+0x6e/0x90 [22755420.778427] [<ffffffff810af026>] ? tick_sched_timer+0x66/0xc0 [22755420.778554] [<ffffffff810a21ce>] ? __run_hrtimer+0x8e/0x1d0 [22755420.778681] [<ffffffff810a8f4f>] ? ktime_get_update_offsets+0x4f/0xd0 [22755420.778809] [<ffffffff810a2566>] ? hrtimer_interrupt+0xe6/0x260 [22755420.778937] [<ffffffff8152283b>] ? smp_apic_timer_interrupt+0x6b/0x9b [22755420.779064] [<ffffffff8100bc53>] ? apic_timer_interrupt+0x13/0x20 [22755420.779191] <EOI> [<ffffffff81518372>] ? panic+0x14c/0x16f [22755420.779372] [<ffffffff815182ff>] ? panic+0xd9/0x16f [22755420.779497] [<ffffffff8151cc84>] ? oops_end+0xe4/0x100 [22755420.779622] [<ffffffff8100f29b>] ? die+0x5b/0x90 [22755420.779746] [<ffffffff8151c4a4>] ? do_trap+0xc4/0x170 [22755420.779870] [<ffffffff8100cea5>] ? do_invalid_op+0x95/0xb0 [22755420.780013] [<ffffffffa0275b8d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [22755420.780140] [<ffffffff812660f3>] ? submit_bio+0xf3/0x1a0 [22755420.780262] [<ffffffff8100bf3b>] ? invalid_op+0x1b/0x20 [22755420.780400] [<ffffffffa0275b8d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [22755420.780541] [<ffffffffa0277322>] ? xfs_vm_writepage+0x72/0x590 [xfs] [22755420.780668] [<ffffffff8114c3fb>] ? T.1175+0x12b/0x300 [22755420.780794] [<ffffffff8114d388>] ? T.1174+0x698/0xa80 [22755420.780919] [<ffffffff8114bbf8>] ? isolate_lru_pages+0x118/0x1f0 [22755420.781045] [<ffffffff8114dae7>] ? shrink_inactive_list+0x377/0x9f0 [22755420.781171] [<ffffffff81149b06>] ? __pagevec_release+0x26/0x40 [22755420.781299] [<ffffffff8114b8f8>] ? move_active_pages_to_lru+0x1a8/0x1f0 [22755420.781426] [<ffffffff8114c093>] ? shrink_active_list+0x2c3/0x390 [22755420.781554] [<ffffffff8114579a>] ? determine_dirtyable_memory+0x1a/0x30 [22755420.781680] [<ffffffff8114e580>] ? shrink_lruvec+0x420/0x600 [22755420.781804] [<ffffffff8114e937>] ? shrink_zone+0x1d7/0x400 [22755420.781932] [<ffffffff8114f913>] ? balance_pgdat+0x9e3/0xb60 [22755420.782059] [<ffffffff8115ab00>] ? refresh_zone_stat_thresholds+0x0/0xc0 [22755420.782186] [<ffffffff8114fc0f>] ? kswapd+0x17f/0x400 [22755420.782311] [<ffffffff8109da90>] ? autoremove_wake_function+0x0/0x40 [22755420.782437] [<ffffffff8114fa90>] ? kswapd+0x0/0x400 [22755420.782562] [<ffffffff8109d4b6>] ? kthread+0x96/0xa0 [22755420.782686] [<ffffffff8100c1aa>] ? child_rip+0xa/0x20 [22755420.782812] [<ffffffff8109d420>] ? kthread+0x0/0xa0 [22755420.783174] [<ffffffff8100c1a0>] ? child_rip+0x0/0x20 [22755420.783299] ---[ end trace bfe0a0327597290a ]---
[6096287.536565] ------------[ cut here ]------------ [6096287.536590] kernel BUG at fs/xfs/linux-2.6/xfs_aops.c:86! [6096287.536607] invalid opcode: 0000 [#1] [6096287.536630] last sysfs file: /sys/devices/pci0000:00/0000:00:1e.0/0000:01:03.0/class [6096287.536651] CPU 12 [6096287.536660] Modules linked in: btrfs(T) lzo_compress lzo_decompress zlib_deflate vfat msdos fat reiserfs ext3 jbd ext2 vzethdev vznetdev pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vzrst vzcpt vziolimit vzdquota vzmon vzdev xt_state xt_length xt_hl xt_tcpmss xt_TCPMSS xt_multiport xt_limit xt_dscp ipt_REJECT vzevent nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc ipv6 xfs netconsole configfs max6650 iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle iptable_filter ip_tables tun fuse lp parport snd_pcsp snd_pcm snd_page_alloc iTCO_wdt iTCO_vendor_support i2c_i801 snd_timer snd lpc_ich i7core_edac soundcore i2c_core mfd_core ioatdma dca edac_core ext4 jbd2 mbcache sr_mod sd_mod cdrom sg crc_t10dif ata_generic e1000e pata_acpi ptp ata_piix pps_core arcmsr [last unloaded: scsi_wait_scan] [6096287.537881] [6096287.537965] Pid: 181, comm: kswapd0 veid: 0 Tainted: G --------------- T 2.6.32-openvz-042stab092.3-amd64 #1 042stab092_3 Supermicro X8DT6/X8DT6 [6096287.538157] RIP: 0010:[<ffffffffa02c8e0d>] [<ffffffffa02c8e0d>] xfs_count_page_state+0x5d/0x70 [xfs] [6096287.538376] RSP: 0000:ffff8806384357e0 EFLAGS: 00010246 [6096287.538465] RAX: 0040000000060009 RBX: ffff88063842e500 RCX: 0000000000000000 [6096287.538629] RDX: ffff880638435878 RSI: ffff88063843587c RDI: ffffea0012afb600 [6096287.538793] RBP: ffff8806384357e0 R08: 0000000000000044 R09: 0000000000000001 [6096287.538956] R10: 0000000000000000 R11: 0000000000000000 R12: ffffea0012afb600 [6096287.539121] R13: 0000000000000000 R14: ffffea0012afb600 R15: ffff880638435a00 [6096287.539286] FS: 0000000000000000(0000) GS:ffff880041900000(0000) knlGS:0000000000000000 [6096287.539454] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [6096287.539543] CR2: 000000001dd25730 CR3: 0000000001a85000 CR4: 00000000000007e0 [6096287.539706] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [6096287.539871] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [6096287.540034] Process kswapd0 (pid: 181, veid: 0, threadinfo ffff880638434000, task ffff88063842e500) [6096287.540200] Stack: [6096287.540282] ffff8806384358b0 ffffffffa02ca5a2 ffff8806384358c0 ffff8803c23e30c0 [6096287.540388] <d> 00007f0331c31000 00000000ffffffff 0000000038435840 ffffffff8104f990 [6096287.540578] <d> ffff8803c23e30c0 ffff8806384358c0 ffff880638435a18 ffff88053fc35380 [6096287.540843] Call Trace: [6096287.540953] [<ffffffffa02ca5a2>] xfs_vm_writepage+0x72/0x580 [xfs] [6096287.541049] [<ffffffff8104f990>] ? ptep_clear_flush_young+0x50/0x70 [6096287.541142] [<ffffffff81177604>] ? page_referenced_one+0xa4/0x200 [6096287.541234] [<ffffffff81292b06>] ? prio_tree_next+0x206/0x240 [6096287.541326] [<ffffffff8115296b>] T.1185+0x12b/0x2f0 [6096287.541416] [<ffffffff8115425d>] T.1183+0x7cd/0xaf0 [6096287.541506] [<ffffffff8115490e>] shrink_inactive_list+0x38e/0xc90 [6096287.541597] [<ffffffff811534ff>] ? move_active_pages_to_lru+0x2af/0x490 [6096287.541694] [<ffffffff81155630>] shrink_lruvec+0x420/0x600 [6096287.541790] [<ffffffff811559e7>] shrink_zone+0x1d7/0x400 [6096287.541884] [<ffffffff81156b13>] balance_pgdat+0x9e3/0xb60 [6096287.541978] [<ffffffff81156e0f>] kswapd+0x17f/0x3f0 [6096287.542076] [<ffffffff810a2cc0>] ? autoremove_wake_function+0x0/0x40 [6096287.542173] [<ffffffff81156c90>] ? kswapd+0x0/0x3f0 [6096287.542266] [<ffffffff810a26a6>] kthread+0x96/0xa0 [6096287.542359] [<ffffffff8100c34a>] child_rip+0xa/0x20 [6096287.542452] [<ffffffff810a2610>] ? kthread+0x0/0xa0 [6096287.542545] [<ffffffff8100c340>] ? child_rip+0x0/0x20 [6096287.542635] Code: <0f> [6096287.543197] RIP [<ffffffffa02c8e0d>] xfs_count_page_state+0x5d/0x70 [xfs] [6096287.543325] RSP <ffff8806384357e0> [6096287.543972] Tainting kernel with flag 0x7 [6096287.544132] Pid: 181, comm: kswapd0 veid: 0 Tainted: G --------------- T 2.6.32-openvz-042stab092.3-amd64 #1 [6096287.544379] Call Trace: [6096287.544535] [<ffffffff81076461>] ? add_taint+0x71/0x80 [6096287.544697] [<ffffffff81536474>] ? oops_end+0x54/0x100 [6096287.544861] [<ffffffff8101152b>] ? die+0x5b/0x90 [6096287.545022] [<ffffffff81535d24>] ? do_trap+0xc4/0x170 [6096287.545184] [<ffffffff8100d0e5>] ? do_invalid_op+0x95/0xb0 [6096287.545370] [<ffffffffa02c8e0d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [6096287.545537] [<ffffffff812729aa>] ? blk_queue_bio+0x49a/0x610 [6096287.545697] [<ffffffff8100c0db>] ? invalid_op+0x1b/0x20 [6096287.545884] [<ffffffffa02c8e0d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [6096287.546072] [<ffffffffa02ca5a2>] ? xfs_vm_writepage+0x72/0x580 [xfs] [6096287.546236] [<ffffffff8104f990>] ? ptep_clear_flush_young+0x50/0x70 [6096287.546397] [<ffffffff81177604>] ? page_referenced_one+0xa4/0x200 [6096287.546556] [<ffffffff81292b06>] ? prio_tree_next+0x206/0x240 [6096287.546717] [<ffffffff8115296b>] ? T.1185+0x12b/0x2f0 [6096287.546875] [<ffffffff8115425d>] ? T.1183+0x7cd/0xaf0 [6096287.547034] [<ffffffff8115490e>] ? shrink_inactive_list+0x38e/0xc90 [6096287.547195] [<ffffffff811534ff>] ? move_active_pages_to_lru+0x2af/0x490 [6096287.547357] [<ffffffff81155630>] ? shrink_lruvec+0x420/0x600 [6096287.547517] [<ffffffff811559e7>] ? shrink_zone+0x1d7/0x400 [6096287.547678] [<ffffffff81156b13>] ? balance_pgdat+0x9e3/0xb60 [6096287.547839] [<ffffffff81156e0f>] ? kswapd+0x17f/0x3f0 [6096287.547999] [<ffffffff810a2cc0>] ? autoremove_wake_function+0x0/0x40 [6096287.548161] [<ffffffff81156c90>] ? kswapd+0x0/0x3f0 [6096287.548320] [<ffffffff810a26a6>] ? kthread+0x96/0xa0 [6096287.548478] [<ffffffff8100c34a>] ? child_rip+0xa/0x20 [6096287.548637] [<ffffffff810a2610>] ? kthread+0x0/0xa0 [6096287.548793] [<ffffffff8100c340>] ? child_rip+0x0/0x20 [6096287.551986] [<ffffffff8115425d>] ? T.1183+0x7cd/0xaf0 [6096287.553583] [<ffffffff8115490e>] ? shrink_inactive_list+0x38e/0xc90 [6096287.553747] [<ffffffff811534ff>] ? move_active_pages_to_lru+0x2af/0x490 [6096287.553910] [<ffffffff81155630>] ? shrink_lruvec+0x420/0x600 [6096287.554071] [<ffffffff811559e7>] ? shrink_zone+0x1d7/0x400 [6096287.554232] [<ffffffff81156b13>] ? balance_pgdat+0x9e3/0xb60 [6096287.554393] [<ffffffff81156e0f>] ? kswapd+0x17f/0x3f0 [6096287.554553] [<ffffffff810a2cc0>] ? autoremove_wake_function+0x0/0x40 [6096287.554715] [<ffffffff81156c90>] ? kswapd+0x0/0x3f0 [6096287.554874] [<ffffffff810a26a6>] ? kthread+0x96/0xa0 [6096287.555034] [<ffffffff8100c34a>] ? child_rip+0xa/0x20 [6096287.555193] [<ffffffff810a2610>] ? kthread+0x0/0xa0 [6096287.555350] [<ffffffff8100c340>] ? child_rip+0x0/0x20
[1214099.688158] ------------[ cut here ]------------ [1214099.688184] kernel BUG at fs/xfs/linux-2.6/xfs_aops.c:86! [1214099.688239] invalid opcode: 0000 [#1] [1214099.688263] last sysfs file: /sys/devices/pci0000:00/0000:00:1e.0/0000:01:03.0/class [1214099.688444] CPU 13 [1214099.688455] Modules linked in: btrfs(T) lzo_compress lzo_decompress zlib_deflate vfat msdos fat reiserfs ext3 jbd ext2 vzethdev vznetdev pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vzrst vzcpt vziolimit vzdquota vzmon vzdev xt_state xt_length xt_hl xt_tcpmss xt_TCPMSS xt_multiport xt_limit xt_dscp ipt_REJECT vzevent nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc ipv6 xfs netconsole configfs max6650 iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_mangle iptable_filter ip_tables tun fuse lp parport snd_pcsp iTCO_wdt snd_pcm snd_page_alloc iTCO_vendor_support snd_timer snd i7core_edac i2c_i801 lpc_ich soundcore ioatdma dca i2c_core edac_core mfd_core ext4 jbd2 mbcache sr_mod cdrom sd_mod crc_t10dif sg ata_generic pata_acpi e1000e ptp ata_piix pps_core arcmsr [last unloaded: scsi_wait_scan] [1214099.689875] [1214099.689956] Pid: 1108, comm: flush-8:0 veid: 0 Tainted: G --------------- T 2.6.32-openvz-042stab092.3-amd64 #1 042stab092_3 Supermicro X8DT6/X8DT6 [1214099.690174] RIP: 0010:[<ffffffffa02b6e0d>] [<ffffffffa02b6e0d>] xfs_count_page_state+0x5d/0x70 [xfs] [1214099.690366] RSP: 0018:ffff88063225d910 EFLAGS: 00010246 [1214099.690462] RAX: 0040000000020029 RBX: ffff880636480c70 RCX: 00000000ffffffd8 [1214099.690610] RDX: ffff88063225d9a8 RSI: ffff88063225d9ac RDI: ffffea000d6df2c0 [1214099.690760] RBP: ffff88063225d910 R08: 000000000000005a R09: 0000000000800000 [1214099.690911] R10: 0000000000000008 R11: 000000002e3f8928 R12: ffffea000d6df2c0 [1214099.691062] R13: 0000000000000000 R14: ffff88063225dad0 R15: 000000000000000e [1214099.691210] FS: 0000000000000000(0000) GS:ffff880041940000(0000) knlGS:0000000000000000 [1214099.691360] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [1214099.691455] CR2: 00007f5961e74000 CR3: 000000062b44e000 CR4: 00000000000007e0 [1214099.691605] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1214099.691755] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1214099.691881] Process flush-8:0 (pid: 1108, veid: 0, threadinfo ffff88063225c000, task ffff880636480c70) [1214099.692008] Stack: [1214099.692068] ffff88063225d9e0 ffffffffa02b85a2 ffff88063225da80 ffff880400000001 [1214099.692151] <d> 000000013225d980 ffffea0006177b00 0000000100000000 0000000040000000 [1214099.692292] <d> 0000000000001000 ffff88063225dcf0 0000000005d01e30 0000000336598740 [1214099.692492] Call Trace: [1214099.692584] [<ffffffffa02b85a2>] xfs_vm_writepage+0x72/0x580 [xfs] [1214099.692662] [<ffffffff8114bf17>] __writepage+0x17/0x40 [1214099.692731] [<ffffffff8114cd64>] write_cache_pages+0x214/0x4a0 [1214099.692802] [<ffffffff8114eb05>] ? pagevec_lookup_tag+0x25/0x40 [1214099.692873] [<ffffffff8114bf00>] ? __writepage+0x0/0x40 [1214099.692942] [<ffffffff8114d014>] generic_writepages+0x24/0x30 [1214099.693037] [<ffffffffa02b7a3d>] xfs_vm_writepages+0x5d/0x80 [xfs] [1214099.693107] [<ffffffff8114d041>] do_writepages+0x21/0x40 [1214099.693180] [<ffffffff811dced9>] __writeback_single_inode+0xa9/0x2b0 [1214099.693251] [<ffffffff811dd163>] writeback_single_inode+0x83/0xc0 [1214099.693323] [<ffffffff811cb650>] ? iput+0x30/0x70 [1214099.693390] [<ffffffff811dd3f8>] writeback_sb_inodes+0xd8/0x1b0 [1214099.693459] [<ffffffff811dd5e8>] writeback_inodes_wb+0x118/0x170 [1214099.693530] [<ffffffff811dd983>] wb_writeback+0x343/0x460 [1214099.693599] [<ffffffff811ddc55>] wb_do_writeback+0x1b5/0x260 [1214099.693669] [<ffffffff811ddd98>] bdi_writeback_task+0x98/0x1e0 [1214099.693741] [<ffffffff81163260>] ? bdi_start_fn+0x0/0x110 [1214099.693811] [<ffffffff81163260>] ? bdi_start_fn+0x0/0x110 [1214099.693882] [<ffffffff811632f5>] bdi_start_fn+0x95/0x110 [1214099.693954] [<ffffffff81163260>] ? bdi_start_fn+0x0/0x110 [1214099.694035] [<ffffffff810a26a6>] kthread+0x96/0xa0 [1214099.694108] [<ffffffff8100c34a>] child_rip+0xa/0x20 [1214099.694181] [<ffffffff810a2610>] ? kthread+0x0/0xa0 [1214099.694252] [<ffffffff8100c340>] ? child_rip+0x0/0x20 [1214099.694321] Code: <0f> [1214099.694730] RIP [<ffffffffa02b6e0d>] xfs_count_page_state+0x5d/0x70 [xfs] [1214099.694831] RSP <ffff88063225d910> [1214099.695217] Tainting kernel with flag 0x7 [1214099.695324] Pid: 1108, comm: flush-8:0 veid: 0 Tainted: G --------------- T 2.6.32-openvz-042stab092.3-amd64 #1 [1214099.695497] Call Trace: [1214099.695604] [<ffffffff81076461>] ? add_taint+0x71/0x80 [1214099.695715] [<ffffffff81536474>] ? oops_end+0x54/0x100 [1214099.695826] [<ffffffff8101152b>] ? die+0x5b/0x90 [1214099.695934] [<ffffffff81535d24>] ? do_trap+0xc4/0x170 [1214099.696044] [<ffffffff8100d0e5>] ? do_invalid_op+0x95/0xb0 [1214099.696178] [<ffffffffa02b6e0d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [1214099.696293] [<ffffffff81271963>] ? submit_bio+0x83/0x190 [1214099.696402] [<ffffffff8100c0db>] ? invalid_op+0x1b/0x20 [1214099.696536] [<ffffffffa02b6e0d>] ? xfs_count_page_state+0x5d/0x70 [xfs] [1214099.696672] [<ffffffffa02b85a2>] ? xfs_vm_writepage+0x72/0x580 [xfs] [1214099.696785] [<ffffffff8114bf17>] ? __writepage+0x17/0x40 [1214099.696893] [<ffffffff8114cd64>] ? write_cache_pages+0x214/0x4a0 [1214099.697003] [<ffffffff8114eb05>] ? pagevec_lookup_tag+0x25/0x40 [1214099.697113] [<ffffffff8114bf00>] ? __writepage+0x0/0x40 [1214099.697223] [<ffffffff8114d014>] ? generic_writepages+0x24/0x30 [1214099.697359] [<ffffffffa02b7a3d>] ? xfs_vm_writepages+0x5d/0x80 [xfs] [1214099.697469] [<ffffffff8114d041>] ? do_writepages+0x21/0x40 [1214099.697578] [<ffffffff811dced9>] ? __writeback_single_inode+0xa9/0x2b0 [1214099.697689] [<ffffffff811dd163>] ? writeback_single_inode+0x83/0xc0 [1214099.697800] [<ffffffff811cb650>] ? iput+0x30/0x70 [1214099.697908] [<ffffffff811dd3f8>] ? writeback_sb_inodes+0xd8/0x1b0
_______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs