https://bugzilla.kernel.org/show_bug.cgi?id=30042 Summary: page allocation failure when using jumbo frames with kvm guests Product: Virtualization Version: unspecified Kernel Version: 2.6.35 Platform: All OS/Version: Linux Tree: Mainline Status: NEW Severity: low Priority: P1 Component: kvm AssignedTo: virtualization_kvm@xxxxxxxxxxxxxxxxxxxx ReportedBy: kernelbug_mer@xxxxxxxxxxxxxx Regression: No i've got a intel e1000 based network card in my ubuntu 10.10 host, using jumbo frames (mtu 9000). my kvm guest (ubuntu 10.10) i'm using the "virtio" network card - also configured with jumbo frames (mtu 9000). netio shows me about 190MB/s, which is almost double the performance i get from the standard mtu size (1500). the only problems i get is when rtorrent starts hash checking. it's awful slow, cpu at 100% idle, and kernel errors appearing. Feb 27 21:09:48 vmbuntu kernel: [348422.309070] rtorrent: page allocation failure. order:2, mode:0x4020 Feb 27 21:09:48 vmbuntu kernel: [348422.309075] Pid: 984, comm: rtorrent Not tainted 2.6.35-25-virtual #44-Ubuntu Feb 27 21:09:48 vmbuntu kernel: [348422.309078] Call Trace: Feb 27 21:09:48 vmbuntu kernel: [348422.309087] [<ffffffff81107956>] __alloc_pages_slowpath+0x4b6/0x5a0 Feb 27 21:09:48 vmbuntu kernel: [348422.309091] [<ffffffff81107bac>] __alloc_pages_nodemask+0x16c/0x1d0 Feb 27 21:09:48 vmbuntu kernel: [348422.309096] [<ffffffff8113f742>] kmalloc_large_node+0x62/0xb0 Feb 27 21:09:48 vmbuntu kernel: [348422.309100] [<ffffffff8114322c>] __kmalloc_node_track_caller+0x11c/0x1d0 Feb 27 21:09:48 vmbuntu kernel: [348422.309105] [<ffffffff814f1f81>] ? sk_stream_alloc_skb+0x41/0x110 Feb 27 21:09:48 vmbuntu kernel: [348422.309109] [<ffffffff814a8033>] __alloc_skb+0x83/0x170 Feb 27 21:09:48 vmbuntu kernel: [348422.309112] [<ffffffff814f1f81>] sk_stream_alloc_skb+0x41/0x110 Feb 27 21:09:48 vmbuntu kernel: [348422.309116] [<ffffffff814f5868>] tcp_sendmsg+0x3c8/0xa60 Feb 27 21:09:48 vmbuntu kernel: [348422.309121] [<ffffffff81071096>] ? mod_timer+0x176/0x2d0 Feb 27 21:09:48 vmbuntu kernel: [348422.309126] [<ffffffff814a07d3>] sock_sendmsg+0xf3/0x120 Feb 27 21:09:48 vmbuntu kernel: [348422.309129] [<ffffffff814f5c28>] ? tcp_sendmsg+0x788/0xa60 Feb 27 21:09:48 vmbuntu kernel: [348422.309134] [<ffffffff812975f6>] ? blkcipher_walk_next+0x1b6/0x3e0 Feb 27 21:09:48 vmbuntu kernel: [348422.309137] [<ffffffff814a07d3>] ? sock_sendmsg+0xf3/0x120 Feb 27 21:09:48 vmbuntu kernel: [348422.309141] [<ffffffff814a0841>] kernel_sendmsg+0x41/0x60 Feb 27 21:09:48 vmbuntu kernel: [348422.309160] [<ffffffffa0052bee>] xs_send_kvec+0x8e/0xa0 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309177] [<ffffffffa01158be>] ? reserve_space+0xe/0x20 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309185] [<ffffffffa0052db2>] xs_sendpages+0x1b2/0x210 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309194] [<ffffffffa0052f4d>] xs_tcp_send_request+0x5d/0x170 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309202] [<ffffffffa0050fb3>] xprt_transmit+0x83/0x2f0 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309210] [<ffffffffa004e118>] call_transmit+0xa8/0x130 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309219] [<ffffffffa00564a2>] __rpc_execute+0xa2/0x290 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309227] [<ffffffffa0056713>] rpc_execute+0x83/0xa0 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309235] [<ffffffffa004ec99>] rpc_run_task+0x29/0x40 [sunrpc] Feb 27 21:09:48 vmbuntu kernel: [348422.309244] [<ffffffffa010198f>] nfs_read_rpcsetup+0x18f/0x1f0 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309254] [<ffffffffa01027b0>] ? readpage_async_filler+0x0/0x160 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309264] [<ffffffffa0101dd9>] nfs_pagein_one+0xa9/0xf0 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309272] [<ffffffffa00ff6c7>] nfs_pageio_doio+0x37/0x80 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309281] [<ffffffffa00ff764>] nfs_pageio_add_request+0x54/0x100 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309296] [<ffffffffa0102838>] readpage_async_filler+0x88/0x160 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309306] [<ffffffffa01027b0>] ? readpage_async_filler+0x0/0x160 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309311] [<ffffffff8110b49a>] read_cache_pages+0xba/0x130 Feb 27 21:09:48 vmbuntu kernel: [348422.309425] [<ffffffffa0101676>] nfs_readpages+0x146/0x210 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309435] [<ffffffffa0101d30>] ? nfs_pagein_one+0x0/0xf0 [nfs] Feb 27 21:09:48 vmbuntu kernel: [348422.309439] [<ffffffff8110b1db>] __do_page_cache_readahead+0x13b/0x210 Feb 27 21:09:48 vmbuntu kernel: [348422.309443] [<ffffffff8110b351>] force_page_cache_readahead+0x71/0xa0 Feb 27 21:09:48 vmbuntu kernel: [348422.309448] [<ffffffff8111b28b>] madvise_vma+0xcb/0x210 Feb 27 21:09:48 vmbuntu kernel: [348422.309452] [<ffffffff811265f5>] ? do_mmap_pgoff+0x335/0x380 Feb 27 21:09:48 vmbuntu kernel: [348422.309455] [<ffffffff8111b535>] sys_madvise+0x165/0x290 Feb 27 21:09:48 vmbuntu kernel: [348422.309461] [<ffffffff8100a0f2>] system_call_fastpath+0x16/0x1b Feb 27 21:09:48 vmbuntu kernel: [348422.309464] Mem-Info: Feb 27 21:09:48 vmbuntu kernel: [348422.309465] Node 0 DMA per-cpu: Feb 27 21:09:48 vmbuntu kernel: [348422.309468] CPU 0: hi: 0, btch: 1 usd: 0 Feb 27 21:09:48 vmbuntu kernel: [348422.309469] Node 0 DMA32 per-cpu: Feb 27 21:09:48 vmbuntu kernel: [348422.309472] CPU 0: hi: 186, btch: 31 usd: 50 Feb 27 21:09:48 vmbuntu kernel: [348422.309476] active_anon:558 inactive_anon:14286 isolated_anon:0 Feb 27 21:09:48 vmbuntu kernel: [348422.309505] active_file:62168 inactive_file:160876 isolated_file:0 Feb 27 21:09:48 vmbuntu kernel: [348422.309506] unevictable:0 dirty:0 writeback:0 unstable:0 Feb 27 21:09:48 vmbuntu kernel: [348422.309507] free:2170 slab_reclaimable:3884 slab_unreclaimable:2493 Feb 27 21:09:48 vmbuntu kernel: [348422.309508] mapped:3454 shmem:112 pagetables:1452 bounce:0 Feb 27 21:09:48 vmbuntu kernel: [348422.309510] Node 0 DMA free:4008kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:780kB inactive_file:10996kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15 700kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:72kB slab_unreclaimable:4kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Feb 27 21:09:48 vmbuntu kernel: [348422.309520] lowmem_reserve[]: 0 994 994 994 Feb 27 21:09:48 vmbuntu kernel: [348422.309523] Node 0 DMA32 free:4672kB min:4000kB low:5000kB high:6000kB active_anon:2232kB inactive_anon:57144kB active_file:247892kB inactive_file:632508kB unevictable:0kB isolated(anon):0kB isolated(f ile):0kB present:1018068kB mlocked:0kB dirty:0kB writeback:0kB mapped:13816kB shmem:448kB slab_reclaimable:15464kB slab_unreclaimable:9968kB kernel_stack:1456kB pagetables:5808kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Feb 27 21:09:48 vmbuntu kernel: [348422.309532] lowmem_reserve[]: 0 0 0 0 Feb 27 21:09:48 vmbuntu kernel: [348422.309535] Node 0 DMA: 2*4kB 8*8kB 4*16kB 7*32kB 7*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 4008kB Feb 27 21:09:48 vmbuntu kernel: [348422.309544] Node 0 DMA32: 392*4kB 340*8kB 3*16kB 11*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4688kB Feb 27 21:09:48 vmbuntu kernel: [348422.309552] 223212 total pagecache pages Feb 27 21:09:48 vmbuntu kernel: [348422.309554] 43 pages in swap cache Feb 27 21:09:48 vmbuntu kernel: [348422.309556] Swap cache stats: add 108, delete 65, find 30135/30140 Feb 27 21:09:48 vmbuntu kernel: [348422.309557] Free swap = 976624kB Feb 27 21:09:48 vmbuntu kernel: [348422.309559] Total swap = 976892kB Feb 27 21:09:48 vmbuntu kernel: [348422.313348] 262125 pages RAM Feb 27 21:09:48 vmbuntu kernel: [348422.313351] 6524 pages reserved Feb 27 21:09:48 vmbuntu kernel: [348422.313352] 49320 pages shared Feb 27 21:09:48 vmbuntu kernel: [348422.313353] 224583 pages non-shared when i disable jumbo frames on the guest and host, everything works fine. host: ubuntu 10.10 Intel(R) Core(TM)2 Quad CPU Q6600 04:00.0 Ethernet controller: Intel Corporation 82572EI Gigabit Ethernet Controller (Copper) (rev 06) 2.6.35-25-generic #44-Ubuntu SMP Fri Jan 21 17:40:44 UTC 2011 x86_64 GNU/Linux QEMU PC emulator version 0.12.5 (qemu-kvm-0.12.5), Copyright (c) 2003-2008 Fabrice Bellard guest: ubuntu 10.10 'x86_64' machine='pc-0.12' 1 cpu configured virtio network interface 2.6.35-25-virtual #44-Ubuntu SMP Fri Jan 21 20:39:04 UTC 2011 x86_64 GNU/Linux -- Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching the assignee of the bug. -- To unsubscribe from this list: send the line "unsubscribe kvm" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
