On Mon, Sep 10, 2012 at 6:18 AM, Marc Zyngier <marc.zyngier@xxxxxxx> wrote: > On 10/09/12 05:04, Christoffer Dall wrote: >> Hello, >> >> We have a new branch, which will never be rebased and should always be >> bisectable and mergable. It's kvm-arm-master and can be found here: >> >> git://github.com/virtualopensystems/linux-kvm-arm.git kvm-arm-master >> >> (or pointy-clicky web interface:) >> https://github.com/virtualopensystems/linux-kvm-arm >> >> This branch merges 3.6-rc5 >> >> The branch also merges all Marc Zyngier's timer, vgic and hyp-mode >> boot branches. >> >> It is also merged with the IRQ injection API changes (touched >> KVM_IRQ_LINE) as there hasn't been any other comments on this. This >> requires qemu patches, which can be found here: >> >> git://github.com/virtualopensystems/qemu.git kvm-arm-irq-api >> >> (or pointy-clicky web interface:) >> https://github.com/virtualopensystems/qemu >> >> Two things are outstanding on my end before I attempt an initial upstream; >> 1. We have a bug when we start swapping in the host, the guest kernel >> dies with "BUG: Bad page state..." and all sort of bad things follow. >> If we really stress the host on memory pressure it seems that host can >> also crash, or at least become completely unresponsive. The same test >> on a KVM kernel without any VMs does not cause this BUG. > > Is that the one you're seeing? > > [ 312.189234] ------------[ cut here ]------------ > [ 312.203056] kernel BUG at arch/arm/kvm/mmu.c:382! > [ 312.217134] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP THUMB2 > [ 312.235376] Modules linked in: > [ 312.244515] CPU: 0 Not tainted (3.6.0-rc3+ #40) > [ 312.259118] PC is at stage2_clear_pte+0x128/0x134 > [ 312.273193] LR is at kvm_unmap_hva+0x97/0xa0 > [ 312.285967] pc : [<c001e10c>] lr : [<c001ee0f>] psr: 60000133 > [ 312.285967] sp : caa25998 ip : df97a028 fp : 00800000 > [ 312.320355] r10: 873b5b5f r9 : c8654000 r8 : 01c55000 > [ 312.335990] r7 : 00000000 r6 : df249c00 r5 : c688fb80 r4 : df249ccc > [ 312.355532] r3 : 00000000 r2 : 2e001000 r1 : 00000000 r0 : 00000000 > [ 312.375076] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA Thumb Segment user > [ 312.396962] Control: 70c5387d Table: 8a9bbb00 DAC: fffffffd > [ 312.414161] Process hackbench (pid: 7207, stack limit = 0xcaa242f8) > FYI, this is what I'm seeing in the guest in more details (this couldn't be the icache stuff could it?): BUG: Bad page state in process dd pfn:9fa05 page:808d80a0 count:1 mapcount:0 mapping:9f5e1c4c index:0xae4a page flags: 0x3c(referenced|uptodate|dirty|lru) Unable to handle kernel paging request at virtual address 00100104 pgd = 9f014e80 [00100104] *pgd=9f232003, *pmd=9f1cc003, *pte=00000000 Internal error: Oops: a07 [#1] SMP THUMB2 Modules linked in: CPU: 0 Tainted: G B (3.6.0-rc3+ #20) PC is at get_page_from_freelist+0x116/0x44c LR is at get_page_from_freelist+0x39b/0x44c pc : [<800793ee>] lr : [<80079673>] psr: 600000b3 sp : 9f115c60 ip : 00000000 fp : 00000000 r10: 00488000 r9 : 8049e300 r8 : 808d80a0 r7 : 8046703c r6 : 9f114000 r5 : 808ef048 r4 : 00000001 r3 : 00200200 r2 : 00100100 r1 : 00200200 r0 : 00100100 Flags: nZCv IRQs off FIQs on Mode SVC_32 ISA Thumb Segment user Control: 70c53c7d Table: 9f014e80 DAC: fffffffd Process dd (pid: 1013, stack limit = 0x9f1142f0) Stack: (0x9f115c60 to 0x9f116000) 5c60: 00000041 2f286880 00000024 80025809 60000013 808ef048 00000000 804771b8 5c80: 000200d2 00000000 8049e984 00000000 804a7fd8 00000040 00000000 9f114000 5ca0: 0000001b 8002039f 00000000 9f114000 00000000 ffffffff 0000001b 8049e300 5cc0: 00488000 00000000 00000000 000200d2 9f114000 80476fd8 8049e300 00000000 5ce0: 00000000 80079815 00000000 00000041 8049e300 00000000 804771b8 00000000 5d00: 8049e980 00000000 00000000 00000040 00000050 8049e984 000200d2 00000000 5d20: 00000010 00000001 c4ec4ec5 ffffffff 9f115d6c 8000c75b 8bbbb000 76d4c020 5d40: 00000f60 00000000 8049e300 9f5e1c50 00013232 00013232 000000ff 9f5e1c4c 5d60: 00000000 00001000 00013232 000200d2 000000d0 00032000 9f159540 800755b9 5d80: 20000033 8007ab7d 800be335 13232000 00001000 00001000 9f5e1c4c 00000000 5da0: 802fd7a8 800b6f65 800b6f49 9f114000 00001000 9f5e1c4c 00000000 800751af 5dc0: 00001000 00000000 9f115df0 9f115df4 13232000 00000000 00001000 00000000 5de0: 9f115f40 00000001 00032000 000ce000 8065b760 800afce3 504d64b4 13200000 5e00: 9f115ef8 9f159540 9f114000 9f5e1c4c 00100000 9f115f40 9f115ec0 80075c0b 5e20: 13200000 00000000 9f115ef8 00100000 00000000 00000001 00000000 9f5e1b88 5e40: 13200000 00000000 00000020 ffffffff 9f115ef8 00000001 00000000 00100000 5e60: 9f159540 9f115ec0 9f5e1bf0 9f5e1b88 9f159540 9f115f40 00000001 13200000 5e80: 00000000 80075e1d 00100000 00000000 0000000a 9f159540 fffffdee 802fd740 5ea0: 9f115f80 9fa10f00 9f114000 00000000 00019440 8009df9d 13200000 00000000 5ec0: 00000000 00000000 00000000 00000001 ffffffff 9f159540 00000000 00000000 5ee0: 00000000 00000000 9fa10f00 00000000 00000000 00000000 13200000 00000000 5f00: 00000000 00000000 00100000 00000000 00100000 00000000 00000000 00000000 5f20: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 5f40: 76d1b000 00100000 9f159540 00100000 76d1b000 8009df31 9f115f80 8009e5c9 5f60: 00000000 00000000 9f159540 76d1b000 13200000 00000000 00100000 8009e777 5f80: 13200000 00000000 9f115fb0 00000000 00000000 00100000 76d1b000 00000004 5fa0: 8000cd84 8000cbc1 00000000 00100000 00000001 76d1b000 00100000 00000000 5fc0: 00000000 00100000 76d1b000 00000004 00019438 00100000 76d1b000 00019440 5fe0: 00000000 7eed75cc 0000b735 76ebd38c 60000010 00000001 00000000 00000000 [<800793ee>] (get_page_from_freelist+0x116/0x44c) from [<80079815>] (__alloc_pages_nodemask+0xf1/0x4e0) [<80079815>] (__alloc_pages_nodemask+0xf1/0x4e0) from [<800755b9>] (grab_cache_page_write_begin+0x51/0x94) [<800755b9>] (grab_cache_page_write_begin+0x51/0x94) from [<800b6f65>] (simple_write_begin+0x1d/0xac) [<800b6f65>] (simple_write_begin+0x1d/0xac) from [<800751af>] (generic_file_buffered_write+0x10f/0x188) [<800751af>] (generic_file_buffered_write+0x10f/0x188) from [<80075c0b>] (__generic_file_aio_write+0x17f/0x344) [<80075c0b>] (__generic_file_aio_write+0x17f/0x344) from [<80075e1d>] (generic_file_aio_write+0x4d/0x98) [<80075e1d>] (generic_file_aio_write+0x4d/0x98) from [<8009df9d>] (do_sync_write+0x6d/0x98) [<8009df9d>] (do_sync_write+0x6d/0x98) from [<8009e5c9>] (vfs_write+0x69/0xcc) [<8009e5c9>] (vfs_write+0x69/0xcc) from [<8009e777>] (sys_write+0x2f/0x50) [<8009e777>] (sys_write+0x2f/0x50) from [<8000cbc1>] (ret_fast_syscall+0x1/0x46) Code: f2c0 0320 f2c0 0210 (6041) 6008 ---[ end trace b0f4f88d55c46ae3 ]--- Unable to handle kernel paging request at virtual address 00100104 pgd = 80003000 [00100104] *pgd=80000080004003, *pmd=00000000 Internal error: Oops: a07 [#2] SMP THUMB2 Modules linked in: CPU: 0 Tainted: G B D (3.6.0-rc3+ #20) PC is at get_page_from_freelist+0x116/0x44c LR is at get_page_from_freelist+0x379/0x44c pc : [<800793ee>] lr : [<80079651>] psr: 600001b3 sp : 9f1158a8 ip : 00488000 fp : 00000000 r10: 00488000 r9 : 8049e300 r8 : 808d80a0 r7 : 8046703c r6 : 9f114000 r5 : 808ef048 r4 : 00000001 r3 : 00200200 r2 : 00100100 r1 : 00200200 r0 : 00100100 Flags: nZCv IRQs off FIQs on Mode SVC_32 ISA Thumb Segment user Control: 70c53c7d Table: 9f014e80 DAC: fffffffd Process dd (pid: 1013, stack limit = 0x9f1142f0) Stack: (0x9f1158a8 to 0x9f116000) 58a0: 00000041 00000000 00000000 00000000 60000193 808ef048 58c0: 00000000 804771b8 00020200 00000000 8049e984 00000000 80476400 00000040 58e0: 00000000 801b93af 801bb83d 9f8d6a00 804a1694 9f114000 00000000 ffffffff 5900: 8047641c 8049e300 00000027 00000000 00000000 00000200 9f114000 80476fd8 5920: 8049e300 00000000 00000000 80079815 00000000 00000041 8049e300 00000000 5940: 00100100 00000000 8049e980 00000000 00000000 00000040 00000050 8049e984 5960: 00020200 00000000 00000010 00000001 c4ec4ec5 808ebc40 00000001 8049e300 5980: 808bf6a0 8007cd5f 804dd7cc 8007c67d 8049e300 00000000 804771b8 808ebc40 59a0: 00000001 9f0b0c00 9f22de00 9f1159f8 9f22de38 804a099c 8039c8a8 9fa10f00 59c0: 00000a07 80079c15 00000000 8008f9a9 804a24f0 8001bc75 9f22de00 00000001 59e0: 00000000 00000000 20000193 00000000 00000008 9f1159f8 804a11c0 9fa10f00 5a00: 9f22de00 0000000b 8047a2f8 802e320b 9fa10f00 80018895 9f22de00 9f22de00 5a20: 00000000 9fa111dc 9f22de38 8001889b 00040004 9fa10f00 9f22de00 8001d2af 5a40: 0000000b 0000000b 8047a2f8 9fa10f00 0000000b 0000000b 8047a2f8 8001e4d5 5a60: 8039c8a8 9fa10f00 9f114000 00000001 8039e5cc 000c000c 00000002 8047ca04 5a80: 9f114000 804a0998 9f114000 0000000b 8047a2f8 804a099c 8039c8a8 9fa10f00 5aa0: 00000a07 8000f987 9f1142f0 0000000b 803a8938 60000193 8039c7f8 9f22de00 5ac0: 00100104 00000a07 9f115c18 9fa10f00 00010000 00100104 9f22de38 802dee49 5ae0: 9f115c18 800146e5 ffffffff 8039b192 00000053 80190f67 ffffffff 00000029 5b00: 00000800 00000000 804a5050 00000050 00000050 8001bc0b 00000000 8001b0e9 5b20: 00000000 00000001 00000000 804a5040 00000004 80035515 0c640c64 8047ca24 5b40: 00000002 0000002c 804a50b0 0000002c 0000002c 00000a07 8047aae0 00100104 5b60: 9f115c18 808d80a0 8049e300 00488000 00000000 800083a1 0c690c69 8047ca24 5b80: 00000002 8001bab7 804a50a0 8001bc75 00000400 00000010 000000a4 00000000 5ba0: 20000093 00000001 804a11c0 0000002c 804a11c0 00000003 00000000 00000004 5bc0: 8047c9ec 00000000 00000000 8001c085 00000000 00000000 00000000 00000000 5be0: 804a1abe 0000002c 00000000 9f115c0c 60000013 00000000 00000000 00000000 5c00: 9f115fa4 800793ee 600000b3 ffffffff 9f115c4c 8000c6f5 00100100 00200200 5c20: 00100100 00200200 00000001 808ef048 9f114000 8046703c 808d80a0 8049e300 5c40: 00488000 00000000 00000000 9f115c60 80079673 800793ee 600000b3 ffffffff 5c60: 00000041 2f286880 00000024 80025809 60000013 808ef048 00000000 804771b8 5c80: 000200d2 00000000 8049e984 00000000 804a7fd8 00000040 00000000 9f114000 5ca0: 0000001b 8002039f 00000000 9f114000 00000000 ffffffff 0000001b 8049e300 5cc0: 00488000 00000000 00000000 000200d2 9f114000 80476fd8 8049e300 00000000 5ce0: 00000000 80079815 00000000 00000041 8049e300 00000000 804771b8 00000000 5d00: 8049e980 00000000 00000000 00000040 00000050 8049e984 000200d2 00000000 5d20: 00000010 00000001 c4ec4ec5 ffffffff 9f115d6c 8000c75b 8bbbb000 76d4c020 5d40: 00000f60 00000000 8049e300 9f5e1c50 00013232 00013232 000000ff 9f5e1c4c 5d60: 00000000 00001000 00013232 000200d2 000000d0 00032000 9f159540 800755b9 5d80: 20000033 8007ab7d 800be335 13232000 00001000 00001000 9f5e1c4c 00000000 5da0: 802fd7a8 800b6f65 800b6f49 9f114000 00001000 9f5e1c4c 00000000 800751af 5dc0: 00001000 00000000 9f115df0 9f115df4 13232000 00000000 00001000 00000000 5de0: 9f115f40 00000001 00032000 000ce000 8065b760 800afce3 504d64b4 13200000 5e00: 9f115ef8 9f159540 9f114000 9f5e1c4c 00100000 9f115f40 9f115ec0 80075c0b 5e20: 13200000 00000000 9f115ef8 00100000 00000000 00000001 00000000 9f5e1b88 5e40: 13200000 00000000 00000020 ffffffff 9f115ef8 00000001 00000000 00100000 5e60: 9f159540 9f115ec0 9f5e1bf0 9f5e1b88 9f159540 9f115f40 00000001 13200000 5e80: 00000000 80075e1d 00100000 00000000 0000000a 9f159540 fffffdee 802fd740 5ea0: 9f115f80 9fa10f00 9f114000 00000000 00019440 8009df9d 13200000 00000000 5ec0: 00000000 00000000 00000000 00000001 ffffffff 9f159540 00000000 00000000 5ee0: 00000000 00000000 9fa10f00 00000000 00000000 00000000 13200000 00000000 5f00: 00000000 00000000 00100000 00000000 00100000 00000000 00000000 00000000 5f20: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 5f40: 76d1b000 00100000 9f159540 00100000 76d1b000 8009df31 9f115f80 8009e5c9 5f60: 00000000 00000000 9f159540 76d1b000 13200000 00000000 00100000 8009e777 5f80: 13200000 00000000 9f115fb0 00000000 00000000 00100000 76d1b000 00000004 5fa0: 8000cd84 8000cbc1 00000000 00100000 00000001 76d1b000 00100000 00000000 5fc0: 00000000 00100000 76d1b000 00000004 00019438 00100000 76d1b000 00019440 5fe0: 00000000 7eed75cc 0000b735 76ebd38c 60000010 00000001 00000000 00000000 [<800793ee>] (get_page_from_freelist+0x116/0x44c) from [<80079815>] (__alloc_pages_nodemask+0xf1/0x4e0) [<80079815>] (__alloc_pages_nodemask+0xf1/0x4e0) from [<80079c15>] (__get_free_pages+0x11/0x38) [<80079c15>] (__get_free_pages+0x11/0x38) from [<8008f9a9>] (exit_mmap+0x61/0x138) [<8008f9a9>] (exit_mmap+0x61/0x138) from [<8001889b>] (mmput+0x37/0xcc) [<8001889b>] (mmput+0x37/0xcc) from [<8001d2af>] (exit_mm+0xfb/0x118) [<8001d2af>] (exit_mm+0xfb/0x118) from [<8001e4d5>] (do_exit+0xdd/0x5a8) [<8001e4d5>] (do_exit+0xdd/0x5a8) from [<8000f987>] (die+0x167/0x1fc) [<8000f987>] (die+0x167/0x1fc) from [<802dee49>] (__do_kernel_fault.part.8+0x3d/0x58) [<802dee49>] (__do_kernel_fault.part.8+0x3d/0x58) from [<800146e5>] (do_page_fault+0x1dd/0x248) [<800146e5>] (do_page_fault+0x1dd/0x248) from [<800083a1>] (do_DataAbort+0x29/0x68) [<800083a1>] (do_DataAbort+0x29/0x68) from [<8000c6f5>] (__dabt_svc+0x35/0x60) Exception stack(0x9f115c18 to 0x9f115c60) 5c00: 00100100 00200200 5c20: 00100100 00200200 00000001 808ef048 9f114000 8046703c 808d80a0 8049e300 5c40: 00488000 00000000 00000000 9f115c60 80079673 800793ee 600000b3 ffffffff [<8000c6f5>] (__dabt_svc+0x35/0x60) from [<800793ee>] (get_page_from_freelist+0x116/0x44c) [<800793ee>] (get_page_from_freelist+0x116/0x44c) from [<80079815>] (__alloc_pages_nodemask+0xf1/0x4e0) [<80079815>] (__alloc_pages_nodemask+0xf1/0x4e0) from [<800755b9>] (grab_cache_page_write_begin+0x51/0x94) [<800755b9>] (grab_cache_page_write_begin+0x51/0x94) from [<800b6f65>] (simple_write_begin+0x1d/0xac) [<800b6f65>] (simple_write_begin+0x1d/0xac) from [<800751af>] (generic_file_buffered_write+0x10f/0x188) [<800751af>] (generic_file_buffered_write+0x10f/0x188) from [<80075c0b>] (__generic_file_aio_write+0x17f/0x344) [<80075c0b>] (__generic_file_aio_write+0x17f/0x344) from [<80075e1d>] (generic_file_aio_write+0x4d/0x98) [<80075e1d>] (generic_file_aio_write+0x4d/0x98) from [<8009df9d>] (do_sync_write+0x6d/0x98) [<8009df9d>] (do_sync_write+0x6d/0x98) from [<8009e5c9>] (vfs_write+0x69/0xcc) [<8009e5c9>] (vfs_write+0x69/0xcc) from [<8009e777>] (sys_write+0x2f/0x50) [<8009e777>] (sys_write+0x2f/0x50) from [<8000cbc1>] (ret_fast_syscall+0x1/0x46) Code: f2c0 0320 f2c0 0210 (6041) 6008 ---[ end trace b0f4f88d55c46ae4 ]--- Fixing recursive fault but reboot is needed! BUG: Bad rss-counter state mm:9f22cd80 idx:0 val:274 BUG: Bad rss-counter state mm:9f22cd80 idx:1 val:89 -Christoffer _______________________________________________ kvmarm mailing list kvmarm@xxxxxxxxxxxxxxxxxxxxx https://lists.cs.columbia.edu/cucslists/listinfo/kvmarm