On Tue, Feb 11, 2025 at 09:03:08AM +0800, Edgecombe, Rick P wrote: > On Sat, 2025-02-08 at 18:53 +0800, Yan Zhao wrote: > > In the read-only mprotect() phase of mmu_stress_test, ensure that > > mprotect(PROT_READ) has completed before the guest starts writing to the > > read-only mprotect() memory. > > Is this a fix for the intermittent failure we saw on the v6.13-rc3 based kvm > branch? Funnily, I can't seem to reproduce it anymore, with or without this fix. Hmm, it can be reproduced in my SPR (non TDX) almost every time. It depends on the timing when mprotect(PROT_READ) is completed done. Attached the detailed error log in my machine at the bottom. > On the fix though, doesn't this remove the coverage of writing to a region that > is in the process of being made RO? I'm thinking about warnings, etc that may > trigger intermittently based on bugs with a race component. I don't know if we > could fix the test and still leave the write while the "mprotect(PROT_READ) is > underway". It seems to be deliberate. Write before "mprotect(PROT_READ)" has been tested in stage 0. Not sure it's deliberate to test write in the process of being made RO. If it is, maybe we could make the fix by writing to RO memory a second time after mprotect_ro_done is true: --- a/tools/testing/selftests/kvm/mmu_stress_test.c +++ b/tools/testing/selftests/kvm/mmu_stress_test.c @@ -47,17 +47,18 @@ static void guest_code(uint64_t start_gpa, uint64_t end_gpa, uint64_t stride) * is low in this case). For x86, hand-code the exact opcode so that * there is no room for variability in the generated instruction. */ - do { - for (gpa = start_gpa; gpa < end_gpa; gpa += stride) + for (i = 0; i < 2; i++) { + do { + for (gpa = start_gpa; gpa < end_gpa; gpa += stride) #ifdef __x86_64__ - asm volatile(".byte 0x48,0x89,0x00" :: "a"(gpa) : "memory"); /* mov %rax, (%rax) */ + asm volatile(".byte 0x48,0x89,0x00" :: "a"(gpa) : "memory"); /* mov %rax, (%rax) */ #elif defined(__aarch64__) asm volatile("str %0, [%0]" :: "r" (gpa) : "memory"); #else vcpu_arch_put_guest(*((volatile uint64_t *)gpa), gpa); #endif - } while (!READ_ONCE(mprotect_ro_done)); - + } while (!READ_ONCE(mprotect_ro_done)); + } /* * Only architectures that write the entire range can explicitly sync, * as other architectures will be stuck on the write fault. Orig error log: [root@984fee00a151 kvm]# ./mmu_stress_test Random seed: 0x6b8b4567 Running with 128gb of guest memory and 168 vCPUs Waiting for vCPUs to finish spawning... All vCPUs finished spawning, releasing... Waiting for vCPUs to finish run 1... All vCPUs finished run 1, releasing... Waiting for vCPUs to finish reset... All vCPUs finished reset, releasing... Waiting for vCPUs to finish run 2... All vCPUs finished run 2, releasing... Waiting for vCPUs to finish mprotect RO... 168 vCPUs haven't rendezvoused...==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441760 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441782 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441876 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441825 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441905 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441780 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441888 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441834 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441832 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441880 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441792 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441787 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441804 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441784 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441781 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441868 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441902 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441806 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441842 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441844 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441848 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441860 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441766 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441786 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441794 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441763 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441850 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441772 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441818 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441877 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441846 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441768 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441754 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441757 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441800 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441833 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441758 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441841 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441853 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441909 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441862 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441771 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441883 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441799 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441847 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441855 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441793 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441755 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441797 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441805 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441835 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441861 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441863 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441815 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441893 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441776 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441871 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441864 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441899 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441845 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441778 errno=4 - Interrupted system call ==== Test Assertion Failure ==== lib/x86/processor.c:582: Unconditional guest failure pid=441740 tid=441897 errno=4 - Interrupted system call 168 vCPUs haven't rendezvoused... 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 168 vCPUs haven't rendezvoused... Unhandled exception '0xe' at guest RIP '0x402638'Unhandled exception '0xe' at guest RIP '0x402638' 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 168 vCPUs haven't rendezvoused... 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 Unhandled exception '0xe' at guest RIP '0x402638' 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: assert_on_unhandled_exception at processor.c:625 addr2line: '/proc/441740/exe': No such file 2 0x000000000040552d: _vcpu_run at kvm_util.c:1652 3 0x0000000000402a10: vcpu_worker at mmu_stress_test.c:168 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: ?? ??:0 2 0x000000000040552d: ?? ??:0 3 0x0000000000402a10: ?? ??:0 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: ?? ??:0 2 0x000000000040552d: ?? ??:0 3 0x0000000000402a10: ?? ??:0 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: ?? ??:0 2 0x000000000040552d: ?? ??:0 3 0x0000000000402a10: ?? ??:0 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: ?? ??:0 2 0x000000000040552d: ?? ??:0 3 0x0000000000402a10: ?? ??:0 4 0x00007f67fec08179: ?? ??:0 5 0x00007f67fe8fcdc2: ?? ??:0 1 0x000000000040fd01: ?? ??:0 2 0x000000000040552d: ?? ??:0 3 0x0000000000402a10: ?? ??:0 4 0x00007f67fec08179: ?? ??:0