From: Cliff Wickman <cpw@xxxxxxx> Subject: Re: [PATCH] makedumpfile: request the kernel do page scans Date: Mon, 19 Nov 2012 12:07:10 -0600 > On Fri, Nov 16, 2012 at 03:39:44PM -0500, Vivek Goyal wrote: >> On Thu, Nov 15, 2012 at 04:52:40PM -0600, Cliff Wickman wrote: >> > >> > Gentlemen, >> > >> > I know this is rather late to the game, given all the recent work to speed >> > up makedumpfile and reduce the memory that it consumes. >> > But I've been experimenting with asking the kernel to scan the page tables >> > instead of reading all those page structures through /proc/vmcore. >> > >> > The results are rather dramatic -- if they weren't I would not presume to >> > suggest such a radical path. >> > On a small, idle UV system: about 4 sec. versus about 40 sec. >> > On a 8TB UV the unnecessary page scan alone takes 4 minutes, vs. about 200 min >> > through /proc/vmcore. >> > >> > I have not compared it to your version 1.5.1, so I don't know if your recent >> > work provides similar speedups. >> >> I guess try 1.5.1-rc. IIUC, we had the logic of going through page tables >> but that required one single bitmap to be present and in constrained >> memory environment we will not have that. >> >> That's when this idea came up that scan portion of struct page range, >> filter it, dump it and then move on to next range. >> >> Even after 1.5.1-rc if difference is this dramatic, that means we are >> not doing something right in makedumpfile and it needs to be >> fixed/optimized. >> >> But moving the logic to kernel does not make much sense to me at this >> point of time untile and unless there is a good explanation that why >> user space can't do a good job of what kernel is doing. > > I tested a patch in which makedumpfile does nothing but scan all the > page structures using /proc/vmcore. It is simply reading each consecutive > range of page structures in readmem() chunks of 512 structures. And doing > nothing more than accumulating a hash total of the 'flags' field in each > page (for a sanity check). On my test machine there are 6 blocks of page > structures, totaling 12 million structures. This takes 31.1 'units of time' > (I won't say seconds, as the speed of the clock seems to be way too fast in > the crash kernel). If I increase the buffer size to 5120 structures: 31.0 units. > At 51200 structures: 30.9. So buffer size has virtually no effect. > > I also request the kernel to do the same thing. Each of the 6 requests > asks the kernel to scan a range of page structures and accumulate a hash > total of the 'flags' field. (And also copy a 10000-element pfn list back > to user space, to test that such copies don't add significant overhead.) > And the 12 million pages are scanned in 1.6 'units of time'. > > If I compare the time for actual page scanning (unnecessary pages and > free pages) through /proc/vmcore vs. requesting the kernel to do the > scanning: 40 units vs. 3.8 units. > > My conclusion is that makedumpfile's page scanning procedure is extremely > dominated by the overhead of copying page structures through /proc/vmcore. > And that is about 20x slower than using the kernel to access pages. I have not tested your patch set on the machine with 2TB due to reservation problem, but I already tested it on my local machine with 32GB and saw big performance improvement. I applied your patch set on makedumpfile v1.5.1-rc and added an option -N not to dump pages to focus on scanning pages part only. By this, while scanning pages in user-space took about 25 seconds, scanning pages in kernel-space took about 1 second. During the execution I profiled it using perf record/report and its results are attached files. >From this we can notice that current makedumpfile consumes large part of execution time for ioremap and its related processing. copy_to_user was less than 2% only relative to a whole processing. Looking into the codes around read method of /proc/vmcore, its call stack can be broken into as follows: read_vmcore read_from_oldmem copy_oldmem_page copy_oldmem_page reads the 1st kernel's memory *per page* using ioremap_cache and after completing it, immediately unmaps the remapped address using iounmap. Because ioremap/iounmap is called *per page*, this number of calling ioremap throught scanning a whole pages is unchanged even if makedumpfile's cache size is changed. This seems consistent with Cliff's explanation that increasing 512 entries of makedumpfile's cache was meaningless. I think the first step to address this issue is to introduce a kind of cache in read_vmcore path to reduce the number of calling ioremap/iounmap. Porting scanning logic into kernel-space should be considered if it turns out not to work enough. Thanks. HATAYAMA, Daisuke -------------- next part -------------- sadump: does not have partition header sadump: read dump device as unknown format sadump: unknown format LOAD (0) phys_start : 1000000 phys_end : 22f1000 virt_start : ffffffff81000000 virt_end : ffffffff822f1000 LOAD (1) phys_start : 10000 phys_end : 9b000 virt_start : ffff880000010000 virt_end : ffff88000009b000 LOAD (2) phys_start : 100000 phys_end : 27000000 virt_start : ffff880000100000 virt_end : ffff880027000000 LOAD (3) phys_start : 37000000 phys_end : 7b00d000 virt_start : ffff880037000000 virt_end : ffff88007b00d000 LOAD (4) phys_start : 100000000 phys_end : 880000000 virt_start : ffff880100000000 virt_end : ffff880880000000 Linux kdump page_size : 4096 page_size : 4096 max_mapnr : 880000 Buffer size for the cyclic mode: 2228224 num of NODEs : 4 Memory type : SPARSEMEM_EX mem_map (0) mem_map : ffffea0000000000 pfn_start : 0 pfn_end : 8000 mem_map (1) mem_map : ffffea00001c0000 pfn_start : 8000 pfn_end : 10000 mem_map (2) mem_map : ffffea0000380000 pfn_start : 10000 pfn_end : 18000 mem_map (3) mem_map : ffffea0000540000 pfn_start : 18000 pfn_end : 20000 mem_map (4) mem_map : ffffea0000700000 pfn_start : 20000 pfn_end : 28000 mem_map (5) mem_map : ffffea00008c0000 pfn_start : 28000 pfn_end : 30000 mem_map (6) mem_map : ffffea0000a80000 pfn_start : 30000 pfn_end : 38000 mem_map (7) mem_map : ffffea0000c40000 pfn_start : 38000 pfn_end : 40000 mem_map (8) mem_map : ffffea0000e00000 pfn_start : 40000 pfn_end : 48000 mem_map (9) mem_map : ffffea0000fc0000 pfn_start : 48000 pfn_end : 50000 mem_map (10) mem_map : ffffea0001180000 pfn_start : 50000 pfn_end : 58000 mem_map (11) mem_map : ffffea0001340000 pfn_start : 58000 pfn_end : 60000 mem_map (12) mem_map : ffffea0001500000 pfn_start : 60000 pfn_end : 68000 mem_map (13) mem_map : ffffea00016c0000 pfn_start : 68000 pfn_end : 70000 mem_map (14) mem_map : ffffea0001880000 pfn_start : 70000 pfn_end : 78000 mem_map (15) mem_map : ffffea0001a40000 pfn_start : 78000 pfn_end : 80000 mem_map (16) mem_map : 0 pfn_start : 80000 pfn_end : 88000 mem_map (17) mem_map : 0 pfn_start : 88000 pfn_end : 90000 mem_map (18) mem_map : 0 pfn_start : 90000 pfn_end : 98000 mem_map (19) mem_map : 0 pfn_start : 98000 pfn_end : a0000 mem_map (20) mem_map : 0 pfn_start : a0000 pfn_end : a8000 mem_map (21) mem_map : 0 pfn_start : a8000 pfn_end : b0000 mem_map (22) mem_map : 0 pfn_start : b0000 pfn_end : b8000 mem_map (23) mem_map : 0 pfn_start : b8000 pfn_end : c0000 mem_map (24) mem_map : 0 pfn_start : c0000 pfn_end : c8000 mem_map (25) mem_map : 0 pfn_start : c8000 pfn_end : d0000 mem_map (26) mem_map : 0 pfn_start : d0000 pfn_end : d8000 mem_map (27) mem_map : 0 pfn_start : d8000 pfn_end : e0000 mem_map (28) mem_map : 0 pfn_start : e0000 pfn_end : e8000 mem_map (29) mem_map : 0 pfn_start : e8000 pfn_end : f0000 mem_map (30) mem_map : 0 pfn_start : f0000 pfn_end : f8000 mem_map (31) mem_map : 0 pfn_start : f8000 pfn_end : 100000 mem_map (32) mem_map : ffffea0003800000 pfn_start : 100000 pfn_end : 108000 mem_map (33) mem_map : ffffea00039c0000 pfn_start : 108000 pfn_end : 110000 mem_map (34) mem_map : ffffea0003b80000 pfn_start : 110000 pfn_end : 118000 mem_map (35) mem_map : ffffea0003d40000 pfn_start : 118000 pfn_end : 120000 mem_map (36) mem_map : ffffea0003f00000 pfn_start : 120000 pfn_end : 128000 mem_map (37) mem_map : ffffea00040c0000 pfn_start : 128000 pfn_end : 130000 mem_map (38) mem_map : ffffea0004280000 pfn_start : 130000 pfn_end : 138000 mem_map (39) mem_map : ffffea0004440000 pfn_start : 138000 pfn_end : 140000 mem_map (40) mem_map : ffffea0004600000 pfn_start : 140000 pfn_end : 148000 mem_map (41) mem_map : ffffea00047c0000 pfn_start : 148000 pfn_end : 150000 mem_map (42) mem_map : ffffea0004980000 pfn_start : 150000 pfn_end : 158000 mem_map (43) mem_map : ffffea0004b40000 pfn_start : 158000 pfn_end : 160000 mem_map (44) mem_map : ffffea0004d00000 pfn_start : 160000 pfn_end : 168000 mem_map (45) mem_map : ffffea0004ec0000 pfn_start : 168000 pfn_end : 170000 mem_map (46) mem_map : ffffea0005080000 pfn_start : 170000 pfn_end : 178000 mem_map (47) mem_map : ffffea0005240000 pfn_start : 178000 pfn_end : 180000 mem_map (48) mem_map : ffffea0005400000 pfn_start : 180000 pfn_end : 188000 mem_map (49) mem_map : ffffea00055c0000 pfn_start : 188000 pfn_end : 190000 mem_map (50) mem_map : ffffea0005780000 pfn_start : 190000 pfn_end : 198000 mem_map (51) mem_map : ffffea0005940000 pfn_start : 198000 pfn_end : 1a0000 mem_map (52) mem_map : ffffea0005b00000 pfn_start : 1a0000 pfn_end : 1a8000 mem_map (53) mem_map : ffffea0005cc0000 pfn_start : 1a8000 pfn_end : 1b0000 mem_map (54) mem_map : ffffea0005e80000 pfn_start : 1b0000 pfn_end : 1b8000 mem_map (55) mem_map : ffffea0006040000 pfn_start : 1b8000 pfn_end : 1c0000 mem_map (56) mem_map : ffffea0006200000 pfn_start : 1c0000 pfn_end : 1c8000 mem_map (57) mem_map : ffffea00063c0000 pfn_start : 1c8000 pfn_end : 1d0000 mem_map (58) mem_map : ffffea0006580000 pfn_start : 1d0000 pfn_end : 1d8000 mem_map (59) mem_map : ffffea0006740000 pfn_start : 1d8000 pfn_end : 1e0000 mem_map (60) mem_map : ffffea0006900000 pfn_start : 1e0000 pfn_end : 1e8000 mem_map (61) mem_map : ffffea0006ac0000 pfn_start : 1e8000 pfn_end : 1f0000 mem_map (62) mem_map : ffffea0006c80000 pfn_start : 1f0000 pfn_end : 1f8000 mem_map (63) mem_map : ffffea0006e40000 pfn_start : 1f8000 pfn_end : 200000 mem_map (64) mem_map : ffffea0007000000 pfn_start : 200000 pfn_end : 208000 mem_map (65) mem_map : ffffea00071c0000 pfn_start : 208000 pfn_end : 210000 mem_map (66) mem_map : ffffea0007380000 pfn_start : 210000 pfn_end : 218000 mem_map (67) mem_map : ffffea0007540000 pfn_start : 218000 pfn_end : 220000 mem_map (68) mem_map : ffffea0007700000 pfn_start : 220000 pfn_end : 228000 mem_map (69) mem_map : ffffea00078c0000 pfn_start : 228000 pfn_end : 230000 mem_map (70) mem_map : ffffea0007a80000 pfn_start : 230000 pfn_end : 238000 mem_map (71) mem_map : ffffea0007c40000 pfn_start : 238000 pfn_end : 240000 mem_map (72) mem_map : ffffea0007e00000 pfn_start : 240000 pfn_end : 248000 mem_map (73) mem_map : ffffea0007fc0000 pfn_start : 248000 pfn_end : 250000 mem_map (74) mem_map : ffffea0008180000 pfn_start : 250000 pfn_end : 258000 mem_map (75) mem_map : ffffea0008340000 pfn_start : 258000 pfn_end : 260000 mem_map (76) mem_map : ffffea0008500000 pfn_start : 260000 pfn_end : 268000 mem_map (77) mem_map : ffffea00086c0000 pfn_start : 268000 pfn_end : 270000 mem_map (78) mem_map : ffffea0008880000 pfn_start : 270000 pfn_end : 278000 mem_map (79) mem_map : ffffea0008a40000 pfn_start : 278000 pfn_end : 280000 mem_map (80) mem_map : ffffea0008c00000 pfn_start : 280000 pfn_end : 288000 mem_map (81) mem_map : ffffea0008dc0000 pfn_start : 288000 pfn_end : 290000 mem_map (82) mem_map : ffffea0008f80000 pfn_start : 290000 pfn_end : 298000 mem_map (83) mem_map : ffffea0009140000 pfn_start : 298000 pfn_end : 2a0000 mem_map (84) mem_map : ffffea0009300000 pfn_start : 2a0000 pfn_end : 2a8000 mem_map (85) mem_map : ffffea00094c0000 pfn_start : 2a8000 pfn_end : 2b0000 mem_map (86) mem_map : ffffea0009680000 pfn_start : 2b0000 pfn_end : 2b8000 mem_map (87) mem_map : ffffea0009840000 pfn_start : 2b8000 pfn_end : 2c0000 mem_map (88) mem_map : ffffea0009a00000 pfn_start : 2c0000 pfn_end : 2c8000 mem_map (89) mem_map : ffffea0009bc0000 pfn_start : 2c8000 pfn_end : 2d0000 mem_map (90) mem_map : ffffea0009d80000 pfn_start : 2d0000 pfn_end : 2d8000 mem_map (91) mem_map : ffffea0009f40000 pfn_start : 2d8000 pfn_end : 2e0000 mem_map (92) mem_map : ffffea000a100000 pfn_start : 2e0000 pfn_end : 2e8000 mem_map (93) mem_map : ffffea000a2c0000 pfn_start : 2e8000 pfn_end : 2f0000 mem_map (94) mem_map : ffffea000a480000 pfn_start : 2f0000 pfn_end : 2f8000 mem_map (95) mem_map : ffffea000a640000 pfn_start : 2f8000 pfn_end : 300000 mem_map (96) mem_map : ffffea000a800000 pfn_start : 300000 pfn_end : 308000 mem_map (97) mem_map : ffffea000a9c0000 pfn_start : 308000 pfn_end : 310000 mem_map (98) mem_map : ffffea000ab80000 pfn_start : 310000 pfn_end : 318000 mem_map (99) mem_map : ffffea000ad40000 pfn_start : 318000 pfn_end : 320000 mem_map (100) mem_map : ffffea000af00000 pfn_start : 320000 pfn_end : 328000 mem_map (101) mem_map : ffffea000b0c0000 pfn_start : 328000 pfn_end : 330000 mem_map (102) mem_map : ffffea000b280000 pfn_start : 330000 pfn_end : 338000 mem_map (103) mem_map : ffffea000b440000 pfn_start : 338000 pfn_end : 340000 mem_map (104) mem_map : ffffea000b600000 pfn_start : 340000 pfn_end : 348000 mem_map (105) mem_map : ffffea000b7c0000 pfn_start : 348000 pfn_end : 350000 mem_map (106) mem_map : ffffea000b980000 pfn_start : 350000 pfn_end : 358000 mem_map (107) mem_map : ffffea000bb40000 pfn_start : 358000 pfn_end : 360000 mem_map (108) mem_map : ffffea000bd00000 pfn_start : 360000 pfn_end : 368000 mem_map (109) mem_map : ffffea000bec0000 pfn_start : 368000 pfn_end : 370000 mem_map (110) mem_map : ffffea000c080000 pfn_start : 370000 pfn_end : 378000 mem_map (111) mem_map : ffffea000c240000 pfn_start : 378000 pfn_end : 380000 mem_map (112) mem_map : ffffea000c400000 pfn_start : 380000 pfn_end : 388000 mem_map (113) mem_map : ffffea000c5c0000 pfn_start : 388000 pfn_end : 390000 mem_map (114) mem_map : ffffea000c780000 pfn_start : 390000 pfn_end : 398000 mem_map (115) mem_map : ffffea000c940000 pfn_start : 398000 pfn_end : 3a0000 mem_map (116) mem_map : ffffea000cb00000 pfn_start : 3a0000 pfn_end : 3a8000 mem_map (117) mem_map : ffffea000ccc0000 pfn_start : 3a8000 pfn_end : 3b0000 mem_map (118) mem_map : ffffea000ce80000 pfn_start : 3b0000 pfn_end : 3b8000 mem_map (119) mem_map : ffffea000d040000 pfn_start : 3b8000 pfn_end : 3c0000 mem_map (120) mem_map : ffffea000d200000 pfn_start : 3c0000 pfn_end : 3c8000 mem_map (121) mem_map : ffffea000d3c0000 pfn_start : 3c8000 pfn_end : 3d0000 mem_map (122) mem_map : ffffea000d580000 pfn_start : 3d0000 pfn_end : 3d8000 mem_map (123) mem_map : ffffea000d740000 pfn_start : 3d8000 pfn_end : 3e0000 mem_map (124) mem_map : ffffea000d900000 pfn_start : 3e0000 pfn_end : 3e8000 mem_map (125) mem_map : ffffea000dac0000 pfn_start : 3e8000 pfn_end : 3f0000 mem_map (126) mem_map : ffffea000dc80000 pfn_start : 3f0000 pfn_end : 3f8000 mem_map (127) mem_map : ffffea000de40000 pfn_start : 3f8000 pfn_end : 400000 mem_map (128) mem_map : ffffea000e000000 pfn_start : 400000 pfn_end : 408000 mem_map (129) mem_map : ffffea000e1c0000 pfn_start : 408000 pfn_end : 410000 mem_map (130) mem_map : ffffea000e380000 pfn_start : 410000 pfn_end : 418000 mem_map (131) mem_map : ffffea000e540000 pfn_start : 418000 pfn_end : 420000 mem_map (132) mem_map : ffffea000e700000 pfn_start : 420000 pfn_end : 428000 mem_map (133) mem_map : ffffea000e8c0000 pfn_start : 428000 pfn_end : 430000 mem_map (134) mem_map : ffffea000ea80000 pfn_start : 430000 pfn_end : 438000 mem_map (135) mem_map : ffffea000ec40000 pfn_start : 438000 pfn_end : 440000 mem_map (136) mem_map : ffffea000ee00000 pfn_start : 440000 pfn_end : 448000 mem_map (137) mem_map : ffffea000efc0000 pfn_start : 448000 pfn_end : 450000 mem_map (138) mem_map : ffffea000f180000 pfn_start : 450000 pfn_end : 458000 mem_map (139) mem_map : ffffea000f340000 pfn_start : 458000 pfn_end : 460000 mem_map (140) mem_map : ffffea000f500000 pfn_start : 460000 pfn_end : 468000 mem_map (141) mem_map : ffffea000f6c0000 pfn_start : 468000 pfn_end : 470000 mem_map (142) mem_map : ffffea000f880000 pfn_start : 470000 pfn_end : 478000 mem_map (143) mem_map : ffffea000fa40000 pfn_start : 478000 pfn_end : 480000 mem_map (144) mem_map : ffffea000fc00000 pfn_start : 480000 pfn_end : 488000 mem_map (145) mem_map : ffffea000fdc0000 pfn_start : 488000 pfn_end : 490000 mem_map (146) mem_map : ffffea000ff80000 pfn_start : 490000 pfn_end : 498000 mem_map (147) mem_map : ffffea0010140000 pfn_start : 498000 pfn_end : 4a0000 mem_map (148) mem_map : ffffea0010300000 pfn_start : 4a0000 pfn_end : 4a8000 mem_map (149) mem_map : ffffea00104c0000 pfn_start : 4a8000 pfn_end : 4b0000 mem_map (150) mem_map : ffffea0010680000 pfn_start : 4b0000 pfn_end : 4b8000 mem_map (151) mem_map : ffffea0010840000 pfn_start : 4b8000 pfn_end : 4c0000 mem_map (152) mem_map : ffffea0010a00000 pfn_start : 4c0000 pfn_end : 4c8000 mem_map (153) mem_map : ffffea0010bc0000 pfn_start : 4c8000 pfn_end : 4d0000 mem_map (154) mem_map : ffffea0010d80000 pfn_start : 4d0000 pfn_end : 4d8000 mem_map (155) mem_map : ffffea0010f40000 pfn_start : 4d8000 pfn_end : 4e0000 mem_map (156) mem_map : ffffea0011100000 pfn_start : 4e0000 pfn_end : 4e8000 mem_map (157) mem_map : ffffea00112c0000 pfn_start : 4e8000 pfn_end : 4f0000 mem_map (158) mem_map : ffffea0011480000 pfn_start : 4f0000 pfn_end : 4f8000 mem_map (159) mem_map : ffffea0011640000 pfn_start : 4f8000 pfn_end : 500000 mem_map (160) mem_map : ffffea0011800000 pfn_start : 500000 pfn_end : 508000 mem_map (161) mem_map : ffffea00119c0000 pfn_start : 508000 pfn_end : 510000 mem_map (162) mem_map : ffffea0011b80000 pfn_start : 510000 pfn_end : 518000 mem_map (163) mem_map : ffffea0011d40000 pfn_start : 518000 pfn_end : 520000 mem_map (164) mem_map : ffffea0011f00000 pfn_start : 520000 pfn_end : 528000 mem_map (165) mem_map : ffffea00120c0000 pfn_start : 528000 pfn_end : 530000 mem_map (166) mem_map : ffffea0012280000 pfn_start : 530000 pfn_end : 538000 mem_map (167) mem_map : ffffea0012440000 pfn_start : 538000 pfn_end : 540000 mem_map (168) mem_map : ffffea0012600000 pfn_start : 540000 pfn_end : 548000 mem_map (169) mem_map : ffffea00127c0000 pfn_start : 548000 pfn_end : 550000 mem_map (170) mem_map : ffffea0012980000 pfn_start : 550000 pfn_end : 558000 mem_map (171) mem_map : ffffea0012b40000 pfn_start : 558000 pfn_end : 560000 mem_map (172) mem_map : ffffea0012d00000 pfn_start : 560000 pfn_end : 568000 mem_map (173) mem_map : ffffea0012ec0000 pfn_start : 568000 pfn_end : 570000 mem_map (174) mem_map : ffffea0013080000 pfn_start : 570000 pfn_end : 578000 mem_map (175) mem_map : ffffea0013240000 pfn_start : 578000 pfn_end : 580000 mem_map (176) mem_map : ffffea0013400000 pfn_start : 580000 pfn_end : 588000 mem_map (177) mem_map : ffffea00135c0000 pfn_start : 588000 pfn_end : 590000 mem_map (178) mem_map : ffffea0013780000 pfn_start : 590000 pfn_end : 598000 mem_map (179) mem_map : ffffea0013940000 pfn_start : 598000 pfn_end : 5a0000 mem_map (180) mem_map : ffffea0013b00000 pfn_start : 5a0000 pfn_end : 5a8000 mem_map (181) mem_map : ffffea0013cc0000 pfn_start : 5a8000 pfn_end : 5b0000 mem_map (182) mem_map : ffffea0013e80000 pfn_start : 5b0000 pfn_end : 5b8000 mem_map (183) mem_map : ffffea0014040000 pfn_start : 5b8000 pfn_end : 5c0000 mem_map (184) mem_map : ffffea0014200000 pfn_start : 5c0000 pfn_end : 5c8000 mem_map (185) mem_map : ffffea00143c0000 pfn_start : 5c8000 pfn_end : 5d0000 mem_map (186) mem_map : ffffea0014580000 pfn_start : 5d0000 pfn_end : 5d8000 mem_map (187) mem_map : ffffea0014740000 pfn_start : 5d8000 pfn_end : 5e0000 mem_map (188) mem_map : ffffea0014900000 pfn_start : 5e0000 pfn_end : 5e8000 mem_map (189) mem_map : ffffea0014ac0000 pfn_start : 5e8000 pfn_end : 5f0000 mem_map (190) mem_map : ffffea0014c80000 pfn_start : 5f0000 pfn_end : 5f8000 mem_map (191) mem_map : ffffea0014e40000 pfn_start : 5f8000 pfn_end : 600000 mem_map (192) mem_map : ffffea0015000000 pfn_start : 600000 pfn_end : 608000 mem_map (193) mem_map : ffffea00151c0000 pfn_start : 608000 pfn_end : 610000 mem_map (194) mem_map : ffffea0015380000 pfn_start : 610000 pfn_end : 618000 mem_map (195) mem_map : ffffea0015540000 pfn_start : 618000 pfn_end : 620000 mem_map (196) mem_map : ffffea0015700000 pfn_start : 620000 pfn_end : 628000 mem_map (197) mem_map : ffffea00158c0000 pfn_start : 628000 pfn_end : 630000 mem_map (198) mem_map : ffffea0015a80000 pfn_start : 630000 pfn_end : 638000 mem_map (199) mem_map : ffffea0015c40000 pfn_start : 638000 pfn_end : 640000 mem_map (200) mem_map : ffffea0015e00000 pfn_start : 640000 pfn_end : 648000 mem_map (201) mem_map : ffffea0015fc0000 pfn_start : 648000 pfn_end : 650000 mem_map (202) mem_map : ffffea0016180000 pfn_start : 650000 pfn_end : 658000 mem_map (203) mem_map : ffffea0016340000 pfn_start : 658000 pfn_end : 660000 mem_map (204) mem_map : ffffea0016500000 pfn_start : 660000 pfn_end : 668000 mem_map (205) mem_map : ffffea00166c0000 pfn_start : 668000 pfn_end : 670000 mem_map (206) mem_map : ffffea0016880000 pfn_start : 670000 pfn_end : 678000 mem_map (207) mem_map : ffffea0016a40000 pfn_start : 678000 pfn_end : 680000 mem_map (208) mem_map : ffffea0016c00000 pfn_start : 680000 pfn_end : 688000 mem_map (209) mem_map : ffffea0016dc0000 pfn_start : 688000 pfn_end : 690000 mem_map (210) mem_map : ffffea0016f80000 pfn_start : 690000 pfn_end : 698000 mem_map (211) mem_map : ffffea0017140000 pfn_start : 698000 pfn_end : 6a0000 mem_map (212) mem_map : ffffea0017300000 pfn_start : 6a0000 pfn_end : 6a8000 mem_map (213) mem_map : ffffea00174c0000 pfn_start : 6a8000 pfn_end : 6b0000 mem_map (214) mem_map : ffffea0017680000 pfn_start : 6b0000 pfn_end : 6b8000 mem_map (215) mem_map : ffffea0017840000 pfn_start : 6b8000 pfn_end : 6c0000 mem_map (216) mem_map : ffffea0017a00000 pfn_start : 6c0000 pfn_end : 6c8000 mem_map (217) mem_map : ffffea0017bc0000 pfn_start : 6c8000 pfn_end : 6d0000 mem_map (218) mem_map : ffffea0017d80000 pfn_start : 6d0000 pfn_end : 6d8000 mem_map (219) mem_map : ffffea0017f40000 pfn_start : 6d8000 pfn_end : 6e0000 mem_map (220) mem_map : ffffea0018100000 pfn_start : 6e0000 pfn_end : 6e8000 mem_map (221) mem_map : ffffea00182c0000 pfn_start : 6e8000 pfn_end : 6f0000 mem_map (222) mem_map : ffffea0018480000 pfn_start : 6f0000 pfn_end : 6f8000 mem_map (223) mem_map : ffffea0018640000 pfn_start : 6f8000 pfn_end : 700000 mem_map (224) mem_map : ffffea0018800000 pfn_start : 700000 pfn_end : 708000 mem_map (225) mem_map : ffffea00189c0000 pfn_start : 708000 pfn_end : 710000 mem_map (226) mem_map : ffffea0018b80000 pfn_start : 710000 pfn_end : 718000 mem_map (227) mem_map : ffffea0018d40000 pfn_start : 718000 pfn_end : 720000 mem_map (228) mem_map : ffffea0018f00000 pfn_start : 720000 pfn_end : 728000 mem_map (229) mem_map : ffffea00190c0000 pfn_start : 728000 pfn_end : 730000 mem_map (230) mem_map : ffffea0019280000 pfn_start : 730000 pfn_end : 738000 mem_map (231) mem_map : ffffea0019440000 pfn_start : 738000 pfn_end : 740000 mem_map (232) mem_map : ffffea0019600000 pfn_start : 740000 pfn_end : 748000 mem_map (233) mem_map : ffffea00197c0000 pfn_start : 748000 pfn_end : 750000 mem_map (234) mem_map : ffffea0019980000 pfn_start : 750000 pfn_end : 758000 mem_map (235) mem_map : ffffea0019b40000 pfn_start : 758000 pfn_end : 760000 mem_map (236) mem_map : ffffea0019d00000 pfn_start : 760000 pfn_end : 768000 mem_map (237) mem_map : ffffea0019ec0000 pfn_start : 768000 pfn_end : 770000 mem_map (238) mem_map : ffffea001a080000 pfn_start : 770000 pfn_end : 778000 mem_map (239) mem_map : ffffea001a240000 pfn_start : 778000 pfn_end : 780000 mem_map (240) mem_map : ffffea001a400000 pfn_start : 780000 pfn_end : 788000 mem_map (241) mem_map : ffffea001a5c0000 pfn_start : 788000 pfn_end : 790000 mem_map (242) mem_map : ffffea001a780000 pfn_start : 790000 pfn_end : 798000 mem_map (243) mem_map : ffffea001a940000 pfn_start : 798000 pfn_end : 7a0000 mem_map (244) mem_map : ffffea001ab00000 pfn_start : 7a0000 pfn_end : 7a8000 mem_map (245) mem_map : ffffea001acc0000 pfn_start : 7a8000 pfn_end : 7b0000 mem_map (246) mem_map : ffffea001ae80000 pfn_start : 7b0000 pfn_end : 7b8000 mem_map (247) mem_map : ffffea001b040000 pfn_start : 7b8000 pfn_end : 7c0000 mem_map (248) mem_map : ffffea001b200000 pfn_start : 7c0000 pfn_end : 7c8000 mem_map (249) mem_map : ffffea001b3c0000 pfn_start : 7c8000 pfn_end : 7d0000 mem_map (250) mem_map : ffffea001b580000 pfn_start : 7d0000 pfn_end : 7d8000 mem_map (251) mem_map : ffffea001b740000 pfn_start : 7d8000 pfn_end : 7e0000 mem_map (252) mem_map : ffffea001b900000 pfn_start : 7e0000 pfn_end : 7e8000 mem_map (253) mem_map : ffffea001bac0000 pfn_start : 7e8000 pfn_end : 7f0000 mem_map (254) mem_map : ffffea001bc80000 pfn_start : 7f0000 pfn_end : 7f8000 mem_map (255) mem_map : ffffea001be40000 pfn_start : 7f8000 pfn_end : 800000 mem_map (256) mem_map : ffffea001c000000 pfn_start : 800000 pfn_end : 808000 mem_map (257) mem_map : ffffea001c1c0000 pfn_start : 808000 pfn_end : 810000 mem_map (258) mem_map : ffffea001c380000 pfn_start : 810000 pfn_end : 818000 mem_map (259) mem_map : ffffea001c540000 pfn_start : 818000 pfn_end : 820000 mem_map (260) mem_map : ffffea001c700000 pfn_start : 820000 pfn_end : 828000 mem_map (261) mem_map : ffffea001c8c0000 pfn_start : 828000 pfn_end : 830000 mem_map (262) mem_map : ffffea001ca80000 pfn_start : 830000 pfn_end : 838000 mem_map (263) mem_map : ffffea001cc40000 pfn_start : 838000 pfn_end : 840000 mem_map (264) mem_map : ffffea001ce00000 pfn_start : 840000 pfn_end : 848000 mem_map (265) mem_map : ffffea001cfc0000 pfn_start : 848000 pfn_end : 850000 mem_map (266) mem_map : ffffea001d180000 pfn_start : 850000 pfn_end : 858000 mem_map (267) mem_map : ffffea001d340000 pfn_start : 858000 pfn_end : 860000 mem_map Excluding unnecessary pages : [ 0 %] Excluding unnecessary pages : [ 3 %] Excluding unnecessary pages : [ 17 %] Excluding unnecessary pages : [ 26 %] Excluding unnecessary pages : [ 34 %] Excluding unnecessary pages : [ 42 %] Excluding unnecessary pages : [ 50 %] Excluding unnecessary pages : [ 59 %] Excluding unnecessary pages : [ 67 %] Excluding unnecessary pages : [ 75 %] Excluding unnecessary pages : [ 84 %] Excluding unnecessary pages : [ 92 %] Excluding unnecessary pages : [100 %] Excluding unnecessary pages : [ 0 %] Excluding unnecessary pages : [ 13 %] Excluding unnecessary pages : [ 22 %] Excluding unnecessary pages : [ 30 %] Excluding unnecessary pages : [ 38 %] Excluding unnecessary pages : [ 47 %] Excluding unnecessary pages : [ 55 %] Excluding unnecessary pages : [ 63 %] Excluding unnecessary pages : [ 71 %] Excluding unnecessary pages : [ 80 %] Excluding unnecessary pages : [ 88 %] Excluding unnecessary pages : [ 96 %] Excluding unnecessary pages : [100 %] (268) mem_map : ffffea001d500000 pfn_start : 860000 pfn_end : 868000 mem_map (269) mem_map : ffffea001d6c0000 pfn_start : 868000 pfn_end : 870000 mem_map (270) mem_map : ffffea001d880000 pfn_start : 870000 pfn_end : 878000 mem_map (271) mem_map : ffffea001da40000 pfn_start : 878000 pfn_end : 880000 STEP [Excluding unnecessary pages] : 11.224292 seconds STEP [Excluding unnecessary pages] : 11.250834 seconds STEP [Copying data ] : 11.407836 seconds Writing erase info... offset_eraseinfo: 6c0eb8, size_eraseinfo: 0 Original pages : 0x00000000007ec289 Excluded pages : 0x00000000007b9efb Pages filled with zero : 0x0000000000000000 Cache pages : 0x0000000000012cff Cache pages + private : 0x0000000000012015 User process data pages : 0x0000000000001ece Free pages : 0x0000000000793319 Remaining pages : 0x000000000003238e (The number of pages is reduced to 2%.) Memory Hole : 0x0000000000093d77 -------------------------------------------------- Total pages : 0x0000000000880000 The dumpfile is saved to /mnt///127.0.0.1-2012-12-07-16:45:20/vmcore-empty-1. makedumpfile Completed. [ perf record: Woken up 55 times to write data ] [ perf record: Captured and wrote 13.735 MB /mnt///127.0.0.1-2012-12-07-16:45:20/perf.data1 (~600084 samples) ] -------------- next part -------------- sadump: does not have partition header sadump: read dump device as unknown format sadump: unknown format LOAD (0) phys_start : 1000000 phys_end : 22f1000 virt_start : ffffffff81000000 virt_end : ffffffff822f1000 LOAD (1) phys_start : 10000 phys_end : 9b000 virt_start : ffff880000010000 virt_end : ffff88000009b000 LOAD (2) phys_start : 100000 phys_end : 27000000 virt_start : ffff880000100000 virt_end : ffff880027000000 LOAD (3) phys_start : 37000000 phys_end : 7b00d000 virt_start : ffff880037000000 virt_end : ffff88007b00d000 LOAD (4) phys_start : 100000000 phys_end : 880000000 virt_start : ffff880100000000 virt_end : ffff880880000000 Linux kdump page_size : 4096 page_size : 4096 max_mapnr : 880000 Buffer size for the cyclic mode: 2228224 num of NODEs : 4 Memory type : SPARSEMEM_EX mem_map (0) mem_map : ffffea0000000000 pfn_start : 0 pfn_end : 8000 mem_map (1) mem_map : ffffea00001c0000 pfn_start : 8000 pfn_end : 10000 mem_map (2) mem_map : ffffea0000380000 pfn_start : 10000 pfn_end : 18000 mem_map (3) mem_map : ffffea0000540000 pfn_start : 18000 pfn_end : 20000 mem_map (4) mem_map : ffffea0000700000 pfn_start : 20000 pfn_end : 28000 mem_map (5) mem_map : ffffea00008c0000 pfn_start : 28000 pfn_end : 30000 mem_map (6) mem_map : ffffea0000a80000 pfn_start : 30000 pfn_end : 38000 mem_map (7) mem_map : ffffea0000c40000 pfn_start : 38000 pfn_end : 40000 mem_map (8) mem_map : ffffea0000e00000 pfn_start : 40000 pfn_end : 48000 mem_map (9) mem_map : ffffea0000fc0000 pfn_start : 48000 pfn_end : 50000 mem_map (10) mem_map : ffffea0001180000 pfn_start : 50000 pfn_end : 58000 mem_map (11) mem_map : ffffea0001340000 pfn_start : 58000 pfn_end : 60000 mem_map (12) mem_map : ffffea0001500000 pfn_start : 60000 pfn_end : 68000 mem_map (13) mem_map : ffffea00016c0000 pfn_start : 68000 pfn_end : 70000 mem_map (14) mem_map : ffffea0001880000 pfn_start : 70000 pfn_end : 78000 mem_map (15) mem_map : ffffea0001a40000 pfn_start : 78000 pfn_end : 80000 mem_map (16) mem_map : 0 pfn_start : 80000 pfn_end : 88000 mem_map (17) mem_map : 0 pfn_start : 88000 pfn_end : 90000 mem_map (18) mem_map : 0 pfn_start : 90000 pfn_end : 98000 mem_map (19) mem_map : 0 pfn_start : 98000 pfn_end : a0000 mem_map (20) mem_map : 0 pfn_start : a0000 pfn_end : a8000 mem_map (21) mem_map : 0 pfn_start : a8000 pfn_end : b0000 mem_map (22) mem_map : 0 pfn_start : b0000 pfn_end : b8000 mem_map (23) mem_map : 0 pfn_start : b8000 pfn_end : c0000 mem_map (24) mem_map : 0 pfn_start : c0000 pfn_end : c8000 mem_map (25) mem_map : 0 pfn_start : c8000 pfn_end : d0000 mem_map (26) mem_map : 0 pfn_start : d0000 pfn_end : d8000 mem_map (27) mem_map : 0 pfn_start : d8000 pfn_end : e0000 mem_map (28) mem_map : 0 pfn_start : e0000 pfn_end : e8000 mem_map (29) mem_map : 0 pfn_start : e8000 pfn_end : f0000 mem_map (30) mem_map : 0 pfn_start : f0000 pfn_end : f8000 mem_map (31) mem_map : 0 pfn_start : f8000 pfn_end : 100000 mem_map (32) mem_map : ffffea0003800000 pfn_start : 100000 pfn_end : 108000 mem_map (33) mem_map : ffffea00039c0000 pfn_start : 108000 pfn_end : 110000 mem_map (34) mem_map : ffffea0003b80000 pfn_start : 110000 pfn_end : 118000 mem_map (35) mem_map : ffffea0003d40000 pfn_start : 118000 pfn_end : 120000 mem_map (36) mem_map : ffffea0003f00000 pfn_start : 120000 pfn_end : 128000 mem_map (37) mem_map : ffffea00040c0000 pfn_start : 128000 pfn_end : 130000 mem_map (38) mem_map : ffffea0004280000 pfn_start : 130000 pfn_end : 138000 mem_map (39) mem_map : ffffea0004440000 pfn_start : 138000 pfn_end : 140000 mem_map (40) mem_map : ffffea0004600000 pfn_start : 140000 pfn_end : 148000 mem_map (41) mem_map : ffffea00047c0000 pfn_start : 148000 pfn_end : 150000 mem_map (42) mem_map : ffffea0004980000 pfn_start : 150000 pfn_end : 158000 mem_map (43) mem_map : ffffea0004b40000 pfn_start : 158000 pfn_end : 160000 mem_map (44) mem_map : ffffea0004d00000 pfn_start : 160000 pfn_end : 168000 mem_map (45) mem_map : ffffea0004ec0000 pfn_start : 168000 pfn_end : 170000 mem_map (46) mem_map : ffffea0005080000 pfn_start : 170000 pfn_end : 178000 mem_map (47) mem_map : ffffea0005240000 pfn_start : 178000 pfn_end : 180000 mem_map (48) mem_map : ffffea0005400000 pfn_start : 180000 pfn_end : 188000 mem_map (49) mem_map : ffffea00055c0000 pfn_start : 188000 pfn_end : 190000 mem_map (50) mem_map : ffffea0005780000 pfn_start : 190000 pfn_end : 198000 mem_map (51) mem_map : ffffea0005940000 pfn_start : 198000 pfn_end : 1a0000 mem_map (52) mem_map : ffffea0005b00000 pfn_start : 1a0000 pfn_end : 1a8000 mem_map (53) mem_map : ffffea0005cc0000 pfn_start : 1a8000 pfn_end : 1b0000 mem_map (54) mem_map : ffffea0005e80000 pfn_start : 1b0000 pfn_end : 1b8000 mem_map (55) mem_map : ffffea0006040000 pfn_start : 1b8000 pfn_end : 1c0000 mem_map (56) mem_map : ffffea0006200000 pfn_start : 1c0000 pfn_end : 1c8000 mem_map (57) mem_map : ffffea00063c0000 pfn_start : 1c8000 pfn_end : 1d0000 mem_map (58) mem_map : ffffea0006580000 pfn_start : 1d0000 pfn_end : 1d8000 mem_map (59) mem_map : ffffea0006740000 pfn_start : 1d8000 pfn_end : 1e0000 mem_map (60) mem_map : ffffea0006900000 pfn_start : 1e0000 pfn_end : 1e8000 mem_map (61) mem_map : ffffea0006ac0000 pfn_start : 1e8000 pfn_end : 1f0000 mem_map (62) mem_map : ffffea0006c80000 pfn_start : 1f0000 pfn_end : 1f8000 mem_map (63) mem_map : ffffea0006e40000 pfn_start : 1f8000 pfn_end : 200000 mem_map (64) mem_map : ffffea0007000000 pfn_start : 200000 pfn_end : 208000 mem_map (65) mem_map : ffffea00071c0000 pfn_start : 208000 pfn_end : 210000 mem_map (66) mem_map : ffffea0007380000 pfn_start : 210000 pfn_end : 218000 mem_map (67) mem_map : ffffea0007540000 pfn_start : 218000 pfn_end : 220000 mem_map (68) mem_map : ffffea0007700000 pfn_start : 220000 pfn_end : 228000 mem_map (69) mem_map : ffffea00078c0000 pfn_start : 228000 pfn_end : 230000 mem_map (70) mem_map : ffffea0007a80000 pfn_start : 230000 pfn_end : 238000 mem_map (71) mem_map : ffffea0007c40000 pfn_start : 238000 pfn_end : 240000 mem_map (72) mem_map : ffffea0007e00000 pfn_start : 240000 pfn_end : 248000 mem_map (73) mem_map : ffffea0007fc0000 pfn_start : 248000 pfn_end : 250000 mem_map (74) mem_map : ffffea0008180000 pfn_start : 250000 pfn_end : 258000 mem_map (75) mem_map : ffffea0008340000 pfn_start : 258000 pfn_end : 260000 mem_map (76) mem_map : ffffea0008500000 pfn_start : 260000 pfn_end : 268000 mem_map (77) mem_map : ffffea00086c0000 pfn_start : 268000 pfn_end : 270000 mem_map (78) mem_map : ffffea0008880000 pfn_start : 270000 pfn_end : 278000 mem_map (79) mem_map : ffffea0008a40000 pfn_start : 278000 pfn_end : 280000 mem_map (80) mem_map : ffffea0008c00000 pfn_start : 280000 pfn_end : 288000 mem_map (81) mem_map : ffffea0008dc0000 pfn_start : 288000 pfn_end : 290000 mem_map (82) mem_map : ffffea0008f80000 pfn_start : 290000 pfn_end : 298000 mem_map (83) mem_map : ffffea0009140000 pfn_start : 298000 pfn_end : 2a0000 mem_map (84) mem_map : ffffea0009300000 pfn_start : 2a0000 pfn_end : 2a8000 mem_map (85) mem_map : ffffea00094c0000 pfn_start : 2a8000 pfn_end : 2b0000 mem_map (86) mem_map : ffffea0009680000 pfn_start : 2b0000 pfn_end : 2b8000 mem_map (87) mem_map : ffffea0009840000 pfn_start : 2b8000 pfn_end : 2c0000 mem_map (88) mem_map : ffffea0009a00000 pfn_start : 2c0000 pfn_end : 2c8000 mem_map (89) mem_map : ffffea0009bc0000 pfn_start : 2c8000 pfn_end : 2d0000 mem_map (90) mem_map : ffffea0009d80000 pfn_start : 2d0000 pfn_end : 2d8000 mem_map (91) mem_map : ffffea0009f40000 pfn_start : 2d8000 pfn_end : 2e0000 mem_map (92) mem_map : ffffea000a100000 pfn_start : 2e0000 pfn_end : 2e8000 mem_map (93) mem_map : ffffea000a2c0000 pfn_start : 2e8000 pfn_end : 2f0000 mem_map (94) mem_map : ffffea000a480000 pfn_start : 2f0000 pfn_end : 2f8000 mem_map (95) mem_map : ffffea000a640000 pfn_start : 2f8000 pfn_end : 300000 mem_map (96) mem_map : ffffea000a800000 pfn_start : 300000 pfn_end : 308000 mem_map (97) mem_map : ffffea000a9c0000 pfn_start : 308000 pfn_end : 310000 mem_map (98) mem_map : ffffea000ab80000 pfn_start : 310000 pfn_end : 318000 mem_map (99) mem_map : ffffea000ad40000 pfn_start : 318000 pfn_end : 320000 mem_map (100) mem_map : ffffea000af00000 pfn_start : 320000 pfn_end : 328000 mem_map (101) mem_map : ffffea000b0c0000 pfn_start : 328000 pfn_end : 330000 mem_map (102) mem_map : ffffea000b280000 pfn_start : 330000 pfn_end : 338000 mem_map (103) mem_map : ffffea000b440000 pfn_start : 338000 pfn_end : 340000 mem_map (104) mem_map : ffffea000b600000 pfn_start : 340000 pfn_end : 348000 mem_map (105) mem_map : ffffea000b7c0000 pfn_start : 348000 pfn_end : 350000 mem_map (106) mem_map : ffffea000b980000 pfn_start : 350000 pfn_end : 358000 mem_map (107) mem_map : ffffea000bb40000 pfn_start : 358000 pfn_end : 360000 mem_map (108) mem_map : ffffea000bd00000 pfn_start : 360000 pfn_end : 368000 mem_map (109) mem_map : ffffea000bec0000 pfn_start : 368000 pfn_end : 370000 mem_map (110) mem_map : ffffea000c080000 pfn_start : 370000 pfn_end : 378000 mem_map (111) mem_map : ffffea000c240000 pfn_start : 378000 pfn_end : 380000 mem_map (112) mem_map : ffffea000c400000 pfn_start : 380000 pfn_end : 388000 mem_map (113) mem_map : ffffea000c5c0000 pfn_start : 388000 pfn_end : 390000 mem_map (114) mem_map : ffffea000c780000 pfn_start : 390000 pfn_end : 398000 mem_map (115) mem_map : ffffea000c940000 pfn_start : 398000 pfn_end : 3a0000 mem_map (116) mem_map : ffffea000cb00000 pfn_start : 3a0000 pfn_end : 3a8000 mem_map (117) mem_map : ffffea000ccc0000 pfn_start : 3a8000 pfn_end : 3b0000 mem_map (118) mem_map : ffffea000ce80000 pfn_start : 3b0000 pfn_end : 3b8000 mem_map (119) mem_map : ffffea000d040000 pfn_start : 3b8000 pfn_end : 3c0000 mem_map (120) mem_map : ffffea000d200000 pfn_start : 3c0000 pfn_end : 3c8000 mem_map (121) mem_map : ffffea000d3c0000 pfn_start : 3c8000 pfn_end : 3d0000 mem_map (122) mem_map : ffffea000d580000 pfn_start : 3d0000 pfn_end : 3d8000 mem_map (123) mem_map : ffffea000d740000 pfn_start : 3d8000 pfn_end : 3e0000 mem_map (124) mem_map : ffffea000d900000 pfn_start : 3e0000 pfn_end : 3e8000 mem_map (125) mem_map : ffffea000dac0000 pfn_start : 3e8000 pfn_end : 3f0000 mem_map (126) mem_map : ffffea000dc80000 pfn_start : 3f0000 pfn_end : 3f8000 mem_map (127) mem_map : ffffea000de40000 pfn_start : 3f8000 pfn_end : 400000 mem_map (128) mem_map : ffffea000e000000 pfn_start : 400000 pfn_end : 408000 mem_map (129) mem_map : ffffea000e1c0000 pfn_start : 408000 pfn_end : 410000 mem_map (130) mem_map : ffffea000e380000 pfn_start : 410000 pfn_end : 418000 mem_map (131) mem_map : ffffea000e540000 pfn_start : 418000 pfn_end : 420000 mem_map (132) mem_map : ffffea000e700000 pfn_start : 420000 pfn_end : 428000 mem_map (133) mem_map : ffffea000e8c0000 pfn_start : 428000 pfn_end : 430000 mem_map (134) mem_map : ffffea000ea80000 pfn_start : 430000 pfn_end : 438000 mem_map (135) mem_map : ffffea000ec40000 pfn_start : 438000 pfn_end : 440000 mem_map (136) mem_map : ffffea000ee00000 pfn_start : 440000 pfn_end : 448000 mem_map (137) mem_map : ffffea000efc0000 pfn_start : 448000 pfn_end : 450000 mem_map (138) mem_map : ffffea000f180000 pfn_start : 450000 pfn_end : 458000 mem_map (139) mem_map : ffffea000f340000 pfn_start : 458000 pfn_end : 460000 mem_map (140) mem_map : ffffea000f500000 pfn_start : 460000 pfn_end : 468000 mem_map (141) mem_map : ffffea000f6c0000 pfn_start : 468000 pfn_end : 470000 mem_map (142) mem_map : ffffea000f880000 pfn_start : 470000 pfn_end : 478000 mem_map (143) mem_map : ffffea000fa40000 pfn_start : 478000 pfn_end : 480000 mem_map (144) mem_map : ffffea000fc00000 pfn_start : 480000 pfn_end : 488000 mem_map (145) mem_map : ffffea000fdc0000 pfn_start : 488000 pfn_end : 490000 mem_map (146) mem_map : ffffea000ff80000 pfn_start : 490000 pfn_end : 498000 mem_map (147) mem_map : ffffea0010140000 pfn_start : 498000 pfn_end : 4a0000 mem_map (148) mem_map : ffffea0010300000 pfn_start : 4a0000 pfn_end : 4a8000 mem_map (149) mem_map : ffffea00104c0000 pfn_start : 4a8000 pfn_end : 4b0000 mem_map (150) mem_map : ffffea0010680000 pfn_start : 4b0000 pfn_end : 4b8000 mem_map (151) mem_map : ffffea0010840000 pfn_start : 4b8000 pfn_end : 4c0000 mem_map (152) mem_map : ffffea0010a00000 pfn_start : 4c0000 pfn_end : 4c8000 mem_map (153) mem_map : ffffea0010bc0000 pfn_start : 4c8000 pfn_end : 4d0000 mem_map (154) mem_map : ffffea0010d80000 pfn_start : 4d0000 pfn_end : 4d8000 mem_map (155) mem_map : ffffea0010f40000 pfn_start : 4d8000 pfn_end : 4e0000 mem_map (156) mem_map : ffffea0011100000 pfn_start : 4e0000 pfn_end : 4e8000 mem_map (157) mem_map : ffffea00112c0000 pfn_start : 4e8000 pfn_end : 4f0000 mem_map (158) mem_map : ffffea0011480000 pfn_start : 4f0000 pfn_end : 4f8000 mem_map (159) mem_map : ffffea0011640000 pfn_start : 4f8000 pfn_end : 500000 mem_map (160) mem_map : ffffea0011800000 pfn_start : 500000 pfn_end : 508000 mem_map (161) mem_map : ffffea00119c0000 pfn_start : 508000 pfn_end : 510000 mem_map (162) mem_map : ffffea0011b80000 pfn_start : 510000 pfn_end : 518000 mem_map (163) mem_map : ffffea0011d40000 pfn_start : 518000 pfn_end : 520000 mem_map (164) mem_map : ffffea0011f00000 pfn_start : 520000 pfn_end : 528000 mem_map (165) mem_map : ffffea00120c0000 pfn_start : 528000 pfn_end : 530000 mem_map (166) mem_map : ffffea0012280000 pfn_start : 530000 pfn_end : 538000 mem_map (167) mem_map : ffffea0012440000 pfn_start : 538000 pfn_end : 540000 mem_map (168) mem_map : ffffea0012600000 pfn_start : 540000 pfn_end : 548000 mem_map (169) mem_map : ffffea00127c0000 pfn_start : 548000 pfn_end : 550000 mem_map (170) mem_map : ffffea0012980000 pfn_start : 550000 pfn_end : 558000 mem_map (171) mem_map : ffffea0012b40000 pfn_start : 558000 pfn_end : 560000 mem_map (172) mem_map : ffffea0012d00000 pfn_start : 560000 pfn_end : 568000 mem_map (173) mem_map : ffffea0012ec0000 pfn_start : 568000 pfn_end : 570000 mem_map (174) mem_map : ffffea0013080000 pfn_start : 570000 pfn_end : 578000 mem_map (175) mem_map : ffffea0013240000 pfn_start : 578000 pfn_end : 580000 mem_map (176) mem_map : ffffea0013400000 pfn_start : 580000 pfn_end : 588000 mem_map (177) mem_map : ffffea00135c0000 pfn_start : 588000 pfn_end : 590000 mem_map (178) mem_map : ffffea0013780000 pfn_start : 590000 pfn_end : 598000 mem_map (179) mem_map : ffffea0013940000 pfn_start : 598000 pfn_end : 5a0000 mem_map (180) mem_map : ffffea0013b00000 pfn_start : 5a0000 pfn_end : 5a8000 mem_map (181) mem_map : ffffea0013cc0000 pfn_start : 5a8000 pfn_end : 5b0000 mem_map (182) mem_map : ffffea0013e80000 pfn_start : 5b0000 pfn_end : 5b8000 mem_map (183) mem_map : ffffea0014040000 pfn_start : 5b8000 pfn_end : 5c0000 mem_map (184) mem_map : ffffea0014200000 pfn_start : 5c0000 pfn_end : 5c8000 mem_map (185) mem_map : ffffea00143c0000 pfn_start : 5c8000 pfn_end : 5d0000 mem_map (186) mem_map : ffffea0014580000 pfn_start : 5d0000 pfn_end : 5d8000 mem_map (187) mem_map : ffffea0014740000 pfn_start : 5d8000 pfn_end : 5e0000 mem_map (188) mem_map : ffffea0014900000 pfn_start : 5e0000 pfn_end : 5e8000 mem_map (189) mem_map : ffffea0014ac0000 pfn_start : 5e8000 pfn_end : 5f0000 mem_map (190) mem_map : ffffea0014c80000 pfn_start : 5f0000 pfn_end : 5f8000 mem_map (191) mem_map : ffffea0014e40000 pfn_start : 5f8000 pfn_end : 600000 mem_map (192) mem_map : ffffea0015000000 pfn_start : 600000 pfn_end : 608000 mem_map (193) mem_map : ffffea00151c0000 pfn_start : 608000 pfn_end : 610000 mem_map (194) mem_map : ffffea0015380000 pfn_start : 610000 pfn_end : 618000 mem_map (195) mem_map : ffffea0015540000 pfn_start : 618000 pfn_end : 620000 mem_map (196) mem_map : ffffea0015700000 pfn_start : 620000 pfn_end : 628000 mem_map (197) mem_map : ffffea00158c0000 pfn_start : 628000 pfn_end : 630000 mem_map (198) mem_map : ffffea0015a80000 pfn_start : 630000 pfn_end : 638000 mem_map (199) mem_map : ffffea0015c40000 pfn_start : 638000 pfn_end : 640000 mem_map (200) mem_map : ffffea0015e00000 pfn_start : 640000 pfn_end : 648000 mem_map (201) mem_map : ffffea0015fc0000 pfn_start : 648000 pfn_end : 650000 mem_map (202) mem_map : ffffea0016180000 pfn_start : 650000 pfn_end : 658000 mem_map (203) mem_map : ffffea0016340000 pfn_start : 658000 pfn_end : 660000 mem_map (204) mem_map : ffffea0016500000 pfn_start : 660000 pfn_end : 668000 mem_map (205) mem_map : ffffea00166c0000 pfn_start : 668000 pfn_end : 670000 mem_map (206) mem_map : ffffea0016880000 pfn_start : 670000 pfn_end : 678000 mem_map (207) mem_map : ffffea0016a40000 pfn_start : 678000 pfn_end : 680000 mem_map (208) mem_map : ffffea0016c00000 pfn_start : 680000 pfn_end : 688000 mem_map (209) mem_map : ffffea0016dc0000 pfn_start : 688000 pfn_end : 690000 mem_map (210) mem_map : ffffea0016f80000 pfn_start : 690000 pfn_end : 698000 mem_map (211) mem_map : ffffea0017140000 pfn_start : 698000 pfn_end : 6a0000 mem_map (212) mem_map : ffffea0017300000 pfn_start : 6a0000 pfn_end : 6a8000 mem_map (213) mem_map : ffffea00174c0000 pfn_start : 6a8000 pfn_end : 6b0000 mem_map (214) mem_map : ffffea0017680000 pfn_start : 6b0000 pfn_end : 6b8000 mem_map (215) mem_map : ffffea0017840000 pfn_start : 6b8000 pfn_end : 6c0000 mem_map (216) mem_map : ffffea0017a00000 pfn_start : 6c0000 pfn_end : 6c8000 mem_map (217) mem_map : ffffea0017bc0000 pfn_start : 6c8000 pfn_end : 6d0000 mem_map (218) mem_map : ffffea0017d80000 pfn_start : 6d0000 pfn_end : 6d8000 mem_map (219) mem_map : ffffea0017f40000 pfn_start : 6d8000 pfn_end : 6e0000 mem_map (220) mem_map : ffffea0018100000 pfn_start : 6e0000 pfn_end : 6e8000 mem_map (221) mem_map : ffffea00182c0000 pfn_start : 6e8000 pfn_end : 6f0000 mem_map (222) mem_map : ffffea0018480000 pfn_start : 6f0000 pfn_end : 6f8000 mem_map (223) mem_map : ffffea0018640000 pfn_start : 6f8000 pfn_end : 700000 mem_map (224) mem_map : ffffea0018800000 pfn_start : 700000 pfn_end : 708000 mem_map (225) mem_map : ffffea00189c0000 pfn_start : 708000 pfn_end : 710000 mem_map (226) mem_map : ffffea0018b80000 pfn_start : 710000 pfn_end : 718000 mem_map (227) mem_map : ffffea0018d40000 pfn_start : 718000 pfn_end : 720000 mem_map (228) mem_map : ffffea0018f00000 pfn_start : 720000 pfn_end : 728000 mem_map (229) mem_map : ffffea00190c0000 pfn_start : 728000 pfn_end : 730000 mem_map (230) mem_map : ffffea0019280000 pfn_start : 730000 pfn_end : 738000 mem_map (231) mem_map : ffffea0019440000 pfn_start : 738000 pfn_end : 740000 mem_map (232) mem_map : ffffea0019600000 pfn_start : 740000 pfn_end : 748000 mem_map (233) mem_map : ffffea00197c0000 pfn_start : 748000 pfn_end : 750000 mem_map (234) mem_map : ffffea0019980000 pfn_start : 750000 pfn_end : 758000 mem_map (235) mem_map : ffffea0019b40000 pfn_start : 758000 pfn_end : 760000 mem_map (236) mem_map : ffffea0019d00000 pfn_start : 760000 pfn_end : 768000 mem_map (237) mem_map : ffffea0019ec0000 pfn_start : 768000 pfn_end : 770000 mem_map (238) mem_map : ffffea001a080000 pfn_start : 770000 pfn_end : 778000 mem_map (239) mem_map : ffffea001a240000 pfn_start : 778000 pfn_end : 780000 mem_map (240) mem_map : ffffea001a400000 pfn_start : 780000 pfn_end : 788000 mem_map (241) mem_map : ffffea001a5c0000 pfn_start : 788000 pfn_end : 790000 mem_map (242) mem_map : ffffea001a780000 pfn_start : 790000 pfn_end : 798000 mem_map (243) mem_map : ffffea001a940000 pfn_start : 798000 pfn_end : 7a0000 mem_map (244) mem_map : ffffea001ab00000 pfn_start : 7a0000 pfn_end : 7a8000 mem_map (245) mem_map : ffffea001acc0000 pfn_start : 7a8000 pfn_end : 7b0000 mem_map (246) mem_map : ffffea001ae80000 pfn_start : 7b0000 pfn_end : 7b8000 mem_map (247) mem_map : ffffea001b040000 pfn_start : 7b8000 pfn_end : 7c0000 mem_map (248) mem_map : ffffea001b200000 pfn_start : 7c0000 pfn_end : 7c8000 mem_map (249) mem_map : ffffea001b3c0000 pfn_start : 7c8000 pfn_end : 7d0000 mem_map (250) mem_map : ffffea001b580000 pfn_start : 7d0000 pfn_end : 7d8000 mem_map (251) mem_map : ffffea001b740000 pfn_start : 7d8000 pfn_end : 7e0000 mem_map (252) mem_map : ffffea001b900000 pfn_start : 7e0000 pfn_end : 7e8000 mem_map (253) mem_map : ffffea001bac0000 pfn_start : 7e8000 pfn_end : 7f0000 mem_map (254) mem_map : ffffea001bc80000 pfn_start : 7f0000 pfn_end : 7f8000 mem_map (255) mem_map : ffffea001be40000 pfn_start : 7f8000 pfn_end : 800000 mem_map (256) mem_map : ffffea001c000000 pfn_start : 800000 pfn_end : 808000 mem_map (257) mem_map : ffffea001c1c0000 pfn_start : 808000 pfn_end : 810000 mem_map (258) mem_map : ffffea001c380000 pfn_start : 810000 pfn_end : 818000 mem_map (259) mem_map : ffffea001c540000 pfn_start : 818000 pfn_end : 820000 mem_map (260) mem_map : ffffea001c700000 pfn_start : 820000 pfn_end : 828000 mem_map (261) mem_map : ffffea001c8c0000 pfn_start : 828000 pfn_end : 830000 mem_map (262) mem_map : ffffea001ca80000 pfn_start : 830000 pfn_end : 838000 mem_map (263) mem_map : ffffea001cc40000 pfn_start : 838000 pfn_end : 840000 mem_map (264) mem_map : ffffea001ce00000 pfn_start : 840000 pfn_end : 848000 mem_map (265) mem_map : ffffea001cfc0000 pfn_start : 848000 pfn_end : 850000 mem_map (266) mem_map : ffffea001d180000 pfn_start : 850000 pfn_end : 858000 mem_map (267) mem_map : ffffea001d340000 pfn_start : 858000 pfn_end : 860000 mem_map Excluding unnecessary pages : [ 0 %] Excluding unnecessary pages : [100 %] Excluding unnecessary pages : [ 0 %] Excluding unnecessary pages : [100 %] (268) mem_map : ffffea001d500000 pfn_start : 860000 pfn_end : 868000 mem_map (269) mem_map : ffffea001d6c0000 pfn_start : 868000 pfn_end : 870000 mem_map (270) mem_map : ffffea001d880000 pfn_start : 870000 pfn_end : 878000 mem_map (271) mem_map : ffffea001da40000 pfn_start : 878000 pfn_end : 880000 STEP [Excluding unnecessary pages] : 0.438936 seconds STEP [Excluding unnecessary pages] : 0.467304 seconds STEP [Copying data ] : 0.624328 seconds Writing erase info... offset_eraseinfo: 6c0eb8, size_eraseinfo: 0 Original pages : 0x00000000007ec289 Excluded pages : 0x00000000007b9efb Pages filled with zero : 0x0000000000000000 Cache pages : 0x0000000000012cff Cache pages + private : 0x0000000000012015 User process data pages : 0x0000000000001ece Free pages : 0x0000000000793319 Remaining pages : 0x000000000003238e (The number of pages is reduced to 2%.) Memory Hole : 0x0000000000093d77 -------------------------------------------------- Total pages : 0x0000000000880000 The dumpfile is saved to /mnt///127.0.0.1-2012-12-07-16:45:20/vmcore-empty-2. makedumpfile Completed. [ perf record: Woken up 3 times to write data ] [ perf record: Captured and wrote 0.598 MB /mnt///127.0.0.1-2012-12-07-16:45:20/perf.data2 (~26144 samples) ] -------------- next part -------------- Failed to open [ext4], continuing without symbols No kallsyms or vmlinux with build-id a77a2293aab413880b8b361bb5b863a1680c8eab was found [qla2xxx] with build id a77a2293aab413880b8b361bb5b863a1680c8eab not found, continuing without symbols Failed to open [dm_mirror], continuing without symbols No kallsyms or vmlinux with build-id 8e4a472eadb14fb0cde985ef8571b543880472dd was found [megaraid_sas] with build id 8e4a472eadb14fb0cde985ef8571b543880472dd not found, continuing without symbols No kallsyms or vmlinux with build-id 93346fc362be38e207aeaae310a339fb502d9acb was found [jbd2] with build id 93346fc362be38e207aeaae310a339fb502d9acb not found, continuing without symbols # ======== # captured on: Fri Dec 7 16:45:43 2012 # hostname : (none) # os release : 3.7.0-rc8-cliff-bench+ # perf version : 3.7.rc8.3.ge0fb22 # arch : x86_64 # nrcpus online : 1 # nrcpus avail : 1 # cpudesc : Intel(R) Xeon(R) CPU E7- 4820 @ 2.00GHz # cpuid : GenuineIntel,6,47,2 # total memory : 240104 kB # cmdline : /var/crash/perf record -g -o /mnt///127.0.0.1-2012-12-07-16:45:20/perf.data1 /var/crash/makedumpfile-cliff --message-level 31 -i /var/crash/vmcoreinfo.txt -N -o -d 31 /proc/vmcore /mnt///127.0.0.1-2012-12-07-16:45:20/vmcore-empty-1 # event : name = cycles, type = 0, config = 0x0, config1 = 0x0, config2 = 0x0, excl_usr = 0, excl_kern = 0, excl_host = 0, excl_guest = 1, precise_ip = 0, id = { 2 } # HEADER_CPU_TOPOLOGY info available, use -I to display # HEADER_NUMA_TOPOLOGY info available, use -I to display # pmu mappings: cpu = 4, software = 1, tracepoint = 2, uncore_bbox_0 = 15, uncore_bbox_1 = 16, uncore_cbox_0 = 7, uncore_cbox_1 = 8, uncore_cbox_2 = 9, uncore_cbox_3 = 10, uncore_cbox_4 = 11, uncore_cbox_5 = 12, uncore_cbox_6 = 13, uncore_cbox_7 = 14, uncore_mbox_0 = 19, uncore_mbox_1 = 20, uncore_rbox_0 = 21, uncore_rbox_1 = 22, uncore_sbox_0 = 17, uncore_sbox_1 = 18, breakpoint = 5, uncore_ubox = 6, uncore_wbox = 23 # ======== # # Samples: 91K of event 'cycles' # Event count (approx.): 23676246537 # # Overhead Command Shared Object # ........ ............... .................... # 90.38% makedumpfile-cl [kernel.kallsyms] | |--19.73%-- __purge_vmap_area_lazy | | | |--80.50%-- free_vmap_area_noflush | | free_unmap_vmap_area | | remove_vm_area | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | | | |--66.59%-- 0x0 | | | | | --33.41%-- 0x45524f4300000001 | | | |--19.43%-- vm_unmap_aliases | | change_page_attr_set_clr | | _set_memory_wb | | ioremap_change_attr | | kernel_map_sync_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | --0.07%-- [...] | |--15.58%-- try_preserve_large_page | | | |--99.97%-- __change_page_attr | | __change_page_attr_set_clr | | change_page_attr_set_clr | | _set_memory_wb | | ioremap_change_attr | | kernel_map_sync_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | --0.03%-- [...] | |--14.51%-- iomem_map_sanity_check | | | |--99.97%-- __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | | | |--50.01%-- 0x6e6d2f0065726f63 | | | | | --49.99%-- 0x45524f4300000001 | --0.03%-- [...] | |--11.06%-- walk_system_ram_range | | | |--64.71%-- pat_pagerange_is_ram | | | | | |--50.87%-- free_memtype | | | iounmap | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | --49.13%-- reserve_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--34.75%-- page_is_ram | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | --0.54%-- [...] | |--4.84%-- __phys_addr | | | |--52.48%-- __change_page_attr | | __change_page_attr_set_clr | | change_page_attr_set_clr | | _set_memory_wb | | ioremap_change_attr | | kernel_map_sync_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--45.72%-- try_preserve_large_page | | __change_page_attr | | __change_page_attr_set_clr | | change_page_attr_set_clr | | _set_memory_wb | | ioremap_change_attr | | kernel_map_sync_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | --1.80%-- [...] | |--4.82%-- __get_vm_area_node | | | |--99.70%-- get_vm_area_caller | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | | | --100.00%-- 0x0 | --0.30%-- [...] | |--4.13%-- iounmap | | | |--99.59%-- copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | | | |--50.39%-- 0x45524f4300000001 | | | | | --49.61%-- 0x0 | --0.41%-- [...] | |--3.60%-- read_vmcore | | | |--99.83%-- proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | --0.17%-- [...] | |--2.24%-- copy_user_generic_string | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--1.92%-- remove_vm_area | | | |--99.31%-- iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | | | --100.00%-- 0x0 | | | --0.69%-- copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--1.82%-- do_kernel_range_flush | | | |--99.20%-- on_each_cpu | | flush_tlb_kernel_range | | __purge_vmap_area_lazy | | free_vmap_area_noflush | | free_unmap_vmap_area | | remove_vm_area | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --0.80%-- flush_tlb_kernel_range | __purge_vmap_area_lazy | free_vmap_area_noflush | free_unmap_vmap_area | remove_vm_area | iounmap | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--1.01%-- rbt_memtype_erase | | | |--96.66%-- free_memtype | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --3.34%-- iounmap | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--0.87%-- kfree | | | |--55.52%-- free_memtype | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--29.00%-- iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--12.42%-- rcu_do_batch | | __rcu_process_callbacks | | rcu_process_callbacks | | __do_softirq | | call_softirq | | do_softirq | | irq_exit | | smp_apic_timer_interrupt | | apic_timer_interrupt | | | | | |--20.23%-- free_vmap_area_noflush | | | free_unmap_vmap_area | | | remove_vm_area | | | iounmap | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--19.11%-- __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--16.82%-- __change_page_attr | | | __change_page_attr_set_clr | | | change_page_attr_set_clr | | | _set_memory_wb | | | ioremap_change_attr | | | kernel_map_sync_memtype | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--6.75%-- pat_pagerange_is_ram | | | | | | | |--66.67%-- reserve_memtype | | | | __ioremap_caller | | | | ioremap_cache | | | | copy_oldmem_page | | | | read_from_oldmem | | | | read_vmcore | | | | proc_reg_read | | | | vfs_read | | | | sys_read | | | | system_call_fastpath | | | | __read_nocancel | | | | | | | --33.33%-- free_memtype | | | iounmap | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--5.62%-- vm_unmap_aliases | | | change_page_attr_set_clr | | | _set_memory_wb | | | ioremap_change_attr | | | kernel_map_sync_memtype | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--4.50%-- proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--4.49%-- copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--3.37%-- get_vm_area_caller | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--3.37%-- readmem | | | | | |--2.25%-- page_is_ram | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--2.25%-- __exclude_unnecessary_pages | | | exclude_unnecessary_pages_cyclic | | | writeout_dumpfile | | | 0x7fff6c26de6d | | | 0x64656b616d2f6873 | | | | | |--2.25%-- paddr_to_offset | | | exclude_unnecessary_pages_cyclic | | | | | | | --100.00%-- writeout_dumpfile | | | 0x7fff6c26de6d | | | 0x64656b616d2f6873 | | | | | |--1.13%-- try_preserve_large_page | | | __change_page_attr | | | __change_page_attr_set_clr | | | change_page_attr_set_clr | | | _set_memory_wb | | | ioremap_change_attr | | | kernel_map_sync_memtype | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--1.12%-- reserve_memtype | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--1.12%-- __lseek_nocancel | | | | | |--1.12%-- proc_reg_llseek | | | vfs_llseek | | | sys_lseek | | | system_call_fastpath | | | __lseek_nocancel | | | | | |--1.12%-- free_memtype | | | iounmap | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--1.12%-- on_each_cpu | | | flush_tlb_kernel_range | | | __purge_vmap_area_lazy | | | free_vmap_area_noflush | | | free_unmap_vmap_area | | | remove_vm_area | | | iounmap | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | |--1.12%-- __get_vm_area_node | | | get_vm_area_caller | | | __ioremap_caller | | | ioremap_cache | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | --1.12%-- vtop4_x86_64 | | | |--2.09%-- copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --0.98%-- __rcu_process_callbacks | rcu_process_callbacks | __do_softirq | call_softirq | do_softirq | irq_exit | smp_apic_timer_interrupt | apic_timer_interrupt | | | |--57.11%-- __change_page_attr | | __change_page_attr_set_clr | | change_page_attr_set_clr | | _set_memory_wb | | ioremap_change_attr | | kernel_map_sync_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--14.30%-- flush_tlb_kernel_range | | __purge_vmap_area_lazy | | free_vmap_area_noflush | | free_unmap_vmap_area | | remove_vm_area | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--14.30%-- free_vmap_area_noflush | | free_unmap_vmap_area | | remove_vm_area | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --14.30%-- copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--0.58%-- __insert_vmap_area | | | |--98.32%-- alloc_vmap_area | | __get_vm_area_node | | get_vm_area_caller | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --1.68%-- __get_vm_area_node | get_vm_area_caller | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--0.57%-- kmem_cache_alloc_node_trace | | | |--55.58%-- __get_vm_area_node | | get_vm_area_caller | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | |--41.85%-- alloc_vmap_area | | __get_vm_area_node | | get_vm_area_caller | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --2.56%-- get_vm_area_caller | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--0.54%-- vfs_read | | | |--98.21%-- sys_read | | system_call_fastpath | | __read_nocancel | | | | | --100.00%-- 0x0 | | | --1.79%-- system_call_fastpath | __read_nocancel | |--0.54%-- memtype_rb_check_conflict | | | |--95.54%-- rbt_memtype_check_insert | | reserve_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --4.46%-- reserve_memtype | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--0.51%-- __mtrr_type_lookup | | | |--96.91%-- mtrr_type_lookup | | reserve_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | --3.09%-- reserve_memtype | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel --11.15%-- [...] 9.19% makedumpfile-cl makedumpfile-cliff | |--37.97%-- __exclude_unnecessary_pages | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--18.73%-- set_bitmap_cyclic | | | --100.00%-- exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--13.79%-- paddr_to_offset | | | --100.00%-- exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--4.71%-- readmem | | | --100.00%-- exclude_unnecessary_pages_cyclic | writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--4.12%-- get_num_dumpable_cyclic | |--2.90%-- is_in_same_page | |--2.66%-- page_is_buddy_v3 | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--2.37%-- clear_bit_on_2nd_bitmap_for_kernel | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--2.35%-- create_1st_bitmap_cyclic | |--2.04%-- is_xen_memory | | | --100.00%-- exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--2.02%-- vtop4_x86_64 | |--1.67%-- set_bit_on_1st_bitmap | |--1.53%-- clear_bit_on_2nd_bitmap | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--1.25%-- write_kdump_pages_and_bitmap_cyclic | writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--1.15%-- update_cyclic_region | |--0.66%-- vaddr_to_paddr_x86_64 --0.07%-- [...] 0.42% makedumpfile-cl libc.so.6 | |--40.25%-- __lseek_nocancel | |--36.91%-- __read_nocancel | |--8.64%-- __GI___libc_read | |--5.01%-- __memset_sse2 | | | --100.00%-- 0x7fff6c26de6d | 0x64656b616d2f6873 | |--3.90%-- __GI___libc_lseek64 | |--3.72%-- memcpy | | | --100.00%-- writeout_dumpfile | 0x7fff6c26de6d | 0x64656b616d2f6873 | |--0.53%-- memchr --1.04%-- [...] 0.01% makedumpfile-cl ld-linux-x86-64.so.2 | |--49.69%-- strcmp | | | |--67.41%-- 0x8922974 | | 0x42494c4700342e33 | | | --32.59%-- 0x9691a75 | 0x42494c4700352e32 | |--17.46%-- _dl_name_match_p | _dl_check_all_versions | |--16.51%-- do_lookup_x | --16.34%-- _dl_lookup_symbol_x _dl_relocate_object dl_main _dl_sysdep_start 0x4156415741e58948 0.00% makedumpfile-cl libstdc++.so.6 | --- 0x37282bb470 0x3728253b43 0x7fff6c26de6d 0x64656b616d2f6873 0.00% makedumpfile-cl [megaraid_sas] | --- megasas_isr handle_irq_event_percpu handle_irq_event handle_edge_irq handle_irq do_IRQ ret_from_intr __exclude_unnecessary_pages exclude_unnecessary_pages_cyclic writeout_dumpfile 0x7fff6c26de6d 0x64656b616d2f6873 0.00% makedumpfile-cl [qla2xxx] | --- qla24xx_mbx_completion qla24xx_msix_default handle_irq_event_percpu handle_irq_event handle_edge_irq handle_irq do_IRQ ret_from_intr __change_page_attr __change_page_attr_set_clr change_page_attr_set_clr _set_memory_wb ioremap_change_attr kernel_map_sync_memtype __ioremap_caller ioremap_cache copy_oldmem_page read_from_oldmem read_vmcore proc_reg_read vfs_read sys_read system_call_fastpath __read_nocancel 0.00% makedumpfile-cl [jbd2] | --- jbd2_journal_start ext4_dirty_inode __mark_inode_dirty update_time file_update_time __generic_file_aio_write generic_file_aio_write ext4_file_write do_sync_write vfs_write sys_write system_call_fastpath __write_nocancel 0xffffff0000003725 -------------- next part -------------- Failed to open [dm_mirror], continuing without symbols Failed to open [ext4], continuing without symbols # ======== # captured on: Fri Dec 7 16:45:46 2012 # hostname : (none) # os release : 3.7.0-rc8-cliff-bench+ # perf version : 3.7.rc8.3.ge0fb22 # arch : x86_64 # nrcpus online : 1 # nrcpus avail : 1 # cpudesc : Intel(R) Xeon(R) CPU E7- 4820 @ 2.00GHz # cpuid : GenuineIntel,6,47,2 # total memory : 240104 kB # cmdline : /var/crash/perf record -g -o /mnt///127.0.0.1-2012-12-07-16:45:20/perf.data2 /var/crash/makedumpfile-cliff --message-level 31 -i /var/crash/vmcoreinfo.txt -N -d 31 /proc/vmcore /mnt///127.0.0.1-2012-12-07-16:45:20/vmcore-empty-2 # event : name = cycles, type = 0, config = 0x0, config1 = 0x0, config2 = 0x0, excl_usr = 0, excl_kern = 0, excl_host = 0, excl_guest = 1, precise_ip = 0, id = { 3 } # HEADER_CPU_TOPOLOGY info available, use -I to display # HEADER_NUMA_TOPOLOGY info available, use -I to display # pmu mappings: cpu = 4, software = 1, tracepoint = 2, uncore_bbox_0 = 15, uncore_bbox_1 = 16, uncore_cbox_0 = 7, uncore_cbox_1 = 8, uncore_cbox_2 = 9, uncore_cbox_3 = 10, uncore_cbox_4 = 11, uncore_cbox_5 = 12, uncore_cbox_6 = 13, uncore_cbox_7 = 14, uncore_mbox_0 = 19, uncore_mbox_1 = 20, uncore_rbox_0 = 21, uncore_rbox_1 = 22, uncore_sbox_0 = 17, uncore_sbox_1 = 18, breakpoint = 5, uncore_ubox = 6, uncore_wbox = 23 # ======== # # Samples: 5K of event 'cycles' # Event count (approx.): 1493942335 # # Overhead Command Shared Object # ........ ............... .................... # 51.45% makedumpfile-cl makedumpfile-cliff | |--51.45%-- set_bitmap_cyclic | | | --100.00%-- exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--11.66%-- get_num_dumpable_cyclic | |--7.96%-- clear_bit_on_2nd_bitmap_for_kernel | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--6.93%-- create_1st_bitmap_cyclic | |--4.52%-- __exclude_unnecessary_pages_kernel | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--4.35%-- clear_bit_on_2nd_bitmap | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--4.05%-- set_bit_on_1st_bitmap | |--3.63%-- update_cyclic_region | |--3.52%-- write_kdump_pages_and_bitmap_cyclic | writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--1.87%-- is_xen_memory | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 --0.07%-- [...] 47.68% makedumpfile-cl [kernel.kallsyms] | |--77.89%-- write_vmcore_get_excludes | write_vmcore_pfn_lists | proc_reg_write | vfs_write | sys_write | system_call_fastpath | __write_nocancel | exclude_unnecessary_pages_cyclic | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--15.34%-- walk_system_ram_range | | | |--96.92%-- page_is_ram | | __ioremap_caller | | ioremap_cache | | | | | |--99.51%-- write_vmcore_get_memmap | | | write_vmcore_pfn_lists | | | proc_reg_write | | | vfs_write | | | sys_write | | | system_call_fastpath | | | __write_nocancel | | | 0x7fff0b66fe70 | | | 0x64656b616d2f6873 | | --0.49%-- [...] | | | |--2.84%-- pat_pagerange_is_ram | | | | | |--58.30%-- free_memtype | | | iounmap | | | copy_oldmem_page | | | read_from_oldmem | | | read_vmcore | | | proc_reg_read | | | vfs_read | | | sys_read | | | system_call_fastpath | | | __read_nocancel | | | | | | | --100.00%-- 0x45524f4300000001 | | | | | --41.70%-- reserve_memtype | | __ioremap_caller | | ioremap_cache | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | --0.24%-- [...] | |--0.76%-- __purge_vmap_area_lazy | | | |--76.20%-- free_vmap_area_noflush | | free_unmap_vmap_area | | remove_vm_area | | iounmap | | copy_oldmem_page | | read_from_oldmem | | read_vmcore | | proc_reg_read | | vfs_read | | sys_read | | system_call_fastpath | | __read_nocancel | | | | | |--50.02%-- 0x45524f4300000001 | | | | | --49.98%-- 0x0 | | | --23.80%-- vm_unmap_aliases | change_page_attr_set_clr | _set_memory_wb | ioremap_change_attr | kernel_map_sync_memtype | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | |--0.66%-- iomem_map_sanity_check | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel | | | |--50.44%-- 0x45524f4300000001 | | | --49.56%-- 0x0 | |--0.51%-- try_preserve_large_page | __change_page_attr | __change_page_attr_set_clr | change_page_attr_set_clr | _set_memory_wb | ioremap_change_attr | kernel_map_sync_memtype | __ioremap_caller | ioremap_cache | copy_oldmem_page | read_from_oldmem | read_vmcore | proc_reg_read | vfs_read | sys_read | system_call_fastpath | __read_nocancel --4.84%-- [...] 0.72% makedumpfile-cl libc.so.6 | |--36.59%-- __memset_sse2 | | | --100.00%-- 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--31.88%-- memcpy | | | --100.00%-- writeout_dumpfile | 0x7fff0b66fe70 | 0x64656b616d2f6873 | |--4.88%-- time | |--4.80%-- _IO_file_xsputn@@GLIBC_2.2.5 | 0x7f7e97029000 | |--2.46%-- _IO_file_init@@GLIBC_2.2.5 | |--2.45%-- _int_free | |--2.45%-- 0x372527ffa0 | |--2.44%-- _IO_default_xsputn | 0x71e4ef | |--2.42%-- __lseek_nocancel | |--2.41%-- _IO_getline_info | |--2.41%-- __strlen_sse42 | 0x61705f6769746e6f | |--2.41%-- _IO_fgets | 0x3638343533313d45 | --2.40%-- vfprintf fprintf 0.13% makedumpfile-cl ld-linux-x86-64.so.2 | |--28.61%-- _dl_relocate_object | dl_main | _dl_sysdep_start | 0x4156415741e58948 | |--28.61%-- do_lookup_x | |--14.96%-- strcmp | 0x6e696c2d646c0036 | |--14.34%-- _dl_lookup_symbol_x | _dl_relocate_object | dl_main | _dl_sysdep_start | 0x4156415741e58948 | --13.48%-- _dl_sort_fini _dl_fini exit 0.02% makedumpfile-cl libstdc++.so.6 | --- std::basic_ios<char, std::char_traits<char> >::init(std::basic_streambuf<char, std::char_traits<char> >*) 0x37284ebbe0 std::basic_ostream<char, std::char_traits<char> >::~basic_ostream()