On Wed, Sep 16, 2015 at 02:18:49PM +0530, maitysanchayan@xxxxxxxxx wrote: > Hello Peter, > > > > > Enable CONFIG_DEBUG_LIST, it has below position if you > > run make menuconfig > > Kernel hacking ---> > > [*] Debug linked list manipulation > > > > Sorry for the delay. When I enabled this config the first time my test > application ran for 24 hours or so and I did not get any stack traces. > > I restarted the test again and finally got the trace below. You were > spot on, its a list corruption issue. I modified the trace a bit after > copying to remove the sprinkled debug messages throughout the trace > from my test application. > > [ 622.204134] WARNING: CPU: 0 PID: 0 at lib/list_debug.c:59 __list_del_entry+0xc4/0xe8() > [ 622.212870] list_del corruption. prev->next should be 8db63600, but was 36008db6 You see the higher 16 bits were swapped with lower 16 bits, and the virtual memory address should begin from 0x8xxxxxxxx, right? Check with Vybrid errata to see if all ARM/memory system have applied. Peter > [ 622.221119] Modules linked in: > [ 622.225921] CPU: 0 PID: 0 Comm: swapper Not tainted 4.1.5-00004-g326879d #327 > [ ]Hrdware name: Freescale Vybrid VF5xx/VF6xx (Device Tree) > [ 622.241199] Backtrace: > [ 622.245416] [<80012b78>] (dump_backtrace) from [<80012d98>] (show_stack+0x18/0x1c) > [ 622.253810] r7:802a5ff4 r6:0000003b r5:00000009 r4:00000000 > [ 622.263424] [<80012d80>] (show_stack) from [<80590990>] (dump_stack+0x24/0x28) > [ 622.271496] [<8059096c>] (dump_stack) from [<80023e24>] (warn_slowpath_common+0x88/0xb4) > [ 622.280438] [<80023d9c>] (warn_slowpath_common) from [<80023e88>] (warn_slowpath_fmt+0x38/0x40) > [ 622.289980] r8:8d99a8bc r7:8e02f464Cl r6:8d99a880 r5:0000007 r4:80704238ient > [ 622.300980] [<80023e54>] (warn_slowpath_fmt) from [<802a5ff4>] (__list_del_entry+0xc4/0xe8) > [ 622.310175] r3:8db63600 r2:80704238 > [ 622.316275] r4:8d99a8bc > [ 622.320479] [<802a5f30>] (__list_del_entry) from [<803a0740>] (udc_irq+0x3d8/0xcdc) > [ 622.328986] [<803a0368>] (udc_irq) from [<8039d6bc>] (ci_irq+0x58/0x11c) > [ 622.336531] r10:807ddefe r9:8e0bd480 r8:00000027 r7:00000000 r6:00000000 r5:807bd6c4 > [ 622.349426] r4:8e02f010 > [ 622.353633] [<8039d664>] (ci_irq) from [<8004d670>] (handle_irq_event_percpu+0x80/0x148) > [ 622.362557] r5:807bd6c4 r4:8e2d0880 > [ 622.366600] [<8004d5f0>] (handle_irq_event_percpu) from [<8004d768>] (handle_irq_event+0x30/0x40) > [ 622.375470] r10:807ac0d4 r9:807d2540 r8:8e006000 r7:00000000 r6:00000000 r5:807bd6c4 > [ 622.383385] r4:8e0bd480 > [ 622.385947] [<8004d738>] (handle_irq_event) from [<8004fce0>] (handle_fasteoi_irq+0xa4/0x16c) > [ 622.394476] r5:807bd6c4 r4:8e0bd480 > [ 622.398095] [<8004fc3c>] (handle_fasteoi_irq) from [<8004cdd8>] (generic_handle_irq+0x34/0x44) > [ 622.406712] r5:00000027 r4:00000027 > [ 622.410330] [<8004cda4>] (generic_handle_irq) from [<8004d03c>] (__handle_domain_irq+0x5c/0xb0) > [ 622.419027] r5:00000027 r4:807bd4fc > [ 622.422643] [<8004cfe0>] (__handle_domain_irq) from [<80009364>] (gic_handle_irq+0x2c/0x5c) > [ 622.430994] r9:807d2540 r8:807ac0cc r7:90002100 r6:807abf20 r5:807ac364 r4:9000210c > [ 622.438834] [<80009338>] (gic_handle_irq) from [<80013800>] (__irq_svc+0x40/0x54) > [ 622.446323] Exception stack(0x807abf20 to 0x807abf68) > [ 622.451396] bf20: 00000001 00000000 00000000 8001d7a0 807aa000 807ac0cc 00000000 00000000 > [ 622.459586] bf40: 807ac0cc 807d2540 807ac0d4 807abf74 807abf78 807abf68 80010028 8001002c > [ 622.467768] bf60: 60010013 ffffffff > [ 622.471262] r7:807abf54 r6:ffffffff r5:60010013 r4:8001002c > [ 622.477007] [<8000ffec>] (arch_cpu_idle) from [<80045f14>] (cpu_startup_entry+0x1c8/0x254) > [ 622.485297] [<80045d4c>] (cpu_startup_entry) from [<8058f3bc>] (rest_init+0x78/0x7c) > [ 622.493045] r7:ffffffff > [ 622.495614] [<8058f344>] (rest_init) from [<80777cd4>] (start_kernel+0x390/0x39c) > [ 622.503117] [<80777944>] (start_kernel) from [<80008078>] (0x80008078) > [ 622.509648] ---[ end trace 4342257fd07cce01 ]--- > > [snip] Had some prints from test app here > > [ 622.514298] ------------[ cut here ]------------ > [ 622.518935] WARNING: CPU: 0 PID: 0 at lib/list_debug.c:33 __list_add+0xac/0xe0() > [ 622.526339] list_add corruption. prev->next should be next (8d99a8bc), but was 8db63600. (prev=8db63600). > [ 622.535905] Modules linked in: > [ 622.538988] CPU: 0 PID: 0 Comm: swapper Tainted: G W 4.1.5-00004-g326879d #327 > [ 622.547345] Hardware name: Freescale Vybrid VF5xx/VF6xx (Device Tree) > [ 622.553782] Backtrace: > [ 622.556259] [<80012b78>] (dump_backtrace) from [<80012d98>] (show_stack+0x18/0x1c) > [ 622.563834] r7:802a5efc r6:00000021 r5:00000009 r4:00000000 > [ 622.569571] [<80012d80>] (show_stack) from [<80590990>] (dump_stack+0x24/0x28) > [ 622.576814] [<8059096c>] (dump_stack) from [<80023e24>] (warn_slowpath_common+0x88/0xb4) > [ 622.584917] [<80023d9c>] (warn_slowpath_common) from [<80023e88>] (warn_slowpath_fmt+0x38/0x40) > [ 622.593618] r8:8d99a8b4 r7:8e02f464 r6:8d99a8bc r5:8db63600 r4:80704150 > [ 622.600408] [<80023e54>] (warn_slowpath_fmt) from [<802a5efc>] (__list_add+0xac/0xe0) > [ 622.608241] r3:8d99a8bc r2:80704150 > [ 622.611842] r4:8db1c280 > [ 622.614401] [<802a5e50>] (__list_add) from [<8039f4ac>] (add_td_to_list+0x12c/0x19c) > [ 622.622144] r6:00000800 r5:8d99a880 r4:8db1c280 > [ 622.626821] [<8039f380>] (add_td_to_list) from [<8039ffb8>] (_ep_queue.isra.22+0x144/0x46c) > [ 622.635170] r9:8e02f010 r8:8d99a8b4 r7:00000800 r6:00000800 r5:8e02f464 r4:8d99a880 > [ 622.643013] [<8039fe74>] (_ep_queue.isra.22) from [<803a0358>] (ep_queue+0x30/0x40) > [ 622.650669] r10:8d99a8bc r9:8cfffa80 r8:8e02f464 r7:00000020 r6:8d99a880 r5:8da20460 > [ 622.658584] r4:a0010193 > [ 622.661142] [<803a0328>] (ep_queue) from [<803afa6c>] (rx_submit+0xd4/0x14c) > [ 622.668191] r5:8da20460 r4:00000800 > [ 622.671803] [<803af998>] (rx_submit) from [<803afec0>] (rx_complete+0x164/0x20c) > [ 622.679204] r9:a0010193 r8:00000000 r7:8da20480 r6:8d99a880 r5:00000000 r4:8da20460 > [ 622.687052] [<803afd5c>] (rx_complete) from [<803a9040>] (usb_gadget_giveback_request+0x14/0x18) > [ 622.695840] r9:8e02f464 r8:8d99a8bc r7:8e02f464 r6:8d99a880 r5:8d99a8b4 r4:0000007e > [ 622.703684] [<803a902c>] (usb_gadget_giveback_request) from [<803a082c>] (udc_irq+0x4c4/0xcdc) > [ 622.712309] [<803a0368>] (udc_irq) from [<8039d6bc>] (ci_irq+0x58/0x11c) > [ 622.719011] r10:807ddefe r9:8e0bd480 r8:00000027 r7:00000000 r6:00000000 r5:807bd6c4 > [ 622.726926] r4:8e02f010 > [ 622.729485] [<8039d664>] (ci_irq) from [<8004d670>] (handle_irq_event_percpu+0x80/0x148) > [ 622.737574] r5:807bd6c4 r4:8e2d0880 > [ 622.741193] [<8004d5f0>] (handle_irq_event_percpu) from [<8004d768>] (handle_irq_event+0x30/0x40) > [ 622.750063] r10:807ac0d4 r9:807d2540 r8:8e006000 r7:00000000 r6:00000000 r5:807bd6c4 > [ 622.757977] r4:8e0bd480 > [ 622.760537] [<8004d738>] (handle_irq_event) from [<8004fce0>] (handle_fasteoi_irq+0xa4/0x16c) > [ 622.769068] r5:807bd6c4 r4:8e0bd480 > [ 622.772686] [<8004fc3c>] (handle_fasteoi_irq) from [<8004cdd8>] (generic_handle_irq+0x34/0x44) > [ 622.781296] r5:00000027 r4:00000027 > [ 622.784913] [<8004cda4>] (generic_handle_irq) from [<8004d03c>] (__handle_domain_irq+0x5c/0xb0) > [ 622.793610] r5:00000027 r4:807bd4fc > [ 622.797226] [<8004cfe0>] (__handle_domain_irq) from [<80009364>] (gic_handle_irq+0x2c/0x5c) > [ 622.805578] r9:807d2540 r8:807ac0cc r7:90002100 r6:807abf20 r5:807ac364 r4:9000210c > [ 622.813417] [<80009338>] (gic_handle_irq) from [<80013800>] (__irq_svc+0x40/0x54) > [ 622.820906] Exception stack(0x807abf20 to 0x807abf68) > [ 622.825976] bf20: 00000001 00000000 00000000 8001d7a0 807aa000 807ac0cc 00000000 00000000 > [ 622.834169] bf40: 807ac0cc 807d2540 807ac0d4 807abf74 807abf78 807abf68 80010028 8001002c > [ 622.842352] bf60: 60010013 ffffffff > [ 622.845845] r7:807abf54 r6:ffffffff r5:60010013 r4:8001002c > [ 622.851584] [<8000ffec>] (arch_cpu_idle) from [<80045f14>] (cpu_startup_entry+0x1c8/0x254) > [ 622.859870] [<80045d4c>] (cpu_startup_entry) from [<8058f3bc>] (rest_init+0x78/0x7c) > [ 622.867619] r7:ffffffff > [ 622.870181] [<8058f344>] (rest_init) from [<80777cd4>] (start_kernel+0x390/0x39c) > [ 622.877681] [<80777944>] (start_kernel) from [<80008078>] (0x80008078) > [ 622.884213] ---[ end trace 4342257fd07cce02 ]--- > [ 623.357829] Unable to handle kernel NULL pointer dereference at virtual address 00000004 > [ 623.365951] pgd = 80004000 > [ 623.368666] [00000004] *pgd=00000000 > [ 623.372276] Internal error: Oops: 5 [#1] ARM > [ 623.376554] Modules linked in: > [ 623.379637] CPU: 0 PID: 0 Comm: swapper Tainted: G W 4.1.5-00004-g326879d #327 > [ 623.387991] Hardware name: Freescale Vybrid VF5xx/VF6xx (Device Tree) > [ 623.394443] task: 807b04b0 ti: 807aa000 task.ti: 807aa000 > [ 623.399870] PC is at udc_irq+0x3f8/0xcdc > [ 623.403798] LR is at 0x8db63600 > [ 623.406953] pc : [<803a0760>] lr : [<8db63600>] psr: 20070193 > [ 623.406953] sp : 807abdd0 ip : 8db0febc fp : 807abe3c > [ 623.418437] r10: 8db0febc r9 : 8db0febc r8 : 8d99a8bc > [ 623.423671] r7 : 8e02f464 r6 : 8d99a880 r5 : 0000006c r4 : 8db0febc > [ 623.430206] r3 : 00000000 r2 : 00200200 r1 : 8db0febc r0 : 8db63600 > [ 623.436743] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment kernel > [ 623.444144] Control: 10c5387d Table: 8d89c059 DAC: 00000015 > [ 623.449896] Process swapper (pid: 0, stack limit = 0x807aa208) > [ 623.455738] Stack: (0x807abdd0 to 0x807ac000) > [ 623.460110] bdc0: 00000000 807f603c 8039fae8 8e02f408 > [ 623.468305] bde0: 807ac044 00000001 8e02f49c 8e02f464 8e02f010 8e02f010 00000001 8d99a8b4 > [ 623.476497] be00: 8d99a200 8e02f4bc 802d8a50 8045b69c 807abe5c 8e02f010 807bd6c4 00000000 > [ 623.484689] be20: 00000000 00000027 8e0bd480 807ddefe 807abe54 807abe40 8039d6bc 803a0374 > [ 623.492882] be40: 8e2d0880 807bd6c4 807abe8c 807abe58 8004d670 8039d670 eafa9486 00000090 > [ 623.501074] be60: ffffffff 8e0bd480 807bd6c4 00000000 00000000 8e006000 807d2540 807ac0d4 > [ 623.509267] be80: 807abea4 807abe90 8004d768 8004d5fc 8e0bd480 807bd6c4 807abebc 807abea8 > [ 623.517459] bea0: 8004fce0 8004d744 00000027 00000027 807abed4 807abec0 8004cdd8 8004fc48 > [ 623.525651] bec0: 807bd4fc 00000027 807abefc 807abed8 8004d03c 8004cdb0 9000210c 807ac364 > [ 623.533844] bee0: 807abf20 90002100 807ac0cc 807d2540 807abf1c 807abf00 80009364 8004cfec > [ 623.542036] bf00: 8001002c 60070013 ffffffff 807abf54 807abf74 807abf20 80013800 80009344 > [ 623.550228] bf20: 00000001 00000000 00000000 8001d7a0 807aa000 807ac0cc 00000000 00000000 > [ 623.558421] bf40: 807ac0cc 807d2540 807ac0d4 807abf74 807abf78 807abf68 80010028 8001002c > [ 623.566613] bf60: 60070013 ffffffff 807abf9c 807abf78 80045f14 8000fff8 807ddefc 807de0c0 > [ 623.574806] bf80: 807abf9c 807b4350 80591ee8 ffffffff 807abfac 807abfa0 8058f3bc 80045d58 > [ 623.582998] bfa0: 807abff4 807abfb0 80777cd4 8058f350 ffffffff ffffffff 807776d4 00000000 > [ 623.591190] bfc0: 00000000 807a1228 00000000 807de294 807ac074 807a1224 807b16e8 80004059 > [ 623.599382] bfe0: 410fc051 00000000 00000000 807abff8 80008078 80777950 00000000 00000000 > [ 623.607559] Backtrace: > [ 623.610047] [<803a0368>] (udc_irq) from [<8039d6bc>] (ci_irq+0x58/0x11c) > [ 623.616753] r10:807ddefe r9:8e0bd480 r8:00000027 r7:00000000 r6:00000000 r5:807bd6c4 > [ 623.624666] r4:8e02f010 > [ 623.627237] [<8039d664>] (ci_irq) from [<8004d670>] (handle_irq_event_percpu+0x80/0x148) > [ 623.635333] r5:807bd6c4 r4:8e2d0880 > [ 623.638950] [<8004d5f0>] (handle_irq_event_percpu) from [<8004d768>] (handle_irq_event+0x30/0x40) > [ 623.647820] r10:807ac0d4 r9:807d2540 r8:8e006000 r7:00000000 r6:00000000 r5:807bd6c4 > [ 623.655734] r4:8e0bd480 > [ 623.658297] [<8004d738>] (handle_irq_event) from [<8004fce0>] (handle_fasteoi_irq+0xa4/0x16c) > [ 623.666826] r5:807bd6c4 r4:8e0bd480 > [ 623.670444] [<8004fc3c>] (handle_fasteoi_irq) from [<8004cdd8>] (generic_handle_irq+0x34/0x44) > [ 623.679053] r5:00000027 r4:00000027 > [ 623.682671] [<8004cda4>] (generic_handle_irq) from [<8004d03c>] (__handle_domain_irq+0x5c/0xb0) > [ 623.691368] r5:00000027 r4:807bd4fc > [ 623.694986] [<8004cfe0>] (__handle_domain_irq) from [<80009364>] (gic_handle_irq+0x2c/0x5c) > [ 623.703335] r9:807d2540 r8:807ac0cc r7:90002100 r6:807abf20 r5:807ac364 r4:9000210c > [ 623.711176] [<80009338>] (gic_handle_irq) from [<80013800>] (__irq_svc+0x40/0x54) > [ 623.718664] Exception stack(0x807abf20 to 0x807abf68) > [ 623.723734] bf20: 00000001 00000000 00000000 8001d7a0 807aa000 807ac0cc 00000000 00000000 > [ 623.731927] bf40: 807ac0cc 807d2540 807ac0d4 807abf74 807abf78 807abf68 80010028 8001002c > [ 623.740109] bf60: 60070013 ffffffff > [ 623.743603] r7:807abf54 r6:ffffffff r5:60070013 r4:8001002c > [ 623.749356] [<8000ffec>] (arch_cpu_idle) from [<80045f14>] (cpu_startup_entry+0x1c8/0x254) > [ 623.757644] [<80045d4c>] (cpu_startup_entry) from [<8058f3bc>] (rest_init+0x78/0x7c) > [ 623.765386] r7:ffffffff > [ 623.767954] [<8058f344>] (rest_init) from [<80777cd4>] (start_kernel+0x390/0x39c) > [ 623.775447] [<80777944>] (start_kernel) from [<80008078>] (0x80008078) > [ 623.781990] Code: e594c000 0a00005f e594300c e1a09004 (e5933004) > [ 623.788102] ---[ end trace 4342257fd07cce03 ]--- > [ 623.792727] Kernel panic - not syncing: Fatal exception in interrupt > [ 623.799090] ---[ end Kernel panic - not syncing: Fatal exception in interrupt > > > Thanks & Regards, > Sanchayan Maity. -- Best Regards, Peter Chen -- To unsubscribe from this list: send the line "unsubscribe linux-usb" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
