Hello, smp_call_function_many randomly hangs. Attached is the call trace. Below is the location where hang happens. [<ffffffff809137e0>] smp_call_function_many+0x2b0/0x330 When disassembled the vmlinux and checked, the hang was in the SYNC instruction. Code snippet: ffffffff809137d8: 8c830018 lw v1,24(a0) ffffffff809137dc: 0000000f sync ffffffff809137e0: e860fffd bbit1 v1,0x0,ffffffff809137d8 <smp_call_function_many+0x2a8> Is this issue known ? or how to fix this ? -- Guruswamy Basavaiah
Jul 31 13:23:12.087140 warn kernel: [ 302.276150] task: 80000007f96f0d80 ti: 80000007f3210000 task.ti: 80000007f3210000 Jul 31 13:23:12.087140 warn kernel: [ 302.276157] $ 0 : 0000000000000000 ffffffff80864a50 0000000000000002 0000000000000003 Jul 31 13:23:12.087140 warn kernel: [ 302.276166] $ 4 : 80000000c9dd8d40 0000000000000002 0000000000000002 0000000000000000 Jul 31 13:23:12.087140 warn kernel: [ 302.276173] $ 8 : 000000000fffbfff 80000000c51942b0 0000001e3f36020d 80000000a5d17003 Jul 31 13:23:12.087140 warn kernel: [ 302.276180] $12 : 0000000000000000 000000001000001e 0000000122acd037 0000000000000029 Jul 31 13:23:12.087140 warn kernel: [ 302.276187] $16 : 80000000c9f4fd40 ffffffff81074660 80000000c9e89200 ffffffff81070000 Jul 31 13:23:12.087140 warn kernel: [ 302.276194] $20 : 80000000c9e89208 0000000000000001 0000000000000100 0000000000000020 Jul 31 13:23:12.087140 warn kernel: [ 302.276203] $24 : 0000000000000000 000000ffe9afdbe0 Jul 31 13:23:12.087140 warn kernel: [ 302.276210] $28 : 80000007f3210000 80000007f3213b00 80000007f3213b70 ffffffff809137a4 Jul 31 13:23:12.087140 warn kernel: [ 302.276211] Hi : 000000000033b78a Jul 31 13:23:12.087140 warn kernel: [ 302.276212] Lo : 000000000000032b Jul 31 13:23:12.087140 warn kernel: [ 302.276219] epc : ffffffff809137e0 smp_call_function_many+0x2b0/0x330 Jul 31 13:23:12.087140 warn kernel: [ 302.276224] ra : ffffffff809137a4 smp_call_function_many+0x274/0x330 Jul 31 13:23:12.087140 warn kernel: [ 302.276231] Status: 10008ce3KX SX UX KERNEL EXL IE Jul 31 13:23:12.087140 warn kernel: [ 302.276232] Cause : 00800800 (ExcCode 00) Jul 31 13:23:12.087140 warn kernel: [ 302.276236] PrId : 000d9109 (Cavium Octeon II) Jul 31 13:23:12.087140 warn kernel: [ 302.276240] CPU: 14 PID: 7810 Comm: HASNodeAgent Tainted: G O 4.4.227-octeon-distro.git-v2.105-1-rc-wnd #1 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] Stack : 0000000000000000 0000000000000004 0000000000000006 0000000000000000 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] ffffffff81cfa5e0 ffffffff8114ea38 ffffffff8114ea38 ffffffff808e0084 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 0000000000000004 ffffffff81150000 ffffffff81d19140 ffffffff808e5b3c Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 0000000000000000 000000000000006b 000000000000000e ffffffff808e73d4 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 0000000000000000 0000000000000000 ffffffff81ce0000 ffffffff81cd2af8 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] ffffffff8107ab07 ffffffff80fb24b0 80000007f96f0d80 ffffffff81cd2af8 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 0000000000001e82 000000000000000e ffffffff81cce400 80000007ff120600 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 80000007f3213b70 80000007ff0dbcb0 80000007ff0dbdc8 ffffffff80b58238 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 0000000000000000 ffffffff808e8584 00000046611153a9 ffffffff80fb24b0 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] 000000000000000e ffffffff80872e00 0000000000000000 0000000000000000 Jul 31 13:23:12.087140 warn kernel: [ 302.276304] ... Jul 31 13:23:12.087140 warn kernel: [ 302.276307] Call Trace: Jul 31 13:23:12.087140 warn kernel: [ 302.276312] [<ffffffff80872e00>] show_stack+0x98/0xb8 Jul 31 13:23:12.087140 warn kernel: [ 302.276318] [<ffffffff80b58238>] dump_stack+0xe8/0x170 Jul 31 13:23:12.087140 warn kernel: [ 302.276323] [<ffffffff8086e7b0>] arch_dump_stack+0x58/0xc0 Jul 31 13:23:12.087140 warn kernel: [ 302.276329] [<ffffffff80912de0>] flush_smp_call_function_queue+0xd8/0x190 Jul 31 13:23:12.087140 warn kernel: [ 302.276336] [<ffffffff8086484c>] mailbox_interrupt+0x104/0x1d0 Jul 31 13:23:12.087140 warn kernel: [ 302.276341] [<ffffffff808e922c>] handle_irq_event_percpu+0x84/0x2b0 Jul 31 13:23:12.087140 warn kernel: [ 302.276347] [<ffffffff808edf8c>] handle_percpu_irq+0x8c/0xc0 Jul 31 13:23:12.087140 warn kernel: [ 302.276353] [<ffffffff808e8694>] generic_handle_irq+0x44/0x58 Jul 31 13:23:12.087140 warn kernel: [ 302.276359] [<ffffffff80e25e8c>] do_IRQ+0x24/0x30 Jul 31 13:23:12.087140 warn kernel: [ 302.276378] [<ffffffff80806a54>] octeon_irq_ciu2_mbox+0x6c/0x100 Jul 31 13:23:12.087140 warn kernel: [ 302.276383] [<ffffffff80807ddc>] plat_irq_dispatch+0xdc/0x148 Jul 31 13:23:12.087140 warn kernel: [ 302.276387] [<ffffffff8086c514>] handle_int+0x194/0x1a0 Jul 31 13:23:12.087140 warn kernel: [ 302.276393] [<ffffffff809137e0>] smp_call_function_many+0x2b0/0x330 Jul 31 13:23:12.087140 warn kernel: [ 302.276398] [<ffffffff80913894>] smp_call_function+0x34/0x48 Jul 31 13:23:12.087140 warn kernel: [ 302.276405] [<ffffffff80878bec>] flush_tlb_page+0x6c/0x120 Jul 31 13:23:12.087140 warn kernel: [ 302.276411] [<ffffffff809bbe58>] ptep_set_access_flags+0x80/0xd0 Jul 31 13:23:12.087140 warn kernel: [ 302.276419] [<ffffffff809a8814>] do_wp_page+0x12c/0x860 Jul 31 13:23:12.087140 warn kernel: [ 302.276425] [<ffffffff809ab9f8>] handle_mm_fault+0xee8/0x16a8 Jul 31 13:23:12.087140 warn kernel: [ 302.276431] [<ffffffff808847d0>] __do_page_fault+0x1a0/0x598 Jul 31 13:23:12.087140 warn kernel: [ 302.276436] [<ffffffff8086bfc0>] ret_from_exception+0x0/0x18