smp_call_function_many hangs for a moment (from 100millisecond to 1 second)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,
 smp_call_function_many randomly hangs. Attached is the call trace.
 Below is the location where hang happens.
 [<ffffffff809137e0>] smp_call_function_many+0x2b0/0x330

 When disassembled the vmlinux and checked, the hang was in the SYNC
instruction.

Code snippet:
ffffffff809137d8:       8c830018        lw      v1,24(a0)
ffffffff809137dc:       0000000f        sync
ffffffff809137e0:       e860fffd        bbit1
v1,0x0,ffffffff809137d8 <smp_call_function_many+0x2a8>

Is this issue known ? or how to fix this ?
-- 
Guruswamy Basavaiah
Jul 31 13:23:12.087140 warn kernel: [  302.276150] task: 80000007f96f0d80 ti: 80000007f3210000 task.ti: 80000007f3210000
Jul 31 13:23:12.087140 warn kernel: [  302.276157] $ 0   : 0000000000000000 ffffffff80864a50 0000000000000002 0000000000000003
Jul 31 13:23:12.087140 warn kernel: [  302.276166] $ 4   : 80000000c9dd8d40 0000000000000002 0000000000000002 0000000000000000
Jul 31 13:23:12.087140 warn kernel: [  302.276173] $ 8   : 000000000fffbfff 80000000c51942b0 0000001e3f36020d 80000000a5d17003
Jul 31 13:23:12.087140 warn kernel: [  302.276180] $12   : 0000000000000000 000000001000001e 0000000122acd037 0000000000000029
Jul 31 13:23:12.087140 warn kernel: [  302.276187] $16   : 80000000c9f4fd40 ffffffff81074660 80000000c9e89200 ffffffff81070000
Jul 31 13:23:12.087140 warn kernel: [  302.276194] $20   : 80000000c9e89208 0000000000000001 0000000000000100 0000000000000020
Jul 31 13:23:12.087140 warn kernel: [  302.276203] $24   : 0000000000000000 000000ffe9afdbe0
Jul 31 13:23:12.087140 warn kernel: [  302.276210] $28   : 80000007f3210000 80000007f3213b00 80000007f3213b70 ffffffff809137a4
Jul 31 13:23:12.087140 warn kernel: [  302.276211] Hi    : 000000000033b78a
Jul 31 13:23:12.087140 warn kernel: [  302.276212] Lo    : 000000000000032b
Jul 31 13:23:12.087140 warn kernel: [  302.276219] epc   : ffffffff809137e0 smp_call_function_many+0x2b0/0x330
Jul 31 13:23:12.087140 warn kernel: [  302.276224] ra    : ffffffff809137a4 smp_call_function_many+0x274/0x330
Jul 31 13:23:12.087140 warn kernel: [  302.276231] Status: 10008ce3KX SX UX KERNEL EXL IE
Jul 31 13:23:12.087140 warn kernel: [  302.276232] Cause : 00800800 (ExcCode 00)
Jul 31 13:23:12.087140 warn kernel: [  302.276236] PrId  : 000d9109 (Cavium Octeon II)
Jul 31 13:23:12.087140 warn kernel: [  302.276240] CPU: 14 PID: 7810 Comm: HASNodeAgent Tainted: G           O    4.4.227-octeon-distro.git-v2.105-1-rc-wnd #1
Jul 31 13:23:12.087140 warn kernel: [  302.276304] Stack : 0000000000000000 0000000000000004 0000000000000006 0000000000000000
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   ffffffff81cfa5e0 ffffffff8114ea38 ffffffff8114ea38 ffffffff808e0084
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   0000000000000004 ffffffff81150000 ffffffff81d19140 ffffffff808e5b3c
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   0000000000000000 000000000000006b 000000000000000e ffffffff808e73d4
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   0000000000000000 0000000000000000 ffffffff81ce0000 ffffffff81cd2af8
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   ffffffff8107ab07 ffffffff80fb24b0 80000007f96f0d80 ffffffff81cd2af8
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   0000000000001e82 000000000000000e ffffffff81cce400 80000007ff120600
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   80000007f3213b70 80000007ff0dbcb0 80000007ff0dbdc8 ffffffff80b58238
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   0000000000000000 ffffffff808e8584 00000046611153a9 ffffffff80fb24b0
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   000000000000000e ffffffff80872e00 0000000000000000 0000000000000000
Jul 31 13:23:12.087140 warn kernel: [  302.276304]   ...
Jul 31 13:23:12.087140 warn kernel: [  302.276307] Call Trace:
Jul 31 13:23:12.087140 warn kernel: [  302.276312] [<ffffffff80872e00>] show_stack+0x98/0xb8
Jul 31 13:23:12.087140 warn kernel: [  302.276318] [<ffffffff80b58238>] dump_stack+0xe8/0x170
Jul 31 13:23:12.087140 warn kernel: [  302.276323] [<ffffffff8086e7b0>] arch_dump_stack+0x58/0xc0
Jul 31 13:23:12.087140 warn kernel: [  302.276329] [<ffffffff80912de0>] flush_smp_call_function_queue+0xd8/0x190
Jul 31 13:23:12.087140 warn kernel: [  302.276336] [<ffffffff8086484c>] mailbox_interrupt+0x104/0x1d0
Jul 31 13:23:12.087140 warn kernel: [  302.276341] [<ffffffff808e922c>] handle_irq_event_percpu+0x84/0x2b0
Jul 31 13:23:12.087140 warn kernel: [  302.276347] [<ffffffff808edf8c>] handle_percpu_irq+0x8c/0xc0
Jul 31 13:23:12.087140 warn kernel: [  302.276353] [<ffffffff808e8694>] generic_handle_irq+0x44/0x58
Jul 31 13:23:12.087140 warn kernel: [  302.276359] [<ffffffff80e25e8c>] do_IRQ+0x24/0x30
Jul 31 13:23:12.087140 warn kernel: [  302.276378] [<ffffffff80806a54>] octeon_irq_ciu2_mbox+0x6c/0x100
Jul 31 13:23:12.087140 warn kernel: [  302.276383] [<ffffffff80807ddc>] plat_irq_dispatch+0xdc/0x148
Jul 31 13:23:12.087140 warn kernel: [  302.276387] [<ffffffff8086c514>] handle_int+0x194/0x1a0
Jul 31 13:23:12.087140 warn kernel: [  302.276393] [<ffffffff809137e0>] smp_call_function_many+0x2b0/0x330
Jul 31 13:23:12.087140 warn kernel: [  302.276398] [<ffffffff80913894>] smp_call_function+0x34/0x48
Jul 31 13:23:12.087140 warn kernel: [  302.276405] [<ffffffff80878bec>] flush_tlb_page+0x6c/0x120
Jul 31 13:23:12.087140 warn kernel: [  302.276411] [<ffffffff809bbe58>] ptep_set_access_flags+0x80/0xd0
Jul 31 13:23:12.087140 warn kernel: [  302.276419] [<ffffffff809a8814>] do_wp_page+0x12c/0x860
Jul 31 13:23:12.087140 warn kernel: [  302.276425] [<ffffffff809ab9f8>] handle_mm_fault+0xee8/0x16a8
Jul 31 13:23:12.087140 warn kernel: [  302.276431] [<ffffffff808847d0>] __do_page_fault+0x1a0/0x598
Jul 31 13:23:12.087140 warn kernel: [  302.276436] [<ffffffff8086bfc0>] ret_from_exception+0x0/0x18


[Index of Archives]     [LKML Archive]     [Linux ARM Kernel]     [Linux ARM]     [Git]     [Yosemite News]     [Linux SCSI]     [Linux Hams]

  Powered by Linux