Re: raid5:md3: kernel BUG , followed by , Silent halt .

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



	Hello Dan ,

On Mon, 20 Aug 2007, Dan Williams wrote:
On 8/18/07, Mr. James W. Laferriere <babydr@xxxxxxxxxxxxxxxx> wrote:
        Hello All ,  Here we go again .  Again attempting to do bonnie++ testing
on a small array .
        Kernel 2.6.22.1
        Patches involved ,
        IOP1 ,  2.6.22.1-iop1 for improved sequential write performance
(stripe-queue) ,  Dan Williams <dan.j.williams@xxxxxxxxx>

Hello James,

Thanks for the report.

I tried to reproduce this on my system, no luck.
	Possibly because there is significant hardware differances ?
	See 'lspci -v' below .sig .

However it looks
like their is a potential race between 'handle_queue' and
'add_queue_bio'.  The attached patch moves these critical sections
under spin_lock(&sq->lock), and adds some debugging output if this BUG
triggers.  It also includes a fix for retry_aligned_read which is
unrelated to this debug.
--
Dan
Applied your patch . The same 'kernel BUG at drivers/md/raid5.c:3689!' messages appear (see attached) . The system is still responsive with your patch , the kernel crashed last time . Tho the bonnie++ run is stuck in 'D' . And doing a '> /md3/asdf' stays hung even after passing the parent process a 'kill -9' . Any further info You can think of I can/should , I will try to acquire . But I'll have to repeat these steps to attempt to get the same results . I'll be shutting the system down after sending this off .
	Fyi ,  the previous 'BUG" without your patch was quite repeatable .
I might have time over the next couple of weeks to be able to see if it is as repatable as the last one .

	Contents of /proc/mdstat for md3 .

md3 : active raid6 sdx1[3] sdw1[2] sdv1[1] sdu1[0] sdt1[7](S) sds1[6] sdr1[5] sdq1[4]
      717378560 blocks level 6, 1024k chunk, algorithm 2 [7/7] [UUUUUUU]
      bitmap: 2/137 pages [8KB], 512KB chunk

	Commands I ran that lead to the 'BUG' .

bonniemd3() { /root/bonnie++-1.03a/bonnie++  -u0:0  -d /md3  -s 131072  -f; }
bonniemd3 > 131072MB-bonnie++-run-md3-xfs.log-20070825 2>&1 &

 root@filesrv2:~ # top
top - 02:22:09 up  3:39,  2 users,  load average: 3.09, 2.89, 2.48
Tasks: 155 total,   1 running, 154 sleeping,   0 stopped,   0 zombie
Cpu0  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu1  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu2  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu3  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu4  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu5  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu6  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu7  :  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   8256156k total,  7995044k used,   261112k free,     7480k buffers
Swap:   987896k total,     2784k used,   985112k free,  7787320k cached

  PID USER     P  PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 4073 root     0  18   0     0    0    0 D    0  0.0  15:10.86 [bonnie++]
 4076 root     5  15   0  3000 1828 1252 D    0  0.0   0:00.05 -bash
 4308 root     5  15   0     0    0    0 D    0  0.0   0:01.40 [pdflush]
 4422 root     6  18   0  2212 1168  860 R    0  0.0   0:00.13 top


 root@filesrv2:~ # ps -auxww | grep -C3 bonni
Warning: bad ps syntax, perhaps a bogus '-'? See http://procps.sf.net/faq.html
root      4029  0.0  0.0      0     0 ?        S<   Aug25   0:01 [xfsbufd]
root      4030  0.0  0.0      0     0 ?        S<   Aug25   0:00 [xfssyncd]
root      4072  0.0  0.0   2992   848 ?        S    Aug25   0:00 -bash
root      4073  7.3  0.0      0     0 ?        D    Aug25  15:10 [bonnie++]
root      4074  0.1  0.0   6412  1980 ?        Ss   Aug25   0:12 sshd: root@pts/1
root      4076  0.0  0.0   3000  1828 pts/1    Ds+  Aug25   0:00 -bash
root      4302  0.1  0.0      0     0 ?        S    00:50   0:08 [pdflush]


--
+-----------------------------------------------------------------+
| James   W.   Laferriere | System   Techniques | Give me VMS     |
| Network        Engineer | 663  Beaumont  Blvd |  Give me Linux  |
| babydr@xxxxxxxxxxxxxxxx | Pacifica, CA. 94044 |   only  on  AXP |
+-----------------------------------------------------------------+

 root@filesrv2:~ # lspci -v
00:00.0 Host bridge: Intel Corporation 5000P Chipset Memory Controller Hub (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: bus master, fast devsel, latency 0
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
        Capabilities: [6c] Express Root Port (Slot-) IRQ 0
        Capabilities: [100] Advanced Error Reporting

00:02.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 2-3 (rev b1) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=01, subordinate=07, sec-latency=0
        I/O behind bridge: 00002000-00003fff
        Memory behind bridge: d8300000-d85fffff
        Prefetchable memory behind bridge: 00000000d8000000-00000000d8100000
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable+
        Capabilities: [6c] Express Root Port (Slot-) IRQ 0
        Capabilities: [100] Advanced Error Reporting

00:04.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 4-5 (rev b1) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=08, subordinate=08, sec-latency=0
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable+
        Capabilities: [6c] Express Root Port (Slot+) IRQ 0
        Capabilities: [100] Advanced Error Reporting

00:06.0 PCI bridge: Intel Corporation 5000 Series Chipset PCI Express x8 Port 6-7 (rev b1) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=09, subordinate=0b, sec-latency=0
        I/O behind bridge: 00004000-00004fff
        Memory behind bridge: d8200000-d82fffff
        Prefetchable memory behind bridge: 00000000d8800000-00000000d8900000
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable+
        Capabilities: [6c] Express Root Port (Slot+) IRQ 0
        Capabilities: [100] Advanced Error Reporting

00:08.0 System peripheral: Intel Corporation 5000 Series Chipset DMA Engine (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: bus master, fast devsel, latency 0, IRQ 9
        Memory at fe700000 (64-bit, non-prefetchable) [size=1K]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/0 Enable-
        Capabilities: [6c] Express Unknown type IRQ 0

00:10.0 Host bridge: Intel Corporation 5000 Series Chipset Error Reporting Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:10.1 Host bridge: Intel Corporation 5000 Series Chipset Error Reporting Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:10.2 Host bridge: Intel Corporation 5000 Series Chipset Error Reporting Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:11.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:13.0 Host bridge: Intel Corporation 5000 Series Chipset Reserved Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:15.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:16.0 Host bridge: Intel Corporation 5000 Series Chipset FBD Registers (rev b1)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: fast devsel

00:1c.0 PCI bridge: Intel Corporation 631xESB/632xESB/3100 Chipset PCI Express Root Port 1 (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=0c, subordinate=0e, sec-latency=0
        I/O behind bridge: 00005000-00005fff
        Memory behind bridge: d8600000-d86fffff
        Prefetchable memory behind bridge: 00000000d8a00000-00000000d8b00000
        Capabilities: [40] Express Root Port (Slot+) IRQ 0
        Capabilities: [80] Message Signalled Interrupts: 64bit- Queue=0/0 Enable+
        Capabilities: [90] #0d [0000]
        Capabilities: [a0] Power Management version 2
        Capabilities: [100] Virtual Channel
        Capabilities: [180] Unknown (5)

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d9) (prog-if 01 [Subtractive decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=00, secondary=0f, subordinate=0f, sec-latency=32
        I/O behind bridge: 00006000-00006fff
        Memory behind bridge: d8700000-d87fffff
        Prefetchable memory behind bridge: 00000000d0000000-00000000d7f00000
        Capabilities: [50] #0d [0000]

00:1f.0 ISA bridge: Intel Corporation 631xESB/632xESB/3100 Chipset LPC Interface Controller (rev 09)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: bus master, medium devsel, latency 0

00:1f.1 IDE interface: Intel Corporation 631xESB/632xESB IDE Controller (rev 09) (prog-if 8a [Master SecP PriP])
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: bus master, medium devsel, latency 0, IRQ 17
        I/O ports at 01f0 [size=8]
        I/O ports at 03f4 [size=1]
        I/O ports at 0170 [size=8]
        I/O ports at 0374 [size=1]
        I/O ports at 1800 [size=16]

00:1f.3 SMBus: Intel Corporation 631xESB/632xESB/3100 Chipset SMBus Controller (rev 09)
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: medium devsel, IRQ 19
        I/O ports at 1100 [size=32]

01:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Upstream Port (rev 01) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=01, secondary=02, subordinate=06, sec-latency=0
        I/O behind bridge: 00002000-00003fff
        Memory behind bridge: d8400000-d85fffff
        Prefetchable memory behind bridge: 00000000d8000000-00000000d8100000
        Capabilities: [44] Express Upstream Port IRQ 0
        Capabilities: [70] Power Management version 2
        Capabilities: [80] #0d [0000]
        Capabilities: [100] Advanced Error Reporting

01:00.3 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express to PCI-X Bridge (rev 01) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=01, secondary=07, subordinate=07, sec-latency=64
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [6c] Power Management version 2
        Capabilities: [80] #0d [0000]
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting

02:00.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E1 (rev 01) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=02, secondary=03, subordinate=05, sec-latency=0
        I/O behind bridge: 00002000-00002fff
        Memory behind bridge: d8400000-d84fffff
        Prefetchable memory behind bridge: 00000000d8000000-00000000d8100000
        Capabilities: [44] Express Downstream Port (Slot-) IRQ 0
        Capabilities: [60] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable+
        Capabilities: [70] Power Management version 2
        Capabilities: [80] #0d [0000]
        Capabilities: [100] Advanced Error Reporting

02:02.0 PCI bridge: Intel Corporation 6311ESB/6321ESB PCI Express Downstream Port E3 (rev 01) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=02, secondary=06, subordinate=06, sec-latency=0
        I/O behind bridge: 00003000-00003fff
        Memory behind bridge: d8500000-d85fffff
        Capabilities: [44] Express Downstream Port (Slot-) IRQ 0
        Capabilities: [60] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable+
        Capabilities: [70] Power Management version 2
        Capabilities: [80] #0d [0000]
        Capabilities: [100] Advanced Error Reporting

03:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge A (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=03, secondary=04, subordinate=04, sec-latency=64
        I/O behind bridge: 00002000-00002fff
        Memory behind bridge: d8400000-d84fffff
        Prefetchable memory behind bridge: 00000000d8000000-00000000d8100000
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [6c] Power Management version 2
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [300] Power Budgeting

03:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI Bridge B (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=03, secondary=05, subordinate=05, sec-latency=64
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [6c] Power Management version 2
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [300] Power Budgeting

04:01.0 SCSI storage controller: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI (rev 08)
        Subsystem: LSI Logic / Symbios Logic Unknown device 30e0
        Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 16
        I/O ports at 2000 [size=256]
        Memory at d8420000 (64-bit, non-prefetchable) [size=128K]
        Memory at d8400000 (64-bit, non-prefetchable) [size=128K]
        [virtual] Expansion ROM at d8000000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [68] PCI-X non-bridge device

04:01.1 SCSI storage controller: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI (rev 08)
        Subsystem: LSI Logic / Symbios Logic Unknown device 30e0
        Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 18
        I/O ports at 2400 [size=256]
        Memory at d8460000 (64-bit, non-prefetchable) [size=128K]
        Memory at d8440000 (64-bit, non-prefetchable) [size=128K]
        [virtual] Expansion ROM at d8100000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [68] PCI-X non-bridge device

06:00.0 Ethernet controller: Intel Corporation 631xESB/632xESB DPT LAN Controller Copper (rev 01)
        Subsystem: Super Micro Computer Inc Unknown device 0000
        Flags: bus master, fast devsel, latency 0, IRQ 217
        Memory at d8500000 (32-bit, non-prefetchable) [size=128K]
        I/O ports at 3000 [size=32]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable+
        Capabilities: [e0] Express Endpoint IRQ 0
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 9c-9d-34-ff-ff-48-30-00

06:00.1 Ethernet controller: Intel Corporation 631xESB/632xESB DPT LAN Controller Copper (rev 01)
        Subsystem: Super Micro Computer Inc Unknown device 0000
        Flags: bus master, fast devsel, latency 0, IRQ 19
        Memory at d8520000 (32-bit, non-prefetchable) [size=128K]
        I/O ports at 3020 [size=32]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [e0] Express Endpoint IRQ 0
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 9c-9d-34-ff-ff-48-30-00

09:00.0 PCI bridge: Intel Corporation 41210 [Lanai] Serial to Parallel PCI Bridge (A-Segment Bridge) (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=09, secondary=0a, subordinate=0a, sec-latency=136
        I/O behind bridge: 00004000-00004fff
        Memory behind bridge: d8200000-d82fffff
        Prefetchable memory behind bridge: 00000000d8800000-00000000d8900000
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [6c] Power Management version 2
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [300] Power Budgeting

09:00.2 PCI bridge: Intel Corporation 41210 [Lanai] Serial to Parallel PCI Bridge (B-Segment Bridge) (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=09, secondary=0b, subordinate=0b, sec-latency=0
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [6c] Power Management version 2
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [300] Power Budgeting

0a:04.0 SCSI storage controller: Atto Technology Ultra320 SCSI Host Adapter (rev 08)
        Subsystem: Atto Technology Unknown device 8027
        Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 17
        I/O ports at 4000 [size=256]
        Memory at d8240000 (64-bit, non-prefetchable) [size=256K]
        Memory at d8200000 (64-bit, non-prefetchable) [size=256K]
        [virtual] Expansion ROM at d8800000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [68] PCI-X non-bridge device

0a:04.1 SCSI storage controller: Atto Technology Ultra320 SCSI Host Adapter (rev 08)
        Subsystem: Atto Technology Unknown device 8027
        Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 19
        I/O ports at 4400 [size=256]
        Memory at d82c0000 (64-bit, non-prefetchable) [size=256K]
        Memory at d8280000 (64-bit, non-prefetchable) [size=256K]
        [virtual] Expansion ROM at d8900000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [68] PCI-X non-bridge device

0c:00.0 PCI bridge: Intel Corporation 41210 [Lanai] Serial to Parallel PCI Bridge (A-Segment Bridge) (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=0c, secondary=0d, subordinate=0d, sec-latency=136
        I/O behind bridge: 00005000-00005fff
        Memory behind bridge: d8600000-d86fffff
        Prefetchable memory behind bridge: 00000000d8a00000-00000000d8b00000
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [6c] Power Management version 2
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [300] Power Budgeting

0c:00.2 PCI bridge: Intel Corporation 41210 [Lanai] Serial to Parallel PCI Bridge (B-Segment Bridge) (rev 09) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0
        Bus: primary=0c, secondary=0e, subordinate=0e, sec-latency=0
        Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
        Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [6c] Power Management version 2
        Capabilities: [d8] PCI-X bridge device
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [300] Power Budgeting

0d:04.0 SCSI storage controller: Atto Technology Ultra320 SCSI Host Adapter (rev 08)
        Subsystem: Atto Technology Unknown device 8027
        Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 16
        I/O ports at 5000 [size=256]
        Memory at d8640000 (64-bit, non-prefetchable) [size=256K]
        Memory at d8600000 (64-bit, non-prefetchable) [size=256K]
        [virtual] Expansion ROM at d8a00000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [68] PCI-X non-bridge device

0d:04.1 SCSI storage controller: Atto Technology Ultra320 SCSI Host Adapter (rev 08)
        Subsystem: Atto Technology Unknown device 8027
        Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 18
        I/O ports at 5400 [size=256]
        Memory at d86c0000 (64-bit, non-prefetchable) [size=256K]
        Memory at d8680000 (64-bit, non-prefetchable) [size=256K]
        [virtual] Expansion ROM at d8b00000 [disabled] [size=1M]
        Capabilities: [50] Power Management version 2
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
        Capabilities: [68] PCI-X non-bridge device

0f:01.0 VGA compatible controller: ATI Technologies Inc ES1000 (rev 02) (prog-if 00 [VGA])
        Subsystem: Super Micro Computer Inc Unknown device 8080
        Flags: bus master, stepping, fast Back2Back, medium devsel, latency 66, IRQ 17
        Memory at d0000000 (32-bit, prefetchable) [size=128M]
        I/O ports at 6000 [size=256]
        Memory at d8700000 (32-bit, non-prefetchable) [size=64K]
        [virtual] Expansion ROM at d8720000 [disabled] [size=128K]
        Capabilities: [50] Power Management version 2
Aug 25 22:49:25 filesrv2 kernel: Filesystem "md3": Disabling barriers, not supported by the underlying device
Aug 25 22:49:25 filesrv2 kernel: XFS mounting filesystem md3
Aug 25 22:49:25 filesrv2 kernel: Ending clean XFS mount for filesystem: md3
Aug 25 22:49:25 filesrv2 kernel: Filesystem "md4": Disabling barriers, not supported by the underlying device
Aug 25 22:49:25 filesrv2 kernel: XFS mounting filesystem md4
Aug 25 22:49:25 filesrv2 kernel: Starting XFS recovery on filesystem: md4 (logdev: internal)
Aug 25 22:49:25 filesrv2 kernel: Ending XFS recovery on filesystem: md4 (logdev: internal)
Aug 25 22:57:00 filesrv2 sshd[4074]: Accepted password for root from 199.33.245.55 port 44979 ssh2
Aug 25 23:24:46 filesrv2 -- MARK --
Aug 25 23:44:46 filesrv2 -- MARK --
Aug 26 00:04:46 filesrv2 -- MARK --
Aug 26 00:24:46 filesrv2 -- MARK --
Aug 26 00:44:47 filesrv2 -- MARK --
------------[ cut here ]------------
kernel BUG at drivers/md/raid5.c:3689!
invalid opcode: 0000 [#1]
SMP
Modules linked in:
CPU:    0
EIP:    0060:[<c06eeb7a>]    Not tainted VLI
EFLAGS: 00010286   (2.6.22.1-iop1 #3)
EIP is at handle_queue+0xea/0xf0
eax: f6107c30   ebx: f623dc28   ecx: 00000003   edx: 00000000
esi: 00000007   edi: 00000000   ebp: ef1b18dc   esp: ef1b18c8
ds: 007b   es: 007b   fs: 00d8  gs: 0033  ss: 0068
Process bonnie++ (pid: 4073, ti=ef1b0000 task=f7d3e030 task.ti=ef1b0000)
Stack: f623dc44 00000005 f623dc28 f730be00 00000007 ef1b1974 c06ef767 00000001
       00000006 00000000 f730be00 f730bfa0 f730bf40 00000003 00000005 00000001
       0e4efbe0 00000000 0e4efb98 00000000 f7fd1c00 f4243400 00000001 00000006
Call Trace:
 [<c010385a>] show_trace_log_lvl+0x1a/0x30
 [<c010392a>] show_stack_log_lvl+0x9a/0xc0
 [<c0103b86>] show_registers+0x1d6/0x2e0
 [<c0103dfe>] die+0x10e/0x210
 [<c0103f91>] do_trap+0x91/0xd0
 [<c0104239>] do_invalid_op+0x89/0xa0
 [<c0805742>] error_code+0x72/0x78
 [<c06ef767>] make_request+0x2f7/0x3f0
 [<c03f8665>] generic_make_request+0x1d5/0x2c0
 [<c03f879f>] submit_bio+0x4f/0xf0
 [<c03860ae>] xfs_submit_ioend_bio+0x1e/0x30
 [<c03862e2>] xfs_submit_ioend+0xf2/0x100
 [<c0387110>] xfs_page_state_convert+0x430/0x640
 [<c0387383>] xfs_vm_writepage+0x63/0x100
 [<c015b23b>] __writepage+0xb/0x30
 [<c015b136>] write_cache_pages+0x206/0x300
 [<c015b28f>] generic_writepages+0x2f/0x40
 [<c0387444>] xfs_vm_writepages+0x24/0x60
 [<c015b2ce>] do_writepages+0x2e/0x50
 [<c0195b58>] __writeback_single_inode+0x188/0x1e0
 [<c0195cdd>] sync_sb_inodes+0x12d/0x250
 [<c0195ecc>] writeback_inodes+0xcc/0xe0
 [<c015a9c2>] balance_dirty_pages+0x52/0x170
 [<c015ab76>] balance_dirty_pages_ratelimited_nr+0x56/0x60
 [<c0156eb6>] generic_file_buffered_write+0x296/0x640
 [<c038ecd7>] xfs_write+0x7b7/0xb40
 [<c038a172>] xfs_file_aio_write+0x72/0x80
 [<c0177ed7>] do_sync_write+0xc7/0x120
 [<c01780c0>] vfs_write+0x190/0x1a0
 [<c017817d>] sys_write+0x3d/0x70
 [<c0102a76>] syscall_call+0x7/0xb
 =======================
Code: 95 ff ff 83 c4 08 5b 5e 5f 5d c3 f0 0f ba 6b 3c 02 b9 01 00 00 00 89 f2 89 d8 e8 32 9a ff ff 89 c7 eb 9f f0 0f ba 6b 3c 01 eb e6 <0f> 0b eb fe 89 f6 55 89 e5 83 ec 14 89 75 f8 89 c6 89 5d f4 89
EIP: [<c06eeb7a>] handle_queue+0xea/0xf0 SS:ESP 0068:ef1b18c8
Aug 26 00:56:33 filesrv2 kernel: ------------[ cut here ]------------
Aug 26 00:56:33 filesrv2 kernel: kernel BUG at drivers/md/raid5.c:3689!
Aug 26 00:56:33 filesrv2 kernel: invalid opcode: 0000 [#1]
Aug 26 00:56:33 filesrv2 kernel: SMP
Aug 26 00:56:33 filesrv2 kernel: Modules linked in:
Aug 26 00:56:33 filesrv2 kernel: CPU:    0
Aug 26 00:56:33 filesrv2 kernel: EIP:    0060:[<c06eeb7a>]    Not tainted VLI
Aug 26 00:56:33 filesrv2 kernel: EFLAGS: 00010286   (2.6.22.1-iop1 #3)
Aug 26 00:56:33 filesrv2 kernel: EIP is at handle_queue+0xea/0xf0
Aug 26 00:56:33 filesrv2 kernel: eax: f6107c30   ebx: f623dc28   ecx: 00000003   edx: 00000000
Aug 26 00:56:33 filesrv2 kernel: esi: 00000007   edi: 00000000   ebp: ef1b18dc   esp: ef1b18c8
Aug 26 00:56:33 filesrv2 kernel: ds: 007b   es: 007b   fs: 00d8  gs: 0033  ss: 0068
Aug 26 00:56:33 filesrv2 kernel: Process bonnie++ (pid: 4073, ti=ef1b0000 task=f7d3e030 task.ti=ef1b0000)
Aug 26 00:56:33 filesrv2 kernel: Stack: f623dc44 00000005 f623dc28 f730be00 00000007 ef1b1974 c06ef767 00000001
Aug 26 00:56:33 filesrv2 kernel:        00000006 00000000 f730be00 f730bfa0 f730bf40 00000003 00000005 00000001
Aug 26 00:56:34 filesrv2 kernel:        0e4efbe0 00000000 0e4efb98 00000000 f7fd1c00 f4243400 00000001 00000006
Aug 26 00:56:34 filesrv2 kernel: Call Trace:
Aug 26 00:56:34 filesrv2 kernel:  [<c010385a>] show_trace_log_lvl+0x1a/0x30
Aug 26 00:56:34 filesrv2 kernel:  [<c010392a>] show_stack_log_lvl+0x9a/0xc0
Aug 26 00:56:34 filesrv2 kernel:  [<c0103b86>] show_registers+0x1d6/0x2e0
Aug 26 00:56:34 filesrv2 kernel:  [<c0103dfe>] die+0x10e/0x210
Aug 26 00:56:34 filesrv2 kernel:  [<c0103f91>] do_trap+0x91/0xd0
Aug 26 00:56:34 filesrv2 kernel:  [<c0104239>] do_invalid_op+0x89/0xa0
Aug 26 00:56:34 filesrv2 kernel:  [<c0805742>] error_code+0x72/0x78
Aug 26 00:56:34 filesrv2 kernel:  [<c06ef767>] make_request+0x2f7/0x3f0
Aug 26 00:56:34 filesrv2 kernel:  [<c03f8665>] generic_make_request+0x1d5/0x2c0
Aug 26 00:56:34 filesrv2 kernel:  [<c03f879f>] submit_bio+0x4f/0xf0
Aug 26 00:56:34 filesrv2 kernel:  [<c03860ae>] xfs_submit_ioend_bio+0x1e/0x30
Aug 26 00:56:34 filesrv2 kernel:  [<c03862e2>] xfs_submit_ioend+0xf2/0x100
Aug 26 00:56:34 filesrv2 kernel:  [<c0387110>] xfs_page_state_convert+0x430/0x640
Aug 26 00:56:34 filesrv2 kernel:  [<c0387383>] xfs_vm_writepage+0x63/0x100
Aug 26 00:56:34 filesrv2 kernel:  [<c015b23b>] __writepage+0xb/0x30
Aug 26 00:56:34 filesrv2 kernel:  [<c015b136>] write_cache_pages+0x206/0x300
Aug 26 00:56:34 filesrv2 kernel:  [<c015b28f>] generic_writepages+0x2f/0x40
Aug 26 00:56:34 filesrv2 kernel:  [<c0387444>] xfs_vm_writepages+0x24/0x60
Aug 26 00:56:34 filesrv2 kernel:  [<c015b2ce>] do_writepages+0x2e/0x50
Aug 26 00:56:34 filesrv2 kernel:  [<c0195b58>] __writeback_single_inode+0x188/0x1e0
Aug 26 00:56:34 filesrv2 kernel:  [<c0195cdd>] sync_sb_inodes+0x12d/0x250
Aug 26 00:56:34 filesrv2 kernel:  [<c0195ecc>] writeback_inodes+0xcc/0xe0
Aug 26 00:56:34 filesrv2 kernel:  [<c015a9c2>] balance_dirty_pages+0x52/0x170
Aug 26 00:56:34 filesrv2 kernel:  [<c015ab76>] balance_dirty_pages_ratelimited_nr+0x56/0x60
Aug 26 00:56:34 filesrv2 kernel:  [<c0156eb6>] generic_file_buffered_write+0x296/0x640
Aug 26 00:56:34 filesrv2 kernel:  [<c038ecd7>] xfs_write+0x7b7/0xb40
Aug 26 00:56:34 filesrv2 kernel:  [<c038a172>] xfs_file_aio_write+0x72/0x80
Aug 26 00:56:34 filesrv2 kernel:  [<c0177ed7>] do_sync_write+0xc7/0x120
Aug 26 00:56:34 filesrv2 kernel:  [<c01780c0>] vfs_write+0x190/0x1a0
Aug 26 00:56:34 filesrv2 kernel:  [<c017817d>] sys_write+0x3d/0x70
Aug 26 00:56:34 filesrv2 kernel:  [<c0102a76>] syscall_call+0x7/0xb
Aug 26 00:56:34 filesrv2 kernel:  =======================
Aug 26 00:56:34 filesrv2 kernel: Code: 95 ff ff 83 c4 08 5b 5e 5f 5d c3 f0 0f ba 6b 3c 02 b9 01 00 00 00 89 f2 89 d8 e8 32 9a ff ff 89 c7 eb 9f f0 0f ba 6b 3c 01 eb e6 <0f> 0b eb fe 89 f6 55 89 e5 83 ec 14 89 75 f8 89 c6 89 5d f4 89
Aug 26 00:56:34 filesrv2 kernel: EIP: [<c06eeb7a>] handle_queue+0xea/0xf0 SS:ESP 0068:ef1b18c8
Aug 26 01:24:47 filesrv2 -- MARK --
Aug 26 01:44:47 filesrv2 -- MARK --


-- 
+-----------------------------------------------------------------+
| James   W.   Laferriere | System   Techniques | Give me VMS     |
| Network        Engineer | 663  Beaumont  Blvd |  Give me Linux  |
| babydr@xxxxxxxxxxxxxxxx | Pacifica, CA. 94044 |   only  on  AXP |
+-----------------------------------------------------------------+

[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux