Hello Avati,
back to our original problem of all-hanging glusterfs servers and clients.
Today we got another hang with same look and feel, but this time we got
something in the logs, please read and tell us how to further proceed.
Configuration is as before. I send the whole log since boot, crash is visible
at the end. We did the same testing as before, running two bonnies on two
clients.
Linux version 2.6.30.5 (root at linux-tnpx) (gcc version 4.3.2 [gcc-4_3-branch revision 141291] (SUSE Linux) ) #1 SMP Tue Aug 18 12:06:06 CEST 2009
Command line: root=/dev/sda3 resume=/dev/sda1 splash=silent console=ttyS0,9600 console=tty0
KERNEL supported cpus:
Intel GenuineIntel
AMD AuthenticAMD
Centaur CentaurHauls
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009dc00 (usable)
BIOS-e820: 000000000009dc00 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000ca000 - 00000000000cc000 (reserved)
BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000d7e80000 (usable)
BIOS-e820: 00000000d7e80000 - 00000000d7e8a000 (ACPI data)
BIOS-e820: 00000000d7e8a000 - 00000000d7f00000 (ACPI NVS)
BIOS-e820: 00000000d7f00000 - 00000000d8000000 (reserved)
BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000128000000 (usable)
DMI present.
Phoenix BIOS detected: BIOS may corrupt low RAM, working around it.
last_pfn = 0x128000 max_arch_pfn = 0x100000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xd7e80 max_arch_pfn = 0x100000000
init_memory_mapping: 0000000000000000-00000000d7e80000
init_memory_mapping: 0000000100000000-0000000128000000
ACPI: RSDP 00000000000f6390 00014 (v00 PTLTD )
ACPI: RSDT 00000000d7e822bb 0003C (v01 PTLTD RSDT 06040000 LTP 00000000)
ACPI: FACP 00000000d7e89e54 00074 (v01 INTEL 06040000 PTL 00000003)
ACPI: DSDT 00000000d7e83b29 0632B (v01 INTEL MUKLTEO2 06040000 MSFT 0100000E)
ACPI: FACS 00000000d7e8afc0 00040
ACPI: MCFG 00000000d7e89ec8 0003C (v01 PTLTD MCFG 06040000 LTP 00000000)
ACPI: APIC 00000000d7e89f04 00084 (v01 PTLTD APIC 06040000 LTP 00000000)
ACPI: BOOT 00000000d7e89f88 00028 (v01 PTLTD $SBFTBL$ 06040000 LTP 00000001)
ACPI: SPCR 00000000d7e89fb0 00050 (v01 PTLTD $UCRTBL$ 06040000 PTL 00000001)
ACPI: SSDT 00000000d7e822f7 013EC (v01 PmRef CpuPm 00003000 INTL 20050228)
(7 early reservations) ==> bootmem [0000000000 - 0128000000]
#0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
#1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
#2 [0000200000 - 00006e5778] TEXT DATA BSS ==> [0000200000 - 00006e5778]
#3 [000009dc00 - 0000100000] BIOS reserved ==> [000009dc00 - 0000100000]
#4 [00006e6000 - 00006e6174] BRK ==> [00006e6000 - 00006e6174]
#5 [0000010000 - 0000014000] PGTABLE ==> [0000010000 - 0000014000]
#6 [0000014000 - 0000015000] PGTABLE ==> [0000014000 - 0000015000]
found SMP MP-table at [ffff8800000f63c0] f63c0
Zone PFN ranges:
DMA 0x00000010 -> 0x00001000
DMA32 0x00001000 -> 0x00100000
Normal 0x00100000 -> 0x00128000
Movable zone start PFN for each node
early_node_map[3] active PFN ranges
0: 0x00000010 -> 0x0000009d
0: 0x00000100 -> 0x000d7e80
0: 0x00100000 -> 0x00128000
ACPI: PM-Timer IO Port: 0x1008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
ACPI: IOAPIC (id[0x04] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 4, version 0, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
SMP: Allowing 4 CPUs, 0 hotplug CPUs
PM: Registered nosave memory: 000000000009d000 - 000000000009e000
PM: Registered nosave memory: 000000000009e000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000ca000
PM: Registered nosave memory: 00000000000ca000 - 00000000000cc000
PM: Registered nosave memory: 00000000000cc000 - 00000000000e4000
PM: Registered nosave memory: 00000000000e4000 - 0000000000100000
PM: Registered nosave memory: 00000000d7e80000 - 00000000d7e8a000
PM: Registered nosave memory: 00000000d7e8a000 - 00000000d7f00000
PM: Registered nosave memory: 00000000d7f00000 - 00000000d8000000
PM: Registered nosave memory: 00000000d8000000 - 00000000e0000000
PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
PM: Registered nosave memory: 00000000f0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec10000
PM: Registered nosave memory: 00000000fec10000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ff000000
PM: Registered nosave memory: 00000000ff000000 - 0000000100000000
Allocating PCI resources starting at f1000000 (gap: f0000000:ec00000)
NR_CPUS:4 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
PERCPU: Embedded 24 pages at ffff880028022000, static data 67424 bytes
Built 1 zonelists in Zone order, mobility grouping on. Total pages: 1030142
Kernel command line: root=/dev/sda3 resume=/dev/sda1 splash=silent console=ttyS0,9600 console=tty0
Initializing CPU#0
NR_IRQS:384
PID hash table entries: 4096 (order: 12, 32768 bytes)
Fast TSC calibration using PIT
Detected 2399.879 MHz processor.
Console: colour VGA+ 80x25
console [tty0] enabled
console [ttyS0] enabled
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Checking aperture...
No AGP bridge found
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
Memory: 4045940k/4849664k available (2499k kernel code, 657356k absent, 145564k reserved, 1476k data, 356k init)
Calibrating delay loop (skipped), value calculated using timer frequency.. 4799.75 BogoMIPS (lpj=9599516)
Mount-cache hash table entries: 256
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
using mwait in idle threads.
ACPI: Core revision 20090320
Setting APIC routing to flat
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz stepping 0b
Booting processor 1 APIC 0x1 ip 0x6000
Initializing CPU#1
Calibrating delay using timer specific routine.. 4800.29 BogoMIPS (lpj=9600586)
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 1
CPU1: Thermal monitoring enabled (TM2)
x86 PAT enabled: cpu 1, old 0x7040600070406, new 0x7010600070106
CPU1: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz stepping 0b
checking TSC synchronization [CPU#0 -> CPU#1]: passed.
Booting processor 2 APIC 0x2 ip 0x6000
Initializing CPU#2
Calibrating delay using timer specific routine.. 4800.33 BogoMIPS (lpj=9600670)
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 2
CPU2: Thermal monitoring enabled (TM2)
x86 PAT enabled: cpu 2, old 0x7040600070406, new 0x7010600070106
CPU2: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz stepping 0b
checking TSC synchronization [CPU#0 -> CPU#2]: passed.
Booting processor 3 APIC 0x3 ip 0x6000
Initializing CPU#3
Calibrating delay using timer specific routine.. 4800.32 BogoMIPS (lpj=9600643)
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 4096K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 3
CPU3: Thermal monitoring enabled (TM2)
x86 PAT enabled: cpu 3, old 0x7040600070406, new 0x7010600070106
CPU3: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz stepping 0b
checking TSC synchronization [CPU#0 -> CPU#3]: passed.
Brought up 4 CPUs
Total of 4 processors activated (19200.70 BogoMIPS).
net_namespace: 968 bytes
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 9
PCI: MCFG area at e0000000 reserved in E820
PCI: Using MMCONFIG at e0000000 - e09fffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S4 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
ACPI: PCI Root Bridge [PCI0] (0000:00)
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.4: PME# disabled
pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.5: PME# disabled
pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.7: PME# disabled
pci 0000:00:1f.0: quirk: region 1000-107f claimed by ICH6 ACPI/GPIO/TCO
pci 0000:00:1f.0: quirk: region 1180-11bf claimed by ICH6 GPIO
pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0600 (mask 007f)
pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 0ca0 (mask 000f)
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
pci 0000:01:00.0: PME# disabled
pci 0000:01:00.2: PME# supported from D0 D3hot D3cold
pci 0000:01:00.2: PME# disabled
pci 0000:04:00.0: PXH quirk detected; SHPC device MSI disabled
pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
pci 0000:04:00.0: PME# disabled
pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
pci 0000:06:00.0: PME# disabled
pci 0000:07:00.0: PME# supported from D0 D3hot D3cold
pci 0000:07:00.0: PME# disabled
pci 0000:0a:02.0: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:0a:02.0: PME# disabled
pci 0000:00:1e.0: transparent bridge
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 10 *11 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 *10 11 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 10 *11 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 10 11 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 10 11 14 15) *5
SCSI subsystem initialized
PCI: Using ACPI for IRQ routing
HPET: 3 timers in total, 0 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 comparators, 64-bit 14.318180 MHz counter
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 11 devices
ACPI: ACPI bus type pnp unregistered
system 00:01: ioport range 0x600-0x67f has been reserved
system 00:01: ioport range 0x800-0x80f has been reserved
system 00:01: ioport range 0xca0-0xcaf has been reserved
system 00:01: ioport range 0x1000-0x107f has been reserved
system 00:01: ioport range 0x1180-0x11bf has been reserved
system 00:01: ioport range 0x4d0-0x4d1 has been reserved
system 00:01: ioport range 0xfe00-0xfe00 has been reserved
system 00:01: iomem range 0xfed14000-0xfed17fff has been reserved
system 00:01: iomem range 0xfed13000-0xfed13fff has been reserved
system 00:01: iomem range 0xe0000000-0xefffffff has been reserved
system 00:01: iomem range 0xfed20000-0xfed8ffff has been reserved
system 00:01: iomem range 0xfef00000-0xfeffffff has been reserved
pci 0000:01:00.0: PCI bridge, secondary bus 0000:02
pci 0000:01:00.0: IO window: disabled
pci 0000:01:00.0: MEM window: 0xdc500000-0xdc5fffff
pci 0000:01:00.0: PREFETCH window: 0x000000dc000000-0x000000dc3fffff
pci 0000:01:00.2: PCI bridge, secondary bus 0000:03
pci 0000:01:00.2: IO window: disabled
pci 0000:01:00.2: MEM window: disabled
pci 0000:01:00.2: PREFETCH window: disabled
pci 0000:00:01.0: PCI bridge, secondary bus 0000:01
pci 0000:00:01.0: IO window: disabled
pci 0000:00:01.0: MEM window: 0xdc500000-0xdc5fffff
pci 0000:00:01.0: PREFETCH window: 0x000000dc000000-0x000000dc3fffff
pci 0000:04:00.0: PCI bridge, secondary bus 0000:05
pci 0000:04:00.0: IO window: disabled
pci 0000:04:00.0: MEM window: disabled
pci 0000:04:00.0: PREFETCH window: disabled
pci 0000:00:1c.0: PCI bridge, secondary bus 0000:04
pci 0000:00:1c.0: IO window: disabled
pci 0000:00:1c.0: MEM window: disabled
pci 0000:00:1c.0: PREFETCH window: disabled
pci 0000:00:1c.4: PCI bridge, secondary bus 0000:06
pci 0000:00:1c.4: IO window: 0x4000-0x4fff
pci 0000:00:1c.4: MEM window: 0xdc400000-0xdc4fffff
pci 0000:00:1c.4: PREFETCH window: disabled
pci 0000:00:1c.5: PCI bridge, secondary bus 0000:07
pci 0000:00:1c.5: IO window: 0x5000-0x5fff
pci 0000:00:1c.5: MEM window: 0xdc600000-0xdc6fffff
pci 0000:00:1c.5: PREFETCH window: disabled
pci 0000:00:1e.0: PCI bridge, secondary bus 0000:0a
pci 0000:00:1e.0: IO window: 0x6000-0x6fff
pci 0000:00:1e.0: MEM window: 0xdc700000-0xdc7fffff
pci 0000:00:1e.0: PREFETCH window: 0x000000d8000000-0x000000dbffffff
pci 0000:00:01.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1c.4: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1c.5: PCI INT B -> GSI 21 (level, low) -> IRQ 21
NET: Registered protocol family 2
IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 262144 bind 65536)
TCP reno registered
NET: Registered protocol family 1
Simple Boot Flag at 0x36 set to 0x1
HugeTLB registered 2 MB page size, pre-allocated 0 pages
msgmni has been set to 7903
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci 0000:0a:02.0: Firmware left e100 interrupts enabled; disabling
input: Power Button as /class/input/input0
ACPI: Power Button [PWRF]
input: Power Button as /class/input/input1
ACPI: Power Button [PWRB]
ACPI: SSDT 00000000d7e836e3 0017C (v01 PmRef Cpu0Ist 00003000 INTL 20050228)
processor ACPI_CPU:00: registered as cooling_device0
ACPI: SSDT 00000000d7e8385f 00066 (v01 PmRef Cpu1Ist 00003000 INTL 20050228)
processor ACPI_CPU:01: registered as cooling_device1
ACPI: SSDT 00000000d7e838c5 00066 (v01 PmRef Cpu2Ist 00003000 INTL 20050228)
processor ACPI_CPU:02: registered as cooling_device2
ACPI: SSDT 00000000d7e8392b 00066 (v01 PmRef Cpu3Ist 00003000 INTL 20050228)
processor ACPI_CPU:03: registered as cooling_device3
Real Time Clock Driver v1.12b
intel_rng: FWH not detected
Linux agpgart interface v0.103
Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial 00:0a: activated
00:0a: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
arcmsr 0000:02:0e.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
ARECA RAID ADAPTER0: FIRMWARE VERSION V1.43 2007-4-17
scsi0 : Areca SATA Host Adapter RAID Controller
Driver Version 1.20.00.15 2008/02/27
scsi 0:0:0:0: Direct-Access Areca ARC-1210-VOL#00 R001 PQ: 0 ANSI: 5
scsi 0:0:16:0: Processor Areca RAID controller R001 PQ: 0 ANSI: 0
Driver 'sd' needs updating - please use bus_type methods
Driver 'sr' needs updating - please use bus_type methods
sd 0:0:0:0: [sda] 1953124352 512-byte hardware sectors: (999 GB/931 GiB)
sd 0:0:0:0: Attached scsi generic sg0 type 0
scsi 0:0:16:0: Attached scsi generic sg1 type 3
ata_piix 0000:00:1f.1: PCI INT A -> GSI 18 (level, low) -> IRQ 18
scsi1 : ata_piix
scsi2 : ata_piix
ata1: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0x30a0 irq 14
ata2: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0x30a8 irq 15
ata_piix 0000:00:1f.2: PCI INT B -> GSI 19 (level, low) -> IRQ 19
ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
scsi3 : ata_piix
scsi4 : ata_piix
ata3: SATA max UDMA/133 cmd 0x30e8 ctl 0x30dc bmdma 0x30b0 irq 19
ata4: SATA max UDMA/133 cmd 0x30e0 ctl 0x30d8 bmdma 0x30b8 irq 19
ieee1394: raw1394: /dev/raw1394 device initialized
PNP: PS/2 Controller [PNP0303:KBC0,PNP0f13:MSE0] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
cpuidle: using governor ladder
TCP cubic registered
NET: Registered protocol family 17
ata1.00: ATAPI: Optiarc DVD RW AD-7593A, 1.02, max UDMA/33
ata1.00: configured for UDMA/33
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sda: sda1 sda2 sda3 sda4
sd 0:0:0:0: [sda] Attached SCSI disk
scsi 1:0:0:0: CD-ROM Optiarc DVD RW AD-7593A 1.02 PQ: 0 ANSI: 5
sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
Uniform CD-ROM driver Revision: 3.20
sr 1:0:0:0: Attached scsi generic sg2 type 5
REISERFS (device sda3): found reiserfs format "3.6" with standard journal
REISERFS (device sda3): using ordered data mode
REISERFS (device sda3): journal params: device sda3, size 8192, journal first block 18, max trans len 1024, max batch 900, max commit age 30, max trans age 30
REISERFS (device sda3): checking transaction log (sda3)
REISERFS (device sda3): Using r5 hash to sort names
VFS: Mounted root (reiserfs filesystem) readonly on device 8:3.
Freeing unused kernel memory: 356k freed
udevd version 128 started
e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.4-k4
e1000e: Copyright (c) 1999-2008 Intel Corporation.
e1000e 0000:06:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI
e100: Copyright(c) 1999-2006 Intel Corporation
e100 0000:0a:02.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
e100 0000:0a:02.0: PME# disabled
e100: eth0: e100_probe: addr 0xdc720000, irq 16, MAC addr 00:e0:81:4f:32:05
i801_smbus 0000:00:1f.3: PCI INT B -> GSI 19 (level, low) -> IRQ 19
udev: renamed network interface eth0 to eth2
0000:06:00.0: eth0: (PCI Express:2.5GB/s:Width x1) 00:e0:81:4f:32:03
0000:06:00.0: eth0: Intel(R) PRO/1000 Network Connection
0000:06:00.0: eth0: MAC: 2, PHY: 2, PBA No: ffffff-0ff
e1000e 0000:07:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
0000:07:00.0: eth1: (PCI Express:2.5GB/s:Width x1) 00:e0:81:4f:32:04
0000:07:00.0: eth1: Intel(R) PRO/1000 Network Connection
0000:07:00.0: eth1: MAC: 2, PHY: 2, PBA No: ffffff-0ff
Adding 2104472k swap on /dev/sda1. Priority:-1 extents:1 across:2104472k
loop: module loaded
REISERFS (device sda4): found reiserfs format "3.6" with standard journal
REISERFS (device sda4): using ordered data mode
REISERFS (device sda4): journal params: device sda4, size 8192, journal first block 18, max trans len 1024, max batch 900, max commit age 30, max trans age 30
REISERFS (device sda4): checking transaction log (sda4)
REISERFS (device sda4): Using r5 hash to sort names
fuse init (API version 7.11)
mtrr: type mismatch for d8000000,1000000 old: write-back new: write-combining
e1000e: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
general protection fault: 0000 [#1] SMP
last sysfs file: /sys/devices/system/cpu/cpu3/cache/index2/shared_cpu_map
CPU 2
Modules linked in: fuse loop i2c_i801 i2c_core e100 e1000e
Pid: 3833, comm: glusterfsd Not tainted 2.6.30.5 #1 empty
RIP: 0010:[<ffffffff80244305>] [<ffffffff80244305>] __wake_up_bit+0xc/0x2d
RSP: 0018:ffff88011fc51a98 EFLAGS: 00010292
RAX: 8dfd233fe2300848 RBX: ffffe20000220058 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffffe20000220058 RDI: 8dfd233fe2300840
RBP: ffff8800b3be03b0 R08: b000000000000000 R09: ffffe20000220058
R10: ffffffffb3be03b1 R11: 0000000000000001 R12: 00000000000021a4
R13: 00000000021a4000 R14: ffff8800b3be03b0 R15: 00000000000021a4
FS: 00007f684127f950(0000) GS:ffff880028052000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fff5373eb78 CR3: 000000011fc79000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process glusterfsd (pid: 3833, threadinfo ffff88011fc50000, task ffff880126ad53e0)
Stack:
ffffffff8048eb40 ffffffff00000000 ffffe20000220058 ffffffff8025fa3f
ffffffff8048eb40 0000000000004000 00000000ffffffff ffffffff8025fc36
000000d0b3be0298 ffffffff8048eb40 0000000000004000 00000000fffffff4
Call Trace:
[<ffffffff8025fa3f>] ? find_lock_page+0x43/0x55
[<ffffffff8025fc36>] ? grab_cache_page_write_begin+0x3b/0xa1
[<ffffffff802d34ef>] ? reiserfs_write_begin+0x81/0x1dc
[<ffffffff802d5505>] ? reiserfs_get_block+0x0/0xeb5
[<ffffffff8026054a>] ? generic_file_buffered_write+0x12c/0x2fa
[<ffffffff80260bf7>] ? __generic_file_aio_write_nolock+0x349/0x37d
[<ffffffff8024d33f>] ? futex_wait+0x41a/0x42f
[<ffffffff802613ea>] ? generic_file_aio_write+0x64/0xc4
[<ffffffff80261386>] ? generic_file_aio_write+0x0/0xc4
[<ffffffff80286f09>] ? do_sync_readv_writev+0xc0/0x107
[<ffffffff8024d486>] ? futex_wake+0xc8/0xd9
[<ffffffff80244348>] ? autoremove_wake_function+0x0/0x2e
[<ffffffff8024e5e8>] ? do_futex+0xa9/0x8b3
[<ffffffff80286d95>] ? rw_copy_check_uvector+0x6d/0xe4
[<ffffffff80287581>] ? do_readv_writev+0xb2/0x18b
[<ffffffff80249bb7>] ? getnstimeofday+0x55/0xaf
[<ffffffff80246b62>] ? ktime_get_ts+0x21/0x49
[<ffffffff8028775b>] ? sys_writev+0x45/0x6e
[<ffffffff8020ae6b>] ? system_call_fastpath+0x16/0x1b
Code: 00 48 29 f8 2b 8a d0 e7 5d 80 4c 01 c0 48 d3 e8 48 6b c0 18 48 03 82 c0 e7 5d 80 5a 5b 5d c3 48 83 ec 18 48 8d 47 08 89 54 24 08 <48> 39 47 08 74 16 48 89 34 24 48 89 e1 ba 01 00 00 00 be 03 00
RIP [<ffffffff80244305>] __wake_up_bit+0xc/0x2d
RSP <ffff88011fc51a98>
---[ end trace 10a1fa47d70a1dc4 ]---
--
Regards,
Stephan
