Re: Help with a two node cluster for a web serverneeded

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

Am Montag 14 Januar 2008 21:03:46 schrieb Lon Hohberger:
> So, what was happening was this:
[...]
>
> First, let's ping the router with the cable unplugged to see how long it
> takes for our heuristic to complete when things are "broken".  On my
> machine:
>
> [lhh@ayanami ~]$ time ping -c1 -t1 frederick
> PING frederick (12.1.2.99) 56(84) bytes of data.
>
> >From ayanami (12.1.2.37) icmp_seq=1 Destination Host Unreachable
>
> --- frederick ping statistics ---
> 1 packets transmitted, 0 received, +1 errors, 100% packet loss, time 0ms
>
>
> real    0m3.006s
> ^^^^^^^^^^^^^^^^
> user    0m0.000s
> sys     0m0.000s
>

[root@testcluster-1 cluster]# time ping -c3 -t1 10.200.10.1
PING 10.200.10.1 (10.200.10.1) 56(84) bytes of data.
64 bytes from 10.200.10.1: icmp_seq=1 ttl=64 time=1.41 ms
64 bytes from 10.200.10.1: icmp_seq=2 ttl=64 time=1.29 ms
64 bytes from 10.200.10.1: icmp_seq=3 ttl=64 time=1.32 ms

--- 10.200.10.1 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 1.290/1.341/1.410/0.065 ms

real    0m2.007s
^^^^^^^^^^^^^^^^
user    0m0.001s
sys     0m0.002s
[root@testcluster-1 cluster]# time ping -c3 -t1 10.200.10.65
PING 10.200.10.65 (10.200.10.65) 56(84) bytes of data.
From 10.200.10.187 icmp_seq=1 Destination Host Unreachable
From 10.200.10.187 icmp_seq=2 Destination Host Unreachable
From 10.200.10.187 icmp_seq=3 Destination Host Unreachable

--- 10.200.10.65 ping statistics ---
3 packets transmitted, 0 received, +3 errors, 100% packet loss, time 1999ms
, pipe 3

real    0m3.004s
^^^^^^^^^^^^^^^^
user    0m0.001s
sys     0m0.002s

[...]
>
> Option 1:
>
> Make 1 tko sufficient by making the heuristic do more work.  In my quick
> testing, the same 3 seconds for 1 packet was used for 3 packets.
>
[...]
>
> Option 2:
>
> Make things fit around your heuristic.  Given our 12 second "negative"
> case for our heuristic/tko, we can simply make qdisk time out in >12
> seconds.  Then, we double that and add a bit for CMAN:

First I've tried both options, but with no success. Then I've tried to do 
both, to be on the safe side:

        ...
        <quorumd interval="1" label="Qdisk1" tko="15" votes="1">
                <heuristic interval="1" program="ping 10.200.10.1 -c3 -t1" 
score="1" tko="1"/>
        </quorumd>
        <totem token="40000"/>
        ...

Then I watched what happend by running 'clustat -li 1' on node 1. After that I 
unpluged the cable from node 1. After about 45 seconds node 2 was reported 
dead by clustat, but the quorum disk was still reported online. And then 
about 10 seconds later both nodes fenced each other...

I've attached parts of '/var/log/messages' from both nodes. Perhaps it 
contains helpfull information.

Many thanks and best regards,

	Holger

-- 
----------------- SHE - IT-Sicherheit von Experten ------------------
SHE Informationstechnologie AG
Holger L. Ratzel                               Fon:+49 621 5200 - 210 
Service Delivery & Support                     Fax:+49 621 5200 - 555
Donnersbergweg 3                                holger.ratzel@xxxxxxx
D-67059 Ludwigshafen                              http://www.she.net/
Sitz der Gesellschaft und Registergericht Ludwigshafen HRB 4593
Aufsichtsratsvorsitzender: Ulrich Engelhardt
Vorstand: Klaus Schulz
------------------------ I am root. Fear me! ------------------------

PGP-Fingerprint:
9A 73 40 22 72 64 BE D1  D8 1A 54 3C 5B 64 AF C3  CC E3 CA A8
Get my PGP public key at: http://pgp.she.net/
Jan 15 15:29:43 testcluster-1 clurgmgrd: [2699]: <warning> Link for eth0: Not detected 
Jan 15 15:29:43 testcluster-1 clurgmgrd: [2699]: <warning> No link on eth0... 
Jan 15 15:29:43 testcluster-1 clurgmgrd[2699]: <notice> status on ip "10.200.10.189" returned 1 (generic error) 
Jan 15 15:29:45 testcluster-1 kernel: e100: eth0: e100_watchdog: link down
Jan 15 15:30:22 testcluster-1 openais[2097]: [TOTEM] The token was lost in the OPERATIONAL state. 
Jan 15 15:30:22 testcluster-1 openais[2097]: [TOTEM] Receive multicast socket recv buffer size (288000 bytes). 
Jan 15 15:30:22 testcluster-1 openais[2097]: [TOTEM] Transmit multicast socket send buffer size (219136 bytes). 
Jan 15 15:30:22 testcluster-1 openais[2097]: [TOTEM] entering GATHER state from 2. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] entering GATHER state from 0. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] Creating commit token because I am the rep. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] Saving state aru 4b high seq received 4b 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] Storing new sequence id for ring 378 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] entering COMMIT state. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] entering RECOVERY state. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] position [0] member 10.200.10.187: 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] previous ring seq 884 rep 10.200.10.187 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] aru 4b high delivered 4b received flag 1 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] Did not need to originate any messages in recovery. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] Sending initial ORF token 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] New Configuration: 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:30:27 testcluster-1 fenced[2113]: testcluster-2 not a cluster member after 0 sec post_fail_delay
Jan 15 15:30:27 testcluster-1 kernel: dlm: closing connection to node 2
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] Members Left: 
Jan 15 15:30:27 testcluster-1 fenced[2113]: fencing node "testcluster-2"
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] Members Joined: 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] New Configuration: 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] Members Left: 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] Members Joined: 
Jan 15 15:30:27 testcluster-1 openais[2097]: [SYNC ] This node is within the primary component and will provide service. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [TOTEM] entering OPERATIONAL state. 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CLM  ] got nodejoin message 10.200.10.187 
Jan 15 15:30:27 testcluster-1 openais[2097]: [CPG  ] got joinlist message from node 1 
Jan 15 15:34:09 testcluster-1 syslogd 1.4.1: restart.
Jan 15 15:34:10 testcluster-1 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Jan 15 15:34:10 testcluster-1 kernel: Linux version 2.6.18-53.1.4.el5 (brewbuilder@xxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)) #1 SMP Wed Nov 14 10:37:33 EST 2007
Jan 15 15:34:10 testcluster-1 kernel: BIOS-provided physical RAM map:
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 0000000000100000 - 000000001fff0000 (usable)
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 000000001fff0000 - 000000001fffec00 (ACPI data)
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 000000001fffec00 - 000000001ffff000 (reserved)
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
Jan 15 15:34:10 testcluster-1 kernel:  BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved)
Jan 15 15:34:10 testcluster-1 kernel: 0MB HIGHMEM available.
Jan 15 15:34:10 testcluster-1 kernel: 511MB LOWMEM available.
Jan 15 15:34:10 testcluster-1 kernel: found SMP MP-table at 000fe710
Jan 15 15:34:10 testcluster-1 audispd: starting audispd
Jan 15 15:34:10 testcluster-1 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Jan 15 15:34:11 testcluster-1 kernel: disabling kdump
Jan 15 15:34:12 testcluster-1 rpc.statd[1955]: Version 1.0.9 Starting
Jan 15 15:34:12 testcluster-1 kernel: Using x86 segment limits to approximate NX protection
Jan 15 15:34:12 testcluster-1 rpc.statd[1955]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user 
Jan 15 15:34:13 testcluster-1 kernel: DMI 2.3 present.
Jan 15 15:34:13 testcluster-1 kernel: Using APIC driver default
Jan 15 15:34:13 testcluster-1 kernel: ACPI: PM-Timer IO Port: 0x808
Jan 15 15:34:13 testcluster-1 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
Jan 15 15:34:13 testcluster-1 kernel: Processor #0 6:8 APIC version 17
Jan 15 15:34:13 testcluster-1 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] disabled)
Jan 15 15:34:13 testcluster-1 kernel: ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
Jan 15 15:34:13 testcluster-1 kernel: ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
Jan 15 15:34:13 testcluster-1 kernel: ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
Jan 15 15:34:13 testcluster-1 kernel: IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-15
Jan 15 15:34:13 testcluster-1 kernel: ACPI: IOAPIC (id[0x02] address[0xfec01000] gsi_base[16])
Jan 15 15:34:13 testcluster-1 kernel: IOAPIC[1]: apic_id 2, version 17, address 0xfec01000, GSI 16-31
Jan 15 15:34:13 testcluster-1 kernel: Enabling APIC mode:  Flat.  Using 2 I/O APICs
Jan 15 15:34:13 testcluster-1 kernel: Using ACPI (MADT) for SMP configuration information
Jan 15 15:34:13 testcluster-1 kernel: Allocating PCI resources starting at 20000000 (gap: 1ffff000:dec01000)
Jan 15 15:34:13 testcluster-1 kernel: Detected 931.049 MHz processor.
Jan 15 15:34:13 testcluster-1 kernel: Built 1 zonelists.  Total pages: 131056
Jan 15 15:34:13 testcluster-1 kernel: Kernel command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet
Jan 15 15:34:13 testcluster-1 kernel: Enabling fast FPU save and restore... done.
Jan 15 15:34:14 testcluster-1 kernel: Enabling unmasked SIMD FPU exception support... done.
Jan 15 15:34:14 testcluster-1 kernel: Initializing CPU#0
Jan 15 15:34:14 testcluster-1 kernel: CPU 0 irqstacks, hard=c0743000 soft=c0723000
Jan 15 15:34:14 testcluster-1 ccsd[2060]: Starting ccsd 2.0.73: 
Jan 15 15:34:14 testcluster-1 kernel: PID hash table entries: 2048 (order: 11, 8192 bytes)
Jan 15 15:34:14 testcluster-1 ccsd[2060]:  Built: Oct 16 2007 13:05:05 
Jan 15 15:34:14 testcluster-1 kernel: Console: colour VGA+ 80x25
Jan 15 15:34:14 testcluster-1 kernel: Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Jan 15 15:34:14 testcluster-1 kernel: Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Jan 15 15:34:14 testcluster-1 kernel: Memory: 512152k/524224k available (2080k kernel code, 11572k reserved, 869k data, 220k init, 0k highmem)
Jan 15 15:34:14 testcluster-1 kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok.
Jan 15 15:34:14 testcluster-1 kernel: Calibrating delay using timer specific routine.. 1862.59 BogoMIPS (lpj=931298)
Jan 15 15:34:14 testcluster-1 ccsd[2060]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved. 
Jan 15 15:34:14 testcluster-1 kernel: Security Framework v1.0.0 initialized
Jan 15 15:34:14 testcluster-1 kernel: SELinux:  Initializing.
Jan 15 15:34:14 testcluster-1 kernel: selinux_register_security:  Registering secondary module capability
Jan 15 15:34:14 testcluster-1 kernel: Capability LSM initialized as secondary
Jan 15 15:34:14 testcluster-1 ccsd[2060]: cluster.conf (cluster name = Test, version = 27) found. 
Jan 15 15:34:14 testcluster-1 kernel: Mount-cache hash table entries: 512
Jan 15 15:34:14 testcluster-1 ccsd[2060]: Unable to perform sendto: Cannot assign requested address 
Jan 15 15:34:15 testcluster-1 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Jan 15 15:34:15 testcluster-1 kernel: CPU: L2 cache: 256K
Jan 15 15:34:15 testcluster-1 kernel: Intel machine check architecture supported.
Jan 15 15:34:15 testcluster-1 kernel: Intel machine check reporting enabled on CPU#0.
Jan 15 15:34:15 testcluster-1 kernel: Checking 'hlt' instruction... OK.
Jan 15 15:34:15 testcluster-1 kernel: SMP alternatives: switching to UP code
Jan 15 15:34:15 testcluster-1 kernel: Freeing SMP alternatives: 14k freed
Jan 15 15:34:15 testcluster-1 kernel: ACPI: Core revision 20060707
Jan 15 15:34:15 testcluster-1 kernel: CPU0: Intel Pentium III (Coppermine) stepping 0a
Jan 15 15:34:15 testcluster-1 kernel: Total of 1 processors activated (1862.59 BogoMIPS).
Jan 15 15:34:15 testcluster-1 kernel: ENABLING IO-APIC IRQs
Jan 15 15:34:15 testcluster-1 kernel: ..TIMER: vector=0x31 apic1=0 pin1=0 apic2=-1 pin2=-1
Jan 15 15:34:15 testcluster-1 kernel: Brought up 1 CPUs
Jan 15 15:34:15 testcluster-1 kernel: checking if image is initramfs... it is
Jan 15 15:34:15 testcluster-1 kernel: Freeing initrd memory: 3019k freed
Jan 15 15:34:15 testcluster-1 kernel: NET: Registered protocol family 16
Jan 15 15:34:15 testcluster-1 kernel: ACPI: bus type pci registered
Jan 15 15:34:15 testcluster-1 kernel: PCI: PCI BIOS revision 2.10 entry at 0xfc71e, last bus=3
Jan 15 15:34:15 testcluster-1 kernel: PCI: Using configuration type 1
Jan 15 15:34:15 testcluster-1 kernel: Setting up standard PCI resources
Jan 15 15:34:15 testcluster-1 kernel: ACPI: Interpreter enabled
Jan 15 15:34:15 testcluster-1 kernel: ACPI: Using IOAPIC for interrupt routing
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 5 6 7 9 *10 11 12 14)
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 6 7 9 10 *11 12 14)
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK4] (IRQs 3 4 5 6 7 9 10 *11 12 14)
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 6 7 9 *10 11 12 14)
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK6] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:15 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK7] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK8] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNK9] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11 12 14)
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Interrupt Link [LUSB] (IRQs 3 4 *5 6 7 10 11 12 14)
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Root Bridge [PCI1] (0000:00)
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Root Bridge [PCI2] (0000:01)
Jan 15 15:34:16 testcluster-1 kernel: ACPI: PCI Root Bridge [PCI0] (0000:02)
Jan 15 15:34:16 testcluster-1 kernel: PCI: Firmware left 0000:02:04.0 e100 interrupts enabled, disabling
Jan 15 15:34:16 testcluster-1 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Jan 15 15:34:16 testcluster-1 kernel: pnp: PnP ACPI init
Jan 15 15:34:16 testcluster-1 kernel: pnp: PnP ACPI: found 15 devices
Jan 15 15:34:16 testcluster-1 kernel: usbcore: registered new driver usbfs
Jan 15 15:34:16 testcluster-1 kernel: usbcore: registered new driver hub
Jan 15 15:34:16 testcluster-1 kernel: PCI: Using ACPI for IRQ routing
Jan 15 15:34:16 testcluster-1 kernel: PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
Jan 15 15:34:16 testcluster-1 kernel: NetLabel: Initializing
Jan 15 15:34:16 testcluster-1 kernel: NetLabel:  domain hash size = 128
Jan 15 15:34:16 testcluster-1 kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Jan 15 15:34:16 testcluster-1 kernel: NetLabel:  unlabeled traffic allowed by default
Jan 15 15:34:16 testcluster-1 kernel: pnp: 00:0b: ioport range 0x800-0x89f could not be reserved
Jan 15 15:34:16 testcluster-1 kernel: pnp: 00:0b: ioport range 0x500-0x501 has been reserved
Jan 15 15:34:16 testcluster-1 kernel: pnp: 00:0b: ioport range 0x8a0-0x8af has been reserved
Jan 15 15:34:16 testcluster-1 kernel: pnp: 00:0b: ioport range 0xc00-0xcd7 has been reserved
Jan 15 15:34:16 testcluster-1 kernel: pnp: 00:0b: ioport range 0xf50-0xf58 has been reserved
Jan 15 15:34:17 testcluster-1 kernel: PCI: Bridge: 0000:02:02.0
Jan 15 15:34:17 testcluster-1 kernel:   IO window: disabled.
Jan 15 15:34:17 testcluster-1 kernel:   MEM window: disabled.
Jan 15 15:34:17 testcluster-1 kernel:   PREFETCH window: disabled.
Jan 15 15:34:17 testcluster-1 kernel: NET: Registered protocol family 2
Jan 15 15:34:17 testcluster-1 kernel: IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
Jan 15 15:34:17 testcluster-1 kernel: TCP established hash table entries: 16384 (order: 5, 131072 bytes)
Jan 15 15:34:17 testcluster-1 kernel: TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
Jan 15 15:34:17 testcluster-1 kernel: TCP: Hash tables configured (established 16384 bind 8192)
Jan 15 15:34:17 testcluster-1 kernel: TCP reno registered
Jan 15 15:34:17 testcluster-1 kernel: apm: BIOS not found.
Jan 15 15:34:17 testcluster-1 kernel: audit: initializing netlink socket (disabled)
Jan 15 15:34:17 testcluster-1 kernel: audit(1200407579.096:1): initialized
Jan 15 15:34:17 testcluster-1 kernel: Total HugeTLB memory allocated, 0
Jan 15 15:34:17 testcluster-1 kernel: VFS: Disk quotas dquot_6.5.1
Jan 15 15:34:17 testcluster-1 kernel: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Jan 15 15:34:17 testcluster-1 kernel: Initializing Cryptographic API
Jan 15 15:34:17 testcluster-1 kernel: ksign: Installing public key data
Jan 15 15:34:17 testcluster-1 kernel: Loading keyring
Jan 15 15:34:17 testcluster-1 kernel: - Added public key B6BB063468FBFC28
Jan 15 15:34:17 testcluster-1 kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
Jan 15 15:34:17 testcluster-1 kernel: io scheduler noop registered
Jan 15 15:34:17 testcluster-1 kernel: io scheduler anticipatory registered
Jan 15 15:34:17 testcluster-1 kernel: io scheduler deadline registered
Jan 15 15:34:18 testcluster-1 kernel: io scheduler cfq registered (default)
Jan 15 15:34:18 testcluster-1 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Jan 15 15:34:18 testcluster-1 kernel: ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is not present [20060707]
Jan 15 15:34:18 testcluster-1 kernel: ACPI: Getting cpuindex for acpiid 0x2
Jan 15 15:34:18 testcluster-1 kernel: Real Time Clock Driver v1.12ac
Jan 15 15:34:18 testcluster-1 kernel: Non-volatile memory driver v1.2
Jan 15 15:34:18 testcluster-1 kernel: Linux agpgart interface v0.101 (c) Dave Jones
Jan 15 15:34:18 testcluster-1 kernel: agpgart: unable to determine aperture size.
Jan 15 15:34:18 testcluster-1 kernel: agpgart: agp_backend_initialize() failed.
Jan 15 15:34:18 testcluster-1 kernel: agpgart-serverworks: probe of 0000:00:00.0 failed with error -22
Jan 15 15:34:18 testcluster-1 kernel: agpgart: unable to determine aperture size.
Jan 15 15:34:18 testcluster-1 kernel: agpgart: agp_backend_initialize() failed.
Jan 15 15:34:18 testcluster-1 kernel: agpgart-serverworks: probe of 0000:00:00.1 failed with error -22
Jan 15 15:34:18 testcluster-1 kernel: agpgart: ServerWorks CNB20HE is unsupported due to lack of documentation.
Jan 15 15:34:18 testcluster-1 kernel: agpgart: ServerWorks CNB20HE is unsupported due to lack of documentation.
Jan 15 15:34:18 testcluster-1 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Jan 15 15:34:18 testcluster-1 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Jan 15 15:34:18 testcluster-1 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Jan 15 15:34:18 testcluster-1 kernel: 00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Jan 15 15:34:18 testcluster-1 kernel: 00:08: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Jan 15 15:34:18 testcluster-1 kernel: RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Jan 15 15:34:18 testcluster-1 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Jan 15 15:34:18 testcluster-1 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Jan 15 15:34:18 testcluster-1 kernel: SvrWks OSB4: IDE controller at PCI slot 0000:00:0f.1
Jan 15 15:34:18 testcluster-1 kernel: SvrWks OSB4: chipset revision 0
Jan 15 15:34:18 testcluster-1 kernel: SvrWks OSB4: not 100% native mode: will probe irqs later
Jan 15 15:34:18 testcluster-1 kernel:     ide0: BM-DMA at 0x08b0-0x08b7, BIOS settings: hda:DMA, hdb:pio
Jan 15 15:34:18 testcluster-1 kernel:     ide1: BM-DMA at 0x08b8-0x08bf, BIOS settings: hdc:pio, hdd:pio
Jan 15 15:34:18 testcluster-1 kernel: hda: TEAC CD-ROM CD-224E, ATAPI CD/DVD-ROM drive
Jan 15 15:34:18 testcluster-1 kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Jan 15 15:34:19 testcluster-1 kernel: ide-floppy driver 0.99.newide
Jan 15 15:34:19 testcluster-1 kernel: usbcore: registered new driver hiddev
Jan 15 15:34:19 testcluster-1 kernel: usbcore: registered new driver usbhid
Jan 15 15:34:19 testcluster-1 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Jan 15 15:34:19 testcluster-1 kernel: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Jan 15 15:34:19 testcluster-1 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Jan 15 15:34:19 testcluster-1 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Jan 15 15:34:19 testcluster-1 kernel: mice: PS/2 mouse device common for all mice
Jan 15 15:34:19 testcluster-1 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Jan 15 15:34:19 testcluster-1 kernel: md: bitmap version 4.39
Jan 15 15:34:19 testcluster-1 kernel: TCP bic registered
Jan 15 15:34:19 testcluster-1 kernel: Initializing IPsec netlink socket
Jan 15 15:34:19 testcluster-1 kernel: NET: Registered protocol family 1
Jan 15 15:34:19 testcluster-1 kernel: NET: Registered protocol family 17
Jan 15 15:34:19 testcluster-1 kernel: Using IPI No-Shortcut mode
Jan 15 15:34:19 testcluster-1 kernel: Time: tsc clocksource has been installed.
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] AIS Executive Service RELEASE 'subrev 1358 version 0.80.3' 
Jan 15 15:34:19 testcluster-1 kernel: ACPI: (supports S0 S4 S5)
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors. 
Jan 15 15:34:19 testcluster-1 kernel: Freeing unused kernel memory: 220k freed
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] Copyright (C) 2006 Red Hat, Inc. 
Jan 15 15:34:19 testcluster-1 kernel: Write protecting the kernel read-only data: 388k
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] AIS Executive Service: started and ready to provide service. 
Jan 15 15:34:19 testcluster-1 kernel: input: AT Translated Set 2 keyboard as /class/input/input0
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] openais component openais_cpg loaded. 
Jan 15 15:34:19 testcluster-1 kernel: USB Universal Host Controller Interface driver v3.0
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais cluster closed process group service v1.01' 
Jan 15 15:34:19 testcluster-1 openais[2096]: [MAIN ] openais component openais_cfg loaded. 
Jan 15 15:34:20 testcluster-1 kernel: ACPI: PCI Interrupt Link [LUSB] enabled at IRQ 11
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais configuration service' 
Jan 15 15:34:20 testcluster-1 kernel: ACPI: PCI Interrupt 0000:00:0f.2[A] -> Link [LUSB] -> GSI 11 (level, low) -> IRQ 11
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_msg loaded. 
Jan 15 15:34:20 testcluster-1 kernel: ohci_hcd 0000:00:0f.2: OHCI Host Controller
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais message service B.01.01' 
Jan 15 15:34:20 testcluster-1 kernel: ohci_hcd 0000:00:0f.2: new USB bus registered, assigned bus number 1
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_lck loaded. 
Jan 15 15:34:20 testcluster-1 kernel: ohci_hcd 0000:00:0f.2: irq 11, io mem 0xfe100000
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais distributed locking service B.01.01' 
Jan 15 15:34:20 testcluster-1 kernel: usb usb1: configuration #1 chosen from 1 choice
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_evt loaded. 
Jan 15 15:34:20 testcluster-1 kernel: hub 1-0:1.0: USB hub found
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais event service B.01.01' 
Jan 15 15:34:20 testcluster-1 kernel: hub 1-0:1.0: 2 ports detected
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_ckpt loaded. 
Jan 15 15:34:20 testcluster-1 kernel: SCSI subsystem initialized
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais checkpoint service B.01.01' 
Jan 15 15:34:20 testcluster-1 kernel: Adaptec aacraid driver 1.1-5[2437]-mh4
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_amf loaded. 
Jan 15 15:34:20 testcluster-1 kernel: ACPI: PCI Interrupt 0000:02:02.1[A] -> GSI 31 (level, low) -> IRQ 177
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais availability management framework B.01.01' 
Jan 15 15:34:20 testcluster-1 kernel: AAC0: kernel 2.8-1[6098] 
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_clm loaded. 
Jan 15 15:34:20 testcluster-1 kernel: AAC0: monitor 2.8-1[6098]
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais cluster membership service B.01.01' 
Jan 15 15:34:20 testcluster-1 kernel: AAC0: bios 2.8-1[6098]
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] openais component openais_evs loaded. 
Jan 15 15:34:20 testcluster-1 kernel: AAC0: serial CD9810D2
Jan 15 15:34:20 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais extended virtual synchrony service' 
Jan 15 15:34:21 testcluster-1 kernel: AAC0: ROMB RAID/SCSI mode enabled
Jan 15 15:34:21 testcluster-1 openais[2096]: [MAIN ] openais component openais_cman loaded. 
Jan 15 15:34:21 testcluster-1 kernel: AAC0: Non-DASD support enabled.
Jan 15 15:34:21 testcluster-1 openais[2096]: [MAIN ] Registering service handler 'openais CMAN membership service 2.01' 
Jan 15 15:34:21 testcluster-1 kernel: scsi0 : percraid
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] Token Timeout (40000 ms) retransmit timeout (1980 ms) 
Jan 15 15:34:21 testcluster-1 kernel:   Vendor: DELL      Model: Virtual Disk      Rev: V1.0
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] token hold (1574 ms) retransmits before loss (20 retrans) 
Jan 15 15:34:21 testcluster-1 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 02
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms) 
Jan 15 15:34:21 testcluster-1 kernel: SCSI device sda: 35543040 512-byte hdwr sectors (18198 MB)
Jan 15 15:34:21 testcluster-1 ccsd[2060]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs) 
Jan 15 15:34:21 testcluster-1 kernel: sda: Write Protect is off
Jan 15 15:34:21 testcluster-1 ccsd[2060]: Error while processing connect: Connection refused 
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500 
Jan 15 15:34:21 testcluster-1 ccsd[2060]: Initial status:: Quorate 
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages) 
Jan 15 15:34:21 testcluster-1 kernel: SCSI device sda: drive cache: write back
Jan 15 15:34:21 testcluster-1 openais[2096]: [TOTEM] send threads (0 threads) 
Jan 15 15:34:22 testcluster-1 kernel: SCSI device sda: 35543040 512-byte hdwr sectors (18198 MB)
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] RRP token expired timeout (1980 ms) 
Jan 15 15:34:22 testcluster-1 kernel: sda: Write Protect is off
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] RRP token problem counter (2000 ms) 
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] RRP threshold (10 problem count) 
Jan 15 15:34:22 testcluster-1 kernel: SCSI device sda: drive cache: write back
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] RRP mode set to none. 
Jan 15 15:34:22 testcluster-1 kernel:  sda: sda1 sda2
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] heartbeat_failures_allowed (0) 
Jan 15 15:34:22 testcluster-1 kernel: sd 0:0:0:0: Attached scsi removable disk sda
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] max_network_delay (50 ms) 
Jan 15 15:34:22 testcluster-1 kernel:   Vendor: FUJITSU   Model: MAN3184MC         Rev: 5505
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0 
Jan 15 15:34:22 testcluster-1 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 03
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] Receive multicast socket recv buffer size (219136 bytes). 
Jan 15 15:34:22 testcluster-1 kernel:   Vendor: FUJITSU   Model: MAN3184MC         Rev: 5505
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] Transmit multicast socket send buffer size (219136 bytes). 
Jan 15 15:34:22 testcluster-1 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 03
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] The network interface [10.200.10.187] is now up. 
Jan 15 15:34:22 testcluster-1 kernel: input: PS2++ Logitech Wheel Mouse as /class/input/input1
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] Created or loaded sequence id 888.10.200.10.187 for this ring. 
Jan 15 15:34:22 testcluster-1 kernel:   Vendor: DELL      Model: 1x4 U2W SCSI BP   Rev: 1.32
Jan 15 15:34:22 testcluster-1 openais[2096]: [TOTEM] entering GATHER state from 15. 
Jan 15 15:34:22 testcluster-1 kernel:   Type:   Processor                          ANSI SCSI revision: 02
Jan 15 15:34:22 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais extended virtual synchrony service' 
Jan 15 15:34:22 testcluster-1 kernel: ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 20 (level, low) -> IRQ 185
Jan 15 15:34:22 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais cluster membership service B.01.01' 
Jan 15 15:34:22 testcluster-1 kernel: scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 7.0
Jan 15 15:34:22 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais availability management framework B.01.01' 
Jan 15 15:34:22 testcluster-1 kernel:         <Adaptec 3960D Ultra160 SCSI adapter>
Jan 15 15:34:22 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais checkpoint service B.01.01' 
Jan 15 15:34:23 testcluster-1 kernel:         aic7899: Ultra160 Wide Channel A, SCSI Id=6, 32/253 SCBs
Jan 15 15:34:23 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais event service B.01.01' 
Jan 15 15:34:23 testcluster-1 kernel: 
Jan 15 15:34:23 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais distributed locking service B.01.01' 
Jan 15 15:34:23 testcluster-1 kernel:   Vendor: IBM       Model: DNES-309170W      Rev: SA30
Jan 15 15:34:23 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais message service B.01.01' 
Jan 15 15:34:23 testcluster-1 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 03
Jan 15 15:34:23 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais configuration service' 
Jan 15 15:34:23 testcluster-1 kernel: scsi1:A:3:0: Tagged Queuing enabled.  Depth 4
Jan 15 15:34:23 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais cluster closed process group service v1.01' 
Jan 15 15:34:23 testcluster-1 kernel:  target1:0:3: Beginning Domain Validation
Jan 15 15:34:23 testcluster-1 openais[2096]: [SERV ] Initialising service handler 'openais CMAN membership service 2.01' 
Jan 15 15:34:23 testcluster-1 kernel:  target1:0:3: wide asynchronous
Jan 15 15:34:23 testcluster-1 openais[2096]: [CMAN ] CMAN 2.0.73 (built Oct 16 2007 13:05:09) started 
Jan 15 15:34:23 testcluster-1 kernel:  target1:0:3: FAST-20 WIDE SCSI 40.0 MB/s ST (50 ns, offset 31)
Jan 15 15:34:23 testcluster-1 openais[2096]: [SYNC ] Not using a virtual synchrony filter. 
Jan 15 15:34:23 testcluster-1 kernel:  target1:0:3: Domain Validation skipping write tests
Jan 15 15:34:23 testcluster-1 openais[2096]: [TOTEM] Creating commit token because I am the rep. 
Jan 15 15:34:23 testcluster-1 kernel:  target1:0:3: Ending Domain Validation
Jan 15 15:34:23 testcluster-1 openais[2096]: [TOTEM] Saving state aru 0 high seq received 0 
Jan 15 15:34:23 testcluster-1 kernel: SCSI device sdb: 17916240 512-byte hdwr sectors (9173 MB)
Jan 15 15:34:23 testcluster-1 openais[2096]: [TOTEM] Storing new sequence id for ring 37c 
Jan 15 15:34:23 testcluster-1 kernel: sdb: Write Protect is off
Jan 15 15:34:23 testcluster-1 openais[2096]: [TOTEM] entering COMMIT state. 
Jan 15 15:34:23 testcluster-1 openais[2096]: [TOTEM] entering RECOVERY state. 
Jan 15 15:34:23 testcluster-1 kernel: SCSI device sdb: drive cache: write back
Jan 15 15:34:23 testcluster-1 openais[2096]: [TOTEM] position [0] member 10.200.10.187: 
Jan 15 15:34:24 testcluster-1 kernel: SCSI device sdb: 17916240 512-byte hdwr sectors (9173 MB)
Jan 15 15:34:24 testcluster-1 openais[2096]: [TOTEM] previous ring seq 888 rep 10.200.10.187 
Jan 15 15:34:24 testcluster-1 kernel: sdb: Write Protect is off
Jan 15 15:34:24 testcluster-1 openais[2096]: [TOTEM] aru 0 high delivered 0 received flag 1 
Jan 15 15:34:24 testcluster-1 openais[2096]: [TOTEM] Did not need to originate any messages in recovery. 
Jan 15 15:34:24 testcluster-1 kernel: SCSI device sdb: drive cache: write back
Jan 15 15:34:24 testcluster-1 openais[2096]: [TOTEM] Sending initial ORF token 
Jan 15 15:34:24 testcluster-1 kernel:  sdb: sdb1 sdb2
Jan 15 15:34:24 testcluster-1 openais[2096]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:24 testcluster-1 kernel: sd 1:0:3:0: Attached scsi disk sdb
Jan 15 15:34:24 testcluster-1 openais[2096]: [CLM  ] New Configuration: 
Jan 15 15:34:24 testcluster-1 qdiskd[2164]: <info> Quorum Partition: /dev/sdb2 Label: Qdisk1 
Jan 15 15:34:24 testcluster-1 kernel: ACPI: PCI Interrupt 0000:00:02.1[B] -> GSI 21 (level, low) -> IRQ 193
Jan 15 15:34:24 testcluster-1 openais[2096]: [CLM  ] Members Left: 
Jan 15 15:34:24 testcluster-1 qdiskd[2165]: <info> Quorum Daemon Initializing 
Jan 15 15:34:24 testcluster-1 kernel: scsi2 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 7.0
Jan 15 15:34:24 testcluster-1 openais[2096]: [CLM  ] Members Joined: 
Jan 15 15:34:24 testcluster-1 hcid[2181]: Bluetooth HCI daemon
Jan 15 15:34:24 testcluster-1 kernel:         <Adaptec 3960D Ultra160 SCSI adapter>
Jan 15 15:34:24 testcluster-1 openais[2096]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:25 testcluster-1 kernel:         aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs
Jan 15 15:34:25 testcluster-1 hcid[2181]: Register path:/org/bluez fallback:1
Jan 15 15:34:25 testcluster-1 openais[2096]: [CLM  ] New Configuration: 
Jan 15 15:34:25 testcluster-1 sdpd[2185]: Bluetooth SDP daemon 
Jan 15 15:34:25 testcluster-1 kernel: 
Jan 15 15:34:25 testcluster-1 openais[2096]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:34:25 testcluster-1 kernel: device-mapper: ioctl: 4.11.0-ioctl (2006-09-14) initialised: dm-devel@xxxxxxxxxx
Jan 15 15:34:25 testcluster-1 openais[2096]: [CLM  ] Members Left: 
Jan 15 15:34:25 testcluster-1 kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Jan 15 15:34:25 testcluster-1 openais[2096]: [CLM  ] Members Joined: 
Jan 15 15:34:25 testcluster-1 pcscd: pcscdaemon.c:464:main() pcsc-lite 1.3.1 daemon ready.
Jan 15 15:34:25 testcluster-1 kernel: EXT3-fs: write access will be enabled during recovery.
Jan 15 15:34:25 testcluster-1 openais[2096]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:34:25 testcluster-1 kernel: kjournald starting.  Commit interval 5 seconds
Jan 15 15:34:25 testcluster-1 openais[2096]: [SYNC ] This node is within the primary component and will provide service. 
Jan 15 15:34:25 testcluster-1 hidd[2282]: Bluetooth HID daemon
Jan 15 15:34:25 testcluster-1 kernel: EXT3-fs: recovery complete.
Jan 15 15:34:25 testcluster-1 openais[2096]: [TOTEM] entering OPERATIONAL state. 
Jan 15 15:34:25 testcluster-1 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Jan 15 15:34:25 testcluster-1 openais[2096]: [CLM  ] got nodejoin message 10.200.10.187 
Jan 15 15:34:25 testcluster-1 kernel: SELinux:  Disabled at runtime.
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] entering GATHER state from 11. 
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] Creating commit token because I am the rep. 
Jan 15 15:34:26 testcluster-1 kernel: audit(1200407628.116:2): selinux=0 auid=4294967295
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] Saving state aru 9 high seq received 9 
Jan 15 15:34:26 testcluster-1 automount[2307]: lookup_read_master: lookup(nisplus): couldn't locat nis+ table auto.master
Jan 15 15:34:26 testcluster-1 kernel: parport: PnPBIOS parport detected.
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] Storing new sequence id for ring 380 
Jan 15 15:34:26 testcluster-1 kernel: parport0: PC-style at 0x378 (0x778), irq 7 [PCSPP,TRISTATE]
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] entering COMMIT state. 
Jan 15 15:34:26 testcluster-1 kernel: hda: ATAPI 24X CD-ROM drive, 128kB Cache, (U)DMA
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] entering RECOVERY state. 
Jan 15 15:34:26 testcluster-1 kernel: Uniform CD-ROM driver Revision: 3.20
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] position [0] member 10.200.10.187: 
Jan 15 15:34:26 testcluster-1 kernel: piix4_smbus 0000:00:0f.0: Found 0000:00:0f.0 device
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] previous ring seq 892 rep 10.200.10.187 
Jan 15 15:34:26 testcluster-1 kernel: input: PC Speaker as /class/input/input2
Jan 15 15:34:26 testcluster-1 openais[2096]: [TOTEM] aru 9 high delivered 9 received flag 1 
Jan 15 15:34:27 testcluster-1 kernel: tg3.c:v3.80-rh (August 2, 2007)
Jan 15 15:34:27 testcluster-1 hpiod: 1.6.7 accepting connections at 2208... 
Jan 15 15:34:27 testcluster-1 openais[2096]: [TOTEM] position [1] member 10.200.10.188: 
Jan 15 15:34:27 testcluster-1 kernel: ACPI: PCI Interrupt 0000:01:08.0[A] -> GSI 17 (level, low) -> IRQ 201
Jan 15 15:34:27 testcluster-1 openais[2096]: [TOTEM] previous ring seq 892 rep 10.200.10.188 
Jan 15 15:34:27 testcluster-1 kernel: e100: Intel(R) PRO/100 Network Driver, 3.5.10-k2-NAPI
Jan 15 15:34:27 testcluster-1 openais[2096]: [TOTEM] aru b high delivered b received flag 1 
Jan 15 15:34:27 testcluster-1 kernel: e100: Copyright(c) 1999-2005 Intel Corporation
Jan 15 15:34:27 testcluster-1 openais[2096]: [TOTEM] Did not need to originate any messages in recovery. 
Jan 15 15:34:27 testcluster-1 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Jan 15 15:34:27 testcluster-1 openais[2096]: [TOTEM] Sending initial ORF token 
Jan 15 15:34:27 testcluster-1 kernel: scsi 0:1:0:0: Attached scsi generic sg1 type 0
Jan 15 15:34:27 testcluster-1 openais[2096]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:27 testcluster-1 kernel: scsi 0:1:1:0: Attached scsi generic sg2 type 0
Jan 15 15:34:27 testcluster-1 openais[2096]: [CLM  ] New Configuration: 
Jan 15 15:34:27 testcluster-1 qdiskd[2165]: <info> Heuristic: 'ping 10.200.10.1 -c3 -t1' UP 
Jan 15 15:34:28 testcluster-1 kernel: scsi 0:1:6:0: Attached scsi generic sg3 type 3
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:34:28 testcluster-1 kernel: sd 1:0:3:0: Attached scsi generic sg4 type 0
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] Members Left: 
Jan 15 15:34:28 testcluster-1 kernel: eth0: Tigon3 [partno(none) rev 7102 PHY(5401)] (PCI:66MHz:64-bit) 10/100/1000Base-T Ethernet 00:06:5b:04:50:f4
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] Members Joined: 
Jan 15 15:34:28 testcluster-1 kernel: eth0: RXcsums[1] LinkChgREG[1] MIirq[1] ASF[0] WireSpeed[0] TSOcap[0]
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:28 testcluster-1 kernel: eth0: dma_rwctrl[76ff000f] dma_mask[64-bit]
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] New Configuration: 
Jan 15 15:34:28 testcluster-1 kernel: ACPI: PCI Interrupt 0000:02:04.0[A] -> GSI 16 (level, low) -> IRQ 209
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:34:28 testcluster-1 kernel: e100: eth1: e100_probe: addr 0xfe900000, irq 209, MAC addr 00:06:5B:04:50:F3
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:34:28 testcluster-1 kernel: Floppy drive(s): fd0 is 1.44M
Jan 15 15:34:28 testcluster-1 openais[2096]: [CLM  ] Members Left: 
Jan 15 15:34:29 testcluster-1 kernel: FDC 0 is a National Semiconductor PC87306
Jan 15 15:34:29 testcluster-1 openais[2096]: [CLM  ] Members Joined: 
Jan 15 15:34:29 testcluster-1 kernel: lp0: using parport0 (interrupt-driven).
Jan 15 15:34:29 testcluster-1 openais[2096]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:34:29 testcluster-1 kernel: lp0: console ready
Jan 15 15:34:29 testcluster-1 openais[2096]: [SYNC ] This node is within the primary component and will provide service. 
Jan 15 15:34:29 testcluster-1 kernel: ACPI: Power Button (FF) [PWRF]
Jan 15 15:34:29 testcluster-1 openais[2096]: [TOTEM] entering OPERATIONAL state. 
Jan 15 15:34:29 testcluster-1 kernel: ibm_acpi: ec object not found
Jan 15 15:34:29 testcluster-1 openais[2096]: [CMAN ] quorum regained, resuming activity 
Jan 15 15:34:29 testcluster-1 kernel: md: Autodetecting RAID arrays.
Jan 15 15:34:29 testcluster-1 ntpd[2407]: ntpd 4.2.2p1@xxxxxxxx Mon Jun  4 15:13:02 UTC 2007 (1)
Jan 15 15:34:29 testcluster-1 openais[2096]: [CLM  ] got nodejoin message 10.200.10.187 
Jan 15 15:34:29 testcluster-1 kernel: md: autorun ...
Jan 15 15:34:29 testcluster-1 openais[2096]: [CLM  ] got nodejoin message 10.200.10.188 
Jan 15 15:34:29 testcluster-1 kernel: md: ... autorun DONE.
Jan 15 15:34:29 testcluster-1 ntpd[2408]: precision = 1.000 usec
Jan 15 15:34:29 testcluster-1 openais[2096]: [CPG  ] got joinlist message from node 1 
Jan 15 15:34:29 testcluster-1 kernel: device-mapper: multipath: version 1.0.5 loaded
Jan 15 15:34:29 testcluster-1 openais[2096]: [CPG  ] got joinlist message from node 2 
Jan 15 15:34:30 testcluster-1 kernel: EXT3 FS on dm-0, internal journal
Jan 15 15:34:30 testcluster-1 ntpd[2408]: Listening on interface wildcard, 0.0.0.0#123 Disabled
Jan 15 15:34:30 testcluster-1 kernel: kjournald starting.  Commit interval 5 seconds
Jan 15 15:34:30 testcluster-1 ntpd[2408]: Listening on interface wildcard, ::#123 Disabled
Jan 15 15:34:30 testcluster-1 kernel: EXT3 FS on sda1, internal journal
Jan 15 15:34:30 testcluster-1 ntpd[2408]: Listening on interface lo, ::1#123 Enabled
Jan 15 15:34:30 testcluster-1 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Jan 15 15:34:30 testcluster-1 ntpd[2408]: Listening on interface eth0, fe80::206:5bff:fe04:50f3#123 Enabled
Jan 15 15:34:30 testcluster-1 kernel: Adding 1048568k swap on /dev/VolGroup00/LogVol01.  Priority:-1 extents:1 across:1048568k
Jan 15 15:34:30 testcluster-1 ntpd[2408]: Listening on interface lo, 127.0.0.1#123 Enabled
Jan 15 15:34:30 testcluster-1 kernel: IA-32 Microcode Update Driver: v1.14a <tigran@xxxxxxxxxxx>
Jan 15 15:34:30 testcluster-1 kernel: e100: eth0: e100_watchdog: link up, 100Mbps, full-duplex
Jan 15 15:34:30 testcluster-1 ntpd[2408]: Listening on interface eth0, 10.200.10.187#123 Enabled
Jan 15 15:34:30 testcluster-1 kernel: DLM (built Nov 14 2007 10:38:12) installed
Jan 15 15:34:30 testcluster-1 ntpd[2408]: kernel time sync status 0040
Jan 15 15:34:30 testcluster-1 gpm[2459]: *** info [startup.c(95)]: 
Jan 15 15:34:30 testcluster-1 kernel: GFS2 (built Nov 14 2007 10:38:52) installed
Jan 15 15:34:30 testcluster-1 kernel: Lock_DLM (built Nov 14 2007 10:39:01) installed
Jan 15 15:34:30 testcluster-1 kernel: NET: Registered protocol family 10
Jan 15 15:34:30 testcluster-1 ntpd[2408]: frequency initialized 62.421 PPM from /var/lib/ntp/drift
Jan 15 15:34:30 testcluster-1 kernel: lo: Disabled Privacy Extensions
Jan 15 15:34:30 testcluster-1 gpm[2459]: Started gpm successfully. Entered daemon mode.
Jan 15 15:34:31 testcluster-1 kernel: IPv6 over IPv4 tunneling driver
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: Core ver 2.10
Jan 15 15:34:31 testcluster-1 kernel: NET: Registered protocol family 31
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: HCI device and connection manager initialized
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: HCI socket layer initialized
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: L2CAP ver 2.8
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: L2CAP socket layer initialized
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: RFCOMM socket layer initialized
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: RFCOMM TTY layer initialized
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: RFCOMM ver 1.8
Jan 15 15:34:31 testcluster-1 kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Jan 15 15:34:31 testcluster-1 rhnsd[2559]: Red Hat Network Services Daemon starting up.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Successfully dropped root privileges.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: avahi-daemon 0.6.16 starting up.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Successfully called chroot().
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Successfully dropped remaining capabilities.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Loading service file /services/sftp-ssh.service.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: New relevant interface eth0.IPv6 for mDNS.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Joining mDNS multicast group on interface eth0.IPv6 with address fe80::206:5bff:fe04:50f3.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: New relevant interface eth0.IPv4 for mDNS.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Joining mDNS multicast group on interface eth0.IPv4 with address 10.200.10.187.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Network interface enumeration completed.
Jan 15 15:34:34 testcluster-1 avahi-daemon[2593]: Registering new address record for fe80::206:5bff:fe04:50f3 on eth0.
Jan 15 15:34:35 testcluster-1 avahi-daemon[2593]: Registering new address record for 10.200.10.187 on eth0.
Jan 15 15:34:35 testcluster-1 avahi-daemon[2593]: Registering HINFO record with values 'I686'/'LINUX'.
Jan 15 15:34:35 testcluster-1 avahi-daemon[2593]: Server startup complete. Host name is testcluster-1.local. Local service cookie is 1618268430.
Jan 15 15:34:36 testcluster-1 avahi-daemon[2593]: Service "SFTP File Transfer on testcluster-1" (/services/sftp-ssh.service) successfully established.
Jan 15 15:34:40 testcluster-1 qdiskd[2165]: <info> Initial score 1/1 
Jan 15 15:34:40 testcluster-1 qdiskd[2165]: <info> Initialization complete 
Jan 15 15:34:40 testcluster-1 openais[2096]: [CMAN ] quorum device registered 
Jan 15 15:34:40 testcluster-1 qdiskd[2165]: <notice> Score sufficient for master operation (1/1; required=1); upgrading 
Jan 15 15:34:40 testcluster-1 modclusterd: startup succeeded
Jan 15 15:34:40 testcluster-1 kernel: dlm: Using TCP for communications
Jan 15 15:34:40 testcluster-1 kernel: dlm: connecting to 2
Jan 15 15:34:40 testcluster-1 kernel: dlm: got connection from 2
Jan 15 15:34:40 testcluster-1 clurgmgrd[2698]: <notice> Resource Group Manager Starting 
Jan 15 15:34:42 testcluster-1 oddjobd: oddjobd startup succeeded
Jan 15 15:34:42 testcluster-1 saslauthd[3251]: detach_tty      : master pid is: 3251
Jan 15 15:34:42 testcluster-1 saslauthd[3251]: ipc_init        : listening on socket: /var/run/saslauthd/mux
Jan 15 15:34:42 testcluster-1 ricci: startup succeeded
Jan 15 15:34:48 testcluster-1 qdiskd[2165]: <info> Assuming master role 
Jan 15 15:34:53 testcluster-1 clurgmgrd[2698]: <notice> Starting stopped service service:HTTPD 
Jan 15 15:34:53 testcluster-1 kernel: kjournald starting.  Commit interval 5 seconds
Jan 15 15:34:53 testcluster-1 kernel: EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
Jan 15 15:34:53 testcluster-1 kernel: EXT3 FS on sdb1, internal journal
Jan 15 15:34:53 testcluster-1 kernel: EXT3-fs: recovery complete.
Jan 15 15:34:53 testcluster-1 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Jan 15 15:34:53 testcluster-1 avahi-daemon[2593]: Registering new address record for 10.200.10.189 on eth0.
Jan 15 15:34:55 testcluster-1 in.rdiscd[3563]: setsockopt (IP_ADD_MEMBERSHIP): Address already in use
Jan 15 15:34:55 testcluster-1 in.rdiscd[3563]: Failed joining addresses 
Jan 15 15:34:56 testcluster-1 clurgmgrd[2698]: <notice> Service service:HTTPD started 
Jan 15 15:30:22 testcluster-2 openais[2083]: [TOTEM] The token was lost in the OPERATIONAL state. 
Jan 15 15:30:22 testcluster-2 openais[2083]: [TOTEM] Receive multicast socket recv buffer size (288000 bytes). 
Jan 15 15:30:22 testcluster-2 openais[2083]: [TOTEM] Transmit multicast socket send buffer size (219136 bytes). 
Jan 15 15:30:22 testcluster-2 openais[2083]: [TOTEM] entering GATHER state from 2. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] entering GATHER state from 0. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] Creating commit token because I am the rep. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] Saving state aru 4b high seq received 4b 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] Storing new sequence id for ring 378 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] entering COMMIT state. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] entering RECOVERY state. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] position [0] member 10.200.10.188: 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] previous ring seq 884 rep 10.200.10.187 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] aru 4b high delivered 4b received flag 1 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] Did not need to originate any messages in recovery. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] Sending initial ORF token 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:30:27 testcluster-2 fenced[2099]: testcluster-1 not a cluster member after 0 sec post_fail_delay
Jan 15 15:30:27 testcluster-2 kernel: dlm: closing connection to node 1
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] New Configuration: 
Jan 15 15:30:27 testcluster-2 fenced[2099]: fencing node "testcluster-1"
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] Members Left: 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] Members Joined: 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] New Configuration: 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] Members Left: 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] Members Joined: 
Jan 15 15:30:27 testcluster-2 openais[2083]: [SYNC ] This node is within the primary component and will provide service. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [TOTEM] entering OPERATIONAL state. 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CLM  ] got nodejoin message 10.200.10.188 
Jan 15 15:30:27 testcluster-2 openais[2083]: [CPG  ] got joinlist message from node 2 
Jan 15 15:34:05 testcluster-2 syslogd 1.4.1: restart.
Jan 15 15:34:05 testcluster-2 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Jan 15 15:34:05 testcluster-2 kernel: Linux version 2.6.18-53.1.4.el5 (brewbuilder@xxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)) #1 SMP Wed Nov 14 10:37:33 EST 2007
Jan 15 15:34:05 testcluster-2 kernel: BIOS-provided physical RAM map:
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 0000000000100000 - 000000001fff0000 (usable)
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 000000001fff0000 - 000000001fffec00 (ACPI data)
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 000000001fffec00 - 000000001ffff000 (reserved)
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 00000000fee00000 - 00000000fee10000 (reserved)
Jan 15 15:34:05 testcluster-2 kernel:  BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved)
Jan 15 15:34:05 testcluster-2 kernel: 0MB HIGHMEM available.
Jan 15 15:34:05 testcluster-2 kernel: 511MB LOWMEM available.
Jan 15 15:34:05 testcluster-2 kernel: found SMP MP-table at 000fe710
Jan 15 15:34:05 testcluster-2 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Jan 15 15:34:05 testcluster-2 kernel: disabling kdump
Jan 15 15:34:05 testcluster-2 kernel: Using x86 segment limits to approximate NX protection
Jan 15 15:34:05 testcluster-2 kernel: DMI 2.3 present.
Jan 15 15:34:05 testcluster-2 kernel: Using APIC driver default
Jan 15 15:34:05 testcluster-2 kernel: ACPI: PM-Timer IO Port: 0x808
Jan 15 15:34:05 testcluster-2 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
Jan 15 15:34:05 testcluster-2 kernel: Processor #0 6:8 APIC version 17
Jan 15 15:34:05 testcluster-2 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] disabled)
Jan 15 15:34:05 testcluster-2 kernel: ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
Jan 15 15:34:06 testcluster-2 kernel: ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
Jan 15 15:34:06 testcluster-2 kernel: ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
Jan 15 15:34:06 testcluster-2 kernel: IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-15
Jan 15 15:34:06 testcluster-2 kernel: ACPI: IOAPIC (id[0x02] address[0xfec01000] gsi_base[16])
Jan 15 15:34:06 testcluster-2 kernel: IOAPIC[1]: apic_id 2, version 17, address 0xfec01000, GSI 16-31
Jan 15 15:34:06 testcluster-2 kernel: Enabling APIC mode:  Flat.  Using 2 I/O APICs
Jan 15 15:34:06 testcluster-2 kernel: Using ACPI (MADT) for SMP configuration information
Jan 15 15:34:06 testcluster-2 kernel: Allocating PCI resources starting at 20000000 (gap: 1ffff000:dec01000)
Jan 15 15:34:05 testcluster-2 rpc.statd[1940]: Version 1.0.9 Starting
Jan 15 15:34:06 testcluster-2 kernel: Detected 931.012 MHz processor.
Jan 15 15:34:06 testcluster-2 kernel: Built 1 zonelists.  Total pages: 131056
Jan 15 15:34:06 testcluster-2 kernel: Kernel command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet
Jan 15 15:34:06 testcluster-2 rpc.statd[1940]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user 
Jan 15 15:34:06 testcluster-2 kernel: Enabling fast FPU save and restore... done.
Jan 15 15:34:06 testcluster-2 kernel: Enabling unmasked SIMD FPU exception support... done.
Jan 15 15:34:06 testcluster-2 kernel: Initializing CPU#0
Jan 15 15:34:06 testcluster-2 kernel: CPU 0 irqstacks, hard=c0743000 soft=c0723000
Jan 15 15:34:06 testcluster-2 kernel: PID hash table entries: 2048 (order: 11, 8192 bytes)
Jan 15 15:34:06 testcluster-2 kernel: Console: colour VGA+ 80x25
Jan 15 15:34:06 testcluster-2 kernel: Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Jan 15 15:34:06 testcluster-2 kernel: Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Jan 15 15:34:06 testcluster-2 kernel: Memory: 512152k/524224k available (2080k kernel code, 11572k reserved, 869k data, 220k init, 0k highmem)
Jan 15 15:34:06 testcluster-2 kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok.
Jan 15 15:34:06 testcluster-2 kernel: Calibrating delay using timer specific routine.. 1862.56 BogoMIPS (lpj=931284)
Jan 15 15:34:06 testcluster-2 kernel: Security Framework v1.0.0 initialized
Jan 15 15:34:06 testcluster-2 kernel: SELinux:  Initializing.
Jan 15 15:34:06 testcluster-2 kernel: selinux_register_security:  Registering secondary module capability
Jan 15 15:34:06 testcluster-2 kernel: Capability LSM initialized as secondary
Jan 15 15:34:06 testcluster-2 kernel: Mount-cache hash table entries: 512
Jan 15 15:34:06 testcluster-2 kernel: CPU: L1 I cache: 16K, L1 D cache: 16K
Jan 15 15:34:06 testcluster-2 kernel: CPU: L2 cache: 256K
Jan 15 15:34:07 testcluster-2 kernel: Intel machine check architecture supported.
Jan 15 15:34:07 testcluster-2 kernel: Intel machine check reporting enabled on CPU#0.
Jan 15 15:34:07 testcluster-2 kernel: Checking 'hlt' instruction... OK.
Jan 15 15:34:07 testcluster-2 kernel: SMP alternatives: switching to UP code
Jan 15 15:34:07 testcluster-2 kernel: Freeing SMP alternatives: 14k freed
Jan 15 15:34:07 testcluster-2 kernel: ACPI: Core revision 20060707
Jan 15 15:34:07 testcluster-2 kernel: CPU0: Intel Pentium III (Coppermine) stepping 0a
Jan 15 15:34:07 testcluster-2 kernel: Total of 1 processors activated (1862.56 BogoMIPS).
Jan 15 15:34:07 testcluster-2 kernel: ENABLING IO-APIC IRQs
Jan 15 15:34:07 testcluster-2 kernel: ..TIMER: vector=0x31 apic1=0 pin1=0 apic2=-1 pin2=-1
Jan 15 15:34:07 testcluster-2 kernel: Brought up 1 CPUs
Jan 15 15:34:07 testcluster-2 ccsd[2046]: Starting ccsd 2.0.73: 
Jan 15 15:34:07 testcluster-2 ccsd[2046]:  Built: Oct 16 2007 13:05:05 
Jan 15 15:34:07 testcluster-2 ccsd[2046]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved. 
Jan 15 15:34:07 testcluster-2 kernel: checking if image is initramfs... it is
Jan 15 15:34:07 testcluster-2 kernel: Freeing initrd memory: 3018k freed
Jan 15 15:34:07 testcluster-2 kernel: NET: Registered protocol family 16
Jan 15 15:34:07 testcluster-2 kernel: ACPI: bus type pci registered
Jan 15 15:34:07 testcluster-2 kernel: PCI: PCI BIOS revision 2.10 entry at 0xfc71e, last bus=3
Jan 15 15:34:07 testcluster-2 kernel: PCI: Using configuration type 1
Jan 15 15:34:07 testcluster-2 kernel: Setting up standard PCI resources
Jan 15 15:34:07 testcluster-2 kernel: ACPI: Interpreter enabled
Jan 15 15:34:07 testcluster-2 kernel: ACPI: Using IOAPIC for interrupt routing
Jan 15 15:34:07 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 5 6 7 9 *10 11 12 14)
Jan 15 15:34:07 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 6 7 9 10 *11 12 14)
Jan 15 15:34:07 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:07 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:07 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK4] (IRQs 3 4 5 6 7 9 10 *11 12 14)
Jan 15 15:34:08 testcluster-2 ccsd[2046]: cluster.conf (cluster name = Test, version = 27) found. 
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 6 7 9 *10 11 12 14)
Jan 15 15:34:08 testcluster-2 ccsd[2046]: Unable to perform sendto: Cannot assign requested address 
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK6] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK7] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK8] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNK9] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14) *0, disabled.
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11 12 14)
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Interrupt Link [LUSB] (IRQs 3 4 *5 6 7 10 11 12 14)
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Root Bridge [PCI1] (0000:00)
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Root Bridge [PCI2] (0000:01)
Jan 15 15:34:08 testcluster-2 kernel: ACPI: PCI Root Bridge [PCI0] (0000:02)
Jan 15 15:34:08 testcluster-2 kernel: PCI: Firmware left 0000:02:04.0 e100 interrupts enabled, disabling
Jan 15 15:34:08 testcluster-2 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Jan 15 15:34:08 testcluster-2 kernel: pnp: PnP ACPI init
Jan 15 15:34:08 testcluster-2 kernel: pnp: PnP ACPI: found 15 devices
Jan 15 15:34:08 testcluster-2 kernel: usbcore: registered new driver usbfs
Jan 15 15:34:08 testcluster-2 kernel: usbcore: registered new driver hub
Jan 15 15:34:08 testcluster-2 kernel: PCI: Using ACPI for IRQ routing
Jan 15 15:34:08 testcluster-2 kernel: PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
Jan 15 15:34:08 testcluster-2 kernel: NetLabel: Initializing
Jan 15 15:34:08 testcluster-2 kernel: NetLabel:  domain hash size = 128
Jan 15 15:34:08 testcluster-2 kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Jan 15 15:34:08 testcluster-2 kernel: NetLabel:  unlabeled traffic allowed by default
Jan 15 15:34:08 testcluster-2 kernel: pnp: 00:0b: ioport range 0x800-0x89f could not be reserved
Jan 15 15:34:08 testcluster-2 kernel: pnp: 00:0b: ioport range 0x500-0x501 has been reserved
Jan 15 15:34:08 testcluster-2 kernel: pnp: 00:0b: ioport range 0x8a0-0x8af has been reserved
Jan 15 15:34:08 testcluster-2 kernel: pnp: 00:0b: ioport range 0xc00-0xcd7 has been reserved
Jan 15 15:34:08 testcluster-2 kernel: pnp: 00:0b: ioport range 0xf50-0xf58 has been reserved
Jan 15 15:34:08 testcluster-2 kernel: PCI: Bridge: 0000:02:02.0
Jan 15 15:34:08 testcluster-2 kernel:   IO window: disabled.
Jan 15 15:34:08 testcluster-2 kernel:   MEM window: disabled.
Jan 15 15:34:09 testcluster-2 kernel:   PREFETCH window: disabled.
Jan 15 15:34:09 testcluster-2 kernel: NET: Registered protocol family 2
Jan 15 15:34:09 testcluster-2 kernel: IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
Jan 15 15:34:09 testcluster-2 kernel: TCP established hash table entries: 16384 (order: 5, 131072 bytes)
Jan 15 15:34:09 testcluster-2 kernel: TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
Jan 15 15:34:09 testcluster-2 kernel: TCP: Hash tables configured (established 16384 bind 8192)
Jan 15 15:34:09 testcluster-2 kernel: TCP reno registered
Jan 15 15:34:09 testcluster-2 kernel: apm: BIOS not found.
Jan 15 15:34:09 testcluster-2 kernel: audit: initializing netlink socket (disabled)
Jan 15 15:34:09 testcluster-2 kernel: audit(1200407579.096:1): initialized
Jan 15 15:34:09 testcluster-2 kernel: Total HugeTLB memory allocated, 0
Jan 15 15:34:09 testcluster-2 kernel: VFS: Disk quotas dquot_6.5.1
Jan 15 15:34:09 testcluster-2 kernel: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
Jan 15 15:34:09 testcluster-2 kernel: Initializing Cryptographic API
Jan 15 15:34:09 testcluster-2 kernel: ksign: Installing public key data
Jan 15 15:34:09 testcluster-2 kernel: Loading keyring
Jan 15 15:34:09 testcluster-2 kernel: - Added public key B6BB063468FBFC28
Jan 15 15:34:09 testcluster-2 kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
Jan 15 15:34:09 testcluster-2 kernel: io scheduler noop registered
Jan 15 15:34:09 testcluster-2 kernel: io scheduler anticipatory registered
Jan 15 15:34:09 testcluster-2 kernel: io scheduler deadline registered
Jan 15 15:34:09 testcluster-2 kernel: io scheduler cfq registered (default)
Jan 15 15:34:09 testcluster-2 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Jan 15 15:34:09 testcluster-2 kernel: ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is not present [20060707]
Jan 15 15:34:09 testcluster-2 kernel: ACPI: Getting cpuindex for acpiid 0x2
Jan 15 15:34:09 testcluster-2 kernel: Real Time Clock Driver v1.12ac
Jan 15 15:34:09 testcluster-2 kernel: Non-volatile memory driver v1.2
Jan 15 15:34:09 testcluster-2 kernel: Linux agpgart interface v0.101 (c) Dave Jones
Jan 15 15:34:09 testcluster-2 kernel: agpgart: unable to determine aperture size.
Jan 15 15:34:09 testcluster-2 kernel: agpgart: agp_backend_initialize() failed.
Jan 15 15:34:09 testcluster-2 kernel: agpgart-serverworks: probe of 0000:00:00.0 failed with error -22
Jan 15 15:34:09 testcluster-2 kernel: agpgart: unable to determine aperture size.
Jan 15 15:34:09 testcluster-2 kernel: agpgart: agp_backend_initialize() failed.
Jan 15 15:34:09 testcluster-2 kernel: agpgart-serverworks: probe of 0000:00:00.1 failed with error -22
Jan 15 15:34:09 testcluster-2 kernel: agpgart: ServerWorks CNB20HE is unsupported due to lack of documentation.
Jan 15 15:34:09 testcluster-2 kernel: agpgart: ServerWorks CNB20HE is unsupported due to lack of documentation.
Jan 15 15:34:09 testcluster-2 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Jan 15 15:34:09 testcluster-2 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Jan 15 15:34:10 testcluster-2 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Jan 15 15:34:10 testcluster-2 kernel: 00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Jan 15 15:34:10 testcluster-2 kernel: 00:08: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Jan 15 15:34:10 testcluster-2 kernel: RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Jan 15 15:34:10 testcluster-2 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Jan 15 15:34:10 testcluster-2 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Jan 15 15:34:10 testcluster-2 kernel: SvrWks OSB4: IDE controller at PCI slot 0000:00:0f.1
Jan 15 15:34:10 testcluster-2 kernel: SvrWks OSB4: chipset revision 0
Jan 15 15:34:10 testcluster-2 kernel: SvrWks OSB4: not 100% native mode: will probe irqs later
Jan 15 15:34:10 testcluster-2 kernel:     ide0: BM-DMA at 0x08b0-0x08b7, BIOS settings: hda:DMA, hdb:pio
Jan 15 15:34:10 testcluster-2 kernel:     ide1: BM-DMA at 0x08b8-0x08bf, BIOS settings: hdc:pio, hdd:pio
Jan 15 15:34:10 testcluster-2 kernel: hda: TEAC CD-ROM CD-224E, ATAPI CD/DVD-ROM drive
Jan 15 15:34:10 testcluster-2 kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Jan 15 15:34:10 testcluster-2 kernel: ide-floppy driver 0.99.newide
Jan 15 15:34:10 testcluster-2 kernel: usbcore: registered new driver hiddev
Jan 15 15:34:10 testcluster-2 kernel: usbcore: registered new driver usbhid
Jan 15 15:34:10 testcluster-2 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Jan 15 15:34:10 testcluster-2 kernel: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Jan 15 15:34:10 testcluster-2 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Jan 15 15:34:10 testcluster-2 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Jan 15 15:34:10 testcluster-2 kernel: mice: PS/2 mouse device common for all mice
Jan 15 15:34:10 testcluster-2 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Jan 15 15:34:10 testcluster-2 kernel: md: bitmap version 4.39
Jan 15 15:34:10 testcluster-2 kernel: TCP bic registered
Jan 15 15:34:10 testcluster-2 kernel: Initializing IPsec netlink socket
Jan 15 15:34:10 testcluster-2 kernel: NET: Registered protocol family 1
Jan 15 15:34:10 testcluster-2 kernel: NET: Registered protocol family 17
Jan 15 15:34:10 testcluster-2 kernel: Using IPI No-Shortcut mode
Jan 15 15:34:10 testcluster-2 kernel: Time: tsc clocksource has been installed.
Jan 15 15:34:10 testcluster-2 kernel: ACPI: (supports S0 S4 S5)
Jan 15 15:34:10 testcluster-2 kernel: Freeing unused kernel memory: 220k freed
Jan 15 15:34:10 testcluster-2 kernel: Write protecting the kernel read-only data: 388k
Jan 15 15:34:10 testcluster-2 kernel: input: AT Translated Set 2 keyboard as /class/input/input0
Jan 15 15:34:11 testcluster-2 kernel: USB Universal Host Controller Interface driver v3.0
Jan 15 15:34:11 testcluster-2 kernel: ACPI: PCI Interrupt Link [LUSB] enabled at IRQ 11
Jan 15 15:34:11 testcluster-2 kernel: ACPI: PCI Interrupt 0000:00:0f.2[A] -> Link [LUSB] -> GSI 11 (level, low) -> IRQ 11
Jan 15 15:34:11 testcluster-2 kernel: ohci_hcd 0000:00:0f.2: OHCI Host Controller
Jan 15 15:34:11 testcluster-2 kernel: ohci_hcd 0000:00:0f.2: new USB bus registered, assigned bus number 1
Jan 15 15:34:11 testcluster-2 kernel: ohci_hcd 0000:00:0f.2: irq 11, io mem 0xfe100000
Jan 15 15:34:11 testcluster-2 kernel: usb usb1: configuration #1 chosen from 1 choice
Jan 15 15:34:11 testcluster-2 kernel: hub 1-0:1.0: USB hub found
Jan 15 15:34:11 testcluster-2 kernel: hub 1-0:1.0: 2 ports detected
Jan 15 15:34:11 testcluster-2 kernel: SCSI subsystem initialized
Jan 15 15:34:11 testcluster-2 kernel: Adaptec aacraid driver 1.1-5[2437]-mh4
Jan 15 15:34:11 testcluster-2 kernel: ACPI: PCI Interrupt 0000:02:02.1[A] -> GSI 31 (level, low) -> IRQ 177
Jan 15 15:34:11 testcluster-2 kernel: AAC0: kernel 2.8-1[6098] 
Jan 15 15:34:11 testcluster-2 kernel: AAC0: monitor 2.8-1[6098]
Jan 15 15:34:11 testcluster-2 kernel: AAC0: bios 2.8-1[6098]
Jan 15 15:34:11 testcluster-2 kernel: AAC0: serial CD9810D2
Jan 15 15:34:11 testcluster-2 kernel: AAC0: ROMB RAID/SCSI mode enabled
Jan 15 15:34:11 testcluster-2 kernel: AAC0: Non-DASD support enabled.
Jan 15 15:34:11 testcluster-2 kernel: scsi0 : percraid
Jan 15 15:34:11 testcluster-2 kernel:   Vendor: DELL      Model: Virtual Disk      Rev: V1.0
Jan 15 15:34:11 testcluster-2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 02
Jan 15 15:34:11 testcluster-2 kernel: SCSI device sda: 35543040 512-byte hdwr sectors (18198 MB)
Jan 15 15:34:11 testcluster-2 kernel: sda: Write Protect is off
Jan 15 15:34:11 testcluster-2 kernel: SCSI device sda: drive cache: write back
Jan 15 15:34:11 testcluster-2 kernel: SCSI device sda: 35543040 512-byte hdwr sectors (18198 MB)
Jan 15 15:34:11 testcluster-2 kernel: sda: Write Protect is off
Jan 15 15:34:11 testcluster-2 kernel: SCSI device sda: drive cache: write back
Jan 15 15:34:11 testcluster-2 kernel:  sda: sda1 sda2
Jan 15 15:34:11 testcluster-2 kernel: sd 0:0:0:0: Attached scsi removable disk sda
Jan 15 15:34:11 testcluster-2 kernel:   Vendor: FUJITSU   Model: MAN3184MC         Rev: 5505
Jan 15 15:34:11 testcluster-2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 03
Jan 15 15:34:11 testcluster-2 kernel:   Vendor: FUJITSU   Model: MAN3184MC         Rev: 5505
Jan 15 15:34:11 testcluster-2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 03
Jan 15 15:34:11 testcluster-2 kernel: input: PS/2 Generic Mouse as /class/input/input1
Jan 15 15:34:11 testcluster-2 kernel:   Vendor: DELL      Model: 1x4 U2W SCSI BP   Rev: 1.32
Jan 15 15:34:11 testcluster-2 kernel:   Type:   Processor                          ANSI SCSI revision: 02
Jan 15 15:34:11 testcluster-2 kernel: ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 20 (level, low) -> IRQ 185
Jan 15 15:34:12 testcluster-2 kernel: scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 7.0
Jan 15 15:34:12 testcluster-2 kernel:         <Adaptec 3960D Ultra160 SCSI adapter>
Jan 15 15:34:12 testcluster-2 kernel:         aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs
Jan 15 15:34:12 testcluster-2 kernel: 
Jan 15 15:34:12 testcluster-2 kernel:   Vendor: IBM       Model: DNES-309170W      Rev: SA30
Jan 15 15:34:12 testcluster-2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 03
Jan 15 15:34:12 testcluster-2 kernel: scsi1:A:3:0: Tagged Queuing enabled.  Depth 4
Jan 15 15:34:12 testcluster-2 kernel:  target1:0:3: Beginning Domain Validation
Jan 15 15:34:12 testcluster-2 kernel:  target1:0:3: wide asynchronous
Jan 15 15:34:12 testcluster-2 kernel:  target1:0:3: FAST-20 WIDE SCSI 40.0 MB/s ST (50 ns, offset 31)
Jan 15 15:34:12 testcluster-2 kernel:  target1:0:3: Domain Validation skipping write tests
Jan 15 15:34:12 testcluster-2 kernel:  target1:0:3: Ending Domain Validation
Jan 15 15:34:12 testcluster-2 kernel: SCSI device sdb: 17916240 512-byte hdwr sectors (9173 MB)
Jan 15 15:34:12 testcluster-2 kernel: sdb: Write Protect is off
Jan 15 15:34:12 testcluster-2 kernel: SCSI device sdb: drive cache: write back
Jan 15 15:34:12 testcluster-2 kernel: SCSI device sdb: 17916240 512-byte hdwr sectors (9173 MB)
Jan 15 15:34:12 testcluster-2 kernel: sdb: Write Protect is off
Jan 15 15:34:12 testcluster-2 kernel: SCSI device sdb: drive cache: write back
Jan 15 15:34:12 testcluster-2 kernel:  sdb: sdb1 sdb2
Jan 15 15:34:12 testcluster-2 kernel: sd 1:0:3:0: Attached scsi disk sdb
Jan 15 15:34:12 testcluster-2 kernel: ACPI: PCI Interrupt 0000:00:02.1[B] -> GSI 21 (level, low) -> IRQ 193
Jan 15 15:34:12 testcluster-2 kernel: scsi2 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 7.0
Jan 15 15:34:12 testcluster-2 kernel:         <Adaptec 3960D Ultra160 SCSI adapter>
Jan 15 15:34:12 testcluster-2 kernel:         aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs
Jan 15 15:34:12 testcluster-2 kernel: 
Jan 15 15:34:12 testcluster-2 kernel: device-mapper: ioctl: 4.11.0-ioctl (2006-09-14) initialised: dm-devel@xxxxxxxxxx
Jan 15 15:34:12 testcluster-2 kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Jan 15 15:34:12 testcluster-2 kernel: EXT3-fs: write access will be enabled during recovery.
Jan 15 15:34:12 testcluster-2 kernel: kjournald starting.  Commit interval 5 seconds
Jan 15 15:34:12 testcluster-2 kernel: EXT3-fs: recovery complete.
Jan 15 15:34:12 testcluster-2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Jan 15 15:34:12 testcluster-2 kernel: SELinux:  Disabled at runtime.
Jan 15 15:34:12 testcluster-2 kernel: audit(1200407624.813:2): selinux=0 auid=4294967295
Jan 15 15:34:12 testcluster-2 kernel: hda: ATAPI 24X CD-ROM drive, 128kB Cache, (U)DMA
Jan 15 15:34:12 testcluster-2 kernel: Uniform CD-ROM driver Revision: 3.20
Jan 15 15:34:12 testcluster-2 kernel: parport: PnPBIOS parport detected.
Jan 15 15:34:12 testcluster-2 kernel: parport0: PC-style at 0x378 (0x778), irq 7 [PCSPP,TRISTATE]
Jan 15 15:34:12 testcluster-2 openais[2082]: [MAIN ] AIS Executive Service RELEASE 'subrev 1358 version 0.80.3' 
Jan 15 15:34:13 testcluster-2 kernel: piix4_smbus 0000:00:0f.0: Found 0000:00:0f.0 device
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors. 
Jan 15 15:34:13 testcluster-2 kernel: tg3.c:v3.80-rh (August 2, 2007)
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Copyright (C) 2006 Red Hat, Inc. 
Jan 15 15:34:13 testcluster-2 kernel: ACPI: PCI Interrupt 0000:01:08.0[A] -> GSI 17 (level, low) -> IRQ 201
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] AIS Executive Service: started and ready to provide service. 
Jan 15 15:34:13 testcluster-2 kernel: input: PC Speaker as /class/input/input2
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_cpg loaded. 
Jan 15 15:34:13 testcluster-2 kernel: e100: Intel(R) PRO/100 Network Driver, 3.5.10-k2-NAPI
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais cluster closed process group service v1.01' 
Jan 15 15:34:13 testcluster-2 kernel: e100: Copyright(c) 1999-2005 Intel Corporation
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_cfg loaded. 
Jan 15 15:34:13 testcluster-2 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais configuration service' 
Jan 15 15:34:13 testcluster-2 kernel: scsi 0:1:0:0: Attached scsi generic sg1 type 0
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_msg loaded. 
Jan 15 15:34:13 testcluster-2 kernel: scsi 0:1:1:0: Attached scsi generic sg2 type 0
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais message service B.01.01' 
Jan 15 15:34:13 testcluster-2 kernel: scsi 0:1:6:0: Attached scsi generic sg3 type 3
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_lck loaded. 
Jan 15 15:34:13 testcluster-2 kernel: sd 1:0:3:0: Attached scsi generic sg4 type 0
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais distributed locking service B.01.01' 
Jan 15 15:34:13 testcluster-2 kernel: eth0: Tigon3 [partno(none) rev 7102 PHY(5401)] (PCI:66MHz:64-bit) 10/100/1000Base-T Ethernet 00:06:5b:04:54:74
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_evt loaded. 
Jan 15 15:34:13 testcluster-2 kernel: eth0: RXcsums[1] LinkChgREG[1] MIirq[1] ASF[0] WireSpeed[0] TSOcap[0]
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais event service B.01.01' 
Jan 15 15:34:13 testcluster-2 kernel: eth0: dma_rwctrl[76ff000f] dma_mask[64-bit]
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_ckpt loaded. 
Jan 15 15:34:13 testcluster-2 kernel: ACPI: PCI Interrupt 0000:02:04.0[A] -> GSI 16 (level, low) -> IRQ 209
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais checkpoint service B.01.01' 
Jan 15 15:34:13 testcluster-2 kernel: e100: eth1: e100_probe: addr 0xfe900000, irq 209, MAC addr 00:06:5B:04:54:73
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_amf loaded. 
Jan 15 15:34:13 testcluster-2 kernel: Floppy drive(s): fd0 is 1.44M
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais availability management framework B.01.01' 
Jan 15 15:34:13 testcluster-2 kernel: FDC 0 is a National Semiconductor PC87306
Jan 15 15:34:13 testcluster-2 openais[2082]: [MAIN ] openais component openais_clm loaded. 
Jan 15 15:34:14 testcluster-2 kernel: lp0: using parport0 (interrupt-driven).
Jan 15 15:34:14 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais cluster membership service B.01.01' 
Jan 15 15:34:14 testcluster-2 kernel: lp0: console ready
Jan 15 15:34:14 testcluster-2 openais[2082]: [MAIN ] openais component openais_evs loaded. 
Jan 15 15:34:14 testcluster-2 kernel: ACPI: Power Button (FF) [PWRF]
Jan 15 15:34:14 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais extended virtual synchrony service' 
Jan 15 15:34:14 testcluster-2 kernel: ibm_acpi: ec object not found
Jan 15 15:34:14 testcluster-2 openais[2082]: [MAIN ] openais component openais_cman loaded. 
Jan 15 15:34:14 testcluster-2 kernel: md: Autodetecting RAID arrays.
Jan 15 15:34:14 testcluster-2 openais[2082]: [MAIN ] Registering service handler 'openais CMAN membership service 2.01' 
Jan 15 15:34:14 testcluster-2 kernel: md: autorun ...
Jan 15 15:34:14 testcluster-2 openais[2082]: [TOTEM] Token Timeout (40000 ms) retransmit timeout (1980 ms) 
Jan 15 15:34:14 testcluster-2 ccsd[2046]: Initial status:: Inquorate 
Jan 15 15:34:14 testcluster-2 kernel: md: ... autorun DONE.
Jan 15 15:34:14 testcluster-2 openais[2082]: [TOTEM] token hold (1574 ms) retransmits before loss (20 retrans) 
Jan 15 15:34:14 testcluster-2 kernel: device-mapper: multipath: version 1.0.5 loaded
Jan 15 15:34:14 testcluster-2 openais[2082]: [TOTEM] join (60 ms) send_join (0 ms) consensus (4800 ms) merge (200 ms) 
Jan 15 15:34:14 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:14 testcluster-2 kernel: EXT3 FS on dm-0, internal journal
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs) 
Jan 15 15:34:15 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:15 testcluster-2 kernel: kjournald starting.  Commit interval 5 seconds
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1500 
Jan 15 15:34:15 testcluster-2 kernel: EXT3 FS on sda1, internal journal
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages) 
Jan 15 15:34:15 testcluster-2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] send threads (0 threads) 
Jan 15 15:34:15 testcluster-2 kernel: Adding 1048568k swap on /dev/VolGroup00/LogVol01.  Priority:-1 extents:1 across:1048568k
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] RRP token expired timeout (1980 ms) 
Jan 15 15:34:15 testcluster-2 kernel: IA-32 Microcode Update Driver: v1.14a <tigran@xxxxxxxxxxx>
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] RRP token problem counter (2000 ms) 
Jan 15 15:34:15 testcluster-2 kernel: e100: eth0: e100_watchdog: link up, 100Mbps, full-duplex
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] RRP threshold (10 problem count) 
Jan 15 15:34:15 testcluster-2 kernel: DLM (built Nov 14 2007 10:38:12) installed
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] RRP mode set to none. 
Jan 15 15:34:15 testcluster-2 kernel: GFS2 (built Nov 14 2007 10:38:52) installed
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] heartbeat_failures_allowed (0) 
Jan 15 15:34:15 testcluster-2 kernel: Lock_DLM (built Nov 14 2007 10:39:01) installed
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] max_network_delay (50 ms) 
Jan 15 15:34:15 testcluster-2 kernel: NET: Registered protocol family 10
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0 
Jan 15 15:34:15 testcluster-2 kernel: lo: Disabled Privacy Extensions
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] Receive multicast socket recv buffer size (219136 bytes). 
Jan 15 15:34:15 testcluster-2 kernel: IPv6 over IPv4 tunneling driver
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] Transmit multicast socket send buffer size (219136 bytes). 
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] The network interface [10.200.10.188] is now up. 
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] Created or loaded sequence id 888.10.200.10.188 for this ring. 
Jan 15 15:34:15 testcluster-2 openais[2082]: [TOTEM] entering GATHER state from 15. 
Jan 15 15:34:15 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais extended virtual synchrony service' 
Jan 15 15:34:15 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais cluster membership service B.01.01' 
Jan 15 15:34:15 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais availability management framework B.01.01' 
Jan 15 15:34:15 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais checkpoint service B.01.01' 
Jan 15 15:34:15 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais event service B.01.01' 
Jan 15 15:34:16 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais distributed locking service B.01.01' 
Jan 15 15:34:16 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais message service B.01.01' 
Jan 15 15:34:16 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais configuration service' 
Jan 15 15:34:16 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais cluster closed process group service v1.01' 
Jan 15 15:34:16 testcluster-2 openais[2082]: [SERV ] Initialising service handler 'openais CMAN membership service 2.01' 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CMAN ] CMAN 2.0.73 (built Oct 16 2007 13:05:09) started 
Jan 15 15:34:16 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [SYNC ] Not using a virtual synchrony filter. 
Jan 15 15:34:16 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] Creating commit token because I am the rep. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] Saving state aru 0 high seq received 0 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] Storing new sequence id for ring 37c 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] entering COMMIT state. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] entering RECOVERY state. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] position [0] member 10.200.10.188: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] previous ring seq 888 rep 10.200.10.188 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] aru 0 high delivered 0 received flag 1 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] Did not need to originate any messages in recovery. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] Sending initial ORF token 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] New Configuration: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] Members Left: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] Members Joined: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] New Configuration: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] Members Left: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] Members Joined: 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:34:16 testcluster-2 openais[2082]: [SYNC ] This node is within the primary component and will provide service. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [TOTEM] entering OPERATIONAL state. 
Jan 15 15:34:16 testcluster-2 openais[2082]: [CLM  ] got nodejoin message 10.200.10.188 
Jan 15 15:34:17 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:17 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:18 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:18 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:19 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:19 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:20 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:20 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:21 testcluster-2 ccsd[2046]: Cluster is not quorate.  Refusing connection. 
Jan 15 15:34:21 testcluster-2 ccsd[2046]: Error while processing connect: Connection refused 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] entering GATHER state from 11. 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] Saving state aru b high seq received b 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] Storing new sequence id for ring 380 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] entering COMMIT state. 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] entering RECOVERY state. 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] position [0] member 10.200.10.187: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] previous ring seq 892 rep 10.200.10.187 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] aru 9 high delivered 9 received flag 1 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] position [1] member 10.200.10.188: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] previous ring seq 892 rep 10.200.10.188 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] aru b high delivered b received flag 1 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] Did not need to originate any messages in recovery. 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] New Configuration: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] Members Left: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] Members Joined: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] CLM CONFIGURATION CHANGE 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] New Configuration: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] 	r(0) ip(10.200.10.188)  
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] Members Left: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] Members Joined: 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] 	r(0) ip(10.200.10.187)  
Jan 15 15:34:21 testcluster-2 openais[2082]: [SYNC ] This node is within the primary component and will provide service. 
Jan 15 15:34:21 testcluster-2 openais[2082]: [TOTEM] entering OPERATIONAL state. 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CMAN ] quorum regained, resuming activity 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] got nodejoin message 10.200.10.187 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CLM  ] got nodejoin message 10.200.10.188 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CPG  ] got joinlist message from node 1 
Jan 15 15:34:21 testcluster-2 openais[2082]: [CPG  ] got joinlist message from node 2 
Jan 15 15:34:24 testcluster-2 qdiskd[2150]: <info> Quorum Partition: /dev/sdb2 Label: Qdisk1 
Jan 15 15:34:24 testcluster-2 qdiskd[2151]: <info> Quorum Daemon Initializing 
Jan 15 15:34:24 testcluster-2 pcscd: pcscdaemon.c:464:main() pcsc-lite 1.3.1 daemon ready.
Jan 15 15:34:25 testcluster-2 kernel: Bluetooth: Core ver 2.10
Jan 15 15:34:25 testcluster-2 kernel: NET: Registered protocol family 31
Jan 15 15:34:25 testcluster-2 kernel: Bluetooth: HCI device and connection manager initialized
Jan 15 15:34:25 testcluster-2 kernel: Bluetooth: HCI socket layer initialized
Jan 15 15:34:25 testcluster-2 kernel: Bluetooth: L2CAP ver 2.8
Jan 15 15:34:25 testcluster-2 kernel: Bluetooth: L2CAP socket layer initialized
Jan 15 15:34:25 testcluster-2 kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Jan 15 15:34:25 testcluster-2 hidd[2237]: Bluetooth HID daemon
Jan 15 15:34:25 testcluster-2 automount[2261]: lookup_read_master: lookup(nisplus): couldn't locat nis+ table auto.master
Jan 15 15:34:25 testcluster-2 hpiod: 1.6.7 accepting connections at 2208... 
Jan 15 15:34:27 testcluster-2 ntpd[2344]: ntpd 4.2.2p1@xxxxxxxx Mon Jun  4 15:13:02 UTC 2007 (1)
Jan 15 15:34:27 testcluster-2 ntpd[2345]: precision = 1.000 usec
Jan 15 15:34:27 testcluster-2 ntpd[2345]: Listening on interface wildcard, 0.0.0.0#123 Disabled
Jan 15 15:34:27 testcluster-2 ntpd[2345]: Listening on interface wildcard, ::#123 Disabled
Jan 15 15:34:27 testcluster-2 ntpd[2345]: Listening on interface lo, ::1#123 Enabled
Jan 15 15:34:27 testcluster-2 ntpd[2345]: Listening on interface eth0, fe80::206:5bff:fe04:5473#123 Enabled
Jan 15 15:34:27 testcluster-2 ntpd[2345]: Listening on interface lo, 127.0.0.1#123 Enabled
Jan 15 15:34:27 testcluster-2 ntpd[2345]: Listening on interface eth0, 10.200.10.188#123 Enabled
Jan 15 15:34:27 testcluster-2 ntpd[2345]: kernel time sync status 0040
Jan 15 15:34:27 testcluster-2 qdiskd[2151]: <info> Heuristic: 'ping 10.200.10.1 -c3 -t1' UP 
Jan 15 15:34:27 testcluster-2 ntpd[2345]: frequency initialized 148.271 PPM from /var/lib/ntp/drift
Jan 15 15:34:27 testcluster-2 gpm[2396]: *** info [startup.c(95)]: 
Jan 15 15:34:27 testcluster-2 gpm[2396]: Started gpm successfully. Entered daemon mode.
Jan 15 15:34:28 testcluster-2 rhnsd[2496]: Red Hat Network Services Daemon starting up.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Successfully dropped root privileges.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: avahi-daemon 0.6.16 starting up.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Successfully called chroot().
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Successfully dropped remaining capabilities.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Loading service file /services/sftp-ssh.service.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: New relevant interface eth0.IPv6 for mDNS.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Joining mDNS multicast group on interface eth0.IPv6 with address fe80::206:5bff:fe04:5473.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: New relevant interface eth0.IPv4 for mDNS.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Joining mDNS multicast group on interface eth0.IPv4 with address 10.200.10.188.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Network interface enumeration completed.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Registering new address record for fe80::206:5bff:fe04:5473 on eth0.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Registering new address record for 10.200.10.188 on eth0.
Jan 15 15:34:30 testcluster-2 avahi-daemon[2530]: Registering HINFO record with values 'I686'/'LINUX'.
Jan 15 15:34:31 testcluster-2 avahi-daemon[2530]: Server startup complete. Host name is testcluster-2.local. Local service cookie is 2587033062.
Jan 15 15:34:32 testcluster-2 avahi-daemon[2530]: Service "SFTP File Transfer on testcluster-2" (/services/sftp-ssh.service) successfully established.
Jan 15 15:34:36 testcluster-2 modclusterd: startup succeeded
Jan 15 15:34:36 testcluster-2 kernel: dlm: Using TCP for communications
Jan 15 15:34:36 testcluster-2 clurgmgrd[2635]: <notice> Resource Group Manager Starting 
Jan 15 15:34:37 testcluster-2 oddjobd: oddjobd startup succeeded
Jan 15 15:34:38 testcluster-2 saslauthd[3259]: detach_tty      : master pid is: 3259
Jan 15 15:34:38 testcluster-2 saslauthd[3259]: ipc_init        : listening on socket: /var/run/saslauthd/mux
Jan 15 15:34:38 testcluster-2 ricci: startup succeeded
Jan 15 15:34:39 testcluster-2 qdiskd[2151]: <info> Initial score 1/1 
Jan 15 15:34:39 testcluster-2 qdiskd[2151]: <info> Initialization complete 
Jan 15 15:34:39 testcluster-2 openais[2082]: [CMAN ] quorum device registered 
Jan 15 15:34:39 testcluster-2 qdiskd[2151]: <notice> Score sufficient for master operation (1/1; required=1); upgrading 
Jan 15 15:34:40 testcluster-2 kernel: dlm: connecting to 1
Jan 15 15:34:40 testcluster-2 kernel: dlm: got connection from 1
Jan 15 15:34:48 testcluster-2 qdiskd[2151]: <info> Node 1 is the master 
--
Linux-cluster mailing list
Linux-cluster@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/linux-cluster

[Index of Archives]     [Corosync Cluster Engine]     [GFS]     [Linux Virtualization]     [Centos Virtualization]     [Centos]     [Linux RAID]     [Fedora Users]     [Fedora SELinux]     [Big List of Linux Books]     [Yosemite Camping]

  Powered by Linux