Re: Fence Issue on BL 460C G6

"Wahyu Darmawan" <wahyu@xxxxxxxxxxxxxx> · Sat, 30 Oct 2010 17:48:07 +0700

Hi all,
Thanks. I’ve replaced mainboard on both servers. But there’s another problem. Both servers active after mainboard replaced.

But, when I restart the node that is active, other node will be restarted as well. This happened during fencing.
Repeated occurrence, which would in turn lead to both restart repeatedly.

Need your suggestion please..
Please find the attachment of /var/log/messages/
And, here’s my cluster.conf
<?xml version="1.0"?>
<cluster alias="PORTAL_WORLD" config_version="32" name="PORTAL_WORLD">
       <fence_daemon clean_start="0" post_fail_delay="0" post_join_delay="3"/>
       <clusternodes>
               <clusternode name="rhel-cluster-node1.mgmt.local" nodeid="1" votes="1">
                       <fence>
                               <method name="1">
                                       <device name="NODE1-ILO"/>
                               </method>
                       </fence>
               </clusternode>
               <clusternode name="rhel-cluster-node2.mgmt.local" nodeid="2" votes="1">
                       <fence>
                               <method name="1">
                                       <device name="NODE2-ILO"/>
                               </method>
                       </fence>
               </clusternode>
       </clusternodes>
       <quorumd device="/dev/sdf1" interval="3" label="quorum_disk1" tko="23" votes="2">
               <heuristic interval="2" program="ping 10.4.0.1 -c1 -t1" score="1"/>
       </quorumd>
       <cman expected_votes="1" two_node="1"/>
       <fencedevices>
               <fencedevice agent="fence_ilo" hostname="ilo-node2" login="Administrator" name="NODE2-ILO" passwd="password"/>
               <fencedevice agent="fence_ilo" hostname="ilo-node1" login="Administrator" name="NODE1-ILO" passwd="password"/>
       </fencedevices>
       <rm>
               <failoverdomains>
                       <failoverdomain name="Failover" nofailback="0" ordered="0" restricted="0">
                               <failoverdomainnode name="rhel-cluster-node2.mgmt.local" priority="1"/>
                               <failoverdomainnode name="rhel-cluster-node1.mgmt.local" priority="1"/>
                       </failoverdomain>
               </failoverdomains>
               <resources>
                       <ip address="10.4.1.103" monitor_link="1"/>
               </resources>
               <service autostart="1" domain="Failover" exclusive="0" name="IP_Virtual" recovery="relocate">
                       <ip ref="10.4.1.103"/>
               </service>
       </rm>
</cluster>

Thanks,

From: linux-cluster-bounces@xxxxxxxxxx [mailto:linux-cluster-bounces@xxxxxxxxxx] On Behalf Of Dustin Henry Offutt
Sent: Thursday, October 28, 2010 11:46 PM
To: linux clustering
Subject: Re:  Fence Issue on BL 460C G6

I believe your problem is being caused by "nofailback" being set to "1". :

                       <failoverdomain name="Failover" nofailback="1" ordered="0" restricted="0">

Set it to zero and I believe your problem will be resolved.
On Wed, Oct 27, 2010 at 10:43 PM, Wahyu Darmawan <wahyu@xxxxxxxxxxxxxx> wrote:
Hi Ben,
Here is my cluster.conf. Need your help please.

<?xml version="1.0"?>
<cluster alias="PORTAL_WORLD" config_version="32" name="PORTAL_WORLD">
       <fence_daemon clean_start="0" post_fail_delay="0" post_join_delay="3"/>
       <clusternodes>
               <clusternode name="rhel-cluster-node1.mgmt.local" nodeid="1" votes="1">
                       <fence>
                               <method name="1">
                                       <device name="NODE1-ILO"/>
                               </method>
                       </fence>
               </clusternode>
               <clusternode name="rhel-cluster-node2.mgmt.local" nodeid="2" votes="1">
                       <fence>
                               <method name="1">
                                       <device name="NODE2-ILO"/>
                               </method>
                       </fence>
               </clusternode>
       </clusternodes>
       <quorumd device="/dev/sdf1" interval="3" label="quorum_disk1" tko="23" votes="2">
               <heuristic interval="2" program="ping 10.4.0.1 -c1 -t1" score="1"/>
       </quorumd>
       <cman expected_votes="1" two_node="1"/>
       <fencedevices>
               <fencedevice agent="fence_ilo" hostname="ilo-node2" login="Administrator" name="NODE2-ILO" passwd="password"/>
               <fencedevice agent="fence_ilo" hostname="ilo-node1" login="Administrator" name="NODE1-ILO" passwd="password"/>
       </fencedevices>
       <rm>
               <failoverdomains>
                       <failoverdomain name="Failover" nofailback="1" ordered="0" restricted="0">
                               <failoverdomainnode name="rhel-cluster-node2.mgmt.local" priority="1"/>
                               <failoverdomainnode name="rhel-cluster-node1.mgmt.local" priority="1"/>
                       </failoverdomain>
               </failoverdomains>
               <resources>
                       <ip address="10.4.1.103" monitor_link="1"/>
               </resources>
               <service autostart="1" domain="Failover" exclusive="0" name="IP_Virtual" recovery="relocate">
                       <ip ref="10.4.1.103"/>
               </service>
       </rm>
</cluster>

Many thanks,
Wahyu

-----Original Message-----
From: linux-cluster-bounces@xxxxxxxxxx [mailto:linux-cluster-bounces@xxxxxxxxxx] On Behalf Of Ben Turner
Sent: Thursday, October 28, 2010 12:18 AM
To: linux clustering
Subject: Re:  Fence Issue on BL 460C G6

My guess is there is a problem with fencing.  Are you running fence_ilo with an HP blade?   Iirc the iLOs on the blades have a different CLI, I don't think fence_ilo will work with them.  What do you see in the messages files during these events?  If you see failed fence messages you may want to look into using fence_ipmilan:

http://sources.redhat.com/cluster/wiki/IPMI_FencingConfig

If you post a snip of your messages file from this event and your cluster.conf I will have a better idea of what is going on.

-b

----- "Wahyu Darmawan" <wahyu@xxxxxxxxxxxxxx> wrote:

> Hi all,
>
>
>
> For fencing, I’m using HP iLO and server is BL460c G6. Problem is
> resource is start moving to the passive when the failed node is power
> on. It is really strange for me. For example, I shutdown the node1 and
> physically remove the node1 machine from the blade chassis and monitor
> the clustat output, clustat was still showing that the resource is on
> node 1, even node 1 is power down and removed from c7000 blade
> chassis. But when I plugged again the failed node1 on the c7000 blade
> chassis and it power-on, then clustat is showing that the resource is
> start moving to the passive node from the failed node.
> I’m powering down the blade server with power button in front of it,
> then we remove it from the chassis, If we face the hardware problem in
> our active node and the active node goes down then how the resource
> move to the passive node. In addition, When I rebooted or shutdown the
> machine from the CLI, then the resource moves successfully from the
> passive node. Furthurmore, When I shutdown the active node with
> "shutdown -hy 0" command, after shuting down the active node
> automatically restart.
>
> Please help me.
>
>
>
> Many Thanks,
> --
> Linux-cluster mailing list
> Linux-cluster@xxxxxxxxxx
> https://www.redhat.com/mailman/listinfo/linux-cluster

--
Linux-cluster mailing list
Linux-cluster@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/linux-cluster

--
Linux-cluster mailing list
Linux-cluster@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/linux-cluster

Oct 30 09:14:28 rhel-cluster-node2 qdiskd[3503]: <info> Heuristic: 'ping 10.4.0.1 -c1 -t1' DOWN (1/1)
Oct 30 09:14:30 rhel-cluster-node2 qdiskd[3503]: <info> Heuristic: 'ping 10.4.0.1 -c1 -t1' UP
Oct 30 15:49:59 rhel-cluster-node2 syslogd 1.4.1: restart.
Oct 30 15:49:59 rhel-cluster-node2 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Oct 30 15:49:59 rhel-cluster-node2 kernel: Linux version 2.6.18-194.el5 (mockbuild@xxxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP
Tue Mar 16 21:52:39 EDT 2010
Oct 30 15:49:59 rhel-cluster-node2 kernel: Command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet acpi=off
Oct 30 15:49:59 rhel-cluster-node2 kernel: BIOS-provided physical RAM map:
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 0000000000010000 - 000000000009f400 (usable)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 0000000000100000 - 00000000df62f000 (usable)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df62f000 - 00000000df63c000 (ACPI data)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df63c000 - 00000000df63d000 (usable)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df63d000 - 00000000e4000000 (reserved)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 00000000fec00000 - 00000000fee10000 (reserved)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 00000000ff800000 - 0000000100000000 (reserved)
Oct 30 15:49:59 rhel-cluster-node2 kernel:  BIOS-e820: 0000000100000000 - 000000061ffff000 (usable)
Oct 30 15:49:59 rhel-cluster-node2 kernel: DMI 2.6 present.
Oct 30 15:49:59 rhel-cluster-node2 kernel: No NUMA configuration found
Oct 30 15:49:59 rhel-cluster-node2 kernel: Faking a node at 0000000000000000-000000061ffff000
Oct 30 15:49:59 rhel-cluster-node2 kernel: Bootmem setup node 0 0000000000000000-000000061ffff000
Oct 30 15:49:59 rhel-cluster-node2 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Oct 30 15:49:59 rhel-cluster-node2 kernel: disabling kdump
Oct 30 15:50:00 rhel-cluster-node2 kernel: Intel MultiProcessor Specification v1.4
Oct 30 15:50:00 rhel-cluster-node2 kernel:     Virtual Wire compatibility mode.
Oct 30 15:50:00 rhel-cluster-node2 kernel: OEM ID: HP       Product ID: PROLIANT     APIC at: 0xFEE00000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #16 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #0 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #2 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #4 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 rpc.statd[3394]: Version 1.0.9 Starting
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #6 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #18 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #20 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processor #22 6:10 APIC version 20
Oct 30 15:50:00 rhel-cluster-node2 kernel: I/O APIC #8 Version 32 at 0xFEC00000.
Oct 30 15:50:00 rhel-cluster-node2 kernel: I/O APIC #0 Version 32 at 0xFEC80000.
Oct 30 15:50:00 rhel-cluster-node2 kernel: Setting APIC routing to clustered
Oct 30 15:50:00 rhel-cluster-node2 rpc.statd[3394]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user
Oct 30 15:50:00 rhel-cluster-node2 kernel: Processors: 8
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 000000000009f000 - 00000000000a0000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000000a0000 - 00000000000f0000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000000f0000 - 0000000000100000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000df62f000 - 00000000df63c000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000df63d000 - 00000000e4000000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000e4000000 - 00000000fec00000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000fec00000 - 00000000fee10000
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000fee10000 - 00000000ff800000
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]: Starting ccsd 2.0.115:
Oct 30 15:50:00 rhel-cluster-node2 kernel: Nosave address range: 00000000ff800000 - 0000000100000000
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]:  Built: Mar 16 2010 10:28:57
Oct 30 15:50:00 rhel-cluster-node2 kernel: Allocating PCI resources starting at e6000000 (gap: e4000000:1ac00000)
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved.
Oct 30 15:50:00 rhel-cluster-node2 kernel: SMP: Allowing 8 CPUs, 0 hotplug CPUs
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]: cluster.conf (cluster name = PORTAL_WORLD, version = 32) found.
Oct 30 15:50:00 rhel-cluster-node2 kernel: Built 1 zonelists.  Total pages: 6199701
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:50:00 rhel-cluster-node2 kernel: Kernel command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet acpi=off
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]:  Local version # : 32
Oct 30 15:50:00 rhel-cluster-node2 kernel: Initializing CPU#0
Oct 30 15:50:00 rhel-cluster-node2 ccsd[3503]:  Remote version #: 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: PID hash table entries: 4096 (order: 12, 32768 bytes)
Oct 30 15:50:01 rhel-cluster-node2 kernel: Console: colour VGA+ 80x25
Oct 30 15:50:01 rhel-cluster-node2 kernel: Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Oct 30 15:50:01 rhel-cluster-node2 kernel: Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Oct 30 15:50:01 rhel-cluster-node2 kernel: Checking aperture...
Oct 30 15:50:01 rhel-cluster-node2 kernel: ACPI: DMAR not present
Oct 30 15:50:01 rhel-cluster-node2 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Oct 30 15:50:01 rhel-cluster-node2 kernel: Placing software IO TLB between 0x405e000 - 0x805e000
Oct 30 15:50:01 rhel-cluster-node2 kernel: Memory: 24679172k/25690108k available (2577k kernel code, 476148k reserved, 1305k data, 212k init)
Oct 30 15:50:01 rhel-cluster-node2 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 5867.07 BogoMIPS (lpj=2933538)
Oct 30 15:50:01 rhel-cluster-node2 kernel: Security Framework v1.0.0 initialized
Oct 30 15:50:01 rhel-cluster-node2 kernel: SELinux:  Initializing.
Oct 30 15:50:01 rhel-cluster-node2 kernel: selinux_register_security:  Registering secondary module capability
Oct 30 15:50:01 rhel-cluster-node2 kernel: Capability LSM initialized as secondary
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:50:01 rhel-cluster-node2 kernel: Mount-cache hash table entries: 256
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]:  Local version # : 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]:  Remote version #: 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:50:01 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]:  Local version # : 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: using mwait in idle threads.
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]:  Remote version #: 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:50:01 rhel-cluster-node2 kernel: CPU: Processor Core ID: 0
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]:  Local version # : 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: CPU0: Thermal monitoring enabled (TM1)
Oct 30 15:50:01 rhel-cluster-node2 ccsd[3503]:  Remote version #: 32
Oct 30 15:50:01 rhel-cluster-node2 kernel: SMP alternatives: switching to UP code
Oct 30 15:50:01 rhel-cluster-node2 openais[3516]: [MAIN ] AIS Executive Service RELEASE 'subrev 1887 version 0.80.6'
Oct 30 15:50:01 rhel-cluster-node2 kernel: ExtINT not setup in hardware but reported by MP table
Oct 30 15:50:01 rhel-cluster-node2 openais[3516]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
Oct 30 15:50:01 rhel-cluster-node2 kernel: Using IO-APIC 8
Oct 30 15:50:01 rhel-cluster-node2 openais[3516]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
Oct 30 15:50:01 rhel-cluster-node2 kernel: Using IO-APIC 0
Oct 30 15:50:01 rhel-cluster-node2 openais[3516]: [MAIN ] AIS Executive Service: started and ready to provide service.
Oct 30 15:50:01 rhel-cluster-node2 kernel: GSI 16 sharing vector 0xA9 and IRQ 16
Oct 30 15:50:01 rhel-cluster-node2 openais[3516]: [MAIN ] Using default multicast address of 239.192.253.106
Oct 30 15:50:01 rhel-cluster-node2 kernel: GSI 17 sharing vector 0xB1 and IRQ 17
Oct 30 15:50:01 rhel-cluster-node2 openais[3516]: [TOTEM] Token Timeout (10000 ms) retransmit timeout (495 ms)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 18 sharing vector 0xB9 and IRQ 18
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] token hold (386 ms) retransmits before loss (20 retrans)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 19 sharing vector 0xC1 and IRQ 19
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] join (60 ms) send_join (0 ms) consensus (20000 ms) merge (200 ms)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 20 sharing vector 0xC9 and IRQ 20
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 21 sharing vector 0xD1 and IRQ 21
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1402
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 22 sharing vector 0xD9 and IRQ 22
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 23 sharing vector 0xE1 and IRQ 23
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] send threads (0 threads)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 24 sharing vector 0xE9 and IRQ 24
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] RRP token expired timeout (495 ms)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 28 sharing vector 0x32 and IRQ 28
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] RRP token problem counter (2000 ms)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 30 sharing vector 0x3A and IRQ 30
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] RRP threshold (10 problem count)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 32 sharing vector 0x42 and IRQ 32
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] RRP mode set to none.
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 34 sharing vector 0x4A and IRQ 34
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] heartbeat_failures_allowed (0)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 35 sharing vector 0x52 and IRQ 35
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] max_network_delay (50 ms)
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 36 sharing vector 0x5A and IRQ 36
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 37 sharing vector 0x62 and IRQ 37
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes).
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 38 sharing vector 0x6A and IRQ 38
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes).
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 39 sharing vector 0x72 and IRQ 39
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] The network interface [10.4.1.102] is now up.
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 40 sharing vector 0x7A and IRQ 40
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] Created or loaded sequence id 1512.10.4.1.102 for this ring.
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 41 sharing vector 0x82 and IRQ 41
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [TOTEM] entering GATHER state from 15.
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 42 sharing vector 0x8A and IRQ 42
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [CMAN ] CMAN 2.0.115 (built Mar 16 2010 10:29:01) started
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 45 sharing vector 0x92 and IRQ 45
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [MAIN ] Service initialized 'openais CMAN membership service 2.01'
Oct 30 15:50:02 rhel-cluster-node2 kernel: GSI 47 sharing vector 0x9A and IRQ 47
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais extended virtual synchrony service'
Oct 30 15:50:02 rhel-cluster-node2 ccsd[3503]: Initial status:: Quorate
Oct 30 15:50:02 rhel-cluster-node2 kernel: Using local APIC timer interrupts.
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais cluster membership service B.01.01'
Oct 30 15:50:02 rhel-cluster-node2 kernel: Detected 8.333 MHz APIC timer.
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais availability management framework B.01.01'
Oct 30 15:50:02 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:02 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais checkpoint service B.01.01'
Oct 30 15:50:03 rhel-cluster-node2 kernel: Booting processor 1/8 APIC 0x0
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais event service B.01.01'
Oct 30 15:50:03 rhel-cluster-node2 kernel: Initializing CPU#1
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais distributed locking service B.01.01'
Oct 30 15:50:03 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.13 BogoMIPS (lpj=2933069)
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais message service B.01.01'
Oct 30 15:50:03 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais configuration service'
Oct 30 15:50:03 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais cluster closed process group service v1.01'
Oct 30 15:50:03 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SERV ] Service initialized 'openais cluster config database access v1.01'
Oct 30 15:50:03 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [SYNC ] Not using a virtual synchrony filter.
Oct 30 15:50:03 rhel-cluster-node2 kernel: CPU: Processor Core ID: 0
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [TOTEM] Creating commit token because I am the rep.
Oct 30 15:50:03 rhel-cluster-node2 kernel: CPU1: Thermal monitoring enabled (TM1)
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [TOTEM] Saving state aru 0 high seq received 0
Oct 30 15:50:03 rhel-cluster-node2 qdiskd[3534]: <info> Quorum Partition: /dev/disk/by-id/scsi-3600a0b800017387c000019664cb37790-part1 Label: quorum_disk1
Oct 30 15:50:03 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [TOTEM] Storing new sequence id for ring 5ec
Oct 30 15:50:03 rhel-cluster-node2 qdiskd[3535]: <info> Quorum Daemon Initializing
Oct 30 15:50:03 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:03 rhel-cluster-node2 openais[3516]: [TOTEM] entering COMMIT state.
Oct 30 15:50:03 rhel-cluster-node2 kernel: Booting processor 2/8 APIC 0x2
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] entering RECOVERY state.
Oct 30 15:50:04 rhel-cluster-node2 kernel: Initializing CPU#2
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 15:50:04 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.09 BogoMIPS (lpj=2933047)
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] previous ring seq 1512 rep 10.4.1.102
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] aru 0 high delivered 0 received flag 1
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] Sending initial ORF token
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: Processor Core ID: 1
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] New Configuration:
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU2: Thermal monitoring enabled (TM1)
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] Members Left:
Oct 30 15:50:04 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] Members Joined:
Oct 30 15:50:04 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:50:04 rhel-cluster-node2 kernel: Booting processor 3/8 APIC 0x4
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] New Configuration:
Oct 30 15:50:04 rhel-cluster-node2 kernel: Initializing CPU#3
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:50:04 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.10 BogoMIPS (lpj=2933054)
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] Members Left:
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ] Members Joined:
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:50:04 rhel-cluster-node2 qdiskd[3535]: <info> Heuristic: 'ping 10.4.0.1 -c1 -t1' UP
Oct 30 15:50:04 rhel-cluster-node2 openais[3516]: [TOTEM] entering OPERATIONAL state.
Oct 30 15:50:04 rhel-cluster-node2 kernel: CPU: Processor Core ID: 2
Oct 30 15:50:05 rhel-cluster-node2 openais[3516]: [CMAN ] quorum regained, resuming activity
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU3: Thermal monitoring enabled (TM1)
Oct 30 15:50:05 rhel-cluster-node2 openais[3516]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 15:50:05 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:05 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:05 rhel-cluster-node2 kernel: Booting processor 4/8 APIC 0x6
Oct 30 15:50:05 rhel-cluster-node2 kernel: Initializing CPU#4
Oct 30 15:50:05 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.20 BogoMIPS (lpj=2933103)
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Processor Core ID: 3
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU4: Thermal monitoring enabled (TM1)
Oct 30 15:50:05 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:05 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:05 rhel-cluster-node2 kernel: Booting processor 5/8 APIC 0x12
Oct 30 15:50:05 rhel-cluster-node2 kernel: Initializing CPU#5
Oct 30 15:50:05 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.04 BogoMIPS (lpj=2933023)
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Processor Core ID: 1
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU5: Thermal monitoring enabled (TM1)
Oct 30 15:50:05 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:05 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:05 rhel-cluster-node2 kernel: Booting processor 6/8 APIC 0x14
Oct 30 15:50:05 rhel-cluster-node2 kernel: Initializing CPU#6
Oct 30 15:50:05 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.11 BogoMIPS (lpj=2933055)
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Processor Core ID: 2
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU6: Thermal monitoring enabled (TM1)
Oct 30 15:50:05 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:05 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:50:05 rhel-cluster-node2 kernel: Booting processor 7/8 APIC 0x16
Oct 30 15:50:05 rhel-cluster-node2 kernel: Initializing CPU#7
Oct 30 15:50:05 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.06 BogoMIPS (lpj=2933031)
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:50:05 rhel-cluster-node2 kernel: CPU: Processor Core ID: 3
Oct 30 15:50:06 rhel-cluster-node2 kernel: CPU7: Thermal monitoring enabled (TM1)
Oct 30 15:50:06 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:50:06 rhel-cluster-node2 kernel: Brought up 8 CPUs
Oct 30 15:50:06 rhel-cluster-node2 kernel: testing NMI watchdog ... OK.
Oct 30 15:50:06 rhel-cluster-node2 kernel: time.c: Using 1.193182 MHz WALL PIT GTOD PIT/TSC timer.
Oct 30 15:50:06 rhel-cluster-node2 kernel: time.c: Detected 2933.538 MHz processor.
Oct 30 15:50:06 rhel-cluster-node2 kernel: migration_cost=36,1657
Oct 30 15:50:06 rhel-cluster-node2 kernel: checking if image is initramfs... it is
Oct 30 15:50:06 rhel-cluster-node2 kernel: Freeing initrd memory: 3835k freed
Oct 30 15:50:06 rhel-cluster-node2 kernel: NET: Registered protocol family 16
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI: Using configuration type 1
Oct 30 15:50:06 rhel-cluster-node2 kernel: ACPI: Interpreter disabled.
Oct 30 15:50:06 rhel-cluster-node2 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Oct 30 15:50:06 rhel-cluster-node2 kernel: pnp: PnP ACPI: disabled
Oct 30 15:50:06 rhel-cluster-node2 kernel: usbcore: registered new driver usbfs
Oct 30 15:50:06 rhel-cluster-node2 kernel: usbcore: registered new driver hub
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI: Probing PCI hardware
Oct 30 15:50:06 rhel-cluster-node2 kernel: ACPI Error (tbget-0168): Invalid address flags 8 [20060707]
Oct 30 15:50:06 rhel-cluster-node2 last message repeated 43 times
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI: Transparent bridge - 0000:00:1e.0
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1c.0[A] -> IRQ 169
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.0[A] -> IRQ 201
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.1[B] -> IRQ 225
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.2[C] -> IRQ 217
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.3[D] -> IRQ 225
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.7[A] -> IRQ 201
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:02:00.0[A] -> IRQ 50
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:02:00.1[D] -> IRQ 154
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:06:00.0[A] -> IRQ 58
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:06:00.1[B] -> IRQ 98
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI: using PPB 0000:09:00.0[A] to get irq 32
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0a:04.0[A] -> IRQ 66
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI: using PPB 0000:09:00.0[B] to get irq 42
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0a:04.1[B] -> IRQ 138
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0c:00.0[A] -> IRQ 169
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:03.0[A] -> IRQ 225
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.0[A] -> IRQ 209
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.2[B] -> IRQ 217
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.4[B] -> IRQ 217
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.6[A] -> IRQ 209
Oct 30 15:50:06 rhel-cluster-node2 kernel: NetLabel: Initializing
Oct 30 15:50:06 rhel-cluster-node2 kernel: NetLabel:  domain hash size = 128
Oct 30 15:50:06 rhel-cluster-node2 kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Oct 30 15:50:06 rhel-cluster-node2 kernel: NetLabel:  unlabeled traffic allowed by default
Oct 30 15:50:06 rhel-cluster-node2 kernel: ACPI: DMAR not present
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI-GART: No AMD northbridge found.
Oct 30 15:50:06 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:01.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: f3800000-fb7fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6000000-0x00000000e60fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:02.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:03.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:07.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: 4000-4fff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: fb900000-fb9fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6100000-0x00000000e61fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:08.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:09:00.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: fba00000-fbafffff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6200000-0x00000000e62fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:09.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: fba00000-fbafffff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6200000-0x00000000e62fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:0a.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:1c.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: 5000-5fff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: fbb00000-fbffffff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6300000-0x00000000e63fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:1e.0
Oct 30 15:50:07 rhel-cluster-node2 kernel:   IO window: 2000-3fff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   MEM window: f3600000-f37fffff
Oct 30 15:50:07 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e8000000-0x00000000efffffff
Oct 30 15:50:08 rhel-cluster-node2 kernel: NET: Registered protocol family 2
Oct 30 15:50:08 rhel-cluster-node2 kernel: IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
Oct 30 15:50:08 rhel-cluster-node2 kernel: TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
Oct 30 15:50:08 rhel-cluster-node2 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Oct 30 15:50:08 rhel-cluster-node2 kernel: TCP: Hash tables configured (established 262144 bind 65536)
Oct 30 15:50:08 rhel-cluster-node2 kernel: TCP reno registered
Oct 30 15:50:08 rhel-cluster-node2 kernel: audit: initializing netlink socket (disabled)
Oct 30 15:50:08 rhel-cluster-node2 kernel: type=2000 audit(1288428527.608:1): initialized
Oct 30 15:50:08 rhel-cluster-node2 kernel: Total HugeTLB memory allocated, 0
Oct 30 15:50:08 rhel-cluster-node2 kernel: VFS: Disk quotas dquot_6.5.1
Oct 30 15:50:08 rhel-cluster-node2 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Oct 30 15:50:08 rhel-cluster-node2 kernel: Initializing Cryptographic API
Oct 30 15:50:08 rhel-cluster-node2 kernel: alg: No test for crc32c (crc32c-generic)
Oct 30 15:50:08 rhel-cluster-node2 kernel: ksign: Installing public key data
Oct 30 15:50:08 rhel-cluster-node2 kernel: Loading keyring
Oct 30 15:50:08 rhel-cluster-node2 kernel: - Added public key 78CCFEAA9428026A
Oct 30 15:50:08 rhel-cluster-node2 kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
Oct 30 15:50:08 rhel-cluster-node2 kernel: io scheduler noop registered
Oct 30 15:50:08 rhel-cluster-node2 kernel: io scheduler anticipatory registered
Oct 30 15:50:08 rhel-cluster-node2 kernel: io scheduler deadline registered
Oct 30 15:50:08 rhel-cluster-node2 kernel: io scheduler cfq registered (default)
Oct 30 15:50:08 rhel-cluster-node2 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Oct 30 15:50:08 rhel-cluster-node2 kernel: Real Time Clock Driver v1.12ac
Oct 30 15:50:08 rhel-cluster-node2 kernel: Non-volatile memory driver v1.2
Oct 30 15:50:08 rhel-cluster-node2 kernel: Linux agpgart interface v0.101 (c) Dave Jones
Oct 30 15:50:08 rhel-cluster-node2 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Oct 30 15:50:08 rhel-cluster-node2 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Oct 30 15:50:08 rhel-cluster-node2 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Oct 30 15:50:08 rhel-cluster-node2 kernel: brd: module loaded
Oct 30 15:50:08 rhel-cluster-node2 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Oct 30 15:50:08 rhel-cluster-node2 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Oct 30 15:50:08 rhel-cluster-node2 kernel: ide-floppy driver 0.99.newide
Oct 30 15:50:08 rhel-cluster-node2 kernel: usbcore: registered new driver hiddev
Oct 30 15:50:08 rhel-cluster-node2 kernel: usbcore: registered new driver usbhid
Oct 30 15:50:08 rhel-cluster-node2 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Oct 30 15:50:08 rhel-cluster-node2 kernel: PNP: No PS/2 controller found. Probing ports directly.
Oct 30 15:50:08 rhel-cluster-node2 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Oct 30 15:50:08 rhel-cluster-node2 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Oct 30 15:50:08 rhel-cluster-node2 kernel: mice: PS/2 mouse device common for all mice
Oct 30 15:50:08 rhel-cluster-node2 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Oct 30 15:50:08 rhel-cluster-node2 kernel: md: bitmap version 4.39
Oct 30 15:50:08 rhel-cluster-node2 kernel: TCP bic registered
Oct 30 15:50:08 rhel-cluster-node2 kernel: Initializing IPsec netlink socket
Oct 30 15:50:08 rhel-cluster-node2 kernel: NET: Registered protocol family 1
Oct 30 15:50:08 rhel-cluster-node2 kernel: NET: Registered protocol family 17
Oct 30 15:50:08 rhel-cluster-node2 kernel: Initalizing network drop monitor service
Oct 30 15:50:08 rhel-cluster-node2 kernel: Freeing unused kernel memory: 212k freed
Oct 30 15:50:09 rhel-cluster-node2 kernel: Write protecting the kernel read-only data: 504k
Oct 30 15:50:09 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: EHCI Host Controller
Oct 30 15:50:09 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
Oct 30 15:50:09 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: debug port 1
Oct 30 15:50:09 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: irq 201, io mem 0xf35f0000
Oct 30 15:50:09 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
Oct 30 15:50:09 rhel-cluster-node2 kernel: usb usb1: configuration #1 chosen from 1 choice
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 1-0:1.0: USB hub found
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 1-0:1.0: 8 ports detected
Oct 30 15:50:09 rhel-cluster-node2 kernel: USB Universal Host Controller Interface driver v3.0
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: UHCI Host Controller
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: irq 201, io base 0x00001000
Oct 30 15:50:09 rhel-cluster-node2 kernel: usb usb2: configuration #1 chosen from 1 choice
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 2-0:1.0: USB hub found
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 2-0:1.0: 2 ports detected
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: UHCI Host Controller
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: irq 225, io base 0x00001020
Oct 30 15:50:09 rhel-cluster-node2 kernel: usb usb3: configuration #1 chosen from 1 choice
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 3-0:1.0: USB hub found
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 3-0:1.0: 2 ports detected
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: UHCI Host Controller
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: irq 217, io base 0x00001040
Oct 30 15:50:09 rhel-cluster-node2 kernel: usb usb4: configuration #1 chosen from 1 choice
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 4-0:1.0: USB hub found
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 4-0:1.0: 2 ports detected
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: UHCI Host Controller
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: irq 225, io base 0x00001060
Oct 30 15:50:09 rhel-cluster-node2 kernel: usb usb5: configuration #1 chosen from 1 choice
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 5-0:1.0: USB hub found
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 5-0:1.0: 2 ports detected
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: UHCI Host Controller
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: new USB bus registered, assigned bus number 6
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: port count misdetected? forcing to 2 ports
Oct 30 15:50:09 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: irq 217, io base 0x00003800
Oct 30 15:50:09 rhel-cluster-node2 kernel: usb usb6: configuration #1 chosen from 1 choice
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 6-0:1.0: USB hub found
Oct 30 15:50:09 rhel-cluster-node2 kernel: hub 6-0:1.0: 2 ports detected
Oct 30 15:50:09 rhel-cluster-node2 kernel: SCSI subsystem initialized
Oct 30 15:50:09 rhel-cluster-node2 kernel: HP CISS Driver (v 3.6.20-RH4)
Oct 30 15:50:09 rhel-cluster-node2 kernel: cciss0: <0x323a> at PCI 0000:0c:00.0 IRQ 59 using DAC
Oct 30 15:50:09 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 15:50:10 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 15:50:10 rhel-cluster-node2 kernel:
Oct 30 15:50:10 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 15:50:10 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 15:50:10 rhel-cluster-node2 kernel:
Oct 30 15:50:10 rhel-cluster-node2 kernel:  cciss/c0d0: p1 p2
Oct 30 15:50:10 rhel-cluster-node2 kernel: QLogic Fibre Channel HBA Driver
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Found an ISP2432, irq 58, iobase 0xffffc20000014000
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configuring PCI space...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configure NVRAM parameters...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Verifying loaded RISC code...
Oct 30 15:50:10 rhel-cluster-node2 kernel: usb 6-1: new full speed USB device using uhci_hcd and address 2
Oct 30 15:50:10 rhel-cluster-node2 kernel: usb 6-1: configuration #1 chosen from 1 choice
Oct 30 15:50:10 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input0
Oct 30 15:50:10 rhel-cluster-node2 kernel: input: USB HID v1.01 Keyboard [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 15:50:10 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input1
Oct 30 15:50:10 rhel-cluster-node2 kernel: input: USB HID v1.01 Mouse [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (64 KB) for EFT...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (1413 KB) for firmware dump...
Oct 30 15:50:10 rhel-cluster-node2 kernel: scsi0 : qla2xxx
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0:
Oct 30 15:50:10 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 15:50:10 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 15:50:10 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.0 hdma+, host#=0, fw=4.04.09 (486)
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Found an ISP2432, irq 98, iobase 0xffffc2000017a000
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Configuring PCI space...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Configure NVRAM parameters...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Verifying loaded RISC code...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Allocated (64 KB) for EFT...
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Allocated (1413 KB) for firmware dump...
Oct 30 15:50:10 rhel-cluster-node2 kernel: scsi1 : qla2xxx
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1:
Oct 30 15:50:10 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 15:50:10 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 15:50:10 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.1 hdma+, host#=1, fw=4.04.09 (486)
Oct 30 15:50:10 rhel-cluster-node2 kernel: Initializing USB Mass Storage driver...
Oct 30 15:50:10 rhel-cluster-node2 kernel: usbcore: registered new driver usb-storage
Oct 30 15:50:10 rhel-cluster-node2 kernel: USB Mass Storage support registered.
Oct 30 15:50:10 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: LOOP UP detected (4 Gbps).
Oct 30 15:50:10 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:50:10 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:50:10 rhel-cluster-node2 kernel: SCSI device sda: 446653440 512-byte hdwr sectors (228687 MB)
Oct 30 15:50:10 rhel-cluster-node2 kernel: sda: Write Protect is off
Oct 30 15:50:10 rhel-cluster-node2 kernel: SCSI device sda: drive cache: write back w/ FUA
Oct 30 15:50:10 rhel-cluster-node2 kernel: SCSI device sda: 446653440 512-byte hdwr sectors (228687 MB)
Oct 30 15:50:10 rhel-cluster-node2 kernel: sda: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sda: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel:  sda: unknown partition table
Oct 30 15:50:11 rhel-cluster-node2 kernel: sd 0:0:0:0: Attached scsi disk sda
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdb: 52008960 512-byte hdwr sectors (26629 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sdb: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdb: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdb: 52008960 512-byte hdwr sectors (26629 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sdb: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdb: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel:  sdb: unknown partition table
Oct 30 15:50:11 rhel-cluster-node2 kernel: sd 0:0:0:1: Attached scsi disk sdb
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdc: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sdc: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdc: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdc: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sdc: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdc: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel:  sdc: unknown partition table
Oct 30 15:50:11 rhel-cluster-node2 kernel: sd 0:0:0:2: Attached scsi disk sdc
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdd: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sdd: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdd: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdd: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sdd: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sdd: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel:  sdd: unknown partition table
Oct 30 15:50:11 rhel-cluster-node2 kernel: sd 0:0:0:3: Attached scsi disk sdd
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sde: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sde: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sde: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sde: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:50:11 rhel-cluster-node2 kernel: sde: Write Protect is off
Oct 30 15:50:11 rhel-cluster-node2 kernel: SCSI device sde: drive cache: write back w/ FUA
Oct 30 15:50:11 rhel-cluster-node2 kernel:  sde: unknown partition table
Oct 30 15:50:11 rhel-cluster-node2 kernel: sd 0:0:0:4: Attached scsi disk sde
Oct 30 15:50:11 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:50:12 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:50:12 rhel-cluster-node2 kernel: SCSI device sdf: 409600 512-byte hdwr sectors (210 MB)
Oct 30 15:50:12 rhel-cluster-node2 kernel: sdf: Write Protect is off
Oct 30 15:50:12 rhel-cluster-node2 kernel: SCSI device sdf: drive cache: write back w/ FUA
Oct 30 15:50:12 rhel-cluster-node2 kernel: SCSI device sdf: 409600 512-byte hdwr sectors (210 MB)
Oct 30 15:50:12 rhel-cluster-node2 kernel: sdf: Write Protect is off
Oct 30 15:50:12 rhel-cluster-node2 kernel: SCSI device sdf: drive cache: write back w/ FUA
Oct 30 15:50:12 rhel-cluster-node2 kernel:  sdf: sdf1 sdf2
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:5: Attached scsi disk sdf
Oct 30 15:50:12 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: LOOP UP detected (4 Gbps).
Oct 30 15:50:12 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: SNS scan failed -- assuming zero-entry result...
Oct 30 15:50:12 rhel-cluster-node2 kernel: device-mapper: uevent: version 1.0.3
Oct 30 15:50:12 rhel-cluster-node2 kernel: device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@xxxxxxxxxx
Oct 30 15:50:12 rhel-cluster-node2 kernel: device-mapper: dm-raid45: initialized v0.2594l
Oct 30 15:50:12 rhel-cluster-node2 kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Oct 30 15:50:12 rhel-cluster-node2 kernel: EXT3-fs: write access will be enabled during recovery.
Oct 30 15:50:12 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:12 rhel-cluster-node2 kernel: EXT3-fs: recovery complete.
Oct 30 15:50:12 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:12 rhel-cluster-node2 kernel: SELinux:  Disabled at runtime.
Oct 30 15:50:12 rhel-cluster-node2 kernel: type=1404 audit(1288428560.257:2): selinux=0 auid=4294967295 ses=4294967295
Oct 30 15:50:12 rhel-cluster-node2 kernel: input: PC Speaker as /class/input/input2
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:1: Attached scsi generic sg1 type 0
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:2: Attached scsi generic sg2 type 0
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:3: Attached scsi generic sg3 type 0
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:4: Attached scsi generic sg4 type 0
Oct 30 15:50:12 rhel-cluster-node2 kernel: sd 0:0:0:5: Attached scsi generic sg5 type 0
Oct 30 15:50:12 rhel-cluster-node2 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
Oct 30 15:50:12 rhel-cluster-node2 kernel: tg3.c:v3.106 (January 12, 2010)
Oct 30 15:50:12 rhel-cluster-node2 kernel: Floppy drive(s): fd0 is 1.44M
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth0: Tigon3 [partno(N/A) rev 9003 PHY(5714)] (PCIX:133MHz:64-bit) 1000Base-SX Ethernet f4:ce:46:86:f6:06
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[0] TSOcap[1]
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth0: dma_rwctrl[76148000] dma_mask[40-bit]
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth1: Tigon3 [partno(N/A) rev 9003 PHY(5714)] (PCIX:133MHz:64-bit) 1000Base-SX Ethernet f4:ce:46:86:f6:07
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[0] TSOcap[1]
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth1: dma_rwctrl[76148000] dma_mask[40-bit]
Oct 30 15:50:12 rhel-cluster-node2 kernel: Broadcom NetXtreme II 5771x 10Gigabit Ethernet Driver bnx2x 1.52.1-6 (2010/02/16)
Oct 30 15:50:12 rhel-cluster-node2 kernel: bnx2x: part number 412F4E-0-0-0
Oct 30 15:50:12 rhel-cluster-node2 kernel: bnx2x: Loading bnx2x-e1h-5.2.13.0.fw
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth2: Broadcom NetXtreme II BCM57711E XGb (A0) PCI-E x4 5GHz (Gen2) found at mem fb000000, IRQ 50, node addr d8d385590038
Oct 30 15:50:12 rhel-cluster-node2 kernel: bnx2x: part number 412F4E-0-0-0
Oct 30 15:50:12 rhel-cluster-node2 kernel: bnx2x: Loading bnx2x-e1h-5.2.13.0.fw
Oct 30 15:50:12 rhel-cluster-node2 kernel: eth3: Broadcom NetXtreme II BCM57711E XGb (A0) PCI-E x4 5GHz (Gen2) found at mem fa000000, IRQ 154, node addr d8d38559003c
Oct 30 15:50:12 rhel-cluster-node2 kernel: floppy0: no floppy controllers found
Oct 30 15:50:12 rhel-cluster-node2 kernel: Floppy drive(s): fd0 is 1.44M
Oct 30 15:50:12 rhel-cluster-node2 kernel: floppy0: no floppy controllers found
Oct 30 15:50:12 rhel-cluster-node2 kernel: lp: driver loaded but no devices found
Oct 30 15:50:12 rhel-cluster-node2 kernel: md: Autodetecting RAID arrays.
Oct 30 15:50:12 rhel-cluster-node2 kernel: md: autorun ...
Oct 30 15:50:12 rhel-cluster-node2 kernel: md: ... autorun DONE.
Oct 30 15:50:13 rhel-cluster-node2 kernel: device-mapper: multipath: version 1.0.5 loaded
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-0, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-1, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-2, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-3, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-4, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-5, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on dm-6, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3 FS on cciss/c0d0p1, internal journal
Oct 30 15:50:13 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:50:13 rhel-cluster-node2 kernel: NET: Registered protocol family 10
Oct 30 15:50:13 rhel-cluster-node2 kernel: lo: Disabled Privacy Extensions
Oct 30 15:50:13 rhel-cluster-node2 kernel: IPv6 over IPv4 tunneling driver
Oct 30 15:50:13 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 15:50:13 rhel-cluster-node2 kernel: Adding 20479992k swap on /dev/VolGroup00/LogVol01.  Priority:-1 extents:1 across:20479992k
Oct 30 15:50:13 rhel-cluster-node2 kernel: IA-32 Microcode Update Driver: v1.14a <tigran@xxxxxxxxxxx>
Oct 30 15:50:13 rhel-cluster-node2 kernel: Loading iSCSI transport class v2.0-871.
Oct 30 15:50:13 rhel-cluster-node2 kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@xxxxxxxxxxxxxxx>
Oct 30 15:50:13 rhel-cluster-node2 kernel: All bugs added by David S. Miller <davem@xxxxxxxxxx>
Oct 30 15:50:13 rhel-cluster-node2 kernel: cxgb3i: tag itt 0x1fff, 13 bits, age 0xf, 4 bits.
Oct 30 15:50:13 rhel-cluster-node2 kernel: iscsi: registered transport (cxgb3i)
Oct 30 15:50:13 rhel-cluster-node2 kernel: Broadcom NetXtreme II CNIC Driver cnic v2.1.0 (Oct 10, 2009)
Oct 30 15:50:13 rhel-cluster-node2 kernel: cnic: Added CNIC device: eth2
Oct 30 15:50:13 rhel-cluster-node2 kernel: cnic: Added CNIC device: eth3
Oct 30 15:50:13 rhel-cluster-node2 kernel: Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.0 (Dec 06, 2009)
Oct 30 15:50:13 rhel-cluster-node2 kernel: iscsi: registered transport (bnx2i)
Oct 30 15:50:13 rhel-cluster-node2 kernel: scsi2 : Broadcom Offload iSCSI Initiator
Oct 30 15:50:13 rhel-cluster-node2 kernel: scsi3 : Broadcom Offload iSCSI Initiator
Oct 30 15:50:13 rhel-cluster-node2 kernel: iscsi: registered transport (tcp)
Oct 30 15:50:13 rhel-cluster-node2 kernel: iscsi: registered transport (iser)
Oct 30 15:50:13 rhel-cluster-node2 kernel: iscsi: registered transport (be2iscsi)
Oct 30 15:50:13 rhel-cluster-node2 kernel: bnx2x: eth2: using MSI-X  IRQs: sp 75  fp[0] 91 ... fp[7] 147
Oct 30 15:50:13 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_UP): eth2: link is not ready
Oct 30 15:50:13 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth2
Oct 30 15:50:13 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Down
Oct 30 15:50:13 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Down
Oct 30 15:50:13 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Up, 1000 Mbps full duplex
Oct 30 15:50:13 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth2
Oct 30 15:50:14 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
Oct 30 15:50:14 rhel-cluster-node2 kernel: bnx2x: eth3: using MSI-X  IRQs: sp 155  fp[0] 171 ... fp[7] 227
Oct 30 15:50:14 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_UP): eth3: link is not ready
Oct 30 15:50:14 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth3
Oct 30 15:50:14 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Down
Oct 30 15:50:14 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Down
Oct 30 15:50:14 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Up, 1000 Mbps full duplex
Oct 30 15:50:14 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth3
Oct 30 15:50:14 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready
Oct 30 15:50:14 rhel-cluster-node2 kernel: DLM (built Mar 16 2010 21:53:04) installed
Oct 30 15:50:14 rhel-cluster-node2 kernel: GFS2 (built Mar 16 2010 21:53:24) installed
Oct 30 15:50:14 rhel-cluster-node2 kernel: Lock_DLM (built Mar 16 2010 21:53:29) installed
Oct 30 15:50:27 rhel-cluster-node2 qdiskd[3535]: <info> Node 1 is the master
Oct 30 15:50:53 rhel-cluster-node2 fenced[3551]: rhel-cluster-node1.mgmt.local not a cluster member after 3 sec post_join_delay
Oct 30 15:50:53 rhel-cluster-node2 fenced[3551]: fencing node "rhel-cluster-node1.mgmt.local"
Oct 30 15:51:07 rhel-cluster-node2 fenced[3551]: fence "rhel-cluster-node1.mgmt.local" success
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:admin"
Oct 30 15:51:07 rhel-cluster-node2 kernel: dlm: Using TCP for communications
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: Joined cluster. Now mounting FS...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0, already locked for use
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0: Looking at journal...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0: Done
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Trying to acquire journal lock...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Looking at journal...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Done
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Trying to acquire journal lock...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Looking at journal...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Done
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Trying to acquire journal lock...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Looking at journal...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Done
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Trying to acquire journal lock...
Oct 30 15:51:07 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:1102"
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: Joined cluster. Now mounting FS...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0, already locked for use
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Trying to acquire journal lock...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Looking at journal...
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Done
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u04"
Oct 30 15:51:08 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: Joined cluster. Now mounting FS...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0, already locked for use
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u05"
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: Joined cluster. Now mounting FS...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0, already locked for use
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Looking at journal...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Done
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Trying to acquire journal lock...
Oct 30 15:51:09 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u06"
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: Joined cluster. Now mounting FS...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0, already locked for use
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Looking at journal...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Done
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Trying to acquire journal lock...
Oct 30 15:51:10 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Looking at journal...
Oct 30 15:51:11 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Done
Oct 30 15:51:11 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Trying to acquire journal lock...
Oct 30 15:51:11 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Looking at journal...
Oct 30 15:51:11 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Done
Oct 30 15:51:11 rhel-cluster-node2 pcscd: pcscdaemon.c:507:main() pcsc-lite 1.4.4 daemon ready.
Oct 30 15:51:11 rhel-cluster-node2 pcscd: hotplug_libusb.c:402:HPEstablishUSBNotifications() Driver ifd-egate.bundle does not support IFD_GENERATE_HOTPLUG. Using active polling instead.
Oct 30 15:51:11 rhel-cluster-node2 pcscd: hotplug_libusb.c:411:HPEstablishUSBNotifications() Polling forced every 1 second(s)
Oct 30 15:51:11 rhel-cluster-node2 scsi_reserve: [error] cluster not configured for scsi reservations
Oct 30 15:51:12 rhel-cluster-node2 qdiskd[3535]: <info> Initial score 1/1
Oct 30 15:51:12 rhel-cluster-node2 qdiskd[3535]: <info> Initialization complete
Oct 30 15:51:12 rhel-cluster-node2 openais[3516]: [CMAN ] quorum device registered
Oct 30 15:51:12 rhel-cluster-node2 qdiskd[3535]: <notice> Score sufficient for master operation (1/1; required=1); upgrading
Oct 30 15:51:13 rhel-cluster-node2 clvmd: Cluster LVM daemon started - connected to CMAN
Oct 30 15:51:19 rhel-cluster-node2 kernel: Bluetooth: Core ver 2.10
Oct 30 15:51:19 rhel-cluster-node2 kernel: NET: Registered protocol family 31
Oct 30 15:51:19 rhel-cluster-node2 kernel: Bluetooth: HCI device and connection manager initialized
Oct 30 15:51:19 rhel-cluster-node2 kernel: Bluetooth: HCI socket layer initialized
Oct 30 15:51:19 rhel-cluster-node2 kernel: Bluetooth: L2CAP ver 2.8
Oct 30 15:51:19 rhel-cluster-node2 kernel: Bluetooth: L2CAP socket layer initialized
Oct 30 15:51:19 rhel-cluster-node2 kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Oct 30 15:51:19 rhel-cluster-node2 hidd[3947]: Bluetooth HID daemon
Oct 30 15:51:19 rhel-cluster-node2 kernel: i2c /dev entries driver
Oct 30 15:51:20 rhel-cluster-node2 automount[4002]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
Oct 30 15:51:20 rhel-cluster-node2 hpiod: 1.6.7 accepting connections at 2208...
Oct 30 15:51:21 rhel-cluster-node2 gpm[4069]: *** info [startup.c(95)]:
Oct 30 15:51:21 rhel-cluster-node2 gpm[4069]: Started gpm successfully. Entered daemon mode.
Oct 30 15:51:22 rhel-cluster-node2 xinetd[4060]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in.
Oct 30 15:51:22 rhel-cluster-node2 xinetd[4060]: Started working: 0 available services
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Successfully dropped root privileges.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: avahi-daemon 0.6.16 starting up.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Successfully called chroot().
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Successfully dropped remaining capabilities.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: No service found in /etc/avahi/services.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: New relevant interface eth3.IPv6 for mDNS.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Joining mDNS multicast group on interface eth3.IPv6 with address fe80::dad3:85ff:fe59:3c.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: New relevant interface eth3.IPv4 for mDNS.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Joining mDNS multicast group on interface eth3.IPv4 with address 1.1.1.2.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: New relevant interface eth2.IPv6 for mDNS.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Joining mDNS multicast group on interface eth2.IPv6 with address fe80::dad3:85ff:fe59:38.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: New relevant interface eth2.IPv4 for mDNS.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Joining mDNS multicast group on interface eth2.IPv4 with address 10.4.1.102.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Network interface enumeration completed.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Registering new address record for fe80::dad3:85ff:fe59:3c on eth3.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Registering new address record for 1.1.1.2 on eth3.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Registering new address record for fe80::dad3:85ff:fe59:38 on eth2.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Registering new address record for 10.4.1.102 on eth2.
Oct 30 15:51:22 rhel-cluster-node2 avahi-daemon[4155]: Registering HINFO record with values 'X86_64'/'LINUX'.
Oct 30 15:51:23 rhel-cluster-node2 avahi-daemon[4155]: Server startup complete. Host name is rhel-cluster-node2.local. Local service cookie is 799230076.
Oct 30 15:51:24 rhel-cluster-node2 modclusterd: startup succeeded
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: smartd version 5.38 [x86_64-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Home page is http://smartmontools.sourceforge.net/
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Opened configuration file /etc/smartd.conf
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Problem creating device name scan list
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sda, opened
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sda, is SMART capable. Adding to "monitor" list.
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sdb, opened
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sdb, is SMART capable. Adding to "monitor" list.
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sdc, opened
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sdc, is SMART capable. Adding to "monitor" list.
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sdd, opened
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sdd, is SMART capable. Adding to "monitor" list.
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sde, opened
Oct 30 15:51:24 rhel-cluster-node2 smartd[4266]: Device: /dev/sde, is SMART capable. Adding to "monitor" list.
Oct 30 15:51:25 rhel-cluster-node2 smartd[4266]: Device: /dev/sdf, opened
Oct 30 15:51:25 rhel-cluster-node2 smartd[4266]: Device: /dev/sdf, is SMART capable. Adding to "monitor" list.
Oct 30 15:51:25 rhel-cluster-node2 smartd[4266]: Monitoring 0 ATA and 6 SCSI devices
Oct 30 15:51:25 rhel-cluster-node2 smartd[4272]: smartd has fork()ed into background mode. New PID=4272.
Oct 30 15:51:25 rhel-cluster-node2 clurgmgrd[4252]: <notice> Resource Group Manager Starting
Oct 30 15:51:27 rhel-cluster-node2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
Oct 30 15:51:27 rhel-cluster-node2 last message repeated 3 times
Oct 30 15:51:28 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 15:51:32 rhel-cluster-node2 clurgmgrd[4252]: <notice> Starting stopped service service:IP_Virtual
Oct 30 15:51:34 rhel-cluster-node2 avahi-daemon[4155]: Registering new address record for 10.4.1.103 on eth2.
Oct 30 15:51:35 rhel-cluster-node2 clurgmgrd[4252]: <notice> Service service:IP_Virtual started
Oct 30 15:52:42 rhel-cluster-node2 qdiskd[3535]: <info> Assuming master role
Oct 30 15:52:45 rhel-cluster-node2 qdiskd[3535]: <notice> Writing eviction notice for node 1
Oct 30 15:52:48 rhel-cluster-node2 qdiskd[3535]: <notice> Node 1 evicted
Oct 30 15:54:29 rhel-cluster-node2 openais[3516]: [TOTEM] entering GATHER state from 11.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] entering GATHER state from 0.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] Creating commit token because I am the rep.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] Saving state aru 43 high seq received 43
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] Storing new sequence id for ring 5f8
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] entering COMMIT state.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] entering RECOVERY state.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] previous ring seq 1516 rep 10.4.1.102
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] aru 43 high delivered 43 received flag 1
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] Sending initial ORF token
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] New Configuration:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] Members Left:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] Members Joined:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] New Configuration:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] Members Left:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] Members Joined:
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] entering OPERATIONAL state.
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [CPG  ] got joinlist message from node 2
Oct 30 15:54:49 rhel-cluster-node2 openais[3516]: [TOTEM] entering GATHER state from 9.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] entering GATHER state from 0.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] Creating commit token because I am the rep.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] Saving state aru e high seq received e
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] Storing new sequence id for ring 5fc
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] entering COMMIT state.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] entering RECOVERY state.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] previous ring seq 1528 rep 10.4.1.102
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] aru e high delivered e received flag 1
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] Sending initial ORF token
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] New Configuration:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] Members Left:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] Members Joined:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] New Configuration:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] Members Left:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] Members Joined:
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] entering OPERATIONAL state.
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [CPG  ] got joinlist message from node 2
Oct 30 15:55:09 rhel-cluster-node2 openais[3516]: [TOTEM] entering GATHER state from 9.
Oct 30 15:58:41 rhel-cluster-node2 syslogd 1.4.1: restart.
Oct 30 15:58:41 rhel-cluster-node2 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Oct 30 15:58:41 rhel-cluster-node2 kernel: Linux version 2.6.18-194.el5 (mockbuild@xxxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Tue Mar 16 21:52:39 EDT 2010
Oct 30 15:58:41 rhel-cluster-node2 kernel: Command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet acpi=off
Oct 30 15:58:41 rhel-cluster-node2 kernel: BIOS-provided physical RAM map:
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 0000000000010000 - 000000000009f400 (usable)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 0000000000100000 - 00000000df62f000 (usable)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df62f000 - 00000000df63c000 (ACPI data)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df63c000 - 00000000df63d000 (usable)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df63d000 - 00000000e4000000 (reserved)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 00000000fec00000 - 00000000fee10000 (reserved)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 00000000ff800000 - 0000000100000000 (reserved)
Oct 30 15:58:41 rhel-cluster-node2 kernel:  BIOS-e820: 0000000100000000 - 000000061ffff000 (usable)
Oct 30 15:58:41 rhel-cluster-node2 kernel: DMI 2.6 present.
Oct 30 15:58:41 rhel-cluster-node2 kernel: No NUMA configuration found
Oct 30 15:58:41 rhel-cluster-node2 kernel: Faking a node at 0000000000000000-000000061ffff000
Oct 30 15:58:41 rhel-cluster-node2 kernel: Bootmem setup node 0 0000000000000000-000000061ffff000
Oct 30 15:58:42 rhel-cluster-node2 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Oct 30 15:58:42 rhel-cluster-node2 kernel: disabling kdump
Oct 30 15:58:42 rhel-cluster-node2 kernel: Intel MultiProcessor Specification v1.4
Oct 30 15:58:42 rhel-cluster-node2 kernel:     Virtual Wire compatibility mode.
Oct 30 15:58:42 rhel-cluster-node2 kernel: OEM ID: HP       Product ID: PROLIANT     APIC at: 0xFEE00000
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #16 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 rpc.statd[3390]: Version 1.0.9 Starting
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #0 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #2 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #4 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 rpc.statd[3390]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #6 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #18 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #20 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processor #22 6:10 APIC version 20
Oct 30 15:58:42 rhel-cluster-node2 kernel: I/O APIC #8 Version 32 at 0xFEC00000.
Oct 30 15:58:42 rhel-cluster-node2 kernel: I/O APIC #0 Version 32 at 0xFEC80000.
Oct 30 15:58:42 rhel-cluster-node2 kernel: Setting APIC routing to clustered
Oct 30 15:58:42 rhel-cluster-node2 kernel: Processors: 8
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 000000000009f000 - 00000000000a0000
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 00000000000a0000 - 00000000000f0000
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 00000000000f0000 - 0000000000100000
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 00000000df62f000 - 00000000df63c000
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 00000000df63d000 - 00000000e4000000
Oct 30 15:58:42 rhel-cluster-node2 ccsd[3502]: Starting ccsd 2.0.115:
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 00000000e4000000 - 00000000fec00000
Oct 30 15:58:42 rhel-cluster-node2 ccsd[3502]:  Built: Mar 16 2010 10:28:57
Oct 30 15:58:42 rhel-cluster-node2 kernel: Nosave address range: 00000000fec00000 - 00000000fee10000
Oct 30 15:58:42 rhel-cluster-node2 ccsd[3502]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved.
Oct 30 15:58:43 rhel-cluster-node2 kernel: Nosave address range: 00000000fee10000 - 00000000ff800000
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]: cluster.conf (cluster name = PORTAL_WORLD, version = 32) found.
Oct 30 15:58:43 rhel-cluster-node2 kernel: Nosave address range: 00000000ff800000 - 0000000100000000
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:58:43 rhel-cluster-node2 kernel: Allocating PCI resources starting at e6000000 (gap: e4000000:1ac00000)
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Local version # : 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: SMP: Allowing 8 CPUs, 0 hotplug CPUs
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Remote version #: 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: Built 1 zonelists.  Total pages: 6199701
Oct 30 15:58:43 rhel-cluster-node2 kernel: Kernel command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet acpi=off
Oct 30 15:58:43 rhel-cluster-node2 kernel: Initializing CPU#0
Oct 30 15:58:43 rhel-cluster-node2 kernel: PID hash table entries: 4096 (order: 12, 32768 bytes)
Oct 30 15:58:43 rhel-cluster-node2 kernel: Console: colour VGA+ 80x25
Oct 30 15:58:43 rhel-cluster-node2 kernel: Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Oct 30 15:58:43 rhel-cluster-node2 kernel: Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Oct 30 15:58:43 rhel-cluster-node2 kernel: Checking aperture...
Oct 30 15:58:43 rhel-cluster-node2 kernel: ACPI: DMAR not present
Oct 30 15:58:43 rhel-cluster-node2 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Oct 30 15:58:43 rhel-cluster-node2 kernel: Placing software IO TLB between 0x405e000 - 0x805e000
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:58:43 rhel-cluster-node2 kernel: Memory: 24679172k/25690108k available (2577k kernel code, 476148k reserved, 1305k data, 212k init)
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Local version # : 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 5867.06 BogoMIPS (lpj=2933534)
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Remote version #: 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: Security Framework v1.0.0 initialized
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:58:43 rhel-cluster-node2 kernel: SELinux:  Initializing.
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Local version # : 32
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Remote version #: 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: selinux_register_security:  Registering secondary module capability
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]: Remote copy of cluster.conf is from quorate node.
Oct 30 15:58:43 rhel-cluster-node2 kernel: Capability LSM initialized as secondary
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Local version # : 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: Mount-cache hash table entries: 256
Oct 30 15:58:43 rhel-cluster-node2 ccsd[3502]:  Remote version #: 32
Oct 30 15:58:43 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:43 rhel-cluster-node2 openais[3511]: [MAIN ] AIS Executive Service RELEASE 'subrev 1887 version 0.80.6'
Oct 30 15:58:44 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
Oct 30 15:58:44 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:44 rhel-cluster-node2 kernel: using mwait in idle threads.
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
Oct 30 15:58:44 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [MAIN ] AIS Executive Service: started and ready to provide service.
Oct 30 15:58:44 rhel-cluster-node2 kernel: CPU: Processor Core ID: 0
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [MAIN ] Using default multicast address of 239.192.253.106
Oct 30 15:58:44 rhel-cluster-node2 kernel: CPU0: Thermal monitoring enabled (TM1)
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] Token Timeout (10000 ms) retransmit timeout (495 ms)
Oct 30 15:58:44 rhel-cluster-node2 kernel: SMP alternatives: switching to UP code
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] token hold (386 ms) retransmits before loss (20 retrans)
Oct 30 15:58:44 rhel-cluster-node2 kernel: ExtINT not setup in hardware but reported by MP table
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] join (60 ms) send_join (0 ms) consensus (20000 ms) merge (200 ms)
Oct 30 15:58:44 rhel-cluster-node2 kernel: Using IO-APIC 8
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
Oct 30 15:58:44 rhel-cluster-node2 kernel: Using IO-APIC 0
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1402
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 16 sharing vector 0xA9 and IRQ 16
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 17 sharing vector 0xB1 and IRQ 17
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] send threads (0 threads)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 18 sharing vector 0xB9 and IRQ 18
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] RRP token expired timeout (495 ms)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 19 sharing vector 0xC1 and IRQ 19
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] RRP token problem counter (2000 ms)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 20 sharing vector 0xC9 and IRQ 20
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] RRP threshold (10 problem count)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 21 sharing vector 0xD1 and IRQ 21
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] RRP mode set to none.
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 22 sharing vector 0xD9 and IRQ 22
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] heartbeat_failures_allowed (0)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 23 sharing vector 0xE1 and IRQ 23
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] max_network_delay (50 ms)
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 24 sharing vector 0xE9 and IRQ 24
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 28 sharing vector 0x32 and IRQ 28
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes).
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 30 sharing vector 0x3A and IRQ 30
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes).
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 32 sharing vector 0x42 and IRQ 32
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] The network interface [10.4.1.102] is now up.
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 34 sharing vector 0x4A and IRQ 34
Oct 30 15:58:44 rhel-cluster-node2 openais[3511]: [TOTEM] Created or loaded sequence id 1532.10.4.1.102 for this ring.
Oct 30 15:58:44 rhel-cluster-node2 kernel: GSI 35 sharing vector 0x52 and IRQ 35
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [TOTEM] entering GATHER state from 15.
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 36 sharing vector 0x5A and IRQ 36
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [CMAN ] CMAN 2.0.115 (built Mar 16 2010 10:29:01) started
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 37 sharing vector 0x62 and IRQ 37
Oct 30 15:58:45 rhel-cluster-node2 ccsd[3502]: Initial status:: Quorate
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [MAIN ] Service initialized 'openais CMAN membership service 2.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 38 sharing vector 0x6A and IRQ 38
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais extended virtual synchrony service'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 39 sharing vector 0x72 and IRQ 39
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais cluster membership service B.01.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 40 sharing vector 0x7A and IRQ 40
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais availability management framework B.01.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 41 sharing vector 0x82 and IRQ 41
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais checkpoint service B.01.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 42 sharing vector 0x8A and IRQ 42
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais event service B.01.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 45 sharing vector 0x92 and IRQ 45
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais distributed locking service B.01.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: GSI 47 sharing vector 0x9A and IRQ 47
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais message service B.01.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: Using local APIC timer interrupts.
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais configuration service'
Oct 30 15:58:45 rhel-cluster-node2 kernel: Detected 8.333 MHz APIC timer.
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais cluster closed process group service v1.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:45 rhel-cluster-node2 openais[3511]: [SERV ] Service initialized 'openais cluster config database access v1.01'
Oct 30 15:58:45 rhel-cluster-node2 kernel: Booting processor 1/8 APIC 0x0
Oct 30 15:58:46 rhel-cluster-node2 qdiskd[3530]: <info> Quorum Partition: /dev/disk/by-id/scsi-3600a0b800017387c000019664cb37790-part1 Label: quorum_disk1
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [SYNC ] Not using a virtual synchrony filter.
Oct 30 15:58:46 rhel-cluster-node2 kernel: Initializing CPU#1
Oct 30 15:58:46 rhel-cluster-node2 qdiskd[3531]: <info> Quorum Daemon Initializing
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] Creating commit token because I am the rep.
Oct 30 15:58:46 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.24 BogoMIPS (lpj=2933124)
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] Saving state aru 0 high seq received 0
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] Storing new sequence id for ring 600
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering COMMIT state.
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering RECOVERY state.
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: Processor Core ID: 0
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] previous ring seq 1532 rep 10.4.1.102
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU1: Thermal monitoring enabled (TM1)
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] aru 0 high delivered 0 received flag 1
Oct 30 15:58:46 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 15:58:46 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [TOTEM] Sending initial ORF token
Oct 30 15:58:46 rhel-cluster-node2 kernel: Booting processor 2/8 APIC 0x2
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:58:46 rhel-cluster-node2 kernel: Initializing CPU#2
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [CLM  ] New Configuration:
Oct 30 15:58:46 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.12 BogoMIPS (lpj=2933060)
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [CLM  ] Members Left:
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:46 rhel-cluster-node2 openais[3511]: [CLM  ] Members Joined:
Oct 30 15:58:46 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ] New Configuration:
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: Processor Core ID: 1
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ] Members Left:
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU2: Thermal monitoring enabled (TM1)
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ] Members Joined:
Oct 30 15:58:47 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:47 rhel-cluster-node2 qdiskd[3531]: <info> Heuristic: 'ping 10.4.0.1 -c1 -t1' UP
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 15:58:47 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 15:58:47 rhel-cluster-node2 kernel: Booting processor 3/8 APIC 0x4
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [TOTEM] entering OPERATIONAL state.
Oct 30 15:58:47 rhel-cluster-node2 kernel: Initializing CPU#3
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CMAN ] quorum regained, resuming activity
Oct 30 15:58:47 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.05 BogoMIPS (lpj=2933026)
Oct 30 15:58:47 rhel-cluster-node2 openais[3511]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: Processor Core ID: 2
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU3: Thermal monitoring enabled (TM1)
Oct 30 15:58:47 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:47 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:47 rhel-cluster-node2 kernel: Booting processor 4/8 APIC 0x6
Oct 30 15:58:47 rhel-cluster-node2 kernel: Initializing CPU#4
Oct 30 15:58:47 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.28 BogoMIPS (lpj=2933142)
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: Processor Core ID: 3
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU4: Thermal monitoring enabled (TM1)
Oct 30 15:58:47 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:47 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:47 rhel-cluster-node2 kernel: Booting processor 5/8 APIC 0x12
Oct 30 15:58:47 rhel-cluster-node2 kernel: Initializing CPU#5
Oct 30 15:58:47 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.00 BogoMIPS (lpj=2933004)
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:47 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: Processor Core ID: 1
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU5: Thermal monitoring enabled (TM1)
Oct 30 15:58:48 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:48 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:48 rhel-cluster-node2 kernel: Booting processor 6/8 APIC 0x14
Oct 30 15:58:48 rhel-cluster-node2 kernel: Initializing CPU#6
Oct 30 15:58:48 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5865.86 BogoMIPS (lpj=2932934)
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: Processor Core ID: 2
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU6: Thermal monitoring enabled (TM1)
Oct 30 15:58:48 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:48 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 15:58:48 rhel-cluster-node2 kernel: Booting processor 7/8 APIC 0x16
Oct 30 15:58:48 rhel-cluster-node2 kernel: Initializing CPU#7
Oct 30 15:58:48 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.19 BogoMIPS (lpj=2933097)
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU: Processor Core ID: 3
Oct 30 15:58:48 rhel-cluster-node2 kernel: CPU7: Thermal monitoring enabled (TM1)
Oct 30 15:58:48 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 15:58:48 rhel-cluster-node2 kernel: Brought up 8 CPUs
Oct 30 15:58:48 rhel-cluster-node2 kernel: testing NMI watchdog ... OK.
Oct 30 15:58:48 rhel-cluster-node2 kernel: time.c: Using 1.193182 MHz WALL PIT GTOD PIT/TSC timer.
Oct 30 15:58:48 rhel-cluster-node2 kernel: time.c: Detected 2933.534 MHz processor.
Oct 30 15:58:48 rhel-cluster-node2 kernel: migration_cost=30,1642
Oct 30 15:58:48 rhel-cluster-node2 kernel: checking if image is initramfs... it is
Oct 30 15:58:48 rhel-cluster-node2 kernel: Freeing initrd memory: 3835k freed
Oct 30 15:58:48 rhel-cluster-node2 kernel: NET: Registered protocol family 16
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Using configuration type 1
Oct 30 15:58:49 rhel-cluster-node2 kernel: ACPI: Interpreter disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Oct 30 15:58:49 rhel-cluster-node2 kernel: pnp: PnP ACPI: disabled
Oct 30 15:58:49 rhel-cluster-node2 kernel: usbcore: registered new driver usbfs
Oct 30 15:58:49 rhel-cluster-node2 kernel: usbcore: registered new driver hub
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Probing PCI hardware
Oct 30 15:58:49 rhel-cluster-node2 kernel: ACPI Error (tbget-0168): Invalid address flags 8 [20060707]
Oct 30 15:58:49 rhel-cluster-node2 last message repeated 43 times
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Transparent bridge - 0000:00:1e.0
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1c.0[A] -> IRQ 169
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.0[A] -> IRQ 201
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.1[B] -> IRQ 225
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.2[C] -> IRQ 217
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.3[D] -> IRQ 225
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.7[A] -> IRQ 201
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:02:00.0[A] -> IRQ 50
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:02:00.1[D] -> IRQ 154
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:06:00.0[A] -> IRQ 58
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:06:00.1[B] -> IRQ 98
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: using PPB 0000:09:00.0[A] to get irq 32
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0a:04.0[A] -> IRQ 66
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: using PPB 0000:09:00.0[B] to get irq 42
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0a:04.1[B] -> IRQ 138
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0c:00.0[A] -> IRQ 169
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:03.0[A] -> IRQ 225
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.0[A] -> IRQ 209
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.2[B] -> IRQ 217
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.4[B] -> IRQ 217
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.6[A] -> IRQ 209
Oct 30 15:58:49 rhel-cluster-node2 kernel: NetLabel: Initializing
Oct 30 15:58:49 rhel-cluster-node2 kernel: NetLabel:  domain hash size = 128
Oct 30 15:58:49 rhel-cluster-node2 kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Oct 30 15:58:49 rhel-cluster-node2 kernel: NetLabel:  unlabeled traffic allowed by default
Oct 30 15:58:49 rhel-cluster-node2 kernel: ACPI: DMAR not present
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI-GART: No AMD northbridge found.
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:01.0
Oct 30 15:58:49 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel:   MEM window: f3800000-fb7fffff
Oct 30 15:58:49 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6000000-0x00000000e60fffff
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:02.0
Oct 30 15:58:49 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:03.0
Oct 30 15:58:49 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:58:49 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:07.0
Oct 30 15:58:49 rhel-cluster-node2 kernel:   IO window: 4000-4fff
Oct 30 15:58:49 rhel-cluster-node2 kernel:   MEM window: fb900000-fb9fffff
Oct 30 15:58:49 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6100000-0x00000000e61fffff
Oct 30 15:58:50 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:08.0
Oct 30 15:58:50 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel: PCI: Bridge: 0000:09:00.0
Oct 30 15:58:50 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel:   MEM window: fba00000-fbafffff
Oct 30 15:58:50 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6200000-0x00000000e62fffff
Oct 30 15:58:50 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:09.0
Oct 30 15:58:50 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel:   MEM window: fba00000-fbafffff
Oct 30 15:58:50 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6200000-0x00000000e62fffff
Oct 30 15:58:50 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:0a.0
Oct 30 15:58:50 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 15:58:50 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:1c.0
Oct 30 15:58:50 rhel-cluster-node2 kernel:   IO window: 5000-5fff
Oct 30 15:58:50 rhel-cluster-node2 kernel:   MEM window: fbb00000-fbffffff
Oct 30 15:58:50 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6300000-0x00000000e63fffff
Oct 30 15:58:50 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:1e.0
Oct 30 15:58:50 rhel-cluster-node2 kernel:   IO window: 2000-3fff
Oct 30 15:58:50 rhel-cluster-node2 kernel:   MEM window: f3600000-f37fffff
Oct 30 15:58:50 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e8000000-0x00000000efffffff
Oct 30 15:58:50 rhel-cluster-node2 kernel: NET: Registered protocol family 2
Oct 30 15:58:50 rhel-cluster-node2 kernel: IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
Oct 30 15:58:50 rhel-cluster-node2 kernel: TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
Oct 30 15:58:50 rhel-cluster-node2 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Oct 30 15:58:50 rhel-cluster-node2 kernel: TCP: Hash tables configured (established 262144 bind 65536)
Oct 30 15:58:50 rhel-cluster-node2 kernel: TCP reno registered
Oct 30 15:58:50 rhel-cluster-node2 kernel: audit: initializing netlink socket (disabled)
Oct 30 15:58:50 rhel-cluster-node2 kernel: type=2000 audit(1288429053.630:1): initialized
Oct 30 15:58:50 rhel-cluster-node2 kernel: Total HugeTLB memory allocated, 0
Oct 30 15:58:50 rhel-cluster-node2 kernel: VFS: Disk quotas dquot_6.5.1
Oct 30 15:58:50 rhel-cluster-node2 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Oct 30 15:58:50 rhel-cluster-node2 kernel: Initializing Cryptographic API
Oct 30 15:58:50 rhel-cluster-node2 kernel: alg: No test for crc32c (crc32c-generic)
Oct 30 15:58:50 rhel-cluster-node2 kernel: ksign: Installing public key data
Oct 30 15:58:50 rhel-cluster-node2 kernel: Loading keyring
Oct 30 15:58:51 rhel-cluster-node2 kernel: - Added public key 78CCFEAA9428026A
Oct 30 15:58:51 rhel-cluster-node2 kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
Oct 30 15:58:51 rhel-cluster-node2 kernel: io scheduler noop registered
Oct 30 15:58:51 rhel-cluster-node2 kernel: io scheduler anticipatory registered
Oct 30 15:58:51 rhel-cluster-node2 kernel: io scheduler deadline registered
Oct 30 15:58:51 rhel-cluster-node2 kernel: io scheduler cfq registered (default)
Oct 30 15:58:51 rhel-cluster-node2 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Oct 30 15:58:51 rhel-cluster-node2 kernel: Real Time Clock Driver v1.12ac
Oct 30 15:58:51 rhel-cluster-node2 kernel: Non-volatile memory driver v1.2
Oct 30 15:58:51 rhel-cluster-node2 kernel: Linux agpgart interface v0.101 (c) Dave Jones
Oct 30 15:58:51 rhel-cluster-node2 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Oct 30 15:58:51 rhel-cluster-node2 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Oct 30 15:58:51 rhel-cluster-node2 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Oct 30 15:58:51 rhel-cluster-node2 kernel: brd: module loaded
Oct 30 15:58:51 rhel-cluster-node2 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Oct 30 15:58:51 rhel-cluster-node2 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Oct 30 15:58:51 rhel-cluster-node2 kernel: ide-floppy driver 0.99.newide
Oct 30 15:58:51 rhel-cluster-node2 kernel: usbcore: registered new driver hiddev
Oct 30 15:58:51 rhel-cluster-node2 kernel: usbcore: registered new driver usbhid
Oct 30 15:58:51 rhel-cluster-node2 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Oct 30 15:58:51 rhel-cluster-node2 kernel: PNP: No PS/2 controller found. Probing ports directly.
Oct 30 15:58:51 rhel-cluster-node2 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Oct 30 15:58:51 rhel-cluster-node2 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Oct 30 15:58:51 rhel-cluster-node2 kernel: mice: PS/2 mouse device common for all mice
Oct 30 15:58:51 rhel-cluster-node2 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Oct 30 15:58:51 rhel-cluster-node2 kernel: md: bitmap version 4.39
Oct 30 15:58:51 rhel-cluster-node2 kernel: TCP bic registered
Oct 30 15:58:51 rhel-cluster-node2 kernel: Initializing IPsec netlink socket
Oct 30 15:58:51 rhel-cluster-node2 kernel: NET: Registered protocol family 1
Oct 30 15:58:51 rhel-cluster-node2 kernel: NET: Registered protocol family 17
Oct 30 15:58:51 rhel-cluster-node2 kernel: Initalizing network drop monitor service
Oct 30 15:58:51 rhel-cluster-node2 kernel: Freeing unused kernel memory: 212k freed
Oct 30 15:58:51 rhel-cluster-node2 kernel: Write protecting the kernel read-only data: 504k
Oct 30 15:58:51 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: EHCI Host Controller
Oct 30 15:58:51 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
Oct 30 15:58:51 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: debug port 1
Oct 30 15:58:51 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: irq 201, io mem 0xf35f0000
Oct 30 15:58:51 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
Oct 30 15:58:51 rhel-cluster-node2 kernel: usb usb1: configuration #1 chosen from 1 choice
Oct 30 15:58:51 rhel-cluster-node2 kernel: hub 1-0:1.0: USB hub found
Oct 30 15:58:51 rhel-cluster-node2 kernel: hub 1-0:1.0: 8 ports detected
Oct 30 15:58:51 rhel-cluster-node2 kernel: USB Universal Host Controller Interface driver v3.0
Oct 30 15:58:51 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: UHCI Host Controller
Oct 30 15:58:51 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
Oct 30 15:58:51 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: irq 201, io base 0x00001000
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb usb2: configuration #1 chosen from 1 choice
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 2-0:1.0: USB hub found
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 2-0:1.0: 2 ports detected
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: UHCI Host Controller
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: irq 225, io base 0x00001020
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb usb3: configuration #1 chosen from 1 choice
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 3-0:1.0: USB hub found
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 3-0:1.0: 2 ports detected
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: UHCI Host Controller
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: irq 217, io base 0x00001040
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb usb4: configuration #1 chosen from 1 choice
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 4-0:1.0: USB hub found
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 4-0:1.0: 2 ports detected
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: UHCI Host Controller
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: irq 225, io base 0x00001060
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb usb5: configuration #1 chosen from 1 choice
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 5-0:1.0: USB hub found
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 5-0:1.0: 2 ports detected
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: UHCI Host Controller
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: new USB bus registered, assigned bus number 6
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: port count misdetected? forcing to 2 ports
Oct 30 15:58:52 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: irq 217, io base 0x00003800
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb usb6: configuration #1 chosen from 1 choice
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 6-0:1.0: USB hub found
Oct 30 15:58:52 rhel-cluster-node2 kernel: hub 6-0:1.0: 2 ports detected
Oct 30 15:58:52 rhel-cluster-node2 kernel: SCSI subsystem initialized
Oct 30 15:58:52 rhel-cluster-node2 kernel: HP CISS Driver (v 3.6.20-RH4)
Oct 30 15:58:52 rhel-cluster-node2 kernel: cciss0: <0x323a> at PCI 0000:0c:00.0 IRQ 59 using DAC
Oct 30 15:58:52 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 15:58:52 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 15:58:52 rhel-cluster-node2 kernel:
Oct 30 15:58:52 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 15:58:52 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 15:58:52 rhel-cluster-node2 kernel:
Oct 30 15:58:52 rhel-cluster-node2 kernel:  cciss/c0d0: p1 p2
Oct 30 15:58:52 rhel-cluster-node2 kernel: QLogic Fibre Channel HBA Driver
Oct 30 15:58:52 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Found an ISP2432, irq 58, iobase 0xffffc20000014000
Oct 30 15:58:52 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configuring PCI space...
Oct 30 15:58:52 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configure NVRAM parameters...
Oct 30 15:58:52 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Verifying loaded RISC code...
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb 6-1: new full speed USB device using uhci_hcd and address 2
Oct 30 15:58:52 rhel-cluster-node2 kernel: usb 6-1: configuration #1 chosen from 1 choice
Oct 30 15:58:52 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input0
Oct 30 15:58:52 rhel-cluster-node2 kernel: input: USB HID v1.01 Keyboard [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 15:58:53 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input1
Oct 30 15:58:53 rhel-cluster-node2 kernel: input: USB HID v1.01 Mouse [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (64 KB) for EFT...
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (1413 KB) for firmware dump...
Oct 30 15:58:53 rhel-cluster-node2 kernel: scsi0 : qla2xxx
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0:
Oct 30 15:58:53 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 15:58:53 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 15:58:53 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.0 hdma+, host#=0, fw=4.04.09 (486)
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Found an ISP2432, irq 98, iobase 0xffffc2000017a000
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Configuring PCI space...
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Configure NVRAM parameters...
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Verifying loaded RISC code...
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Allocated (64 KB) for EFT...
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Allocated (1413 KB) for firmware dump...
Oct 30 15:58:53 rhel-cluster-node2 kernel: scsi1 : qla2xxx
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1:
Oct 30 15:58:53 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 15:58:53 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 15:58:53 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.1 hdma+, host#=1, fw=4.04.09 (486)
Oct 30 15:58:53 rhel-cluster-node2 kernel: Initializing USB Mass Storage driver...
Oct 30 15:58:53 rhel-cluster-node2 kernel: usbcore: registered new driver usb-storage
Oct 30 15:58:53 rhel-cluster-node2 kernel: USB Mass Storage support registered.
Oct 30 15:58:53 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: LOOP UP detected (4 Gbps).
Oct 30 15:58:53 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:58:53 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sda: 446653440 512-byte hdwr sectors (228687 MB)
Oct 30 15:58:53 rhel-cluster-node2 kernel: sda: Write Protect is off
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sda: drive cache: write back w/ FUA
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sda: 446653440 512-byte hdwr sectors (228687 MB)
Oct 30 15:58:53 rhel-cluster-node2 kernel: sda: Write Protect is off
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sda: drive cache: write back w/ FUA
Oct 30 15:58:53 rhel-cluster-node2 kernel:  sda: unknown partition table
Oct 30 15:58:53 rhel-cluster-node2 kernel: sd 0:0:0:0: Attached scsi disk sda
Oct 30 15:58:53 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:58:53 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sdb: 52008960 512-byte hdwr sectors (26629 MB)
Oct 30 15:58:53 rhel-cluster-node2 kernel: sdb: Write Protect is off
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sdb: drive cache: write back w/ FUA
Oct 30 15:58:53 rhel-cluster-node2 kernel: SCSI device sdb: 52008960 512-byte hdwr sectors (26629 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdb: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdb: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel:  sdb: unknown partition table
Oct 30 15:58:54 rhel-cluster-node2 kernel: sd 0:0:0:1: Attached scsi disk sdb
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdc: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdc: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdc: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdc: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdc: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdc: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel:  sdc: unknown partition table
Oct 30 15:58:54 rhel-cluster-node2 kernel: sd 0:0:0:2: Attached scsi disk sdc
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdd: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdd: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdd: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdd: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdd: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdd: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel:  sdd: unknown partition table
Oct 30 15:58:54 rhel-cluster-node2 kernel: sd 0:0:0:3: Attached scsi disk sdd
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sde: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sde: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sde: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sde: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sde: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sde: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel:  sde: unknown partition table
Oct 30 15:58:54 rhel-cluster-node2 kernel: sd 0:0:0:4: Attached scsi disk sde
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 15:58:54 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdf: 409600 512-byte hdwr sectors (210 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdf: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdf: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdf: 409600 512-byte hdwr sectors (210 MB)
Oct 30 15:58:54 rhel-cluster-node2 kernel: sdf: Write Protect is off
Oct 30 15:58:54 rhel-cluster-node2 kernel: SCSI device sdf: drive cache: write back w/ FUA
Oct 30 15:58:54 rhel-cluster-node2 kernel:  sdf: sdf1 sdf2
Oct 30 15:58:54 rhel-cluster-node2 kernel: sd 0:0:0:5: Attached scsi disk sdf
Oct 30 15:58:54 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: LOOP UP detected (4 Gbps).
Oct 30 15:58:55 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: SNS scan failed -- assuming zero-entry result...
Oct 30 15:58:55 rhel-cluster-node2 kernel: device-mapper: uevent: version 1.0.3
Oct 30 15:58:55 rhel-cluster-node2 kernel: device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@xxxxxxxxxx
Oct 30 15:58:55 rhel-cluster-node2 kernel: device-mapper: dm-raid45: initialized v0.2594l
Oct 30 15:58:55 rhel-cluster-node2 kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Oct 30 15:58:55 rhel-cluster-node2 kernel: EXT3-fs: write access will be enabled during recovery.
Oct 30 15:58:55 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:55 rhel-cluster-node2 kernel: EXT3-fs: recovery complete.
Oct 30 15:58:55 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:55 rhel-cluster-node2 kernel: SELinux:  Disabled at runtime.
Oct 30 15:58:55 rhel-cluster-node2 kernel: type=1404 audit(1288429085.676:2): selinux=0 auid=4294967295 ses=4294967295
Oct 30 15:58:55 rhel-cluster-node2 kernel: input: PC Speaker as /class/input/input2
Oct 30 15:58:55 rhel-cluster-node2 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Oct 30 15:58:55 rhel-cluster-node2 kernel: sd 0:0:0:1: Attached scsi generic sg1 type 0
Oct 30 15:58:55 rhel-cluster-node2 kernel: sd 0:0:0:2: Attached scsi generic sg2 type 0
Oct 30 15:58:55 rhel-cluster-node2 kernel: sd 0:0:0:3: Attached scsi generic sg3 type 0
Oct 30 15:58:55 rhel-cluster-node2 kernel: sd 0:0:0:4: Attached scsi generic sg4 type 0
Oct 30 15:58:55 rhel-cluster-node2 kernel: sd 0:0:0:5: Attached scsi generic sg5 type 0
Oct 30 15:58:55 rhel-cluster-node2 kernel: tg3.c:v3.106 (January 12, 2010)
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth0: Tigon3 [partno(N/A) rev 9003 PHY(5714)] (PCIX:133MHz:64-bit) 1000Base-SX Ethernet f4:ce:46:86:f6:06
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[0] TSOcap[1]
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth0: dma_rwctrl[76148000] dma_mask[40-bit]
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth1: Tigon3 [partno(N/A) rev 9003 PHY(5714)] (PCIX:133MHz:64-bit) 1000Base-SX Ethernet f4:ce:46:86:f6:07
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[0] TSOcap[1]
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth1: dma_rwctrl[76148000] dma_mask[40-bit]
Oct 30 15:58:55 rhel-cluster-node2 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
Oct 30 15:58:55 rhel-cluster-node2 kernel: Broadcom NetXtreme II 5771x 10Gigabit Ethernet Driver bnx2x 1.52.1-6 (2010/02/16)
Oct 30 15:58:55 rhel-cluster-node2 kernel: bnx2x: part number 412F4E-0-0-0
Oct 30 15:58:55 rhel-cluster-node2 kernel: bnx2x: Loading bnx2x-e1h-5.2.13.0.fw
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth2: Broadcom NetXtreme II BCM57711E XGb (A0) PCI-E x4 5GHz (Gen2) found at mem fb000000, IRQ 50, node addr d8d385590038
Oct 30 15:58:55 rhel-cluster-node2 kernel: bnx2x: part number 412F4E-0-0-0
Oct 30 15:58:55 rhel-cluster-node2 kernel: bnx2x: Loading bnx2x-e1h-5.2.13.0.fw
Oct 30 15:58:55 rhel-cluster-node2 kernel: eth3: Broadcom NetXtreme II BCM57711E XGb (A0) PCI-E x4 5GHz (Gen2) found at mem fa000000, IRQ 154, node addr d8d38559003c
Oct 30 15:58:55 rhel-cluster-node2 kernel: Floppy drive(s): fd0 is 1.44M
Oct 30 15:58:55 rhel-cluster-node2 kernel: floppy0: no floppy controllers found
Oct 30 15:58:55 rhel-cluster-node2 kernel: Floppy drive(s): fd0 is 1.44M
Oct 30 15:58:55 rhel-cluster-node2 kernel: floppy0: no floppy controllers found
Oct 30 15:58:55 rhel-cluster-node2 kernel: lp: driver loaded but no devices found
Oct 30 15:58:55 rhel-cluster-node2 kernel: md: Autodetecting RAID arrays.
Oct 30 15:58:55 rhel-cluster-node2 kernel: md: autorun ...
Oct 30 15:58:55 rhel-cluster-node2 kernel: md: ... autorun DONE.
Oct 30 15:58:55 rhel-cluster-node2 kernel: device-mapper: multipath: version 1.0.5 loaded
Oct 30 15:58:55 rhel-cluster-node2 kernel: EXT3 FS on dm-0, internal journal
Oct 30 15:58:55 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on dm-1, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on dm-2, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on dm-3, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on dm-4, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on dm-5, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on dm-6, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3 FS on cciss/c0d0p1, internal journal
Oct 30 15:58:56 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 15:58:56 rhel-cluster-node2 kernel: NET: Registered protocol family 10
Oct 30 15:58:56 rhel-cluster-node2 kernel: lo: Disabled Privacy Extensions
Oct 30 15:58:56 rhel-cluster-node2 kernel: IPv6 over IPv4 tunneling driver
Oct 30 15:58:56 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 15:58:56 rhel-cluster-node2 kernel: Adding 20479992k swap on /dev/VolGroup00/LogVol01.  Priority:-1 extents:1 across:20479992k
Oct 30 15:58:56 rhel-cluster-node2 kernel: IA-32 Microcode Update Driver: v1.14a <tigran@xxxxxxxxxxx>
Oct 30 15:58:56 rhel-cluster-node2 kernel: Loading iSCSI transport class v2.0-871.
Oct 30 15:58:56 rhel-cluster-node2 kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@xxxxxxxxxxxxxxx>
Oct 30 15:58:56 rhel-cluster-node2 kernel: All bugs added by David S. Miller <davem@xxxxxxxxxx>
Oct 30 15:58:56 rhel-cluster-node2 kernel: cxgb3i: tag itt 0x1fff, 13 bits, age 0xf, 4 bits.
Oct 30 15:58:56 rhel-cluster-node2 kernel: iscsi: registered transport (cxgb3i)
Oct 30 15:58:56 rhel-cluster-node2 kernel: Broadcom NetXtreme II CNIC Driver cnic v2.1.0 (Oct 10, 2009)
Oct 30 15:58:56 rhel-cluster-node2 kernel: cnic: Added CNIC device: eth2
Oct 30 15:58:56 rhel-cluster-node2 kernel: cnic: Added CNIC device: eth3
Oct 30 15:58:56 rhel-cluster-node2 kernel: Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.0 (Dec 06, 2009)
Oct 30 15:58:56 rhel-cluster-node2 kernel: iscsi: registered transport (bnx2i)
Oct 30 15:58:56 rhel-cluster-node2 kernel: scsi2 : Broadcom Offload iSCSI Initiator
Oct 30 15:58:56 rhel-cluster-node2 kernel: scsi3 : Broadcom Offload iSCSI Initiator
Oct 30 15:58:56 rhel-cluster-node2 kernel: iscsi: registered transport (tcp)
Oct 30 15:58:56 rhel-cluster-node2 kernel: iscsi: registered transport (iser)
Oct 30 15:58:56 rhel-cluster-node2 kernel: iscsi: registered transport (be2iscsi)
Oct 30 15:58:56 rhel-cluster-node2 kernel: bnx2x: eth2: using MSI-X  IRQs: sp 75  fp[0] 91 ... fp[7] 147
Oct 30 15:58:56 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_UP): eth2: link is not ready
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth2
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Down
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Down
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Up, 1000 Mbps full duplex
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth2
Oct 30 15:58:57 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth3: using MSI-X  IRQs: sp 155  fp[0] 171 ... fp[7] 227
Oct 30 15:58:57 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_UP): eth3: link is not ready
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth3
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Down
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Down
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Up, 1000 Mbps full duplex
Oct 30 15:58:57 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth3
Oct 30 15:58:57 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready
Oct 30 15:58:57 rhel-cluster-node2 kernel: DLM (built Mar 16 2010 21:53:04) installed
Oct 30 15:58:57 rhel-cluster-node2 kernel: GFS2 (built Mar 16 2010 21:53:24) installed
Oct 30 15:58:57 rhel-cluster-node2 kernel: Lock_DLM (built Mar 16 2010 21:53:29) installed
Oct 30 15:59:10 rhel-cluster-node2 qdiskd[3531]: <info> Node 1 is the master
Oct 30 15:59:35 rhel-cluster-node2 fenced[3545]: rhel-cluster-node1.mgmt.local not a cluster member after 3 sec post_join_delay
Oct 30 15:59:35 rhel-cluster-node2 fenced[3545]: fencing node "rhel-cluster-node1.mgmt.local"
Oct 30 15:59:49 rhel-cluster-node2 fenced[3545]: fence "rhel-cluster-node1.mgmt.local" success
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:admin"
Oct 30 15:59:49 rhel-cluster-node2 kernel: dlm: Using TCP for communications
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: Joined cluster. Now mounting FS...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0, already locked for use
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0: Looking at journal...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0: Done
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Trying to acquire journal lock...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Looking at journal...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Done
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Trying to acquire journal lock...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Looking at journal...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Done
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Trying to acquire journal lock...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Looking at journal...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Done
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Trying to acquire journal lock...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Looking at journal...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Done
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Trying to acquire journal lock...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Looking at journal...
Oct 30 15:59:49 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:1102"
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: Joined cluster. Now mounting FS...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0, already locked for use
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u04"
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: Joined cluster. Now mounting FS...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0, already locked for use
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Looking at journal...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Done
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Trying to acquire journal lock...
Oct 30 15:59:50 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Done
Oct 30 15:59:51 rhel-cluster-node2 pcscd: pcscdaemon.c:507:main() pcsc-lite 1.4.4 daemon ready.
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Done
Oct 30 15:59:51 rhel-cluster-node2 pcscd: hotplug_libusb.c:402:HPEstablishUSBNotifications() Driver ifd-egate.bundle does not support IFD_GENERATE_HOTPLUG. Using active polling instead.
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 pcscd: hotplug_libusb.c:411:HPEstablishUSBNotifications() Polling forced every 1 second(s)
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u05"
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: Joined cluster. Now mounting FS...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0, already locked for use
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Done
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Trying to acquire journal lock...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Looking at journal...
Oct 30 15:59:51 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u06"
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: Joined cluster. Now mounting FS...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0, already locked for use
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Done
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Done
Oct 30 15:59:52 rhel-cluster-node2 scsi_reserve: [error] cluster not configured for scsi reservations
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Trying to acquire journal lock...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Looking at journal...
Oct 30 15:59:52 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Done
Oct 30 15:59:53 rhel-cluster-node2 clvmd: Cluster LVM daemon started - connected to CMAN
Oct 30 15:59:55 rhel-cluster-node2 qdiskd[3531]: <info> Initial score 1/1
Oct 30 15:59:55 rhel-cluster-node2 qdiskd[3531]: <info> Initialization complete
Oct 30 15:59:55 rhel-cluster-node2 openais[3511]: [CMAN ] quorum device registered
Oct 30 15:59:55 rhel-cluster-node2 qdiskd[3531]: <notice> Score sufficient for master operation (1/1; required=1); upgrading
Oct 30 16:00:00 rhel-cluster-node2 kernel: Bluetooth: Core ver 2.10
Oct 30 16:00:00 rhel-cluster-node2 kernel: NET: Registered protocol family 31
Oct 30 16:00:00 rhel-cluster-node2 kernel: Bluetooth: HCI device and connection manager initialized
Oct 30 16:00:00 rhel-cluster-node2 kernel: Bluetooth: HCI socket layer initialized
Oct 30 16:00:00 rhel-cluster-node2 kernel: Bluetooth: L2CAP ver 2.8
Oct 30 16:00:00 rhel-cluster-node2 kernel: Bluetooth: L2CAP socket layer initialized
Oct 30 16:00:00 rhel-cluster-node2 kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Oct 30 16:00:00 rhel-cluster-node2 hidd[3943]: Bluetooth HID daemon
Oct 30 16:00:00 rhel-cluster-node2 kernel: i2c /dev entries driver
Oct 30 16:00:01 rhel-cluster-node2 automount[3997]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
Oct 30 16:00:01 rhel-cluster-node2 hpiod: 1.6.7 accepting connections at 2208...
Oct 30 16:00:02 rhel-cluster-node2 gpm[4065]: *** info [startup.c(95)]:
Oct 30 16:00:02 rhel-cluster-node2 gpm[4065]: Started gpm successfully. Entered daemon mode.
Oct 30 16:00:03 rhel-cluster-node2 xinetd[4056]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in.
Oct 30 16:00:03 rhel-cluster-node2 xinetd[4056]: Started working: 0 available services
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Successfully dropped root privileges.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: avahi-daemon 0.6.16 starting up.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Successfully called chroot().
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Successfully dropped remaining capabilities.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: No service found in /etc/avahi/services.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: New relevant interface eth3.IPv6 for mDNS.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Joining mDNS multicast group on interface eth3.IPv6 with address fe80::dad3:85ff:fe59:3c.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: New relevant interface eth3.IPv4 for mDNS.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Joining mDNS multicast group on interface eth3.IPv4 with address 1.1.1.2.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: New relevant interface eth2.IPv6 for mDNS.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Joining mDNS multicast group on interface eth2.IPv6 with address fe80::dad3:85ff:fe59:38.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: New relevant interface eth2.IPv4 for mDNS.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Joining mDNS multicast group on interface eth2.IPv4 with address 10.4.1.102.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Network interface enumeration completed.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Registering new address record for fe80::dad3:85ff:fe59:3c on eth3.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Registering new address record for 1.1.1.2 on eth3.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Registering new address record for fe80::dad3:85ff:fe59:38 on eth2.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Registering new address record for 10.4.1.102 on eth2.
Oct 30 16:00:03 rhel-cluster-node2 avahi-daemon[4150]: Registering HINFO record with values 'X86_64'/'LINUX'.
Oct 30 16:00:04 rhel-cluster-node2 avahi-daemon[4150]: Server startup complete. Host name is rhel-cluster-node2.local. Local service cookie is 3813901178.
Oct 30 16:00:05 rhel-cluster-node2 modclusterd: startup succeeded
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: smartd version 5.38 [x86_64-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Home page is http://smartmontools.sourceforge.net/
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Opened configuration file /etc/smartd.conf
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Problem creating device name scan list
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sda, opened
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sda, is SMART capable. Adding to "monitor" list.
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdb, opened
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdb, is SMART capable. Adding to "monitor" list.
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdc, opened
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdc, is SMART capable. Adding to "monitor" list.
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdd, opened
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdd, is SMART capable. Adding to "monitor" list.
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sde, opened
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sde, is SMART capable. Adding to "monitor" list.
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdf, opened
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Device: /dev/sdf, is SMART capable. Adding to "monitor" list.
Oct 30 16:00:06 rhel-cluster-node2 smartd[4261]: Monitoring 0 ATA and 6 SCSI devices
Oct 30 16:00:06 rhel-cluster-node2 smartd[4267]: smartd has fork()ed into background mode. New PID=4267.
Oct 30 16:00:06 rhel-cluster-node2 clurgmgrd[4247]: <notice> Resource Group Manager Starting
Oct 30 16:00:08 rhel-cluster-node2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
Oct 30 16:00:08 rhel-cluster-node2 last message repeated 3 times
Oct 30 16:00:09 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 16:00:13 rhel-cluster-node2 clurgmgrd[4247]: <notice> Starting stopped service service:IP_Virtual
Oct 30 16:00:16 rhel-cluster-node2 avahi-daemon[4150]: Registering new address record for 10.4.1.103 on eth2.
Oct 30 16:00:17 rhel-cluster-node2 clurgmgrd[4247]: <notice> Service service:IP_Virtual started
Oct 30 16:01:22 rhel-cluster-node2 qdiskd[3531]: <info> Assuming master role
Oct 30 16:01:25 rhel-cluster-node2 qdiskd[3531]: <notice> Writing eviction notice for node 1
Oct 30 16:01:28 rhel-cluster-node2 qdiskd[3531]: <notice> Node 1 evicted
Oct 30 16:03:05 rhel-cluster-node2 openais[3511]: [TOTEM] entering GATHER state from 11.
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] entering GATHER state from 0.
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] Creating commit token because I am the rep.
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] Saving state aru 43 high seq received 43
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] Storing new sequence id for ring 608
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] entering COMMIT state.
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] entering RECOVERY state.
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] previous ring seq 1536 rep 10.4.1.102
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] aru 43 high delivered 43 received flag 1
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [TOTEM] Sending initial ORF token
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ] New Configuration:
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ] Members Left:
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ] Members Joined:
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 16:03:25 rhel-cluster-node2 openais[3511]: [CLM  ] New Configuration:
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [CLM  ] Members Left:
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [CLM  ] Members Joined:
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [TOTEM] entering OPERATIONAL state.
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [CPG  ] got joinlist message from node 2
Oct 30 16:03:26 rhel-cluster-node2 openais[3511]: [TOTEM] entering GATHER state from 9.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering GATHER state from 0.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] Creating commit token because I am the rep.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] Saving state aru e high seq received e
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] Storing new sequence id for ring 60c
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering COMMIT state.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering RECOVERY state.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] previous ring seq 1544 rep 10.4.1.102
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] aru e high delivered e received flag 1
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] Sending initial ORF token
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] New Configuration:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] Members Left:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] Members Joined:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] New Configuration:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] Members Left:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] Members Joined:
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering OPERATIONAL state.
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [CPG  ] got joinlist message from node 2
Oct 30 16:03:46 rhel-cluster-node2 openais[3511]: [TOTEM] entering GATHER state from 9.
Oct 30 16:07:21 rhel-cluster-node2 syslogd 1.4.1: restart.
Oct 30 16:07:21 rhel-cluster-node2 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Oct 30 16:07:21 rhel-cluster-node2 kernel: Linux version 2.6.18-194.el5 (mockbuild@xxxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Tue Mar 16 21:52:39 EDT 2010
Oct 30 16:07:21 rhel-cluster-node2 kernel: Command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet acpi=off
Oct 30 16:07:21 rhel-cluster-node2 kernel: BIOS-provided physical RAM map:
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 0000000000010000 - 000000000009f400 (usable)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 0000000000100000 - 00000000df62f000 (usable)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df62f000 - 00000000df63c000 (ACPI data)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df63c000 - 00000000df63d000 (usable)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 00000000df63d000 - 00000000e4000000 (reserved)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 00000000fec00000 - 00000000fee10000 (reserved)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 00000000ff800000 - 0000000100000000 (reserved)
Oct 30 16:07:21 rhel-cluster-node2 kernel:  BIOS-e820: 0000000100000000 - 000000061ffff000 (usable)
Oct 30 16:07:21 rhel-cluster-node2 kernel: DMI 2.6 present.
Oct 30 16:07:21 rhel-cluster-node2 kernel: No NUMA configuration found
Oct 30 16:07:22 rhel-cluster-node2 kernel: Faking a node at 0000000000000000-000000061ffff000
Oct 30 16:07:22 rhel-cluster-node2 kernel: Bootmem setup node 0 0000000000000000-000000061ffff000
Oct 30 16:07:22 rhel-cluster-node2 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Oct 30 16:07:22 rhel-cluster-node2 kernel: disabling kdump
Oct 30 16:07:22 rhel-cluster-node2 kernel: Intel MultiProcessor Specification v1.4
Oct 30 16:07:22 rhel-cluster-node2 kernel:     Virtual Wire compatibility mode.
Oct 30 16:07:22 rhel-cluster-node2 kernel: OEM ID: HP       Product ID: PROLIANT     APIC at: 0xFEE00000
Oct 30 16:07:22 rhel-cluster-node2 rpc.statd[3392]: Version 1.0.9 Starting
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #16 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #0 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #2 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 rpc.statd[3392]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #4 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #6 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #18 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #20 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processor #22 6:10 APIC version 20
Oct 30 16:07:22 rhel-cluster-node2 kernel: I/O APIC #8 Version 32 at 0xFEC00000.
Oct 30 16:07:22 rhel-cluster-node2 kernel: I/O APIC #0 Version 32 at 0xFEC80000.
Oct 30 16:07:22 rhel-cluster-node2 kernel: Setting APIC routing to clustered
Oct 30 16:07:22 rhel-cluster-node2 kernel: Processors: 8
Oct 30 16:07:22 rhel-cluster-node2 kernel: Nosave address range: 000000000009f000 - 00000000000a0000
Oct 30 16:07:22 rhel-cluster-node2 kernel: Nosave address range: 00000000000a0000 - 00000000000f0000
Oct 30 16:07:22 rhel-cluster-node2 kernel: Nosave address range: 00000000000f0000 - 0000000000100000
Oct 30 16:07:22 rhel-cluster-node2 kernel: Nosave address range: 00000000df62f000 - 00000000df63c000
Oct 30 16:07:22 rhel-cluster-node2 kernel: Nosave address range: 00000000df63d000 - 00000000e4000000
Oct 30 16:07:22 rhel-cluster-node2 ccsd[3504]: Starting ccsd 2.0.115:
Oct 30 16:07:22 rhel-cluster-node2 kernel: Nosave address range: 00000000e4000000 - 00000000fec00000
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Built: Mar 16 2010 10:28:57
Oct 30 16:07:23 rhel-cluster-node2 kernel: Nosave address range: 00000000fec00000 - 00000000fee10000
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Copyright (C) Red Hat, Inc.  2004  All rights reserved.
Oct 30 16:07:23 rhel-cluster-node2 kernel: Nosave address range: 00000000fee10000 - 00000000ff800000
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]: cluster.conf (cluster name = PORTAL_WORLD, version = 32) found.
Oct 30 16:07:23 rhel-cluster-node2 kernel: Nosave address range: 00000000ff800000 - 0000000100000000
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]: Remote copy of cluster.conf is from quorate node.
Oct 30 16:07:23 rhel-cluster-node2 kernel: Allocating PCI resources starting at e6000000 (gap: e4000000:1ac00000)
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Local version # : 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: SMP: Allowing 8 CPUs, 0 hotplug CPUs
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Remote version #: 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: Built 1 zonelists.  Total pages: 6199701
Oct 30 16:07:23 rhel-cluster-node2 kernel: Kernel command line: ro root=/dev/VolGroup00/LogVol00 rhgb quiet acpi=off
Oct 30 16:07:23 rhel-cluster-node2 kernel: Initializing CPU#0
Oct 30 16:07:23 rhel-cluster-node2 kernel: PID hash table entries: 4096 (order: 12, 32768 bytes)
Oct 30 16:07:23 rhel-cluster-node2 kernel: Console: colour VGA+ 80x25
Oct 30 16:07:23 rhel-cluster-node2 kernel: Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Oct 30 16:07:23 rhel-cluster-node2 kernel: Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Oct 30 16:07:23 rhel-cluster-node2 kernel: Checking aperture...
Oct 30 16:07:23 rhel-cluster-node2 kernel: ACPI: DMAR not present
Oct 30 16:07:23 rhel-cluster-node2 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Oct 30 16:07:23 rhel-cluster-node2 kernel: Placing software IO TLB between 0x405e000 - 0x805e000
Oct 30 16:07:23 rhel-cluster-node2 kernel: Memory: 24679172k/25690108k available (2577k kernel code, 476148k reserved, 1305k data, 212k init)
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]: Remote copy of cluster.conf is from quorate node.
Oct 30 16:07:23 rhel-cluster-node2 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 5867.08 BogoMIPS (lpj=2933544)
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Local version # : 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: Security Framework v1.0.0 initialized
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Remote version #: 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: SELinux:  Initializing.
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]: Remote copy of cluster.conf is from quorate node.
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Local version # : 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: selinux_register_security:  Registering secondary module capability
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Remote version #: 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: Capability LSM initialized as secondary
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]: Remote copy of cluster.conf is from quorate node.
Oct 30 16:07:23 rhel-cluster-node2 kernel: Mount-cache hash table entries: 256
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Local version # : 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:23 rhel-cluster-node2 ccsd[3504]:  Remote version #: 32
Oct 30 16:07:23 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [MAIN ] AIS Executive Service RELEASE 'subrev 1887 version 0.80.6'
Oct 30 16:07:24 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:24 rhel-cluster-node2 kernel: using mwait in idle threads.
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [MAIN ] Copyright (C) 2002-2006 MontaVista Software, Inc and contributors.
Oct 30 16:07:24 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [MAIN ] Copyright (C) 2006 Red Hat, Inc.
Oct 30 16:07:24 rhel-cluster-node2 kernel: CPU: Processor Core ID: 0
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [MAIN ] AIS Executive Service: started and ready to provide service.
Oct 30 16:07:24 rhel-cluster-node2 kernel: CPU0: Thermal monitoring enabled (TM1)
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [MAIN ] Using default multicast address of 239.192.253.106
Oct 30 16:07:24 rhel-cluster-node2 kernel: SMP alternatives: switching to UP code
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] Token Timeout (10000 ms) retransmit timeout (495 ms)
Oct 30 16:07:24 rhel-cluster-node2 kernel: ExtINT not setup in hardware but reported by MP table
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] token hold (386 ms) retransmits before loss (20 retrans)
Oct 30 16:07:24 rhel-cluster-node2 kernel: Using IO-APIC 8
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] join (60 ms) send_join (0 ms) consensus (20000 ms) merge (200 ms)
Oct 30 16:07:24 rhel-cluster-node2 kernel: Using IO-APIC 0
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] downcheck (1000 ms) fail to recv const (50 msgs)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 16 sharing vector 0xA9 and IRQ 16
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] seqno unchanged const (30 rotations) Maximum network MTU 1402
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 17 sharing vector 0xB1 and IRQ 17
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] window size per rotation (50 messages) maximum messages per rotation (17 messages)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 18 sharing vector 0xB9 and IRQ 18
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] send threads (0 threads)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 19 sharing vector 0xC1 and IRQ 19
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] RRP token expired timeout (495 ms)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 20 sharing vector 0xC9 and IRQ 20
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] RRP token problem counter (2000 ms)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 21 sharing vector 0xD1 and IRQ 21
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] RRP threshold (10 problem count)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 22 sharing vector 0xD9 and IRQ 22
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] RRP mode set to none.
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 23 sharing vector 0xE1 and IRQ 23
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] heartbeat_failures_allowed (0)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 24 sharing vector 0xE9 and IRQ 24
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] max_network_delay (50 ms)
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 28 sharing vector 0x32 and IRQ 28
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] HeartBeat is Disabled. To enable set heartbeat_failures_allowed > 0
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 30 sharing vector 0x3A and IRQ 30
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] Receive multicast socket recv buffer size (262142 bytes).
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 32 sharing vector 0x42 and IRQ 32
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] Transmit multicast socket send buffer size (262142 bytes).
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 34 sharing vector 0x4A and IRQ 34
Oct 30 16:07:24 rhel-cluster-node2 openais[3514]: [TOTEM] The network interface [10.4.1.102] is now up.
Oct 30 16:07:24 rhel-cluster-node2 kernel: GSI 35 sharing vector 0x52 and IRQ 35
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [TOTEM] Created or loaded sequence id 1548.10.4.1.102 for this ring.
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 36 sharing vector 0x5A and IRQ 36
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [TOTEM] entering GATHER state from 15.
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 37 sharing vector 0x62 and IRQ 37
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [CMAN ] CMAN 2.0.115 (built Mar 16 2010 10:29:01) started
Oct 30 16:07:25 rhel-cluster-node2 ccsd[3504]: Initial status:: Quorate
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 38 sharing vector 0x6A and IRQ 38
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [MAIN ] Service initialized 'openais CMAN membership service 2.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 39 sharing vector 0x72 and IRQ 39
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais extended virtual synchrony service'
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 40 sharing vector 0x7A and IRQ 40
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais cluster membership service B.01.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 41 sharing vector 0x82 and IRQ 41
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais availability management framework B.01.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 42 sharing vector 0x8A and IRQ 42
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais checkpoint service B.01.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 45 sharing vector 0x92 and IRQ 45
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais event service B.01.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: GSI 47 sharing vector 0x9A and IRQ 47
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais distributed locking service B.01.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: Using local APIC timer interrupts.
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais message service B.01.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: Detected 8.333 MHz APIC timer.
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais configuration service'
Oct 30 16:07:25 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais cluster closed process group service v1.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: Booting processor 1/8 APIC 0x0
Oct 30 16:07:25 rhel-cluster-node2 qdiskd[3532]: <info> Quorum Partition: /dev/disk/by-id/scsi-3600a0b800017387c000019664cb37790-part1 Label: quorum_disk1
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SERV ] Service initialized 'openais cluster config database access v1.01'
Oct 30 16:07:25 rhel-cluster-node2 kernel: Initializing CPU#1
Oct 30 16:07:25 rhel-cluster-node2 qdiskd[3533]: <info> Quorum Daemon Initializing
Oct 30 16:07:25 rhel-cluster-node2 openais[3514]: [SYNC ] Not using a virtual synchrony filter.
Oct 30 16:07:26 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.10 BogoMIPS (lpj=2933053)
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] Creating commit token because I am the rep.
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] Saving state aru 0 high seq received 0
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] Storing new sequence id for ring 610
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] entering COMMIT state.
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] entering RECOVERY state.
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: Processor Core ID: 0
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] position [0] member 10.4.1.102:
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU1: Thermal monitoring enabled (TM1)
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] previous ring seq 1548 rep 10.4.1.102
Oct 30 16:07:26 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] aru 0 high delivered 0 received flag 1
Oct 30 16:07:26 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] Did not need to originate any messages in recovery.
Oct 30 16:07:26 rhel-cluster-node2 kernel: Booting processor 2/8 APIC 0x2
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [TOTEM] Sending initial ORF token
Oct 30 16:07:26 rhel-cluster-node2 kernel: Initializing CPU#2
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 16:07:26 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5865.95 BogoMIPS (lpj=2932978)
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [CLM  ] New Configuration:
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [CLM  ] Members Left:
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [CLM  ] Members Joined:
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:26 rhel-cluster-node2 openais[3514]: [CLM  ] CLM CONFIGURATION CHANGE
Oct 30 16:07:26 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CLM  ] New Configuration:
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: Processor Core ID: 1
Oct 30 16:07:27 rhel-cluster-node2 qdiskd[3533]: <info> Heuristic: 'ping 10.4.0.1 -c1 -t1' UP
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU2: Thermal monitoring enabled (TM1)
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CLM  ] Members Left:
Oct 30 16:07:27 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CLM  ] Members Joined:
Oct 30 16:07:27 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CLM  ]       r(0) ip(10.4.1.102)
Oct 30 16:07:27 rhel-cluster-node2 kernel: Booting processor 3/8 APIC 0x4
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [SYNC ] This node is within the primary component and will provide service.
Oct 30 16:07:27 rhel-cluster-node2 kernel: Initializing CPU#3
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [TOTEM] entering OPERATIONAL state.
Oct 30 16:07:27 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.07 BogoMIPS (lpj=2933039)
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CMAN ] quorum regained, resuming activity
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:27 rhel-cluster-node2 openais[3514]: [CLM  ] got nodejoin message 10.4.1.102
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: Processor Core ID: 2
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU3: Thermal monitoring enabled (TM1)
Oct 30 16:07:27 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:27 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:27 rhel-cluster-node2 kernel: Booting processor 4/8 APIC 0x6
Oct 30 16:07:27 rhel-cluster-node2 kernel: Initializing CPU#4
Oct 30 16:07:27 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.07 BogoMIPS (lpj=2933036)
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 0
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU: Processor Core ID: 3
Oct 30 16:07:27 rhel-cluster-node2 kernel: CPU4: Thermal monitoring enabled (TM1)
Oct 30 16:07:27 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:27 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:28 rhel-cluster-node2 kernel: Booting processor 5/8 APIC 0x12
Oct 30 16:07:28 rhel-cluster-node2 kernel: Initializing CPU#5
Oct 30 16:07:28 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.18 BogoMIPS (lpj=2933091)
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: Processor Core ID: 1
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU5: Thermal monitoring enabled (TM1)
Oct 30 16:07:28 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:28 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:28 rhel-cluster-node2 kernel: Booting processor 6/8 APIC 0x14
Oct 30 16:07:28 rhel-cluster-node2 kernel: Initializing CPU#6
Oct 30 16:07:28 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.15 BogoMIPS (lpj=2933079)
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: Processor Core ID: 2
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU6: Thermal monitoring enabled (TM1)
Oct 30 16:07:28 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:28 rhel-cluster-node2 kernel: SMP alternatives: switching to SMP code
Oct 30 16:07:28 rhel-cluster-node2 kernel: Booting processor 7/8 APIC 0x16
Oct 30 16:07:28 rhel-cluster-node2 kernel: Initializing CPU#7
Oct 30 16:07:28 rhel-cluster-node2 kernel: Calibrating delay using timer specific routine.. 5866.06 BogoMIPS (lpj=2933034)
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L2 cache: 256K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: L3 cache: 8192K
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: Physical Processor ID: 1
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU: Processor Core ID: 3
Oct 30 16:07:28 rhel-cluster-node2 kernel: CPU7: Thermal monitoring enabled (TM1)
Oct 30 16:07:28 rhel-cluster-node2 kernel: Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz stepping 05
Oct 30 16:07:28 rhel-cluster-node2 kernel: Brought up 8 CPUs
Oct 30 16:07:28 rhel-cluster-node2 kernel: testing NMI watchdog ... OK.
Oct 30 16:07:28 rhel-cluster-node2 kernel: time.c: Using 1.193182 MHz WALL PIT GTOD PIT/TSC timer.
Oct 30 16:07:28 rhel-cluster-node2 kernel: time.c: Detected 2933.544 MHz processor.
Oct 30 16:07:29 rhel-cluster-node2 kernel: migration_cost=37,1631
Oct 30 16:07:29 rhel-cluster-node2 kernel: checking if image is initramfs... it is
Oct 30 16:07:29 rhel-cluster-node2 kernel: Freeing initrd memory: 3835k freed
Oct 30 16:07:29 rhel-cluster-node2 kernel: NET: Registered protocol family 16
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: Using configuration type 1
Oct 30 16:07:29 rhel-cluster-node2 kernel: ACPI: Interpreter disabled.
Oct 30 16:07:29 rhel-cluster-node2 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Oct 30 16:07:29 rhel-cluster-node2 kernel: pnp: PnP ACPI: disabled
Oct 30 16:07:29 rhel-cluster-node2 kernel: usbcore: registered new driver usbfs
Oct 30 16:07:29 rhel-cluster-node2 kernel: usbcore: registered new driver hub
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: Probing PCI hardware
Oct 30 16:07:29 rhel-cluster-node2 kernel: ACPI Error (tbget-0168): Invalid address flags 8 [20060707]
Oct 30 16:07:29 rhel-cluster-node2 last message repeated 43 times
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: Transparent bridge - 0000:00:1e.0
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1c.0[A] -> IRQ 169
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.0[A] -> IRQ 201
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.1[B] -> IRQ 225
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.2[C] -> IRQ 217
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.3[D] -> IRQ 225
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:00:1d.7[A] -> IRQ 201
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:02:00.0[A] -> IRQ 50
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:02:00.1[D] -> IRQ 154
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:06:00.0[A] -> IRQ 58
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:06:00.1[B] -> IRQ 98
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: using PPB 0000:09:00.0[A] to get irq 32
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0a:04.0[A] -> IRQ 66
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: using PPB 0000:09:00.0[B] to get irq 42
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0a:04.1[B] -> IRQ 138
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:0c:00.0[A] -> IRQ 169
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:03.0[A] -> IRQ 225
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.0[A] -> IRQ 209
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.2[B] -> IRQ 217
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.4[B] -> IRQ 217
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI->APIC IRQ transform: 0000:01:04.6[A] -> IRQ 209
Oct 30 16:07:29 rhel-cluster-node2 kernel: NetLabel: Initializing
Oct 30 16:07:29 rhel-cluster-node2 kernel: NetLabel:  domain hash size = 128
Oct 30 16:07:29 rhel-cluster-node2 kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Oct 30 16:07:29 rhel-cluster-node2 kernel: NetLabel:  unlabeled traffic allowed by default
Oct 30 16:07:29 rhel-cluster-node2 kernel: ACPI: DMAR not present
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI-GART: No AMD northbridge found.
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:01.0
Oct 30 16:07:29 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:29 rhel-cluster-node2 kernel:   MEM window: f3800000-fb7fffff
Oct 30 16:07:29 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6000000-0x00000000e60fffff
Oct 30 16:07:29 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:02.0
Oct 30 16:07:29 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:29 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:03.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:07.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: 4000-4fff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: fb900000-fb9fffff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6100000-0x00000000e61fffff
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:08.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:09:00.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: fba00000-fbafffff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6200000-0x00000000e62fffff
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:09.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: fba00000-fbafffff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6200000-0x00000000e62fffff
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:0a.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window: disabled.
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:1c.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: 5000-5fff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: fbb00000-fbffffff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e6300000-0x00000000e63fffff
Oct 30 16:07:30 rhel-cluster-node2 kernel: PCI: Bridge: 0000:00:1e.0
Oct 30 16:07:30 rhel-cluster-node2 kernel:   IO window: 2000-3fff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   MEM window: f3600000-f37fffff
Oct 30 16:07:30 rhel-cluster-node2 kernel:   PREFETCH window 0x00000000e8000000-0x00000000efffffff
Oct 30 16:07:31 rhel-cluster-node2 kernel: NET: Registered protocol family 2
Oct 30 16:07:31 rhel-cluster-node2 kernel: IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
Oct 30 16:07:31 rhel-cluster-node2 kernel: TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
Oct 30 16:07:31 rhel-cluster-node2 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Oct 30 16:07:31 rhel-cluster-node2 kernel: TCP: Hash tables configured (established 262144 bind 65536)
Oct 30 16:07:31 rhel-cluster-node2 kernel: TCP reno registered
Oct 30 16:07:31 rhel-cluster-node2 kernel: audit: initializing netlink socket (disabled)
Oct 30 16:07:31 rhel-cluster-node2 kernel: type=2000 audit(1288429570.613:1): initialized
Oct 30 16:07:31 rhel-cluster-node2 kernel: Total HugeTLB memory allocated, 0
Oct 30 16:07:31 rhel-cluster-node2 kernel: VFS: Disk quotas dquot_6.5.1
Oct 30 16:07:31 rhel-cluster-node2 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Oct 30 16:07:31 rhel-cluster-node2 kernel: Initializing Cryptographic API
Oct 30 16:07:31 rhel-cluster-node2 kernel: alg: No test for crc32c (crc32c-generic)
Oct 30 16:07:31 rhel-cluster-node2 kernel: ksign: Installing public key data
Oct 30 16:07:31 rhel-cluster-node2 kernel: Loading keyring
Oct 30 16:07:31 rhel-cluster-node2 kernel: - Added public key 78CCFEAA9428026A
Oct 30 16:07:31 rhel-cluster-node2 kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
Oct 30 16:07:31 rhel-cluster-node2 kernel: io scheduler noop registered
Oct 30 16:07:31 rhel-cluster-node2 kernel: io scheduler anticipatory registered
Oct 30 16:07:31 rhel-cluster-node2 kernel: io scheduler deadline registered
Oct 30 16:07:31 rhel-cluster-node2 kernel: io scheduler cfq registered (default)
Oct 30 16:07:31 rhel-cluster-node2 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Oct 30 16:07:31 rhel-cluster-node2 kernel: Real Time Clock Driver v1.12ac
Oct 30 16:07:31 rhel-cluster-node2 kernel: Non-volatile memory driver v1.2
Oct 30 16:07:31 rhel-cluster-node2 kernel: Linux agpgart interface v0.101 (c) Dave Jones
Oct 30 16:07:31 rhel-cluster-node2 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Oct 30 16:07:31 rhel-cluster-node2 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Oct 30 16:07:31 rhel-cluster-node2 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Oct 30 16:07:31 rhel-cluster-node2 kernel: brd: module loaded
Oct 30 16:07:31 rhel-cluster-node2 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Oct 30 16:07:31 rhel-cluster-node2 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Oct 30 16:07:31 rhel-cluster-node2 kernel: ide-floppy driver 0.99.newide
Oct 30 16:07:31 rhel-cluster-node2 kernel: usbcore: registered new driver hiddev
Oct 30 16:07:31 rhel-cluster-node2 kernel: usbcore: registered new driver usbhid
Oct 30 16:07:31 rhel-cluster-node2 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Oct 30 16:07:31 rhel-cluster-node2 kernel: PNP: No PS/2 controller found. Probing ports directly.
Oct 30 16:07:31 rhel-cluster-node2 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Oct 30 16:07:31 rhel-cluster-node2 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Oct 30 16:07:31 rhel-cluster-node2 kernel: mice: PS/2 mouse device common for all mice
Oct 30 16:07:31 rhel-cluster-node2 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Oct 30 16:07:31 rhel-cluster-node2 kernel: md: bitmap version 4.39
Oct 30 16:07:31 rhel-cluster-node2 kernel: TCP bic registered
Oct 30 16:07:31 rhel-cluster-node2 kernel: Initializing IPsec netlink socket
Oct 30 16:07:31 rhel-cluster-node2 kernel: NET: Registered protocol family 1
Oct 30 16:07:31 rhel-cluster-node2 kernel: NET: Registered protocol family 17
Oct 30 16:07:31 rhel-cluster-node2 kernel: Initalizing network drop monitor service
Oct 30 16:07:31 rhel-cluster-node2 kernel: Freeing unused kernel memory: 212k freed
Oct 30 16:07:31 rhel-cluster-node2 kernel: Write protecting the kernel read-only data: 504k
Oct 30 16:07:32 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: EHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
Oct 30 16:07:32 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: debug port 1
Oct 30 16:07:32 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: irq 201, io mem 0xf35f0000
Oct 30 16:07:32 rhel-cluster-node2 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb1: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 1-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 1-0:1.0: 8 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: USB Universal Host Controller Interface driver v3.0
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.0: irq 201, io base 0x00001000
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb2: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 2-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 2-0:1.0: 2 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.1: irq 225, io base 0x00001020
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb3: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 3-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 3-0:1.0: 2 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.2: irq 217, io base 0x00001040
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb4: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 4-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 4-0:1.0: 2 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: irq 225, io base 0x00001060
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb5: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 5-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 5-0:1.0: 2 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: new USB bus registered, assigned bus number 6
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: port count misdetected? forcing to 2 ports
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: irq 217, io base 0x00003800
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb6: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 6-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 6-0:1.0: 2 ports detected
Oct 30 16:07:33 rhel-cluster-node2 kernel: SCSI subsystem initialized
Oct 30 16:07:33 rhel-cluster-node2 kernel: HP CISS Driver (v 3.6.20-RH4)
Oct 30 16:07:33 rhel-cluster-node2 kernel: cciss0: <0x323a> at PCI 0000:0c:00.0 IRQ 59 using DAC
Oct 30 16:07:33 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 16:07:33 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 16:07:33 rhel-cluster-node2 kernel:
Oct 30 16:07:33 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 16:07:33 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 16:07:33 rhel-cluster-node2 kernel:
Oct 30 16:07:33 rhel-cluster-node2 kernel:  cciss/c0d0: p1 p2
Oct 30 16:07:33 rhel-cluster-node2 kernel: QLogic Fibre Channel HBA Driver
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Found an ISP2432, irq 58, iobase 0xffffc20000014000
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configuring PCI space...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configure NVRAM parameters...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Verifying loaded RISC code...
Oct 30 16:07:33 rhel-cluster-node2 kernel: usb 6-1: new full speed USB device using uhci_hcd and address 2
Oct 30 16:07:33 rhel-cluster-node2 kernel: usb 6-1: configuration #1 chosen from 1 choice
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input0
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: USB HID v1.01 Keyboard [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input1
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: USB HID v1.01 Mouse [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (64 KB) for EFT...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (1413 KB) for firmware dump...
Oct 30 16:07:33 rhel-cluster-node2 kernel: scsi0 : qla2xxx
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0:
Oct 30 16:07:33 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 16:07:33 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 16:07:33 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.0 hdma+, host#=0, fw=4.04.09 (486)
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 4-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 4-0:1.0: 2 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:00:1d.3: irq 225, io base 0x00001060
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb5: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 5-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 5-0:1.0: 2 ports detected
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: UHCI Host Controller
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: new USB bus registered, assigned bus number 6
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: port count misdetected? forcing to 2 ports
Oct 30 16:07:32 rhel-cluster-node2 kernel: uhci_hcd 0000:01:04.4: irq 217, io base 0x00003800
Oct 30 16:07:32 rhel-cluster-node2 kernel: usb usb6: configuration #1 chosen from 1 choice
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 6-0:1.0: USB hub found
Oct 30 16:07:32 rhel-cluster-node2 kernel: hub 6-0:1.0: 2 ports detected
Oct 30 16:07:33 rhel-cluster-node2 kernel: SCSI subsystem initialized
Oct 30 16:07:33 rhel-cluster-node2 kernel: HP CISS Driver (v 3.6.20-RH4)
Oct 30 16:07:33 rhel-cluster-node2 kernel: cciss0: <0x323a> at PCI 0000:0c:00.0 IRQ 59 using DAC
Oct 30 16:07:33 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 16:07:33 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 16:07:33 rhel-cluster-node2 kernel:
Oct 30 16:07:33 rhel-cluster-node2 kernel:       blocks= 286677120 block_size= 512
Oct 30 16:07:33 rhel-cluster-node2 kernel:       heads= 255, sectors= 32, cylinders= 35132
Oct 30 16:07:33 rhel-cluster-node2 kernel:
Oct 30 16:07:33 rhel-cluster-node2 kernel:  cciss/c0d0: p1 p2
Oct 30 16:07:33 rhel-cluster-node2 kernel: QLogic Fibre Channel HBA Driver
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Found an ISP2432, irq 58, iobase 0xffffc20000014000
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configuring PCI space...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Configure NVRAM parameters...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Verifying loaded RISC code...
Oct 30 16:07:33 rhel-cluster-node2 kernel: usb 6-1: new full speed USB device using uhci_hcd and address 2
Oct 30 16:07:33 rhel-cluster-node2 kernel: usb 6-1: configuration #1 chosen from 1 choice
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input0
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: USB HID v1.01 Keyboard [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: HP Virtual Keyboard as /class/input/input1
Oct 30 16:07:33 rhel-cluster-node2 kernel: input: USB HID v1.01 Mouse [HP Virtual Keyboard] on usb-0000:01:04.4-1
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (64 KB) for EFT...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: Allocated (1413 KB) for firmware dump...
Oct 30 16:07:33 rhel-cluster-node2 kernel: scsi0 : qla2xxx
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0:
Oct 30 16:07:33 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 16:07:33 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 16:07:33 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.0 hdma+, host#=0, fw=4.04.09 (486)
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Found an ISP2432, irq 98, iobase 0xffffc2000017a000
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Configuring PCI space...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Configure NVRAM parameters...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Verifying loaded RISC code...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Allocated (64 KB) for EFT...
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: Allocated (1413 KB) for firmware dump...
Oct 30 16:07:33 rhel-cluster-node2 kernel: scsi1 : qla2xxx
Oct 30 16:07:33 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1:
Oct 30 16:07:33 rhel-cluster-node2 kernel:  QLogic Fibre Channel HBA Driver: 8.03.01.04.05.05-k
Oct 30 16:07:33 rhel-cluster-node2 kernel:   QLogic QMH2462 - PCI-Express Dual Channel 4Gb Fibre Channel Mezzanine HBA
Oct 30 16:07:33 rhel-cluster-node2 kernel:   ISP2432: PCIe (2.5Gb/s x4) @ 0000:06:00.1 hdma+, host#=1, fw=4.04.09 (486)
Oct 30 16:07:33 rhel-cluster-node2 kernel: Initializing USB Mass Storage driver...
Oct 30 16:07:34 rhel-cluster-node2 kernel: usbcore: registered new driver usb-storage
Oct 30 16:07:34 rhel-cluster-node2 kernel: USB Mass Storage support registered.
Oct 30 16:07:34 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.0: LOOP UP detected (4 Gbps).
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sda: 446653440 512-byte hdwr sectors (228687 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sda: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sda: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sda: 446653440 512-byte hdwr sectors (228687 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sda: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sda: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel:  sda: unknown partition table
Oct 30 16:07:34 rhel-cluster-node2 kernel: sd 0:0:0:0: Attached scsi disk sda
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdb: 52008960 512-byte hdwr sectors (26629 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sdb: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdb: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdb: 52008960 512-byte hdwr sectors (26629 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sdb: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdb: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel:  sdb: unknown partition table
Oct 30 16:07:34 rhel-cluster-node2 kernel: sd 0:0:0:1: Attached scsi disk sdb
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdc: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sdc: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdc: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdc: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sdc: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdc: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel:  sdc: unknown partition table
Oct 30 16:07:34 rhel-cluster-node2 kernel: sd 0:0:0:2: Attached scsi disk sdc
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 16:07:34 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdd: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sdd: Write Protect is off
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdd: drive cache: write back w/ FUA
Oct 30 16:07:34 rhel-cluster-node2 kernel: SCSI device sdd: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 16:07:34 rhel-cluster-node2 kernel: sdd: Write Protect is off
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sdd: drive cache: write back w/ FUA
Oct 30 16:07:35 rhel-cluster-node2 kernel:  sdd: unknown partition table
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:3: Attached scsi disk sdd
Oct 30 16:07:35 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 16:07:35 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sde: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 16:07:35 rhel-cluster-node2 kernel: sde: Write Protect is off
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sde: drive cache: write back w/ FUA
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sde: 545259520 512-byte hdwr sectors (279173 MB)
Oct 30 16:07:35 rhel-cluster-node2 kernel: sde: Write Protect is off
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sde: drive cache: write back w/ FUA
Oct 30 16:07:35 rhel-cluster-node2 kernel:  sde: unknown partition table
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:4: Attached scsi disk sde
Oct 30 16:07:35 rhel-cluster-node2 kernel:   Vendor: IBM       Model: 1742-900          Rev: 0914
Oct 30 16:07:35 rhel-cluster-node2 kernel:   Type:   Direct-Access                      ANSI SCSI revision: 05
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sdf: 409600 512-byte hdwr sectors (210 MB)
Oct 30 16:07:35 rhel-cluster-node2 kernel: sdf: Write Protect is off
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sdf: drive cache: write back w/ FUA
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sdf: 409600 512-byte hdwr sectors (210 MB)
Oct 30 16:07:35 rhel-cluster-node2 kernel: sdf: Write Protect is off
Oct 30 16:07:35 rhel-cluster-node2 kernel: SCSI device sdf: drive cache: write back w/ FUA
Oct 30 16:07:35 rhel-cluster-node2 kernel:  sdf: sdf1 sdf2
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:5: Attached scsi disk sdf
Oct 30 16:07:35 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: LOOP UP detected (4 Gbps).
Oct 30 16:07:35 rhel-cluster-node2 kernel: qla2xxx 0000:06:00.1: SNS scan failed -- assuming zero-entry result...
Oct 30 16:07:35 rhel-cluster-node2 kernel: device-mapper: uevent: version 1.0.3
Oct 30 16:07:35 rhel-cluster-node2 kernel: device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@xxxxxxxxxx
Oct 30 16:07:35 rhel-cluster-node2 kernel: device-mapper: dm-raid45: initialized v0.2594l
Oct 30 16:07:35 rhel-cluster-node2 kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Oct 30 16:07:35 rhel-cluster-node2 kernel: EXT3-fs: write access will be enabled during recovery.
Oct 30 16:07:35 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:35 rhel-cluster-node2 kernel: EXT3-fs: recovery complete.
Oct 30 16:07:35 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:35 rhel-cluster-node2 kernel: SELinux:  Disabled at runtime.
Oct 30 16:07:35 rhel-cluster-node2 kernel: type=1404 audit(1288429602.681:2): selinux=0 auid=4294967295 ses=4294967295
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:1: Attached scsi generic sg1 type 0
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:2: Attached scsi generic sg2 type 0
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:3: Attached scsi generic sg3 type 0
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:4: Attached scsi generic sg4 type 0
Oct 30 16:07:35 rhel-cluster-node2 kernel: sd 0:0:0:5: Attached scsi generic sg5 type 0
Oct 30 16:07:35 rhel-cluster-node2 kernel: input: PC Speaker as /class/input/input2
Oct 30 16:07:36 rhel-cluster-node2 kernel: Broadcom NetXtreme II 5771x 10Gigabit Ethernet Driver bnx2x 1.52.1-6 (2010/02/16)
Oct 30 16:07:36 rhel-cluster-node2 kernel: bnx2x: part number 412F4E-0-0-0
Oct 30 16:07:36 rhel-cluster-node2 kernel: bnx2x: Loading bnx2x-e1h-5.2.13.0.fw
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth0: Broadcom NetXtreme II BCM57711E XGb (A0) PCI-E x4 5GHz (Gen2) found at mem fb000000, IRQ 50, node addr d8d385590038
Oct 30 16:07:36 rhel-cluster-node2 kernel: bnx2x: part number 412F4E-0-0-0
Oct 30 16:07:36 rhel-cluster-node2 kernel: bnx2x: Loading bnx2x-e1h-5.2.13.0.fw
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth1: Broadcom NetXtreme II BCM57711E XGb (A0) PCI-E x4 5GHz (Gen2) found at mem fa000000, IRQ 154, node addr d8d38559003c
Oct 30 16:07:36 rhel-cluster-node2 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
Oct 30 16:07:36 rhel-cluster-node2 kernel: Floppy drive(s): fd0 is 1.44M
Oct 30 16:07:36 rhel-cluster-node2 kernel: tg3.c:v3.106 (January 12, 2010)
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth2: Tigon3 [partno(N/A) rev 9003 PHY(5714)] (PCIX:133MHz:64-bit) 1000Base-SX Ethernet f4:ce:46:86:f6:06
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[0] TSOcap[1]
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth2: dma_rwctrl[76148000] dma_mask[40-bit]
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth3: Tigon3 [partno(N/A) rev 9003 PHY(5714)] (PCIX:133MHz:64-bit) 1000Base-SX Ethernet f4:ce:46:86:f6:07
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[0] TSOcap[1]
Oct 30 16:07:36 rhel-cluster-node2 kernel: eth3: dma_rwctrl[76148000] dma_mask[40-bit]
Oct 30 16:07:36 rhel-cluster-node2 kernel: floppy0: no floppy controllers found
Oct 30 16:07:36 rhel-cluster-node2 kernel: Floppy drive(s): fd0 is 1.44M
Oct 30 16:07:36 rhel-cluster-node2 kernel: floppy0: no floppy controllers found
Oct 30 16:07:36 rhel-cluster-node2 kernel: lp: driver loaded but no devices found
Oct 30 16:07:36 rhel-cluster-node2 kernel: md: Autodetecting RAID arrays.
Oct 30 16:07:36 rhel-cluster-node2 kernel: md: autorun ...
Oct 30 16:07:36 rhel-cluster-node2 kernel: md: ... autorun DONE.
Oct 30 16:07:36 rhel-cluster-node2 kernel: device-mapper: multipath: version 1.0.5 loaded
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-0, internal journal
Oct 30 16:07:36 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-1, internal journal
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:36 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-2, internal journal
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:36 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-3, internal journal
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:36 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-4, internal journal
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:36 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-5, internal journal
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:36 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:36 rhel-cluster-node2 kernel: EXT3 FS on dm-6, internal journal
Oct 30 16:07:37 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:37 rhel-cluster-node2 kernel: kjournald starting.  Commit interval 5 seconds
Oct 30 16:07:37 rhel-cluster-node2 kernel: EXT3 FS on cciss/c0d0p1, internal journal
Oct 30 16:07:37 rhel-cluster-node2 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Oct 30 16:07:37 rhel-cluster-node2 kernel: NET: Registered protocol family 10
Oct 30 16:07:37 rhel-cluster-node2 kernel: lo: Disabled Privacy Extensions
Oct 30 16:07:37 rhel-cluster-node2 kernel: IPv6 over IPv4 tunneling driver
Oct 30 16:07:37 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 16:07:37 rhel-cluster-node2 kernel: Adding 20479992k swap on /dev/VolGroup00/LogVol01.  Priority:-1 extents:1 across:20479992k
Oct 30 16:07:37 rhel-cluster-node2 kernel: IA-32 Microcode Update Driver: v1.14a <tigran@xxxxxxxxxxx>
Oct 30 16:07:37 rhel-cluster-node2 kernel: Loading iSCSI transport class v2.0-871.
Oct 30 16:07:37 rhel-cluster-node2 kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@xxxxxxxxxxxxxxx>
Oct 30 16:07:37 rhel-cluster-node2 kernel: All bugs added by David S. Miller <davem@xxxxxxxxxx>
Oct 30 16:07:37 rhel-cluster-node2 kernel: cxgb3i: tag itt 0x1fff, 13 bits, age 0xf, 4 bits.
Oct 30 16:07:37 rhel-cluster-node2 kernel: iscsi: registered transport (cxgb3i)
Oct 30 16:07:37 rhel-cluster-node2 kernel: Broadcom NetXtreme II CNIC Driver cnic v2.1.0 (Oct 10, 2009)
Oct 30 16:07:37 rhel-cluster-node2 kernel: cnic: Added CNIC device: eth2
Oct 30 16:07:37 rhel-cluster-node2 kernel: cnic: Added CNIC device: eth3
Oct 30 16:07:37 rhel-cluster-node2 kernel: Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.0 (Dec 06, 2009)
Oct 30 16:07:37 rhel-cluster-node2 kernel: iscsi: registered transport (bnx2i)
Oct 30 16:07:37 rhel-cluster-node2 kernel: scsi2 : Broadcom Offload iSCSI Initiator
Oct 30 16:07:37 rhel-cluster-node2 kernel: scsi3 : Broadcom Offload iSCSI Initiator
Oct 30 16:07:37 rhel-cluster-node2 kernel: iscsi: registered transport (tcp)
Oct 30 16:07:37 rhel-cluster-node2 kernel: iscsi: registered transport (iser)
Oct 30 16:07:37 rhel-cluster-node2 kernel: iscsi: registered transport (be2iscsi)
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth2: using MSI-X  IRQs: sp 75  fp[0] 91 ... fp[7] 147
Oct 30 16:07:37 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_UP): eth2: link is not ready
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth2
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Down
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Down
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth2 NIC Link is Up, 1000 Mbps full duplex
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth2
Oct 30 16:07:37 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth3: using MSI-X  IRQs: sp 155  fp[0] 171 ... fp[7] 227
Oct 30 16:07:37 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_UP): eth3: link is not ready
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth3
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Down
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Down
Oct 30 16:07:37 rhel-cluster-node2 kernel: bnx2x: eth3 NIC Link is Up, 1000 Mbps full duplex
Oct 30 16:07:38 rhel-cluster-node2 kernel: bnx2i: iSCSI not supported, dev=eth3
Oct 30 16:07:38 rhel-cluster-node2 kernel: ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready
Oct 30 16:07:38 rhel-cluster-node2 kernel: DLM (built Mar 16 2010 21:53:04) installed
Oct 30 16:07:38 rhel-cluster-node2 kernel: GFS2 (built Mar 16 2010 21:53:24) installed
Oct 30 16:07:38 rhel-cluster-node2 kernel: Lock_DLM (built Mar 16 2010 21:53:29) installed
Oct 30 16:07:50 rhel-cluster-node2 qdiskd[3533]: <info> Node 1 is the master
Oct 30 16:08:15 rhel-cluster-node2 fenced[3549]: rhel-cluster-node1.mgmt.local not a cluster member after 3 sec post_join_delay
Oct 30 16:08:15 rhel-cluster-node2 fenced[3549]: fencing node "rhel-cluster-node1.mgmt.local"
Oct 30 16:08:29 rhel-cluster-node2 fenced[3549]: fence "rhel-cluster-node1.mgmt.local" success
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:admin"
Oct 30 16:08:29 rhel-cluster-node2 kernel: dlm: Using TCP for communications
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: Joined cluster. Now mounting FS...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0, already locked for use
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0: Looking at journal...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=0: Done
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Trying to acquire journal lock...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Looking at journal...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=1: Done
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Trying to acquire journal lock...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Looking at journal...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=2: Done
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Trying to acquire journal lock...
Oct 30 16:08:29 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=3: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=4: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=5: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=6: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:admin.0: jid=7: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:1102"
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: Joined cluster. Now mounting FS...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0, already locked for use
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=0: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=1: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=2: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=3: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=4: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Looking at journal...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=5: Done
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Trying to acquire journal lock...
Oct 30 16:08:30 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=6: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:1102.0: jid=7: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u04"
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: Joined cluster. Now mounting FS...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0, already locked for use
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=0: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=1: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=2: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=3: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=4: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=5: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=6: Done
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Trying to acquire journal lock...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Looking at journal...
Oct 30 16:08:31 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u04.0: jid=7: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u05"
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: Joined cluster. Now mounting FS...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0, already locked for use
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=0: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=1: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=2: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=3: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=4: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=5: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=6: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u05.0: jid=7: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=: Trying to join cluster "lock_dlm", "PORTAL_WORLD:u06"
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: Joined cluster. Now mounting FS...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0, already locked for use
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0: Looking at journal...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=0: Done
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Trying to acquire journal lock...
Oct 30 16:08:32 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=1: Done
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Trying to acquire journal lock...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=2: Done
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Trying to acquire journal lock...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=3: Done
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Trying to acquire journal lock...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=4: Done
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Trying to acquire journal lock...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=5: Done
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Trying to acquire journal lock...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=6: Done
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Trying to acquire journal lock...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Looking at journal...
Oct 30 16:08:33 rhel-cluster-node2 kernel: GFS2: fsid=PORTAL_WORLD:u06.0: jid=7: Done
Oct 30 16:08:33 rhel-cluster-node2 pcscd: pcscdaemon.c:507:main() pcsc-lite 1.4.4 daemon ready.
Oct 30 16:08:33 rhel-cluster-node2 pcscd: hotplug_libusb.c:402:HPEstablishUSBNotifications() Driver ifd-egate.bundle does not support IFD_GENERATE_HOTPLUG. Using active polling instead.
Oct 30 16:08:33 rhel-cluster-node2 pcscd: hotplug_libusb.c:411:HPEstablishUSBNotifications() Polling forced every 1 second(s)
Oct 30 16:08:34 rhel-cluster-node2 scsi_reserve: [error] cluster not configured for scsi reservations
Oct 30 16:08:35 rhel-cluster-node2 qdiskd[3533]: <info> Initial score 1/1
Oct 30 16:08:35 rhel-cluster-node2 qdiskd[3533]: <info> Initialization complete
Oct 30 16:08:35 rhel-cluster-node2 openais[3514]: [CMAN ] quorum device registered
Oct 30 16:08:35 rhel-cluster-node2 qdiskd[3533]: <notice> Score sufficient for master operation (1/1; required=1); upgrading
Oct 30 16:08:35 rhel-cluster-node2 clvmd: Cluster LVM daemon started - connected to CMAN
Oct 30 16:08:41 rhel-cluster-node2 kernel: Bluetooth: Core ver 2.10
Oct 30 16:08:41 rhel-cluster-node2 kernel: NET: Registered protocol family 31
Oct 30 16:08:41 rhel-cluster-node2 kernel: Bluetooth: HCI device and connection manager initialized
Oct 30 16:08:41 rhel-cluster-node2 kernel: Bluetooth: HCI socket layer initialized
Oct 30 16:08:41 rhel-cluster-node2 kernel: Bluetooth: L2CAP ver 2.8
Oct 30 16:08:41 rhel-cluster-node2 kernel: Bluetooth: L2CAP socket layer initialized
Oct 30 16:08:41 rhel-cluster-node2 kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Oct 30 16:08:41 rhel-cluster-node2 hidd[3945]: Bluetooth HID daemon
Oct 30 16:08:42 rhel-cluster-node2 kernel: i2c /dev entries driver
Oct 30 16:08:43 rhel-cluster-node2 automount[4000]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
Oct 30 16:08:43 rhel-cluster-node2 hpiod: 1.6.7 accepting connections at 2208...
Oct 30 16:08:44 rhel-cluster-node2 gpm[4068]: *** info [startup.c(95)]:
Oct 30 16:08:44 rhel-cluster-node2 gpm[4068]: Started gpm successfully. Entered daemon mode.
Oct 30 16:08:44 rhel-cluster-node2 xinetd[4059]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in.
Oct 30 16:08:44 rhel-cluster-node2 xinetd[4059]: Started working: 0 available services
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70).
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Successfully dropped root privileges.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: avahi-daemon 0.6.16 starting up.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Successfully called chroot().
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Successfully dropped remaining capabilities.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: No service found in /etc/avahi/services.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth3.IPv6 for mDNS.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth3.IPv6 with address fe80::dad3:85ff:fe59:3c.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth3.IPv4 for mDNS.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth3.IPv4 with address 1.1.1.2.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth2.IPv6 for mDNS.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth2.IPv6 with address fe80::dad3:85ff:fe59:38.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth2.IPv4 for mDNS.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth2.IPv4 with address 10.4.1.102.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Network interface enumeration completed.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for fe80::dad3:85ff:fe59:3c on eth3.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for 1.1.1.2 on eth3.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for fe80::dad3:85ff:fe59:38 on eth2.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for 10.4.1.102 on eth2.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering HINFO record with values 'X86_64'/'LINUX'.
Oct 30 16:08:46 rhel-cluster-node2 avahi-daemon[4153]: Server startup complete. Host name is rhel-cluster-node2.local. Local service cookie is 475112272.
Oct 30 16:08:46 rhel-cluster-node2 modclusterd: startup succeeded
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: smartd version 5.38 [x86_64-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Home page is http://smartmontools.sourceforge.net/
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Opened configuration file /etc/smartd.conf
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Problem creating device name scan list
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sda, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sda, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdb, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdb, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdc, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdc, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdd, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdd, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sde, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sde, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdf, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdf, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Monitoring 0 ATA and 6 SCSI devices
Oct 30 16:08:47 rhel-cluster-node2 smartd[4270]: smartd has fork()ed into background mode. New PID=4270.
Oct 30 16:08:48 rhel-cluster-node2 clurgmgrd[4250]: <notice> Resource Group Manager Starting
Oct 30 16:08:49 rhel-cluster-node2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
Oct 30 16:08:49 rhel-cluster-node2 last message repeated 3 times
Oct 30 16:08:50 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 16:08:55 rhel-cluster-node2 clurgmgrd[4250]: <notice> Starting stopped service service:IP_Virtual
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth3.IPv4 for mDNS.
Oct 30 16:08:44 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth3.IPv4 with address 1.1.1.2.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth2.IPv6 for mDNS.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth2.IPv6 with address fe80::dad3:85ff:fe59:38.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: New relevant interface eth2.IPv4 for mDNS.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Joining mDNS multicast group on interface eth2.IPv4 with address 10.4.1.102.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Network interface enumeration completed.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for fe80::dad3:85ff:fe59:3c on eth3.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for 1.1.1.2 on eth3.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for fe80::dad3:85ff:fe59:38 on eth2.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for 10.4.1.102 on eth2.
Oct 30 16:08:45 rhel-cluster-node2 avahi-daemon[4153]: Registering HINFO record with values 'X86_64'/'LINUX'.
Oct 30 16:08:46 rhel-cluster-node2 avahi-daemon[4153]: Server startup complete. Host name is rhel-cluster-node2.local. Local service cookie is 475112272.
Oct 30 16:08:46 rhel-cluster-node2 modclusterd: startup succeeded
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: smartd version 5.38 [x86_64-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Home page is http://smartmontools.sourceforge.net/
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Opened configuration file /etc/smartd.conf
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Problem creating device name scan list
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sda, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sda, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdb, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdb, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdc, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdc, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdd, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdd, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sde, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sde, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdf, opened
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Device: /dev/sdf, is SMART capable. Adding to "monitor" list.
Oct 30 16:08:47 rhel-cluster-node2 smartd[4264]: Monitoring 0 ATA and 6 SCSI devices
Oct 30 16:08:47 rhel-cluster-node2 smartd[4270]: smartd has fork()ed into background mode. New PID=4270.
Oct 30 16:08:48 rhel-cluster-node2 clurgmgrd[4250]: <notice> Resource Group Manager Starting
Oct 30 16:08:49 rhel-cluster-node2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
Oct 30 16:08:49 rhel-cluster-node2 last message repeated 3 times
Oct 30 16:08:50 rhel-cluster-node2 kernel: mtrr: type mismatch for e8000000,4000000 old: uncachable new: write-combining
Oct 30 16:08:55 rhel-cluster-node2 clurgmgrd[4250]: <notice> Starting stopped service service:IP_Virtual
Oct 30 16:08:57 rhel-cluster-node2 avahi-daemon[4153]: Registering new address record for 10.4.1.103 on eth2.
Oct 30 16:08:58 rhel-cluster-node2 clurgmgrd[4250]: <notice> Service service:IP_Virtual started
Oct 30 16:10:02 rhel-cluster-node2 qdiskd[3533]: <info> Assuming master role
Oct 30 16:10:05 rhel-cluster-node2 qdiskd[3533]: <notice> Writing eviction notice for node 1
Oct 30 16:10:08 rhel-cluster-node2 qdiskd[3533]: <notice> Node 1 evicted
--
Linux-cluster mailing list
Linux-cluster@xxxxxxxxxx
https://www.redhat.com/mailman/listinfo/linux-cluster