I am trying to set up GFS on a 2 node cluster running Fedora core 3.
The GFS kernel module is generating this error: "FATAL: Error inserting
gfs (/lib/modules/2.6.9/kernel/fs/gfs/gfs.ko): Unknown symbol in
module, or unknown parameter (see dmesg)". I am also getting a "gfs:
no version for "lm_mount" found: kernel tainted." and "gfs: Unknown
symbol panic_on_oops" errors in the logs. The lock_dlm, dlm, cman and
lock_harness modules do load, but the gfs module does not.
Any ideas?
The source code for the cluster, device-mapper and LVM2 were pulled from
the CVS server today (12/3/2004). I have tried the default kernel,
2.6.9-1.681_FC3 using the source code in the SRPM and I also tried a
copy of linux-2.6.9 from kernel.org.
I have included a copy of the 2.6.9 kernel dmesg, appropriate log
entries from /var/log/messages, the commands that I typed, and a copy of
the cluster.conf.
The logical volumes and GFS file systems were not created with this
version of GFS, but from a version of GFS that I set up almost 2 months
ago. I doubt that the logical volumes and file systems are part of
this problem because I never got to the point where I was loading clvmd.
Thanks for you help
Matthew B. Brookover
Colorado School of Mines
mbrookov@xxxxxxxxx
Commands:
[root@fouroften GFS-FEDORA-try2]# modprobe dm-mod
[root@fouroften GFS-FEDORA-try2]#./device-mapper/scripts/devmap_mknod.sh
Creating /dev/mapper/control character device with major:10 minor:63.
[root@fouroften GFS-FEDORA-try2]# modprobe gfs
FATAL: Error inserting gfs (/lib/modules/2.6.9/kernel/fs/gfs/gfs.ko):
Unknown symbol in module, or unknown parameter (see dmesg)
[root@fouroften GFS-FEDORA-try2]# modprobe lock_dlm
[root@fouroften GFS-FEDORA-try2]# dmesg > dmesg.out
[root@fouroften GFS-FEDORA-try2]# ccsd
[root@fouroften GFS-FEDORA-try2]# cman_tool join
cman_tool: local node name "fouroften" not found in cluster.conf
[root@fouroften GFS-FEDORA-try2]#
Logs:
Dec 3 14:56:02 fouroften kernel: Lock_Harness <CVS> (built Dec 3 2004
14:18:33) installed
Dec 3 14:56:02 fouroften kernel: gfs: no version for "lm_mount" found:
kernel tainted.
Dec 3 14:56:02 fouroften kernel: gfs: Unknown symbol panic_on_oops
Dec 3 14:56:07 fouroften ntpd[2188]: synchronized to LOCAL(0), stratum
10
Dec 3 14:56:07 fouroften ntpd[2188]: kernel time sync disabled 0041
Dec 3 14:56:13 fouroften kernel: CMAN <CVS> (built Dec 3 2004
14:17:50) installed
Dec 3 14:56:13 fouroften kernel: NET: Registered protocol family 30
Dec 3 14:56:13 fouroften kernel: DLM <CVS> (built Dec 3 2004 14:18:20)
installed
Dec 3 14:56:13 fouroften kernel: Lock_DLM (built Dec 3 2004 14:18:43)
installed
cluster.conf:
<?xml version="1.0"?>
<cluster name="CSMTEST" config_version="6">
<cman two_node="1" expected_votes="1">
</cman>
<nodes>
<node name="fouroften" votes="1">
<fence>
<method name="cascade1">
<device name="human" ipaddr="fouroften"/>
</method>
</fence>
</node>
<node name="fiveoften" votes="1">
<fence>
<method name="cascade1">
<device name="human" ipaddr="fiveoften"/>
</method>
</fence>
</node>
</nodes>
<fence_devices>
<device name="apc1" agent="fence_apc" ipaddr="10.1.1.1"
login="apc" passwd="apc"/>
<device name="brocade1" agent="fence_brocade" ipaddr="10.1.1.2"
login="user" passwd="pw"/>
<device name="brocade2" agent="fence_brocade" ipaddr="10.1.1.3"
login="user" passwd="pw"/>
<device name="human" agent="fence_manual"/>
</fence_devices>
</cluster>
dmesg output for 2.6.9:
Linux version 2.6.9 (mbrookov@xxxxxxxxxxxxxxxxxxx) (gcc version 3.4.2
20041017 (Red Hat 3.4.2-6.fc3)) #1 Fri Dec 3 11:05:35 MST 2004
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 000000001ffc0000 (usable)
BIOS-e820: 000000001ffc0000 - 000000001fff8000 (ACPI data)
BIOS-e820: 000000001fff8000 - 0000000020000000 (ACPI NVS)
BIOS-e820: 00000000ffb80000 - 00000000ffc00000 (reserved)
BIOS-e820: 00000000fff00000 - 0000000100000000 (reserved)
0MB HIGHMEM available.
511MB LOWMEM available.
On node 0 totalpages: 131008
DMA zone: 4096 pages, LIFO batch:1
Normal zone: 126912 pages, LIFO batch:16
HighMem zone: 0 pages, LIFO batch:1
DMI 2.3 present.
ACPI: RSDP (v000 AMI ) @ 0x000ff980
ACPI: RSDT (v001 D815EA D815EPFV 0x20010404 MSFT 0x00001011) @
0x1fff0000
ACPI: FADT (v001 D815EA EA81510A 0x20010404 MSFT 0x00001011) @
0x1fff1000
ACPI: DSDT (v001 D815E2 EA81520A 0x00000021 MSFT 0x0100000b) @
0x00000000
ACPI: PM-Timer IO Port: 0x408
Built 1 zonelists
Kernel command line: ro root=LABEL=/ rhgb quiet
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 32768 bytes)
Detected 996.487 MHz processor.
Using pmtmr for high-res timesource
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 514296k/524032k available (2512k kernel code, 9208k reserved,
672k data, 168k init, 0k highmem)
Checking if this processor honours the WP bit even in supervisor mode...
Ok.
Calibrating delay loop... 1978.36 BogoMIPS (lpj=989184)
Security Scaffold v1.0.0 initialized
SELinux: Initializing.
SELinux: Starting in permissive mode
There is already a security framework initialized, register_security
failed.
selinux_register_security: Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 512 (order: 0, 4096 bytes)
CPU: After generic identify, caps: 0383f9ff 00000000 00000000 00000000
CPU: After vendor identify, caps: 0383f9ff 00000000 00000000 00000000
CPU: L1 I cache: 16K, L1 D cache: 16K
CPU: L2 cache: 256K
CPU: After all inits, caps: 0383f9ff 00000000 00000000 00000040
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
CPU: Intel Pentium III (Coppermine) stepping 0a
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
ACPI: IRQ9 SCI: Level Trigger.
checking if image is initramfs... it is
Freeing initrd memory: 574k freed
NET: Registered protocol family 16
PCI: PCI BIOS revision 2.10 entry at 0xfda95, last bus=2
PCI: Using configuration type 1
mtrr: v2.0 (20020519)
ACPI: Subsystem revision 20040816
ACPI: Interpreter enabled
ACPI: Using PIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (00:00)
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:1e.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI1._PRT]
ACPI: Power Resource [URP1] (off)
ACPI: Power Resource [URP2] (off)
ACPI: Power Resource [FDDP] (off)
ACPI: Power Resource [LPTP] (off)
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 *10 11 12)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 11 12) *0,
disabled.
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12) *0,
disabled.
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 *9 10 11 12)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 *11 12)
Linux Plug and Play Support v0.97 (c) Adam Belay
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
ACPI: PCI interrupt 0000:00:1f.2[D] -> GSI 11 (level, low) -> IRQ 11
ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10
ACPI: PCI interrupt 0000:00:1f.3[B] -> GSI 10 (level, low) -> IRQ 10
ACPI: PCI Interrupt Link [LNKH] enabled at IRQ 11
ACPI: PCI interrupt 0000:00:1f.4[C] -> GSI 11 (level, low) -> IRQ 11
ACPI: PCI interrupt 0000:00:1f.5[B] -> GSI 10 (level, low) -> IRQ 10
ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11
ACPI: PCI interrupt 0000:02:00.0[A] -> GSI 11 (level, low) -> IRQ 11
ACPI: PCI Interrupt Link [LNKE] enabled at IRQ 11
ACPI: PCI interrupt 0000:01:08.0[A] -> GSI 11 (level, low) -> IRQ 11
ACPI: PCI Interrupt Link [LNKG] enabled at IRQ 9
ACPI: PCI interrupt 0000:01:0a.0[A] -> GSI 9 (level, low) -> IRQ 9
apm: BIOS version 1.2 Flags 0x03 (Driver version 1.16ac)
apm: overridden by ACPI.
audit: initializing netlink socket (disabled)
audit(1102085502.573:0): initialized
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SELinux: Registering netfilter hooks
Initializing Cryptographic API
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
vesafb: probe of vesafb0 failed with error -6
ACPI: Processor [CPU1] (supports C1)
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12
Linux agpgart interface v0.100 (c) Dave Jones
agpgart: Detected an Intel i815 Chipset.
agpgart: Maximum main memory to use for agp memory: 439M
agpgart: AGP aperture is 64M @ 0xf8000000
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing enabled
ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
divert: not allocating divert_blk for non-ethernet device lo
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with
idebus=xx
ICH2: IDE controller at PCI slot 0000:00:1f.1
ICH2: chipset revision 17
ICH2: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:pio, hdd:DMA
Probing IDE interface ide0...
hda: QUANTUM FIREBALLP AS40.0, ATA DISK drive
hdb: QUANTUM FIREBALLP AS40.0, ATA DISK drive
Using anticipatory io scheduler
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Probing IDE interface ide1...
hdc: IOMEGA ZIP 250 ATAPI, ATAPI FLOPPY drive
hdd: SONY CD-RW CRX160E, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
Probing IDE interface ide2...
ide2: Wait for ready failed before probe !
Probing IDE interface ide3...
ide3: Wait for ready failed before probe !
Probing IDE interface ide4...
ide4: Wait for ready failed before probe !
Probing IDE interface ide5...
ide5: Wait for ready failed before probe !
hda: max request size: 128KiB
hda: 78177792 sectors (40027 MB) w/1902KiB Cache, CHS=65535/16/63,
UDMA(100)
hda: cache flushes not supported
hda: hda1 hda2 hda3 hda4 < hda5 hda6 hda7 hda8 hda9 >
hdb: max request size: 128KiB
hdb: 78177792 sectors (40027 MB) w/1902KiB Cache, CHS=65535/16/63,
UDMA(100)
hdb: cache flushes not supported
hdb: hdb1
hdd: ATAPI 32X CD-ROM CD-R/RW drive, 4096kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.20
ide-floppy driver 0.99.newide
hdc: No disk in drive
hdc: 0kB, 0/64/32 CHS, 4096 kBps, 512 sector size, 2941 rpm
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.0:USB HID core driver
mice: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard on isa0060/serio0
input: ImExPS/2 Generic Explorer Mouse on isa0060/serio1
md: md driver 0.90.0 MAX_MD_DEVS=256, MD_SB_DISKS=27
NET: Registered protocol family 2
IP: routing cache hash table of 1024 buckets, 32Kbytes
TCP: Hash tables configured (established 32768 bind 9362)
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
ACPI: (supports S0 S1 S4 S5)
ACPI wakeup devices:
SBTN PCI1 UAR1 USB USB2 AC9 SMB
Freeing unused kernel memory: 168k freed
SCSI subsystem initialized
ACPI: PCI interrupt 0000:01:0a.0[A] -> GSI 9 (level, low) -> IRQ 9
scsi0 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
<Adaptec 2940 Ultra SCSI adapter>
aic7880: Ultra Wide Channel A, SCSI Id=7, 16/253 SCBs
(scsi0:A:0): 20.000MB/s transfers (20.000MHz, offset 15)
Vendor: SEAGATE Model: ST173404LW Rev: 0003
Type: Direct-Access ANSI SCSI revision: 03
scsi0:A:0:0: Tagged Queuing enabled. Depth 4
SCSI device sda: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sda: drive cache: write through
sda:
Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
(scsi0:A:1): 40.000MB/s transfers (20.000MHz, offset 8, 16bit)
Vendor: SEAGATE Model: ST173404LW Rev: 0003
Type: Direct-Access ANSI SCSI revision: 03
scsi0:A:1:0: Tagged Queuing enabled. Depth 4
SCSI device sdb: 143374738 512-byte hdwr sectors (73408 MB)
SCSI device sdb: drive cache: write through
sdb:
Attached scsi disk sdb at scsi0, channel 0, id 1, lun 0
device-mapper: 4.1.0-ioctl (2003-12-10) initialised: dm@xxxxxxxxxxxxxx
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: Disabled at runtime.
SELinux: Unregistering netfilter hooks
inserting floppy driver for 2.6.9
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
e100: Intel(R) PRO/100 Network Driver, 3.0.27-k2-NAPI
e100: Copyright(c) 1999-2004 Intel Corporation
ACPI: PCI interrupt 0000:01:08.0[A] -> GSI 11 (level, low) -> IRQ 11
divert: allocating divert_blk for eth0
e100: eth0: e100_probe: addr 0xfc9fe000, irq 11, MAC addr
00:03:47:A0:AC:36
ACPI: PCI interrupt 0000:00:1f.5[B] -> GSI 10 (level, low) -> IRQ 10
PCI: Setting latency timer of device 0000:00:1f.5 to 64
intel8x0_measure_ac97_clock: measured 49927 usecs
intel8x0: clocking to 41142
USB Universal Host Controller Interface driver v2.2
ACPI: PCI interrupt 0000:00:1f.2[D] -> GSI 11 (level, low) -> IRQ 11
uhci_hcd 0000:00:1f.2: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1f.2 to 64
uhci_hcd 0000:00:1f.2: irq 11, io base 0000ef40
uhci_hcd 0000:00:1f.2: new USB bus registered, assigned bus number 1
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ACPI: PCI interrupt 0000:00:1f.4[C] -> GSI 11 (level, low) -> IRQ 11
uhci_hcd 0000:00:1f.4: UHCI Host Controller
PCI: Setting latency timer of device 0000:00:1f.4 to 64
uhci_hcd 0000:00:1f.4: irq 11, io base 0000ef80
uhci_hcd 0000:00:1f.4: new USB bus registered, assigned bus number 2
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
usb 2-2: new full speed USB device using address 2
hub 2-2:1.0: USB hub found
hub 2-2:1.0: 4 ports detected
ACPI: Power Button (FF) [PWRF]
ACPI: Sleep Button (CM) [SBTN]
EXT3 FS on hda3, internal journal
ide-floppy: hdc: I/O error, pc = 0, key = 2, asc = 3a, ascq = 0
ide-floppy: hdc: I/O error, pc = 1b, key = 2, asc = 3a, ascq = 0
hdc: No disk in drive
cdrom: open failed.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hda5, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hdb1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hda7, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hda8, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hda6, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on hda9, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
NET: Registered protocol family 10
Disabled Privacy Extensions on device c03dc960(lo)
IPv6 over IPv4 tunneling driver
divert: not allocating divert_blk for non-ethernet device sit0
Adding 2047744k swap on /dev/hda2. Priority:-1 extents:1
parport0: PC-style at 0x378 [PCSPP,TRISTATE,EPP]
ip_tables: (C) 2000-2002 Netfilter core team
ip_conntrack version 2.1 (4094 buckets, 32752 max) - 356 bytes per
conntrack
e100: eth0: e100_watchdog: link up, 100Mbps, full-duplex
i2c /dev entries driver
parport0: PC-style at 0x378 [PCSPP,TRISTATE,EPP]
lp0: using parport0 (polling).
lp0: console ready
eth0: no IPv6 routers present
Installing knfsd (copyright (C) 1996 okir@xxxxxxxxxxxx).
Lock_Harness <CVS> (built Dec 3 2004 14:18:33) installed
gfs: no version for "lm_mount" found: kernel tainted.
gfs: Unknown symbol panic_on_oops
CMAN <CVS> (built Dec 3 2004 14:17:50) installed
NET: Registered protocol family 30
DLM <CVS> (built Dec 3 2004 14:18:20) installed
Lock_DLM (built Dec 3 2004 14:18:43) installed
