Hi, we had a crash this morning that appears to be ext3 related in 2.4.21-rc-1 and wanted to share with the list. This is on a redhat 7.2 with a 2.4.21-rc-1 built running with an Athlon xp 1800. it looks like sendmail was running who runs a queue from a 30GB ext3 partiton on an IDE drive. there is another 8 GB ext3 partition on the disk mouned root, and a 400 GB external scsi raid with 3 partitions, two ext2 and one 193 GB ext3. Here is the crash and following is the startup info. Any insight is appreciated. If you need more info I will provide it promptly. Thanks in advance. Mike May 8 11:33:13 mofo kernel: Unable to handle kernel NULL pointer dereference at virtual address 00000018 May 8 11:33:13 mofo kernel: printing eip: May 8 11:33:13 mofo kernel: c0158571 May 8 11:33:13 mofo kernel: *pde = 00000000 May 8 11:33:13 mofo kernel: Oops: 0000 May 8 11:33:13 mofo kernel: CPU: 0 May 8 11:33:13 mofo kernel: EIP: 0010:[journal_dirty_data+17/368] Not tainted May 8 11:33:13 mofo kernel: EIP: 0010:[<c0158571>] Not tainted May 8 11:33:13 mofo kernel: EFLAGS: 00010246 May 8 11:33:13 mofo kernel: eax: 00000000 ebx: c089b640 ecx: 00000000 edx: 00000000 May 8 11:33:13 mofo kernel: esi: 00000000 edi: c089b640 ebp: 00000018 esp: cc665df0 May 8 11:33:13 mofo kernel: ds: 0018 es: 0018 ss: 0018 May 8 11:33:14 mofo kernel: Process sendmail (pid: 12637, stackpage=cc665000) May 8 11:33:14 mofo kernel: Stack: 00001000 c34eee40 cc665e50 c012f35a 00000303 c089b640 00000018 c089b640 May 8 11:33:14 mofo kernel: 00001000 c0150c47 00000018 c089b640 00000000 c012f656 c7006580 00000000 May 8 11:33:14 mofo kernel: c012f677 c089b640 c089b640 cbd8a000 00001000 00000009 00001000 c089b640 May 8 11:33:14 mofo kernel: Call Trace: [unmap_underlying_metadata+26/96] [journal_dirty_sync_data+23/112] [__block_prepare_write+230/768] [__block_prepare_write+263/768] [__jbd_kmalloc+39/112] May 8 11:33:14 mofo kernel: Call Trace: [<c012f35a>] [<c0150c47>] [<c012f656>] [<c012f677>] [<c015d787>] May 8 11:33:14 mofo kernel: [walk_page_buffers+93/128] [ext3_commit_write+280/448] [journal_dirty_sync_data+0/112] [generic_file_write+1256/1760] [ext3_file_write+31/176] [sys_write+149/240] May 8 11:33:14 mofo kernel: [<c0150a8d>] [<c0150e88>] [<c0150c30>] [<c01231b8>] [<c014e85f>] [<c012d365>] May 8 11:33:14 mofo kernel: [bh_action+27/80] [tasklet_hi_action+67/112] [do_softirq+75/144] [do_IRQ+156/176] [system_call+51/56] May 8 11:33:14 mofo kernel: [<c011530b>] [<c0115213>] [<c011503b>] [<c01082dc>] [<c0106d83>] May 8 11:33:14 mofo kernel: May 8 11:33:14 mofo kernel: Code: 8b 45 00 85 d2 8b 38 89 f0 0f 95 c0 c7 04 24 00 00 00 00 89 May 8 11:33:14 mofo kernel: <1>Unable to handle kernel NULL pointer dereference at virtual address 00000018 May 8 11:33:14 mofo kernel: printing eip: May 8 11:33:14 mofo kernel: c0118ae0 May 8 11:33:14 mofo kernel: *pde = 00000000 May 8 11:33:14 mofo kernel: Oops: 0000 May 8 11:33:14 mofo kernel: CPU: 0 May 8 11:33:14 mofo kernel: EIP: 0010:[flush_sigqueue+48/80] Not tainted May 8 11:33:14 mofo kernel: EIP: 0010:[<c0118ae0>] Not tainted May 8 11:33:14 mofo kernel: EFLAGS: 00010006 May 8 11:33:14 mofo kernel: eax: cc664568 ebx: cc664000 ecx: cd882000 edx: 00000018 May 8 11:33:14 mofo kernel: esi: cfecd000 edi: cc664000 ebp: 0000000b esp: cc665c6c May 8 11:33:14 mofo kernel: ds: 0018 es: 0018 ss: 0018 May 8 11:33:14 mofo kernel: Process sendmail (pid: 12637, stackpage=cc665000) May 8 11:33:14 mofo kernel: Stack: cc664000 c0118b64 cc664568 cfecd000 c0113eea cc664000 08aa10b6 00000001 May 8 11:33:14 mofo kernel: 00000018 cf29df44 00000046 cc665cb8 00000086 00000086 00000001 c03740e4 May 8 11:33:14 mofo kernel: c03df521 00000046 00000001 00000018 c0112ee4 0000000f cc665dbc c0311b8e May 8 11:33:14 mofo kernel: Call Trace: [exit_sighand+68/80] [do_exit+410/528] [printk+260/272] [bust_spinlocks+62/80] [die+76/96] May 8 11:33:14 mofo kernel: Call Trace: [<c0118b64>] [<c0113eea>] [<c0112ee4>] [<c010f23e>] [<c010731c>] May 8 11:33:14 mofo kernel: [journal_dirty_data+17/368] [do_page_fault+870/1164] [ext3_do_update_inode+852/896] [ext3_do_update_inode+759/896] [ext3_do_update_inode+852/896] [bread+22/112] May 8 11:33:14 mofo kernel: [<c0158571>] [<c010f5b6>] [<c0152744>] [<c01526e7>] [<c0152744>] [<c012eef6>] May 8 11:33:14 mofo kernel: [ext3_get_block_handle+477/640] [do_page_fault+0/1164] [error_code+52/60] [journal_dirty_data+17/368] [unmap_underlying_metadata+26/96] [journal_dirty_sync_data+23/112] May 8 11:33:14 mofo kernel: [<c015063d>] [<c010f250>] [<c0106e74>] [<c0158571>] [<c012f35a>] [<c0150c47>] May 8 11:33:14 mofo kernel: [__block_prepare_write+230/768] [__block_prepare_write+263/768] [__jbd_kmalloc+39/112] [walk_page_buffers+93/128] [ext3_commit_write+280/448] [journal_dirty_sync_data+0/112] May 8 11:33:14 mofo kernel: [<c012f656>] [<c012f677>] [<c015d787>] [<c0150a8d>] [<c0150e88>] [<c0150c30>] May 8 11:33:14 mofo kernel: [generic_file_write+1256/1760] [ext3_file_write+31/176] [sys_write+149/240] [bh_action+27/80] [tasklet_hi_action+67/112] [do_softirq+75/144] May 8 11:33:14 mofo kernel: [<c01231b8>] [<c014e85f>] [<c012d365>] [<c011530b>] [<c0115213>] [<c011503b>] May 8 11:33:14 mofo kernel: [do_IRQ+156/176] [system_call+51/56] May 8 11:33:14 mofo kernel: [<c01082dc>] [<c0106d83>] May 8 11:33:14 mofo kernel: May 8 11:33:14 mofo kernel: Code: 8b 1a 52 ff 35 40 53 3e c0 e8 72 d1 00 00 58 5a ff 0d 44 53 -------------- May 8 12:39:41 mofo syslogd 1.4.1: restart. May 8 12:39:41 mofo syslog: syslogd startup succeeded May 8 12:39:41 mofo syslog: klogd startup succeeded May 8 12:39:41 mofo kernel: klogd 1.4.1, log source = /proc/kmsg started. May 8 12:39:41 mofo kernel: Inspecting /boot/System.map May 8 12:39:41 mofo portmap: portmap startup succeeded May 8 12:39:41 mofo kernel: Loaded 18166 symbols from /boot/System.map. May 8 12:39:41 mofo kernel: Symbols match kernel version 2.4.21. May 8 12:39:41 mofo kernel: No module symbols loaded - kernel modules not enabled. May 8 12:39:41 mofo kernel: Linux version 2.4.21-rc1 (root@mofo) (gcc version 2.96 20000731 (Red Hat Linux 7.2 2.96-112.7.2)) #3 Tue Apr 22 23:06:43 CDT 2003 May 8 12:39:41 mofo kernel: BIOS-provided physical RAM map: May 8 12:39:41 mofo kernel: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) May 8 12:39:41 mofo kernel: BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) May 8 12:39:41 mofo kernel: BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) May 8 12:39:41 mofo kernel: BIOS-e820: 0000000000100000 - 000000000fff0000 (usable) May 8 12:39:41 mofo kernel: BIOS-e820: 000000000fff0000 - 000000000fff3000 (ACPI NVS) May 8 12:39:41 mofo kernel: BIOS-e820: 000000000fff3000 - 0000000010000000 (ACPI data) May 8 12:39:41 mofo kernel: BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) May 8 12:39:41 mofo kernel: BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) May 8 12:39:41 mofo kernel: BIOS-e820: 00000000ffff0000 - 0000000100000000 (reserved) May 8 12:39:41 mofo kernel: 255MB LOWMEM available. May 8 12:39:41 mofo kernel: On node 0 totalpages: 65520 May 8 12:39:41 mofo kernel: zone(0): 4096 pages. May 8 12:39:41 mofo kernel: zone(1): 61424 pages. May 8 12:39:41 mofo kernel: zone(2): 0 pages. May 8 12:39:42 mofo nfslock: rpc.statd startup succeeded May 8 12:39:41 mofo kernel: Kernel command line: auto BOOT_IMAGE=linux ro root=301 BOOT_FILE=/boot/bzImage.2.4.21-rc1 May 8 12:39:42 mofo kernel: Initializing CPU#0 May 8 12:39:42 mofo rpc.statd[783]: Version 0.3.1 Starting May 8 12:39:42 mofo kernel: Detected 1534.037 MHz processor. May 8 12:39:42 mofo kernel: Console: colour VGA+ 80x25 May 8 12:39:42 mofo kernel: Calibrating delay loop... 3060.53 BogoMIPS May 8 12:39:42 mofo kernel: Memory: 255720k/262080k available (2067k kernel code, 5972k reserved, 738k data, 108k init, 0k highmem) May 8 12:39:42 mofo kernel: Dentry cache hash table entries: 32768 (order: 6, 262144 bytes) May 8 12:39:42 mofo kernel: Inode cache hash table entries: 16384 (order: 5, 131072 bytes) May 8 12:39:42 mofo kernel: Mount cache hash table entries: 512 (order: 0, 4096 bytes) May 8 12:39:42 mofo kernel: Buffer-cache hash table entries: 16384 (order: 4, 65536 bytes) May 8 12:39:42 mofo kernel: Page-cache hash table entries: 65536 (order: 6, 262144 bytes) May 8 12:39:42 mofo kernel: CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) May 8 12:39:42 mofo kernel: CPU: L2 Cache: 256K (64 bytes/line) May 8 12:39:42 mofo kernel: Intel machine check architecture supported. May 8 12:39:42 mofo kernel: Intel machine check reporting enabled on CPU#0. May 8 12:39:42 mofo kernel: CPU: AMD Athlon(tm) XP 1800+ stepping 02 May 8 12:39:42 mofo kernel: Enabling fast FPU save and restore... done. May 8 12:39:42 mofo kernel: Enabling unmasked SIMD FPU exception support... done. May 8 12:39:42 mofo kernel: Checking 'hlt' instruction... OK. May 8 12:39:42 mofo kernel: POSIX conformance testing by UNIFIX May 8 12:39:42 mofo kernel: PCI: PCI BIOS revision 2.10 entry at 0xfb4b0, last bus=1 May 8 12:39:42 mofo kernel: PCI: Using configuration type 1 May 8 12:39:42 mofo kernel: PCI: Probing PCI hardware May 8 12:39:42 mofo kernel: PCI: Using IRQ router default [1106/3099] at 00:00.0 May 8 12:39:42 mofo kernel: isapnp: Scanning for PnP cards... May 8 12:39:42 mofo kernel: isapnp: No Plug & Play device found May 8 12:39:42 mofo kernel: Linux NET4.0 for Linux 2.4 May 8 12:39:42 mofo kernel: Based upon Swansea University Computer Society NET3.039 May 8 12:39:42 mofo keytable: Loading keymap: succeeded May 8 12:39:42 mofo kernel: Initializing RT netlink socket May 8 12:39:42 mofo kernel: Starting kswapd May 8 12:39:42 mofo kernel: Journalled Block Device driver loaded May 8 12:39:42 mofo kernel: Installing knfsd (copyright (C) 1996 okir@monad.swb.de). May 8 12:39:42 mofo kernel: pty: 256 Unix98 ptys configured May 8 12:39:42 mofo keytable: Loading system font: succeeded May 8 12:39:42 mofo kernel: Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI ISAPNP enabled May 8 12:39:42 mofo kernel: ttyS00 at 0x03f8 (irq = 4) is a 16550A May 8 12:39:42 mofo kernel: ttyS01 at 0x02f8 (irq = 3) is a 16550A May 8 12:39:42 mofo kernel: Floppy drive(s): fd0 is 1.44M May 8 12:39:42 mofo kernel: FDC 0 is a post-1991 82077 May 8 12:39:42 mofo kernel: loop: loaded (max 8 devices) May 8 12:39:42 mofo kernel: Linux Tulip driver version 0.9.15-pre12 (Aug 9, 2002) May 8 12:39:42 mofo kernel: eth0: ADMtek Comet rev 17 at 0xd800, 00:04:5A:5C:2F:F4, IRQ 5. May 8 12:39:42 mofo kernel: eth1: ADMtek Comet rev 17 at 0xdc00, 00:04:5A:62:8C:B6, IRQ 5. May 8 12:39:42 mofo kernel: PPP generic driver version 2.4.2 May 8 12:39:42 mofo kernel: PPP Deflate Compression module registered May 8 12:39:42 mofo kernel: PPP BSD Compression module registered May 8 12:39:42 mofo random: Initializing random number generator: succeeded May 8 12:39:42 mofo kernel: Linux agpgart interface v0.99 (c) Jeff Hartmann May 8 12:39:42 mofo kernel: agpgart: Maximum main memory to use for agp memory: 203M May 8 12:39:42 mofo kernel: agpgart: Detected Via Apollo Pro KT266 chipset May 8 12:39:42 mofo kernel: agpgart: AGP aperture is 64M @ 0xe0000000 May 8 12:39:42 mofo kernel: [drm] Initialized tdfx 1.0.0 20010216 on minor 0 May 8 12:39:42 mofo kernel: [drm] AGP 0.99 on VIA Apollo KT133 @ 0xe0000000 64MB May 8 12:39:42 mofo kernel: [drm] Initialized radeon 1.1.1 20010405 on minor 1 May 8 12:39:42 mofo kernel: [drm] AGP 0.99 on VIA Apollo KT133 @ 0xe0000000 64MB May 8 12:39:42 mofo kernel: [drm] Initialized i810 1.2.0 20010920 on minor 2 May 8 12:39:42 mofo kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00beta-2.4 May 8 12:39:42 mofo kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx May 8 12:39:42 mofo kernel: hda: WDC WD400BB-00DGA0, ATA DISK drive May 8 12:39:42 mofo kernel: hdc: MATSHITA CR-175, ATAPI CD/DVD-ROM drive May 8 12:39:42 mofo kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 May 8 12:39:42 mofo kernel: ide1 at 0x170-0x177,0x376 on irq 15 May 8 12:39:42 mofo kernel: hda: attached ide-disk driver. May 8 12:39:42 mofo kernel: hda: host protected area => 1 May 8 12:39:42 mofo kernel: hda: 78165360 sectors (40021 MB) w/2048KiB Cache, CHS=4865/255/63 May 8 12:39:42 mofo kernel: hdc: attached ide-cdrom driver. May 8 12:39:42 mofo kernel: hdc: ATAPI 24X CD-ROM drive, 128kB Cache May 8 12:39:42 mofo kernel: Uniform CD-ROM driver Revision: 3.12 May 8 12:39:42 mofo kernel: Partition check: May 8 12:39:42 mofo kernel: hda: hda1 hda2 hda3 May 8 12:39:42 mofo kernel: SCSI subsystem driver Revision: 1.00 May 8 12:39:42 mofo kernel: scsi1 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.28 May 8 12:39:42 mofo kernel: <Adaptec 2940 Ultra SCSI adapter> May 8 12:39:42 mofo netfs: Mounting other filesystems: succeeded May 8 12:39:42 mofo kernel: aic7880: Ultra Wide Channel A, SCSI Id=7, 16/253 SCBs May 8 12:39:42 mofo kernel: May 8 12:39:42 mofo kernel: Vendor: BellStor Model: Rev: May 8 12:39:42 mofo kernel: Type: Direct-Access ANSI SCSI revision: 02 May 8 12:39:42 mofo kernel: (scsi1:A:3): 40.000MB/s transfers (20.000MHz, offset 8, 16bit) May 8 12:39:42 mofo kernel: scsi1:A:3:0: Tagged Queuing enabled. Depth 32 May 8 12:39:42 mofo kernel: Attached scsi disk sda at scsi1, channel 0, id 3, lun 0 May 8 12:39:42 mofo kernel: SCSI device sda: 1073723392 512-byte hdwr sectors (549746 MB) May 8 12:39:42 mofo kernel: sda: sda1 sda2 sda3 sda4 May 8 12:39:42 mofo kernel: Linux Kernel Card Services 3.1.22 May 8 12:39:42 mofo kernel: options: [pci] [cardbus] [pm] May 8 12:39:42 mofo kernel: usb.c: registered new driver hub May 8 12:39:42 mofo kernel: host/uhci.c: USB Universal Host Controller Interface driver v1.1 May 8 12:39:42 mofo kernel: host/uhci.c: USB UHCI at I/O 0xe800, IRQ 11 May 8 12:39:42 mofo kernel: usb.c: new USB bus registered, assigned bus number 1 May 8 12:39:42 mofo kernel: hub.c: USB hub found May 8 12:39:42 mofo kernel: hub.c: 2 ports detected May 8 12:39:42 mofo kernel: host/uhci.c: USB UHCI at I/O 0xec00, IRQ 11 May 8 12:39:42 mofo kernel: usb.c: new USB bus registered, assigned bus number 2 May 8 12:39:42 mofo kernel: hub.c: USB hub found May 8 12:39:42 mofo kernel: hub.c: 2 ports detected May 8 12:39:42 mofo kernel: Initializing USB Mass Storage driver... May 8 12:39:42 mofo kernel: usb.c: registered new driver usb-storage May 8 12:39:42 mofo kernel: USB Mass Storage support registered. May 8 12:39:42 mofo kernel: NET4: Linux TCP/IP 1.0 for NET4.0 May 8 12:39:42 mofo kernel: IP Protocols: ICMP, UDP, TCP, IGMP May 8 12:39:43 mofo kernel: IP: routing cache hash table of 2048 buckets, 16Kbytes May 8 12:39:43 mofo kernel: TCP: Hash tables configured (established 16384 bind 32768) May 8 12:39:43 mofo kernel: IPv4 over IPv4 tunneling driver May 8 12:39:43 mofo kernel: GRE over IPv4 tunneling driver May 8 12:39:43 mofo kernel: klips_info:ipsec_init: KLIPS startup, FreeS/WAN IPSec version: 1.99 May 8 12:39:43 mofo kernel: ip_conntrack version 2.1 (2047 buckets, 16376 max) - 292 bytes per conntrack May 8 12:39:43 mofo kernel: ip_tables: (C) 2000-2002 Netfilter core team May 8 12:39:43 mofo kernel: arp_tables: (C) 2002 David S. Miller May 8 12:39:43 mofo kernel: NET4: Unix domain sockets 1.0/SMP for Linux NET4.0. May 8 12:39:43 mofo kernel: ds: no socket drivers loaded! May 8 12:39:43 mofo kernel: kjournald starting. Commit interval 5 seconds May 8 12:39:43 mofo kernel: EXT3-fs: mounted filesystem with ordered data mode. May 8 12:39:43 mofo kernel: VFS: Mounted root (ext3 filesystem) readonly. May 8 12:39:43 mofo kernel: Freeing unused kernel memory: 108k freed May 8 12:39:43 mofo kernel: Adding Swap: 1028152k swap-space (priority -1) May 8 12:39:43 mofo kernel: EXT3 FS 2.4-0.9.19, 19 August 2002 on ide0(3,1), internal journal May 8 12:39:43 mofo kernel: kjournald starting. Commit interval 5 seconds May 8 12:39:43 mofo kernel: EXT3 FS 2.4-0.9.19, 19 August 2002 on ide0(3,3), internal journal May 8 12:39:43 mofo kernel: EXT3-fs: mounted filesystem with ordered data mode. _______________________________________________ Ext3-users@redhat.com https://listman.redhat.com/mailman/listinfo/ext3-users
