Hi Bryan,
Bryan Kadzban wrote:
Are there any other oops reports in your kernel log? One of the possible error condition behaviors of ext3 is to remount the FS readonly in case of a problem detected in the code, so that might be what made it read-only in the first place.
Are you using Alsa by any chance? I've heard vague rumors of Alsa 0.9.7 (the one that comes in kernel 2.6.something) causing FS corruption issues, though I hadn't seen it happen with 2.6.1-rc1.
Yeah, it looks like I missed a bunch of messages in /var/log/syslog... see the attached trace.
The trouble appears to have started with this message:
Jan 22 01:52:42 kimchi kernel: EXT3-fs warning (device hda2): ext3_unlink: Deleting nonexistent file (2874981), 0
and goes until I shut the machine down:
Jan 22 17:03:42 kimchi dhcpcd[106]: terminating on signal 15
Jan 22 17:53:57 kimchi kernel: Linux version 2.6.1 (mike@kimchi) (gcc version 3.2.3) #11 Sun Jan 11 15:57:17 KST 2
Full log is attached.
Mike
Jan 18 16:16:12 kimchi kernel: Unable to handle kernel paging request at virtual address 00200014 Jan 18 16:16:12 kimchi kernel: printing eip: Jan 18 16:16:12 kimchi kernel: c016ba37 Jan 18 16:16:12 kimchi kernel: *pde = 00000000 Jan 18 16:16:12 kimchi kernel: Oops: 0000 [#1] Jan 18 16:16:12 kimchi kernel: CPU: 0 Jan 18 16:16:12 kimchi kernel: EIP: 0060:[<c016ba37>] Not tainted Jan 18 16:16:12 kimchi kernel: EFLAGS: 00010206 Jan 18 16:16:12 kimchi kernel: EIP is at prune_dcache+0x177/0x200 Jan 18 16:16:12 kimchi kernel: eax: 00200000 ebx: ca2c8cc0 ecx: c266e364 edx: dfe3a000 Jan 18 16:16:12 kimchi kernel: esi: c266e354 edi: 00000018 ebp: dfe3be7c esp: dfe3be54 Jan 18 16:16:12 kimchi kernel: ds: 007b es: 007b ss: 0068 Jan 18 16:16:12 kimchi kernel: Process kswapd0 (pid: 7, threadinfo=dfe3a000 task=dfe3f2c0) Jan 18 16:16:12 kimchi kernel: Stack: d6057f40 00000077 dfe3a000 dfe3a000 dfe3a000 dfe3a000 dfe3a000 00000080 Jan 18 16:16:12 kimchi kernel: dfe3a000 00000058 dfe3be8c c016bf8e 00000080 00000080 dfe3bec4 c014168f Jan 18 16:16:12 kimchi kernel: 00000080 000000d0 0001338f 0000000c 0404cf54 00000000 00000358 00000000 Jan 18 16:16:12 kimchi kernel: Call Trace: Jan 18 16:16:12 kimchi kernel: [<c016bf8e>] shrink_dcache_memory+0x3e/0x40 Jan 18 16:16:12 kimchi kernel: [<c014168f>] shrink_slab+0x11f/0x170 Jan 18 16:16:12 kimchi kernel: [<c0142b1c>] balance_pgdat+0x1ec/0x210 Jan 18 16:16:12 kimchi kernel: [<c0142c41>] kswapd+0x101/0x110 Jan 18 16:16:12 kimchi kernel: [<c011c6d0>] autoremove_wake_function+0x0/0x50 Jan 18 16:16:12 kimchi kernel: [<c010a3a2>] ret_from_fork+0x6/0x14 Jan 18 16:16:12 kimchi kernel: [<c011c6d0>] autoremove_wake_function+0x0/0x50 Jan 18 16:16:12 kimchi kernel: [<c0142b40>] kswapd+0x0/0x110 Jan 18 16:16:12 kimchi kernel: [<c01082d9>] kernel_thread_helper+0x5/0xc Jan 18 16:16:12 kimchi kernel: Jan 18 16:16:12 kimchi kernel: Code: 8b 50 14 85 d2 75 2a 89 34 24 e8 0a 2b 00 00 8b 73 60 89 1c Jan 18 17:29:19 kimchi kernel: <4>atkbd.c: Unknown key released (translated set 2, code 0x19, data 0xf1, on isa0060/serio0). Jan 18 23:50:20 kimchi kernel: atkbd.c: Unknown key released (translated set 2, code 0x19, data 0xf1, on isa0060/serio0). Jan 19 19:47:58 kimchi dhcpcd[101]: terminating on signal 15 Jan 19 19:48:57 kimchi kernel: Linux version 2.6.1 (mike@kimchi) (gcc version 3.2.3) #11 Sun Jan 11 15:57:17 KST 2004 Jan 19 19:48:57 kimchi kernel: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) Jan 19 19:48:57 kimchi kernel: BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) Jan 19 19:48:57 kimchi kernel: BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) Jan 19 19:48:57 kimchi kernel: BIOS-e820: 0000000000100000 - 000000001fff0000 (usable) Jan 19 19:48:57 kimchi kernel: BIOS-e820: 000000001fff0000 - 000000001fff3000 (ACPI NVS) Jan 19 19:48:57 kimchi kernel: BIOS-e820: 000000001fff3000 - 0000000020000000 (ACPI data) Jan 19 19:48:57 kimchi kernel: BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved) Jan 19 19:48:57 kimchi kernel: On node 0 totalpages: 131056 Jan 19 19:48:57 kimchi kernel: DMA zone: 4096 pages, LIFO batch:1 Jan 19 19:48:57 kimchi kernel: Normal zone: 126960 pages, LIFO batch:16 Jan 19 19:48:57 kimchi kernel: HighMem zone: 0 pages, LIFO batch:1 Jan 19 19:48:57 kimchi kernel: Building zonelist for node : 0 Jan 19 19:48:57 kimchi kernel: Kernel command line: BOOT_IMAGE=Linux-2.6.1 ro root=301 Jan 19 19:48:57 kimchi kernel: PID hash table entries: 2048 (order 11: 16384 bytes) Jan 19 19:48:57 kimchi kernel: Detected 1004.258 MHz processor. Jan 19 19:48:57 kimchi kernel: Console: colour VGA+ 80x25 Jan 19 19:48:57 kimchi kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok. Jan 19 19:48:57 kimchi kernel: Calibrating delay loop... 1986.56 BogoMIPS Jan 19 19:48:57 kimchi kernel: Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) Jan 19 19:48:57 kimchi kernel: Mount-cache hash table entries: 512 (order: 0, 4096 bytes) Jan 19 19:48:57 kimchi kernel: CPU: Intel Pentium III (Coppermine) stepping 06 Jan 19 19:48:57 kimchi kernel: POSIX conformance testing by UNIFIX Jan 19 19:48:57 kimchi kernel: PCI: Probing PCI hardware (bus 00) Jan 19 19:48:57 kimchi kernel: Transparent bridge - 0000:00:1e.0 Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 *10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 *11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 *5 6 7 10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 9 Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 9 Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK1] enabled at IRQ 9 Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKF] enabled at IRQ 11 Jan 19 19:48:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK0] enabled at IRQ 5 Jan 19 19:48:57 kimchi kernel: pty: 256 Unix98 ptys configured Jan 19 19:48:57 kimchi kernel: hda: ST340014A, ATA DISK drive Jan 19 19:48:57 kimchi kernel: hdb: ST340014A, ATA DISK drive Jan 19 19:48:57 kimchi kernel: Using anticipatory io scheduler Jan 19 19:48:57 kimchi kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 Jan 19 19:48:57 kimchi kernel: hdc: TOSHIBA DVD-ROM SD-M1102, ATAPI CD/DVD-ROM drive Jan 19 19:48:57 kimchi kernel: hdd: SAMSUNG CD-R/RW SW-216B Q000 20010914, ATAPI CD/DVD-ROM drive Jan 19 19:48:57 kimchi kernel: ide1 at 0x170-0x177,0x376 on irq 15 Jan 19 19:48:57 kimchi kernel: hda: max request size: 1024KiB Jan 19 19:48:57 kimchi kernel: hdb: max request size: 1024KiB Jan 19 19:48:57 kimchi kernel: hdc: ATAPI 24X DVD-ROM drive, 256kB Cache, DMA Jan 19 19:48:57 kimchi kernel: hdd: ATAPI 32X CD-ROM CD-R/RW drive, 2048kB Cache, DMA Jan 19 19:48:57 kimchi kernel: VFS: Mounted root (ext3 filesystem) readonly. Jan 19 19:48:58 kimchi kernel: ip_tables: (C) 2000-2002 Netfilter core team Jan 19 19:49:30 kimchi kernel: atkbd.c: Unknown key released (translated set 2, code 0x7a on isa0060/serio0). Jan 19 19:49:30 kimchi kernel: atkbd.c: Unknown key released (translated set 2, code 0x7a on isa0060/serio0). Jan 19 19:57:28 kimchi kernel: sda: assuming drive cache: write through Jan 19 19:57:28 kimchi kernel: sda: assuming drive cache: write through Jan 19 19:57:28 kimchi kernel: Jan 20 17:22:22 kimchi kernel: sda: assuming drive cache: write through Jan 20 17:22:23 kimchi kernel: sda1 Jan 20 17:24:19 kimchi kernel: end_request: I/O error, dev sda, sector 19 Jan 20 17:24:19 kimchi kernel: Buffer I/O error on device sda, logical block 19 Jan 20 17:24:19 kimchi kernel: lost page write due to I/O error on sda Jan 22 01:52:42 kimchi kernel: EXT3-fs warning (device hda2): ext3_unlink: Deleting nonexistent file (2874981), 0 Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2): ext3_free_blocks: Freeing blocks not in datazone - block = 3401777460, count = 1 Jan 22 16:53:26 kimchi kernel: Aborting journal on device hda2. Jan 22 16:53:26 kimchi kernel: ext3_free_blocks: aborting transaction: Journal has aborted in __ext3_journal_get_undo_access<2>EXT3-fs error (device hda2) in ext3_free_blocks: Journal has aborted Jan 22 16:53:26 kimchi last message repeated 42 times Jan 22 16:53:26 kimchi kernel: ext3_reserve_inode_write: aborting transaction: Journal has aborted in __ext3_journal_get_write_access<2>EXT3-fs error (device hda2) in ext3_reserve_inode_write: Journal has aborted Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2) in ext3_truncate: Journal has aborted Jan 22 16:53:26 kimchi kernel: ext3_reserve_inode_write: aborting transaction: Journal has aborted in __ext3_journal_get_write_access<2>EXT3-fs error (device hda2) in ext3_reserve_inode_write: Journal has aborted Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2) in ext3_orphan_del: Journal has aborted Jan 22 16:53:26 kimchi kernel: ext3_reserve_inode_write: aborting transaction: Journal has aborted in __ext3_journal_get_write_access<2>EXT3-fs error (device hda2) in ext3_reserve_inode_write: Journal has aborted Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2) in ext3_delete_inode: Journal has aborted Jan 22 16:53:26 kimchi kernel: ext3_reserve_inode_write: aborting transaction: Journal has aborted in __ext3_journal_get_write_access<2>EXT3-fs error (device hda2) in ext3_reserve_inode_write: Journal has aborted Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2) in ext3_truncate: Journal has aborted Jan 22 16:53:26 kimchi kernel: ext3_reserve_inode_write: aborting transaction: Journal has aborted in __ext3_journal_get_write_access<2>EXT3-fs error (device hda2) in ext3_reserve_inode_write: Journal has aborted Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2) in ext3_orphan_del: Journal has aborted Jan 22 16:53:26 kimchi kernel: ext3_reserve_inode_write: aborting transaction: Journal has aborted in __ext3_journal_get_write_access<2>EXT3-fs error (device hda2) in ext3_reserve_inode_write: Journal has aborted Jan 22 16:53:26 kimchi kernel: EXT3-fs error (device hda2) in ext3_delete_inode: Journal has aborted Jan 22 16:53:26 kimchi kernel: __journal_remove_journal_head: freeing b_committed_data Jan 22 16:53:26 kimchi last message repeated 4 times Jan 22 16:53:26 kimchi kernel: ext3_abort called. Jan 22 16:53:26 kimchi kernel: EXT3-fs abort (device hda2): ext3_journal_start: Detected aborted journal Jan 22 16:53:26 kimchi kernel: Remounting filesystem read-only Jan 22 16:53:32 kimchi kernel: EXT3-fs error (device hda2) in start_transaction: Journal has aborted Jan 22 16:53:32 kimchi kernel: EXT3-fs error (device hda2) in ext3_delete_inode: Journal has aborted Jan 22 16:53:40 kimchi kernel: EXT3-fs error (device hda2) in start_transaction: Journal has aborted Jan 22 16:54:11 kimchi last message repeated 10 times Jan 22 16:55:25 kimchi last message repeated 10 times Jan 22 16:56:07 kimchi last message repeated 17 times Jan 22 16:58:27 kimchi kernel: EXT3-fs error (device hda2) in start_transaction: Journal has aborted Jan 22 16:59:16 kimchi last message repeated 11 times Jan 22 17:00:30 kimchi last message repeated 10 times Jan 22 17:01:14 kimchi last message repeated 4 times Jan 22 17:02:26 kimchi last message repeated 24 times Jan 22 17:02:36 kimchi last message repeated 7 times Jan 22 17:02:36 kimchi kernel: EXT3-fs error (device hda2) in ext3_delete_inode: Journal has aborted Jan 22 17:02:42 kimchi kernel: EXT3-fs error (device hda2) in start_transaction: Journal has aborted Jan 22 17:02:44 kimchi last message repeated 16 times Jan 22 17:03:42 kimchi dhcpcd[106]: terminating on signal 15 Jan 22 17:53:57 kimchi kernel: Linux version 2.6.1 (mike@kimchi) (gcc version 3.2.3) #11 Sun Jan 11 15:57:17 KST 2004 Jan 22 17:53:57 kimchi kernel: BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) Jan 22 17:53:57 kimchi kernel: BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) Jan 22 17:53:57 kimchi kernel: BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) Jan 22 17:53:57 kimchi kernel: BIOS-e820: 0000000000100000 - 000000001fff0000 (usable) Jan 22 17:53:57 kimchi kernel: BIOS-e820: 000000001fff0000 - 000000001fff3000 (ACPI NVS) Jan 22 17:53:57 kimchi kernel: BIOS-e820: 000000001fff3000 - 0000000020000000 (ACPI data) Jan 22 17:53:57 kimchi kernel: BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved) Jan 22 17:53:57 kimchi kernel: On node 0 totalpages: 131056 Jan 22 17:53:57 kimchi kernel: DMA zone: 4096 pages, LIFO batch:1 Jan 22 17:53:57 kimchi kernel: Normal zone: 126960 pages, LIFO batch:16 Jan 22 17:53:57 kimchi kernel: HighMem zone: 0 pages, LIFO batch:1 Jan 22 17:53:57 kimchi kernel: Building zonelist for node : 0 Jan 22 17:53:57 kimchi kernel: Kernel command line: BOOT_IMAGE=Linux-2.6.1 ro root=301 S Jan 22 17:53:57 kimchi kernel: PID hash table entries: 2048 (order 11: 16384 bytes) Jan 22 17:53:57 kimchi kernel: Detected 1004.258 MHz processor. Jan 22 17:53:57 kimchi kernel: Console: colour VGA+ 80x25 Jan 22 17:53:57 kimchi kernel: Checking if this processor honours the WP bit even in supervisor mode... Ok. Jan 22 17:53:57 kimchi kernel: Calibrating delay loop... 1986.56 BogoMIPS Jan 22 17:53:57 kimchi kernel: Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) Jan 22 17:53:57 kimchi kernel: Mount-cache hash table entries: 512 (order: 0, 4096 bytes) Jan 22 17:53:57 kimchi kernel: CPU: Intel Pentium III (Coppermine) stepping 06 Jan 22 17:53:57 kimchi kernel: POSIX conformance testing by UNIFIX Jan 22 17:53:57 kimchi kernel: PCI: Probing PCI hardware (bus 00) Jan 22 17:53:57 kimchi kernel: Transparent bridge - 0000:00:1e.0 Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 *10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 *11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 *5 6 7 10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 6 7 10 11 12 14 15) Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 9 Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 9 Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK1] enabled at IRQ 9 Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNKF] enabled at IRQ 11 Jan 22 17:53:57 kimchi kernel: ACPI: PCI Interrupt Link [LNK0] enabled at IRQ 5 Jan 22 17:53:57 kimchi kernel: pty: 256 Unix98 ptys configured Jan 22 17:53:57 kimchi kernel: hda: ST340014A, ATA DISK drive Jan 22 17:53:57 kimchi kernel: hdb: ST340014A, ATA DISK drive Jan 22 17:53:57 kimchi kernel: Using anticipatory io scheduler Jan 22 17:53:57 kimchi kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 Jan 22 17:53:57 kimchi kernel: hdc: TOSHIBA DVD-ROM SD-M1102, ATAPI CD/DVD-ROM drive Jan 22 17:53:57 kimchi kernel: hdd: SAMSUNG CD-R/RW SW-216B Q000 20010914, ATAPI CD/DVD-ROM drive Jan 22 17:53:57 kimchi kernel: ide1 at 0x170-0x177,0x376 on irq 15 Jan 22 17:53:57 kimchi kernel: hda: max request size: 1024KiB Jan 22 17:53:57 kimchi kernel: hdb: max request size: 1024KiB Jan 22 17:53:57 kimchi kernel: hdc: ATAPI 24X DVD-ROM drive, 256kB Cache, DMA Jan 22 17:53:57 kimchi kernel: hdd: ATAPI 32X CD-ROM CD-R/RW drive, 2048kB Cache, DMA Jan 22 17:53:57 kimchi kernel: VFS: Mounted root (ext3 filesystem) readonly. Jan 22 17:53:57 kimchi kernel: EXT3-fs warning: mounting fs with errors, running e2fsck is recommended Jan 22 17:53:57 kimchi kernel: ip_tables: (C) 2000-2002 Netfilter core team Jan 22 17:54:56 kimchi kernel: atkbd.c: Unknown key released (translated set 2, code 0x7a on isa0060/serio0). Jan 22 17:54:56 kimchi kernel: atkbd.c: Unknown key released (translated set 2, code 0x7a on isa0060/serio0).