I have a large (70 TB) XFS filesystem which I am unable to mount. The
mount command hangs for a very long time, and /var/log/messages shows
the following:
Sep 1 16:49:00 myhost kernel: XFS (dm-2): Mounting V4 Filesystem
Sep 1 16:49:00 myhost kernel: XFS (dm-2): Starting recovery (logdev:
internal)
Sep 1 16:49:04 myhost kernel: XFS: Internal error
XFS_WANT_CORRUPTED_GOTO at line 1649 of file fs/xfs/xfs_alloc.c. Caller
xfs_free_extent+0xe5/0x120 [xfs]
Sep 1 16:49:04 myhost kernel: CPU: 1 PID: 2380 Comm: mount Tainted: PF
O-------------- 3.10.0-229.el7.x86_64 #1
Sep 1 16:49:04 myhost kernel: Hardware name: Supermicro Super
Server/X10DRL-i, BIOS 2.0 12/18/2015
Sep 1 16:49:04 myhost kernel: 0000000000000026 00000000555eb038
ffff8800366c3b00 ffffffff81604b0a
Sep 1 16:49:04 myhost kernel: ffff8800366c3b18 ffffffffa031d08b
ffffffffa0337f45 ffff8800366c3bb8
Sep 1 16:49:04 myhost kernel: ffffffffa0336d34 ffff88085e40b000
ffff88045ad04780 ffff8804612bacc0
Sep 1 16:49:04 myhost kernel: Call Trace:
Sep 1 16:49:04 myhost kernel: [<ffffffff81604b0a>] dump_stack+0x19/0x1b
Sep 1 16:49:04 myhost kernel: [<ffffffffa031d08b>]
xfs_error_report+0x3b/0x40 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0337f45>] ?
xfs_free_extent+0xe5/0x120 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0336d34>]
xfs_free_ag_extent+0x634/0x750 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0337f45>]
xfs_free_extent+0xe5/0x120 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa036d4b0>]
xlog_recover_process_efi+0x170/0x1b0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa037d214>] ?
xfs_trans_ail_cursor_init+0x24/0x30 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa036f4b4>]
xlog_recover_process_efis.isra.27+0x74/0xd0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0372841>]
xlog_recover_finish+0x21/0xb0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0377404>]
xfs_log_mount_finish+0x34/0x50 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa032d399>]
xfs_mountfs+0x499/0x740 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0330872>]
xfs_fs_fill_super+0x2b2/0x330 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffff811ca300>] mount_bdev+0x1b0/0x1f0
Sep 1 16:49:04 myhost kernel: [<ffffffffa03305c0>] ?
xfs_parseargs+0xbf0/0xbf0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa032e7b5>]
xfs_fs_mount+0x15/0x20 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffff811cac39>] mount_fs+0x39/0x1b0
Sep 1 16:49:04 myhost kernel: [<ffffffff81178810>] ?
__alloc_percpu+0x10/0x20
Sep 1 16:49:04 myhost kernel: [<ffffffff811e613f>] vfs_kern_mount+0x5f/0xf0
Sep 1 16:49:04 myhost kernel: [<ffffffff811e868e>] do_mount+0x24e/0xa40
Sep 1 16:49:04 myhost kernel: [<ffffffff8117357b>] ? strndup_user+0x4b/0xf0
Sep 1 16:49:04 myhost kernel: [<ffffffff811e8f16>] SyS_mount+0x96/0xf0
Sep 1 16:49:04 myhost kernel: [<ffffffff81614a29>]
system_call_fastpath+0x16/0x1b
Sep 1 16:49:04 myhost kernel: XFS (dm-2): Internal error
xfs_trans_cancel at line 958 of file fs/xfs/xfs_trans.c. Caller
xlog_recover_process_efi+0x184/0x1b0 [xfs]
Sep 1 16:49:04 myhost kernel: CPU: 1 PID: 2380 Comm: mount Tainted: PF
O-------------- 3.10.0-229.el7.x86_64 #1
Sep 1 16:49:04 myhost kernel: Hardware name: Supermicro Super
Server/X10DRL-i, BIOS 2.0 12/18/2015
Sep 1 16:49:04 myhost kernel: ffff8800367dc828 00000000555eb038
ffff8800366c3c10 ffffffff81604b0a
Sep 1 16:49:04 myhost kernel: ffff8800366c3c28 ffffffffa031d08b
ffffffffa036d4c4 ffff8800366c3c50
Sep 1 16:49:04 myhost kernel: ffffffffa03333f9 ffff88045bd24640
ffff88045bd246e0 0000000000000001
Sep 1 16:49:04 myhost kernel: Call Trace:
Sep 1 16:49:04 myhost kernel: [<ffffffff81604b0a>] dump_stack+0x19/0x1b
Sep 1 16:49:04 myhost kernel: [<ffffffffa031d08b>]
xfs_error_report+0x3b/0x40 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa036d4c4>] ?
xlog_recover_process_efi+0x184/0x1b0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa03333f9>]
xfs_trans_cancel+0xd9/0x100 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa036d4c4>]
xlog_recover_process_efi+0x184/0x1b0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa036f4b4>]
xlog_recover_process_efis.isra.27+0x74/0xd0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0372841>]
xlog_recover_finish+0x21/0xb0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0377404>]
xfs_log_mount_finish+0x34/0x50 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa032d399>]
xfs_mountfs+0x499/0x740 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa0330872>]
xfs_fs_fill_super+0x2b2/0x330 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffff811ca300>] mount_bdev+0x1b0/0x1f0
Sep 1 16:49:04 myhost kernel: [<ffffffffa03305c0>] ?
xfs_parseargs+0xbf0/0xbf0 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffffa032e7b5>]
xfs_fs_mount+0x15/0x20 [xfs]
Sep 1 16:49:04 myhost kernel: [<ffffffff811cac39>] mount_fs+0x39/0x1b0
Sep 1 16:49:04 myhost kernel: [<ffffffff81178810>] ?
__alloc_percpu+0x10/0x20
Sep 1 16:49:04 myhost kernel: [<ffffffff811e613f>] vfs_kern_mount+0x5f/0xf0
Sep 1 16:49:04 myhost kernel: [<ffffffff811e868e>] do_mount+0x24e/0xa40
Sep 1 16:49:04 myhost kernel: [<ffffffff8117357b>] ? strndup_user+0x4b/0xf0
Sep 1 16:49:04 myhost kernel: [<ffffffff811e8f16>] SyS_mount+0x96/0xf0
Sep 1 16:49:04 myhost kernel: [<ffffffff81614a29>]
system_call_fastpath+0x16/0x1b
Sep 1 16:49:04 myhost kernel: XFS (dm-2): xfs_do_force_shutdown(0x8)
called from line 959 of file fs/xfs/xfs_trans.c. Return address =
0xffffffffa0333412
Sep 1 16:49:04 myhost kernel: XFS (dm-2): Corruption of in-memory data
detected. Shutting down filesystem
Sep 1 16:49:04 myhost kernel: XFS (dm-2): Please umount the filesystem
and rectify the problem(s)
Sep 1 16:49:04 myhost kernel: XFS (dm-2): Failed to recover EFIs
Sep 1 16:49:04 myhost kernel: XFS (dm-2): log mount finish failed
Sep 1 16:49:04 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
Sep 1 16:49:05 myhost kernel: XFS (dm-2): xfs_log_force: error 5 returned.
The error 5 message repeats continuously.
I am running Centos 7. The filesystem is on a logical volume which
resides on a volume group made up of 3 software raid devices.
Any help would be greatly appreciated. Thanks.
Kyle
--
To unsubscribe from this list: send the line "unsubscribe linux-xfs" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
