We are experiencing a strange XFS corruption issue. If we look in /var/log/messages, it simply says -
--
Regards
Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248619] XFS (md0): Corruption detected. Unmount and run xfs_repair
It shuts down the filesystem after this. On rebooting, it calls xfs_repair automatically and everything comes back to normal.
We have had 2 such occurrences till now, I am attaching the relevant parts of /var/log/messages here, assuming someone can enlighten me on whats going wrong.
Machine details are as follows -
We are using Amazon AMI version: Amazon Linux AMI release 2012.09
We are running 8 EBS volumes of 512 MB each, in RAID 0 Array.
$~: uname -a
Linux ip-100-0-100-1 3.2.34-55.46.amzn1.x86_64 #1 SMP Tue Nov 20 10:06:15 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
Ask me if anyone wants any more details
Regards
Shrinath.M
Feb 12 19:47:18 ip-100-0-100-1 kernel: [2541168.014241] XFS (md0): Corruption detected. Unmount and run xfs_repair Feb 12 19:47:18 ip-100-0-100-1 kernel: [2541168.014259] XFS (md0): xfs_iunlink_remove: xfs_itobp() returned error 117. Feb 12 19:47:18 ip-100-0-100-1 kernel: [2541168.014267] XFS (md0): xfs_inactive: xfs_ifree returned error 117 Feb 12 19:47:18 ip-100-0-100-1 kernel: [2541168.014274] XFS (md0): xfs_do_force_shutdown(0x1) called from line 745 of file fs/xfs/xfs_vnodeops.c. Return address = 0xffffffffa021410f Feb 12 19:47:18 ip-100-0-100-1 kernel: [2541168.023638] XFS (md0): I/O Error Detected. Shutting down filesystem Feb 12 19:47:18 ip-100-0-100-1 kernel: [2541168.023654] XFS (md0): Please umount the filesystem and rectify the problem(s) Feb 12 19:47:43 ip-100-0-100-1 kernel: [2541193.052041] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:48:13 ip-100-0-100-1 kernel: [2541223.132038] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:48:43 ip-100-0-100-1 kernel: [2541253.212030] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:49:13 ip-100-0-100-1 kernel: [2541283.292034] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:49:43 ip-100-0-100-1 kernel: [2541313.372036] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:50:14 ip-100-0-100-1 kernel: [2541343.452034] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:50:44 ip-100-0-100-1 kernel: [2541373.532046] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:51:14 ip-100-0-100-1 kernel: [2541403.612031] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:51:44 ip-100-0-100-1 kernel: [2541433.692037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:52:14 ip-100-0-100-1 kernel: [2541463.772035] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:52:44 ip-100-0-100-1 kernel: [2541493.852034] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:53:14 ip-100-0-100-1 kernel: [2541523.932043] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:53:44 ip-100-0-100-1 kernel: [2541554.012032] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:54:14 ip-100-0-100-1 kernel: [2541584.092037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:54:44 ip-100-0-100-1 kernel: [2541614.172037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:55:14 ip-100-0-100-1 kernel: [2541644.252046] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:55:44 ip-100-0-100-1 kernel: [2541674.336034] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:56:14 ip-100-0-100-1 kernel: [2541704.412034] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:56:45 ip-100-0-100-1 kernel: [2541734.492039] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:57:15 ip-100-0-100-1 kernel: [2541764.572045] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:57:45 ip-100-0-100-1 kernel: [2541794.652045] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:58:15 ip-100-0-100-1 kernel: [2541824.732037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:58:45 ip-100-0-100-1 kernel: [2541854.812034] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:59:15 ip-100-0-100-1 kernel: [2541884.892124] XFS (md0): xfs_log_force: error 5 returned. Feb 12 19:59:45 ip-100-0-100-1 kernel: [2541914.972031] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:00:15 ip-100-0-100-1 kernel: [2541945.056036] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:00:45 ip-100-0-100-1 kernel: [2541975.132037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:01:15 ip-100-0-100-1 kernel: [2542005.212051] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:01:45 ip-100-0-100-1 kernel: [2542035.292035] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:02:15 ip-100-0-100-1 kernel: [2542065.372038] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:02:46 ip-100-0-100-1 kernel: [2542095.452035] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:03:16 ip-100-0-100-1 kernel: [2542125.532039] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:03:46 ip-100-0-100-1 kernel: [2542155.612050] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:04:16 ip-100-0-100-1 kernel: [2542185.692032] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:04:46 ip-100-0-100-1 kernel: [2542215.772046] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:05:16 ip-100-0-100-1 kernel: [2542245.852036] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:05:46 ip-100-0-100-1 kernel: [2542275.932047] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:06:16 ip-100-0-100-1 kernel: [2542306.012032] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:06:46 ip-100-0-100-1 kernel: [2542336.092028] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:07:16 ip-100-0-100-1 kernel: [2542366.172030] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:07:46 ip-100-0-100-1 kernel: [2542396.252036] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:08:16 ip-100-0-100-1 kernel: [2542426.332032] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:08:46 ip-100-0-100-1 kernel: [2542456.412033] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:09:17 ip-100-0-100-1 kernel: [2542486.492096] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:09:47 ip-100-0-100-1 kernel: [2542516.572037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:10:17 ip-100-0-100-1 kernel: [2542546.652030] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:10:47 ip-100-0-100-1 kernel: [2542576.732032] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:11:17 ip-100-0-100-1 kernel: [2542606.812042] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:11:47 ip-100-0-100-1 kernel: [2542636.892137] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:12:17 ip-100-0-100-1 kernel: [2542666.972031] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:12:47 ip-100-0-100-1 kernel: [2542697.052037] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:13:17 ip-100-0-100-1 kernel: [2542727.132042] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:13:47 ip-100-0-100-1 kernel: [2542757.212056] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:14:17 ip-100-0-100-1 kernel: [2542787.292033] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:14:47 ip-100-0-100-1 kernel: [2542817.372053] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:15:18 ip-100-0-100-1 kernel: [2542847.452077] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:15:48 ip-100-0-100-1 kernel: [2542877.532044] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:16:18 ip-100-0-100-1 kernel: [2542907.612040] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:16:48 ip-100-0-100-1 kernel: [2542937.692036] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:17:17 ip-100-0-100-1 init: serial (hvc0) main process (1763) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: tty (/dev/tty1) main process (1764) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: tty (/dev/tty2) main process (1767) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: tty (/dev/tty3) main process (1770) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: tty (/dev/tty4) main process (1773) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: tty (/dev/tty5) main process (1775) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: tty (/dev/tty6) main process (1777) killed by TERM signal Feb 12 20:17:17 ip-100-0-100-1 init: plymouth-shutdown main process (13534) terminated with status 1 Feb 12 20:17:17 ip-100-0-100-1 init: splash-manager main process (13530) terminated with status 1 Feb 12 20:17:18 ip-100-0-100-1 kernel: [2542967.772046] XFS (md0): xfs_log_force: error 5 returned. Feb 12 20:17:19 ip-100-0-100-1 ntpd[1415]: ntpd exiting on signal 15 Feb 12 20:17:20 ip-100-0-100-1 init: Disconnected from system bus Feb 12 20:17:20 ip-100-0-100-1 auditd[1301]: The audit daemon is exiting. Feb 12 20:17:20 ip-100-0-100-1 kernel: [2542969.540860] type=1305 audit(1360700240.109:361670): audit_pid=0 old=1301 auid=4294967295 ses=4294967295 res=1 Feb 12 20:17:20 ip-100-0-100-1 kernel: [2542969.644508] type=1305 audit(1360700240.213:361671): audit_enabled=0 old=1 auid=4294967295 ses=4294967295 res=1 Feb 12 20:17:20 ip-100-0-100-1 kernel: Kernel logging (proc) stopped. Feb 12 20:17:20 ip-100-0-100-1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1316" x-info="http://www.rsyslog.com"] exiting on signal 15. Feb 12 20:19:57 ip-100-0-100-1 kernel: imklog 5.8.10, log source = /proc/kmsg started. Feb 12 20:19:57 ip-100-0-100-1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1335" x-info="http://www.rsyslog.com"] start Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Initializing cgroup subsys cpuset Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Initializing cgroup subsys cpu Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Linux version 3.2.34-55.46.amzn1.x86_64 (mockbuild@gobi-build-31003) (gcc version 4.6.2 20111027 (Red Hat 4.6.2-2) (GCC) ) #1 SMP Tue Nov 20 10:06:15 UTC 2012 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Command line: root=LABEL=/ console=hvc0 LANG=en_US.UTF-8 KEYTABLE=us Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Marking TSC unstable due to Xen domain Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] ACPI in unprivileged domain disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Released 0 pages of unused memory Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Set 0 page(s) to 1-1 mapping Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] BIOS-provided physical RAM map: Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Xen: 0000000000100000 - 00000001e0800000 (usable) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] NX (Execute Disable) protection: active Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] DMI not present or invalid. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] No AGP bridge found Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] last_pfn = 0x1e0800 max_arch_pfn = 0x400000000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x400000000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] init_memory_mapping: 0000000100000000-00000001e0800000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] RAMDISK: 019a2000 - 02d74000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] NUMA turned off Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Faking a node at 0000000000000000-00000001e0800000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Initmem setup node 0 0000000000000000-00000001e0800000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] NODE_DATA [00000001dfffb000 - 00000001dfffffff] Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Zone PFN ranges: Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] DMA 0x00000010 -> 0x00001000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] DMA32 0x00001000 -> 0x00100000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Normal 0x00100000 -> 0x001e0800 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Movable zone start PFN for each node Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] early_node_map[2] active PFN ranges Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] 0: 0x00000010 -> 0x000000a0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] 0: 0x00000100 -> 0x001e0800 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] No local APIC present Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] APIC: disable apic facility Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] APIC: switched to apic NOOP Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] PCI: Unassigned devices with 32bit resource registers may break! Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Allocating PCI resources starting at 1e0900000 (gap: 1e0900000:400000) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Booting paravirtualized kernel on Xen Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Xen version: 3.4.3-2.6.18 (preserve-AD) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] PERCPU: Embedded 27 pages/cpu @ffff8801dfc00000 s80512 r8192 d21888 u1048576 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1935244 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Policy zone: Normal Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Kernel command line: root=LABEL=/ console=hvc0 LANG=en_US.UTF-8 KEYTABLE=us Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Checking aperture... Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] No AGP bridge found Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Memory: 7612316k/7872512k available (3844k kernel code, 448k absent, 259748k reserved, 2971k data, 556k init) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Hierarchical RCU implementation. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] NR_IRQS:4352 nr_irqs:288 16 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Console: colour dummy device 80x25 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] console [tty0] enabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] console [hvc0] enabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] installing Xen timer for CPU 0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.000000] Detected 2266.746 MHz processor. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4533.49 BogoMIPS (lpj=9066984) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.004000] pid_max: default: 32768 minimum: 301 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.004000] Security Framework initialized Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.004000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.005068] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006129] Mount-cache hash table entries: 256 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006393] Initializing cgroup subsys cpuacct Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006405] Initializing cgroup subsys devices Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006411] Initializing cgroup subsys freezer Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006416] Initializing cgroup subsys blkio Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006429] Initializing cgroup subsys perf_event Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006534] CPU: Physical Processor ID: 0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006540] CPU: Processor Core ID: 0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.006620] SMP alternatives: switching to UP code Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.028174] cpu 0 spinlock event irq 17 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.028204] Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.028409] installing Xen timer for CPU 1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.028425] cpu 1 spinlock event irq 23 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.028456] SMP alternatives: switching to SMP code Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.049286] Brought up 2 CPUs Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.049349] devtmpfs: initialized Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.049349] Grant table initialized Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.049349] NET: Registered protocol family 16 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.052471] PCI: setting up Xen PCI frontend stub Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.056043] bio: create slab <bio-0> at 0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.056058] ACPI: Interpreter disabled. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.056132] xen/balloon: Initialising balloon driver. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060124] xen-balloon: Initialising balloon driver. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060158] vgaarb: loaded Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060158] PCI: System does not support PCI Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060158] PCI: System does not support PCI Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060301] NetLabel: Initializing Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060307] NetLabel: domain hash size = 128 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060311] NetLabel: protocols = UNLABELED CIPSOv4 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060326] NetLabel: unlabeled traffic allowed by default Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.060334] Switching to clocksource xen Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.066914] pnp: PnP ACPI: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.074316] NET: Registered protocol family 2 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.074862] IP route cache hash table entries: 262144 (order: 9, 2097152 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.077242] TCP established hash table entries: 524288 (order: 11, 8388608 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.079475] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.079720] TCP: Hash tables configured (established 524288 bind 65536) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.079726] TCP reno registered Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.079766] UDP hash table entries: 4096 (order: 5, 131072 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.079835] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.079961] NET: Registered protocol family 1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.080115] Unpacking initramfs... Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.104125] Freeing initrd memory: 20296k freed Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.110637] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.110656] Placing 64MB software IO TLB between ffff8800fb0f3000 - ffff8800ff0f3000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.110662] software IO TLB at phys 0xfb0f3000 - 0xff0f3000 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.110870] platform rtc_cmos: registered platform RTC device (no PNP device found) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.112573] audit: initializing netlink socket (disabled) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.112592] type=2000 audit(1360700379.774:1): initialized Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.136245] VFS: Disk quotas dquot_6.5.2 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.136342] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.136395] msgmni has been set to 14907 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.136800] alg: No test for stdrng (krng) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.136954] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.136998] io scheduler noop registered (default) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.138079] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.254043] loop: module loaded Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.258888] blkfront: xvda1: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.262418] blkfront: xvdb: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.272465] xvdb: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.273878] Setting capacity to 880732160 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.273893] xvdb: detected capacity change from 0 to 450934865920 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.275405] blkfront: xvdc: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.279177] xvdc: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.284292] blkfront: xvdf: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.286728] xvdf: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.287778] Setting capacity to 880732160 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.287790] xvdc: detected capacity change from 0 to 450934865920 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.289138] blkfront: xvdg: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.291063] xvdg: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.291573] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.291586] xvdf: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.293286] blkfront: xvdh: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.295207] xvdh: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.296072] Initialising Xen virtual ethernet driver. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.296160] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.296168] xvdg: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.296583] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.296598] xvdh: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.297953] blkfront: xvdi: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.298589] i8042: PNP: No PS/2 controller found. Probing ports directly. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.299613] mousedev: PS/2 mouse device common for all mice Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.299922] TCP cubic registered Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.299930] NET: Registered protocol family 17 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.299942] Registering the dns_resolver key type Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.300055] xvdi: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.300408] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.300417] xvdi: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.300459] registered taskstats version 1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.301257] blkfront: xvdj: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.303014] xvdj: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.303415] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.303427] xvdj: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.304413] blkfront: xvdk: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.306294] xvdk: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.306548] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.306561] xvdk: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.307302] blkfront: xvdl: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.309150] xvdl: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.309407] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.309420] xvdl: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.310203] blkfront: xvdm: barrier or flush: disabled Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.311626] xvdm: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.311923] Setting capacity to 1073741824 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.311933] xvdm: detected capacity change from 0 to 549755813888 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.400043] XENBUS: Device with no driver: device/console/0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.400459] Freeing unused kernel memory: 556k freed Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.400661] Write protecting the kernel read-only data: 6144k Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.403178] Freeing unused kernel memory: 232k freed Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.403482] Freeing unused kernel memory: 468k freed Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.442489] device-mapper: uevent: version 1.0.3 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.442738] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@xxxxxxxxxx Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.613258] md: bind<xvdh> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.617192] md: bind<xvdi> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.622753] md: bind<xvdg> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.629064] md: bind<xvdj> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.636427] md: bind<xvdl> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.644348] md: bind<xvdf> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.652065] md: bind<xvdm> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.661512] md: bind<xvdk> Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.670157] md: raid0 personality registered for level 0 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.670698] bio: create slab <bio-1> at 1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.670716] md/raid0:md127: md_size is 8589930496 sectors. Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.670727] md: RAID0 configuration for md127 - 1 zone Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.670731] md: zone0=[xvdf/xvdg/xvdh/xvdi/xvdj/xvdk/xvdl/xvdm] Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.671132] zone-offset= 0KB, device-offset= 0KB, size=4294965248KB Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.671139] Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.671163] md127: detected capacity change from 0 to 4398044413952 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 0.680152] md127: unknown partition table Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 1.012334] EXT4-fs (xvda1): INFO: recovery required on readonly filesystem Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 1.012349] EXT4-fs (xvda1): write access will be enabled during recovery Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.498599] EXT4-fs (xvda1): orphan cleanup on readonly fs Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.643158] EXT4-fs (xvda1): 18 orphan inodes deleted Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.643168] EXT4-fs (xvda1): recovery complete Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.658923] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.684777] dracut: Remounting /dev/disk/by-label/\x2f with -o noatime,ro Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.697020] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.719468] dracut: Mounted root filesystem /dev/xvda1 Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.766589] dracut: Loading SELinux policy Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.866701] dracut: /sbin/load_policy: Can't load policy: No such device Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 2.975560] dracut: Switching root Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 7.901373] nf_conntrack version 0.5.0 (16384 buckets, 65536 max) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 7.983268] SCSI subsystem initialized Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 11.659684] EXT4-fs (xvda1): re-mounted. Opts: (null) Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 11.801328] kjournald starting. Commit interval 5 seconds Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 11.801654] EXT3-fs (xvdb): using internal journal Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 11.801664] EXT3-fs (xvdb): mounted filesystem with ordered data mode Feb 12 20:19:57 ip-100-0-100-1 kernel: [ 12.369189] NET: Registered protocol family 10 Feb 12 20:20:04 ip-100-0-100-1 ntpdate[1409]: step time server 138.236.128.112 offset 0.012273 sec Feb 12 20:20:04 ip-100-0-100-1 ntpd[1415]: ntpd 4.2.6p5@1.2349-o Mon Nov 26 17:29:38 UTC 2012 (1) Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: proto: precision = 0.910 usec Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: 0.0.0.0 c01d 0d kern kernel time sync enabled Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123 Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: Listen normally on 1 lo 127.0.0.1 UDP 123 Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: Listen normally on 2 eth0 10.0.1.48 UDP 123 Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: peers refreshed Feb 12 20:20:04 ip-100-0-100-1 ntpd[1416]: Listening on routing socket on fd #19 for interface updates Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.127720] md127: detected capacity change from 4398044413952 to 0 Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.127738] md: md127 stopped. Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.127747] md: unbind<xvdk> Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.136055] md: export_rdev(xvdk) Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.136122] md: unbind<xvdm> Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.148039] md: export_rdev(xvdm) Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.148108] md: unbind<xvdf> Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.168033] md: export_rdev(xvdf) Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.168371] md: unbind<xvdl> Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.204048] md: export_rdev(xvdl) Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.204111] md: unbind<xvdj> Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.240029] md: export_rdev(xvdj) Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.240080] md: unbind<xvdg> Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.304030] md: export_rdev(xvdg) Feb 12 20:22:09 ip-100-0-100-1 kernel: [ 150.304081] md: unbind<xvdi> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.340026] md: export_rdev(xvdi) Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.340080] md: unbind<xvdh> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.376053] md: export_rdev(xvdh) Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.467815] md: md0 stopped. Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.476714] md: bind<xvdg> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.478003] md: bind<xvdh> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.479101] md: bind<xvdi> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.480163] md: bind<xvdj> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.481312] md: bind<xvdk> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.482498] md: bind<xvdl> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.483348] md: bind<xvdm> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.484094] md: bind<xvdf> Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.502697] md/raid0:md0: md_size is 8589930496 sectors. Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.502712] md: RAID0 configuration for md0 - 1 zone Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.502716] md: zone0=[xvdf/xvdg/xvdh/xvdi/xvdj/xvdk/xvdl/xvdm] Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.502728] zone-offset= 0KB, device-offset= 0KB, size=4294965248KB Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.502733] Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.502759] md0: detected capacity change from 0 to 4398044413952 Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.519995] md0: unknown partition table Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.851140] SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, no debug enabled Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.853980] SGI XFS Quota Management subsystem Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 150.863890] XFS (md0): Mounting Filesystem Feb 12 20:22:10 ip-100-0-100-1 kernel: [ 151.187827] XFS (md0): Starting recovery (logdev: internal) Feb 12 20:22:12 ip-100-0-100-1 kernel: [ 152.950963] XFS (md0): Ending recovery (logdev: internal)
Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248619] XFS (md0): Corruption detected. Unmount and run xfs_repair Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248641] XFS (md0): Internal error xfs_trans_cancel at line 1925 of file fs/xfs/xfs_trans.c. Caller 0xffffffffa021738f Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248642] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248654] Pid: 8140, comm: cm-sql-server Not tainted 3.2.28-45.63.amzn1.x86_64 #1 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248681] Call Trace: Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248719] [<ffffffffa020390a>] xfs_error_report+0x3a/0x40 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248744] [<ffffffffa021738f>] ? xfs_create+0x1df/0x640 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248772] [<ffffffffa0251a49>] xfs_trans_cancel+0xe9/0x110 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248794] [<ffffffffa021738f>] xfs_create+0x1df/0x640 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248814] [<ffffffffa0207be2>] ? xfs_iunlock+0x62/0xf0 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248835] [<ffffffffa020be71>] xfs_vn_mknod+0xa1/0x1a0 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248856] [<ffffffffa020bf8b>] xfs_vn_create+0xb/0x10 [xfs] Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248871] [<ffffffff8114f8d0>] vfs_create+0xa0/0xc0 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248878] [<ffffffff8115134a>] do_last+0x57a/0x790 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248885] [<ffffffff81151ea0>] path_openat+0xd0/0x3f0 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248893] [<ffffffff811537ee>] ? user_path_at_empty+0x5e/0xa0 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248899] [<ffffffff811522d4>] do_filp_open+0x44/0xa0 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248907] [<ffffffff8115f2d2>] ? alloc_fd+0x102/0x150 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248916] [<ffffffff81142f42>] do_sys_open+0x102/0x1e0 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248927] [<ffffffff810ba44e>] ? audit_syscall_entry+0x1be/0x1e0 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248935] [<ffffffff8114304b>] sys_open+0x1b/0x20 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248945] [<ffffffff813b9012>] system_call_fastpath+0x16/0x1b Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.248953] XFS (md0): xfs_do_force_shutdown(0x8) called from line 1926 of file fs/xfs/xfs_trans.c. Return address = 0xffffffffa0251a62 Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.255999] XFS (md0): Corruption of in-memory data detected. Shutting down filesystem Mar 5 01:14:33 ip-100-0-100-1 kernel: [14139930.256031] XFS (md0): Please umount the filesystem and rectify the problem(s) Mar 5 01:14:46 ip-100-0-100-1 kernel: [14139943.904054] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:15:16 ip-100-0-100-1 kernel: [14139973.984037] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:15:46 ip-100-0-100-1 kernel: [14140004.064047] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:16:16 ip-100-0-100-1 kernel: [14140034.144035] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:16:46 ip-100-0-100-1 kernel: [14140064.224033] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:17:17 ip-100-0-100-1 kernel: [14140094.304044] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:17:47 ip-100-0-100-1 kernel: [14140124.384089] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:18:17 ip-100-0-100-1 kernel: [14140154.464046] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:18:47 ip-100-0-100-1 kernel: [14140184.544048] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:19:17 ip-100-0-100-1 kernel: [14140214.624042] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:19:47 ip-100-0-100-1 kernel: [14140244.704053] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:20:17 ip-100-0-100-1 kernel: [14140274.784037] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:20:47 ip-100-0-100-1 kernel: [14140304.864053] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:21:17 ip-100-0-100-1 kernel: [14140334.944047] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:21:47 ip-100-0-100-1 kernel: [14140365.024039] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:22:17 ip-100-0-100-1 kernel: [14140395.104048] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:22:47 ip-100-0-100-1 kernel: [14140425.184059] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:23:18 ip-100-0-100-1 kernel: [14140455.268032] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:23:48 ip-100-0-100-1 kernel: [14140485.344057] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:24:18 ip-100-0-100-1 kernel: [14140515.424049] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:24:48 ip-100-0-100-1 kernel: [14140545.504036] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:25:18 ip-100-0-100-1 kernel: [14140575.584050] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:25:48 ip-100-0-100-1 kernel: [14140605.664066] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:26:18 ip-100-0-100-1 kernel: [14140635.744039] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:26:48 ip-100-0-100-1 kernel: [14140665.824046] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:27:18 ip-100-0-100-1 kernel: [14140695.904032] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:27:48 ip-100-0-100-1 kernel: [14140725.984050] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:28:18 ip-100-0-100-1 kernel: [14140756.064031] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:28:48 ip-100-0-100-1 kernel: [14140786.144043] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:29:18 ip-100-0-100-1 kernel: [14140816.224052] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:29:49 ip-100-0-100-1 kernel: [14140846.304055] XFS (md0): xfs_log_force: error 5 returned. Mar 5 01:30:13 ip-100-0-100-1 init: tty (/dev/tty1) main process (1745) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: serial (hvc0) main process (1748) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: tty (/dev/tty2) main process (1750) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: tty (/dev/tty3) main process (1753) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: tty (/dev/tty4) main process (1755) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: tty (/dev/tty5) main process (1757) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: tty (/dev/tty6) main process (1759) killed by TERM signal Mar 5 01:30:13 ip-100-0-100-1 init: plymouth-shutdown main process (28749) terminated with status 1 Mar 5 01:30:13 ip-100-0-100-1 init: splash-manager main process (28745) terminated with status 1 Mar 5 01:30:14 ip-100-0-100-1 ntpd[1397]: ntpd exiting on signal 15 Mar 5 01:30:15 ip-100-0-100-1 init: Disconnected from system bus Mar 5 01:30:15 ip-100-0-100-1 auditd[1299]: The audit daemon is exiting. Mar 5 01:30:15 ip-100-0-100-1 kernel: [14140872.394676] type=1305 audit(1362447015.159:903786): audit_pid=0 old=1299 auid=4294967295 ses=4294967295 res=1 Mar 5 01:30:15 ip-100-0-100-1 kernel: [14140872.504066] type=1305 audit(1362447015.271:903787): audit_enabled=0 old=1 auid=4294967295 ses=4294967295 res=1 Mar 5 01:30:15 ip-100-0-100-1 kernel: Kernel logging (proc) stopped. Mar 5 01:30:15 ip-100-0-100-1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1314" x-info="http://www.rsyslog.com"] exiting on signal 15. Mar 5 01:31:20 ip-100-0-100-1 kernel: imklog 5.8.10, log source = /proc/kmsg started. Mar 5 01:31:20 ip-100-0-100-1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1310" x-info="http://www.rsyslog.com"] start Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Initializing cgroup subsys cpuset Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Initializing cgroup subsys cpu Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Linux version 3.2.28-45.63.amzn1.x86_64 (mockbuild@gobi-build-31004) (gcc version 4.4.6 20110731 (Red Hat 4.4.6-3) (GCC) ) #1 SMP Fri Aug 24 05:34:49 UTC 2012 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Command line: root=LABEL=/ console=hvc0 LANG=en_US.UTF-8 KEYTABLE=us Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Marking TSC unstable due to Xen domain Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] ACPI in unprivileged domain disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Released 0 pages of unused memory Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Set 0 page(s) to 1-1 mapping Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] BIOS-provided physical RAM map: Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Xen: 0000000000000000 - 00000000000a0000 (usable) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Xen: 00000000000a0000 - 0000000000100000 (reserved) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Xen: 0000000000100000 - 00000001e0800000 (usable) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] NX (Execute Disable) protection: active Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] DMI not present or invalid. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] No AGP bridge found Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] last_pfn = 0x1e0800 max_arch_pfn = 0x400000000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x400000000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] init_memory_mapping: 0000000100000000-00000001e0800000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] RAMDISK: 019a5000 - 02d63000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] No NUMA configuration found Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Faking a node at 0000000000000000-00000001e0800000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Initmem setup node 0 0000000000000000-00000001e0800000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] NODE_DATA [00000001dfffb000 - 00000001dfffffff] Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Zone PFN ranges: Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] DMA 0x00000010 -> 0x00001000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] DMA32 0x00001000 -> 0x00100000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Normal 0x00100000 -> 0x001e0800 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Movable zone start PFN for each node Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] early_node_map[2] active PFN ranges Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] 0: 0x00000010 -> 0x000000a0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] 0: 0x00000100 -> 0x001e0800 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] No local APIC present Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] APIC: disable apic facility Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] APIC: switched to apic NOOP Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 0000000000100000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] PCI: Warning: Cannot find a gap in the 32bit address range Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] PCI: Unassigned devices with 32bit resource registers may break! Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Allocating PCI resources starting at 1e0900000 (gap: 1e0900000:400000) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Booting paravirtualized kernel on Xen Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Xen version: 3.4.3-2.6.18 (preserve-AD) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] PERCPU: Embedded 27 pages/cpu @ffff8801dfc00000 s80512 r8192 d21888 u1048576 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1935244 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Policy zone: Normal Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Kernel command line: root=LABEL=/ console=hvc0 LANG=en_US.UTF-8 KEYTABLE=us Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Checking aperture... Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] No AGP bridge found Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Memory: 7612384k/7872512k available (3831k kernel code, 448k absent, 259680k reserved, 2986k data, 564k init) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Hierarchical RCU implementation. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] NR_IRQS:4352 nr_irqs:288 16 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Console: colour dummy device 80x25 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] console [tty0] enabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] console [hvc0] enabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] installing Xen timer for CPU 0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.000000] Detected 2266.746 MHz processor. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4533.49 BogoMIPS (lpj=9066984) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.004000] pid_max: default: 32768 minimum: 301 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.004000] Security Framework initialized Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.004000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.004879] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.005876] Mount-cache hash table entries: 256 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006089] Initializing cgroup subsys cpuacct Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006099] Initializing cgroup subsys devices Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006105] Initializing cgroup subsys freezer Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006110] Initializing cgroup subsys blkio Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006123] Initializing cgroup subsys perf_event Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006204] CPU: Physical Processor ID: 0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006209] CPU: Processor Core ID: 0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.006293] SMP alternatives: switching to UP code Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.031828] cpu 0 spinlock event irq 17 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.031970] Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.032327] installing Xen timer for CPU 1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.032342] cpu 1 spinlock event irq 23 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.032373] SMP alternatives: switching to SMP code Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.052311] Brought up 2 CPUs Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.052610] devtmpfs: initialized Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.056410] Grant table initialized Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.056445] NET: Registered protocol family 16 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.058176] PCI: setting up Xen PCI frontend stub Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.060148] bio: create slab <bio-0> at 0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.060148] ACPI: Interpreter disabled. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.060411] xen/balloon: Initialising balloon driver. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064126] xen-balloon: Initialising balloon driver. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] vgaarb: loaded Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] PCI: System does not support PCI Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] PCI: System does not support PCI Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] NetLabel: Initializing Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] NetLabel: domain hash size = 128 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] NetLabel: protocols = UNLABELED CIPSOv4 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] NetLabel: unlabeled traffic allowed by default Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.064196] Switching to clocksource xen Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.071062] pnp: PnP ACPI: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.077967] NET: Registered protocol family 2 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.078519] IP route cache hash table entries: 262144 (order: 9, 2097152 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.080914] TCP established hash table entries: 524288 (order: 11, 8388608 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083061] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083302] TCP: Hash tables configured (established 524288 bind 65536) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083308] TCP reno registered Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083348] UDP hash table entries: 4096 (order: 5, 131072 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083415] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083539] NET: Registered protocol family 1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.083611] Unpacking initramfs... Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.107495] Freeing initrd memory: 20216k freed Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.114360] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.114382] Placing 64MB software IO TLB between ffff8800fb0f3000 - ffff8800ff0f3000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.114389] software IO TLB at phys 0xfb0f3000 - 0xff0f3000 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.114593] platform rtc_cmos: registered platform RTC device (no PNP device found) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.116254] audit: initializing netlink socket (disabled) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.140897] type=2000 audit(1362447069.000:1): initialized Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.167965] VFS: Disk quotas dquot_6.5.2 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.168142] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.168353] msgmni has been set to 14907 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.168847] alg: No test for stdrng (krng) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.169109] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.169185] io scheduler noop registered (default) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.170111] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.233889] loop: module loaded Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.239661] blkfront: xvda1: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.246811] blkfront: xvdb: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.256682] xvdb: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.262806] Setting capacity to 880732160 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.262818] xvdb: detected capacity change from 0 to 450934865920 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.268257] blkfront: xvdc: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.269543] Initialising Xen virtual ethernet driver. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.271761] i8042: PNP: No PS/2 controller found. Probing ports directly. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.272903] mousedev: PS/2 mouse device common for all mice Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.273117] TCP cubic registered Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.273124] NET: Registered protocol family 17 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.273136] Registering the dns_resolver key type Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.273414] registered taskstats version 1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.278222] xvdc: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.278521] Setting capacity to 880732160 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.278529] xvdc: detected capacity change from 0 to 450934865920 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.279090] blkfront: xvdf: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.280694] xvdf: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.280946] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.280955] xvdf: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.281570] blkfront: xvdg: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.283235] xvdg: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.283466] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.283474] xvdg: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.284065] blkfront: xvdh: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.285854] xvdh: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.286079] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.286088] xvdh: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.286648] blkfront: xvdi: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.288278] xvdi: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.288507] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.288516] xvdi: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.289093] blkfront: xvdj: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.290744] xvdj: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.290976] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.290985] xvdj: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.291551] blkfront: xvdk: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.293249] xvdk: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.293475] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.293484] xvdk: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.294080] blkfront: xvdl: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.295760] xvdl: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.295992] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.296001] xvdl: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.341564] blkfront: xvdm: barrier or flush: disabled Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.343537] xvdm: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.343811] Setting capacity to 1073741824 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.343820] xvdm: detected capacity change from 0 to 549755813888 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.376036] XENBUS: Device with no driver: device/console/0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.376497] Freeing unused kernel memory: 564k freed Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.376667] Write protecting the kernel read-only data: 6144k Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.379215] Freeing unused kernel memory: 248k freed Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.379498] Freeing unused kernel memory: 476k freed Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.424640] device-mapper: uevent: version 1.0.3 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.424938] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@xxxxxxxxxx Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.546167] md: bind<xvdh> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.550535] md: bind<xvdg> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.555182] md: bind<xvdf> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.564242] md: bind<xvdl> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.634878] md: bind<xvdj> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.643855] md: bind<xvdk> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.652782] md: bind<xvdi> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.662105] md: bind<xvdm> Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670066] md: raid0 personality registered for level 0 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670268] bio: create slab <bio-1> at 1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670283] md/raid0:md127: md_size is 8589918208 sectors. Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670292] md: RAID0 configuration for md127 - 1 zone Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670298] md: zone0=[xvdf/xvdg/xvdh/xvdi/xvdj/xvdk/xvdl/xvdm] Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670312] zone-offset= 0KB, device-offset= 0KB, size=4294959104KB Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670318] Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.670339] md127: detected capacity change from 0 to 4398038122496 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 0.672711] md127: unknown partition table Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.032147] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.064561] dracut: Remounting /dev/disk/by-label/\x2f with -o noatime,ro Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.093007] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.097641] dracut: Mounted root filesystem /dev/xvda1 Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.201583] dracut: Loading SELinux policy Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.367920] dracut: /sbin/load_policy: Can't load policy: No such device Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 1.461984] dracut: Switching root Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 6.757631] nf_conntrack version 0.5.0 (16384 buckets, 65536 max) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 6.880038] SCSI subsystem initialized Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 7.328511] EXT4-fs (xvda1): re-mounted. Opts: (null) Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 7.554407] kjournald starting. Commit interval 5 seconds Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 7.554754] EXT3-fs (xvdb): using internal journal Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 7.554763] EXT3-fs (xvdb): mounted filesystem with ordered data mode Mar 5 01:31:20 ip-100-0-100-1 kernel: [ 8.455121] NET: Registered protocol family 10 Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.244240] md127: detected capacity change from 4398038122496 to 0 Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.244257] md: md127 stopped. Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.244265] md: unbind<xvdm> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.260062] md: export_rdev(xvdm) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.260199] md: unbind<xvdi> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.272074] md: export_rdev(xvdi) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.272132] md: unbind<xvdk> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.284061] md: export_rdev(xvdk) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.284121] md: unbind<xvdj> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.340085] md: export_rdev(xvdj) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.340374] md: unbind<xvdl> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.368075] md: export_rdev(xvdl) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.368140] md: unbind<xvdf> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.380060] md: export_rdev(xvdf) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.380128] md: unbind<xvdg> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.408059] md: export_rdev(xvdg) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.408122] md: unbind<xvdh> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.440058] md: export_rdev(xvdh) Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.466272] md: md0 stopped. Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.474154] md: bind<xvdg> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.475207] md: bind<xvdh> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.476115] md: bind<xvdi> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.476993] md: bind<xvdj> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.478148] md: bind<xvdk> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.478984] md: bind<xvdl> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.479975] md: bind<xvdm> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.480837] md: bind<xvdf> Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.495680] md/raid0:md0: md_size is 8589918208 sectors. Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.495693] md: RAID0 configuration for md0 - 1 zone Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.495697] md: zone0=[xvdf/xvdg/xvdh/xvdi/xvdj/xvdk/xvdl/xvdm] Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.495709] zone-offset= 0KB, device-offset= 0KB, size=4294959104KB Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.495715] Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.495740] md0: detected capacity change from 0 to 4398038122496 Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.516737] md0: unknown partition table Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.786885] SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, no debug enabled Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.787293] SGI XFS Quota Management subsystem Mar 5 01:33:34 ip-100-0-100-1 kernel: [ 145.789442] XFS (md0): Mounting Filesystem Mar 5 01:33:35 ip-100-0-100-1 kernel: [ 146.274464] XFS (md0): Starting recovery (logdev: internal) Mar 5 01:33:42 ip-100-0-100-1 kernel: [ 153.274667] XFS (md0): Ending recovery (logdev: internal)
_______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs