On Tue, Dec 8, 2015 at 4:17 PM, President <president@xxxxxxxxxxxxxxxxxx> wrote: > Not sure if this actually made it to the list the first time. > > > Here is the SERIAL output (bottom of message after your questions). > Googling the error indicates it's something people ran into a few years back > but was supposedly fixed. Any ideas? > > > I can verify that if I REMOVE the second CPU, it boots into Xen kernel no > problem. The CPU itself doesn't matter, as I can swap either CPU into the > first slot, and it boots. Only if there is a second CPU does it fail. Great, thanks for the report. This looks like a bug in upstream Xen -- would you mind re-posting this (with the serial output) on the xen-users mailing list? That will get more eyeballs on the problem. -George > > > -----Original message----- > From: George Dunlap <dunlapg@xxxxxxxxx> > Sent: Monday 30th November 2015 6:00 > To: Discussion about the virtualization on CentOS <centos-virt@xxxxxxxxxx> > Subject: Re: new install of Xen 4.6 hangs on Loading initial > ramdisk > > > > On Fri, Nov 27, 2015 at 11:18 PM, Craig Thompson > <president@xxxxxxxxxxxxxxxxxx> wrote: >> >> First post to this list. I would appreciate some help on this issue. >> >> As background, I installed CentOS 7 on a Dell server, and then ran the >> following commands: >> >> yum update >> http://buildlogs.centos.org/centos/7/virt/x86_64/xen/centos-release-xen-7-11.el7.x86_64.rpm >> yum --enablerepo=centos-virt-xen-testing update >> yum --enablerepo=centos-virt-xen-testing install xen >> >> Doing that, I was able to successfully install Xen, create a virtual >> machine with its own HVM setup, logical volume, etc. and boot it just fine. >> >> I then tried to do the same on an IBM x3550 server I’m trying to install >> with CentOS 7. The CentOS 7 install went just fine. I can boot into the >> standard kernel and have a working machine. But after running the commands >> above to install the Xen hypervisor, the machine hangs on boot for a few >> moments after displaying the lines below and then reboots in a loop over and >> over and over: >> >> Loading Xen 4.6.0-2.el7 … >> Loading Linux 3.18.21-16.el7.x86_64 … >> Loading initial ramdisk … >> >> It never gets beyond that. If I choose the stock kernel (no Xen) from the >> Grub menu, it will continue to boot into that just fine. >> >> My grub.cfg file has these entries of note: >> >> multiboot /xen-4.6.0-2.el7.gz placeholder dom0_mem=1024M,max:1024M >> cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all >> ${xen_rm_opts} >> echo 'Loading Linux 3.18.21-16.el7.x86_64 ...' >> module /vmlinuz-3.18.21-16.el7.x86_64 placeholder >> root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde ro crashkernel=auto debug >> irqpoll ipv6.disable=1 console=hvc0 earlyprintk=xen nomodeset >> echo 'Loading initial ramdisk ...' >> module --nounzip /initramfs-3.18.21-16.el7.x86_64.img >> >> >> What I have tried: >> >> 1) adding debug into the vmlinuz line >> 2) disabling ipv6 in that line >> 3) adding root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde to the last line >> AFTER /initramfs …. >> >> Nothing so far has made any difference. Obviously the process works, as >> it works for me just fine on the Dell server. >> >> Underlying this machine is a SATA RAID 1 PCI card with two SSD drives >> attached in a RAID 1 mirror. Not that that should matter, but I’m including >> it for reference. As noted previously, it boots into the stock kernel just >> fine. >> >> Any help would be appreciated. > > > Thanks for the testing and the report. > > Have you tried booting the Xen4CentOS kernel (Linux-3.18.21-16) by itself > (i.e., not under Xen)? > > Also, is there any chance you could get the output of a serial console? > That's pretty critical for debugging this sort of thing. > CentOS-virt mailing list > > > > ### No such file or directory opening port > (XEN) Bad console= option 'tty' > Xen 4.6.0-2.el7 > (XEN) Xen version 4.6.0-2.el7 (mockbuild@xxxxxxxxxx) (gcc (GCC) 4.8.3 > 20140911 (Red Hat 4.8.3-9)) debug=n Tue Nov 3 17:23:39 UTC 2015 > (XEN) Latest ChangeSet: Mon Oct 19 12:05:21 2015 +0100 git:36b6fe9-dirty > (XEN) Bootloader: GRUB 2.02~beta2 > (XEN) Command line: placeholder dom0_mem=1024M,max:1024M cpuinfo > com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all > (XEN) Video information: > (XEN) VGA is text mode 80x25, font 8x16 > (XEN) VBE/DDC methods: V2; EDID transfer time: 2 seconds > (XEN) Disc information: > (XEN) Found 1 MBR signatures > (XEN) Found 1 EDD information structures > (XEN) Xen-e820 RAM map: > (XEN) 0000000000000000 - 000000000009c800 (usable) > (XEN) 000000000009c800 - 00000000000a0000 (reserved) > (XEN) 00000000000e0000 - 0000000000100000 (reserved) > (XEN) 0000000000100000 - 00000000bffcba40 (usable) > (XEN) 00000000bffcba40 - 00000000bffcee00 (ACPI data) > (XEN) 00000000bffcee00 - 00000000c0000000 (reserved) > (XEN) 00000000fec00000 - 0000000100000000 (reserved) > (XEN) 0000000100000000 - 00000001fee00000 (usable) > (XEN) 00000001fee00000 - 00000001fef00000 (reserved) > (XEN) 00000001fef00000 - 00000002fee00000 (usable) > (XEN) 00000002fee00000 - 00000002fef00000 (reserved) > (XEN) 00000002fef00000 - 00000003fee00000 (usable) > (XEN) 00000003fee00000 - 00000003fef00000 (reserved) > (XEN) 00000003fef00000 - 0000000840000000 (usable) > (XEN) ACPI: RSDP 000FDFD0, 0024 (r2 IBM ) > (XEN) ACPI: XSDT BFFCED00, 004C (r1 IBM SERDEFNT 1000 IBM 45444F43) > (XEN) ACPI: FACP BFFCEC40, 0084 (r2 IBM SERDEFNT 1000 IBM 45444F43) > (XEN) ACPI: DSDT BFFCBA40, 246C (r2 IBM SERDEFNT 1000 INTL 20041203) > (XEN) ACPI: FACS BFFCE980, 0040 > (XEN) ACPI: APIC BFFCEB80, 0084 (r1 IBM SERDEFNT 1000 IBM 45444F43) > (XEN) ACPI: SRAT BFFCEA40, 00E8 (r1 IBM SERDEFNT 1000 IBM 45444F43) > (XEN) ACPI: HPET BFFCEA00, 0038 (r1 IBM SERDEFNT 1000 IBM 45444F43) > (XEN) ACPI: MCFG BFFCE9C0, 003C (r1 IBM SERDEFNT 1000 IBM 45444F43) > (XEN) System RAM: 32764MB (33550748kB) > (XEN) SRAT: PXM 0 -> APIC 0 -> Node 0 > (XEN) SRAT: PXM 0 -> APIC 1 -> Node 0 > (XEN) SRAT: PXM 0 -> APIC 6 -> Node 0 > (XEN) SRAT: PXM 0 -> APIC 7 -> Node 0 > (XEN) SRAT: Node 0 PXM 0 0-c0000000 > (XEN) SRAT: Node 0 PXM 0 100000000-840000000 > (XEN) SRAT: Node 0 PXM 0 840000000-1000000000 (hotplug) > (XEN) NUMA: Allocated memnodemap from 83d5cd000 - 83d5ce000 > (XEN) NUMA: Using 18 for the hash shift. > (XEN) Domain heap initialised > (XEN) found SMP MP-table at 0009c940 > (XEN) DMI 2.4 present. > (XEN) Using APIC driver default > (XEN) ACPI: PM-Timer IO Port: 0x588 > (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:584,1:0], pm1x_evt[1:580,1:0] > (XEN) ACPI: wakeup_vec[bffce98c], vec_size[20] > (XEN) ACPI: Local APIC address 0xfee00000 > (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) > (XEN) Processor #0 6:15 APIC version 20 > (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) > (XEN) Processor #1 6:15 APIC version 20 > (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x06] enabled) > (XEN) Processor #6 6:15 APIC version 20 > (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled) > (XEN) Processor #7 6:15 APIC version 20 > (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1]) > (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1]) > (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1]) > (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0x1]) > (XEN) ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0]) > (XEN) IOAPIC[0]: apic_id 14, version 32, address 0xfec00000, GSI 0-23 > (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) > (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) > (XEN) ACPI: IRQ0 used by override. > (XEN) ACPI: IRQ2 used by override. > (XEN) ACPI: IRQ9 used by override. > (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs > (XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000 > (XEN) ERST table was not found > (XEN) Using ACPI (MADT) for SMP configuration information > (XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs) > (XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X > (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K > (XEN) CPU: L2 cache: 4096K > (XEN) CPU: Physical Processor ID: 0 > (XEN) CPU: Processor Core ID: 0 > (XEN) CMCI: CPU0 has no CMCI support > (XEN) CPU0: Thermal monitoring enabled (TM2) > (XEN) Intel machine check reporting enabled > (XEN) Using scheduler: SMP Credit Scheduler (credit) > (XEN) Initializing CPU#0 > (XEN) Detected 2000.117 MHz processor. > (XEN) Initing memory sharing. > (XEN) alt table ffff82d0802b8b50 -> ffff82d0802b9f24 > (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - 14 > (XEN) PCI: Not using MCFG for segment 0000 bus 00-14 > (XEN) I/O virtualisation disabled > (XEN) CPU0: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 > (XEN) ENABLING IO-APIC IRQs > (XEN) -> Using new ACK method > (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1 > (XEN) Platform timer is 14.318MHz HPET > (XEN) Allocated console ring of 32 KiB. > (XEN) mwait-idle: does not run on family 6 model 15 > (XEN) VMX: Supported advanced features: > (XEN) - APIC TPR shadow > (XEN) - MSR direct-access bitmap > (XEN) HVM: ASIDs disabled. > (XEN) HVM: VMX enabled > (XEN) HVM: Hardware Assisted Paging (HAP) not detected > (XEN) HVM: PVH mode not supported on this platform > (XEN) CPU 0 APIC 0 -> Node 0 > (XEN) CPU 1 APIC 1 -> Node 0 > (XEN) Booting processor 1/1 eip 8c000 > (XEN) Initializing CPU#1 > (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K > (XEN) CPU: L2 cache: 4096K > (XEN) CPU: Physical Processor ID: 0 > (XEN) CPU: Processor Core ID: 1 > (XEN) CMCI: CPU1 has no CMCI support > (XEN) CPU1: Thermal monitoring enabled (TM2) > (XEN) CPU1: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 > (XEN) CPU 2 APIC 6 -> Node 0 > (XEN) Booting processor 2/6 eip 8c000 > (XEN) Initializing CPU#2 > (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K > (XEN) CPU: L2 cache: 4096K > (XEN) CPU: Physical Processor ID: 3 > (XEN) CPU: Processor Core ID: 0 > (XEN) CMCI: CPU2 has no CMCI support > (XEN) CPU2: Thermal monitoring enabled (TM2) > (XEN) CPU2: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 > (XEN) ----[ Xen-4.6.0-2.el7 x86_64 debug=n Not tainted ]---- > (XEN) CPU: 2 > (XEN) RIP: e008:[<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340 > (XEN) RFLAGS: 0000000000010006 CONTEXT: hypervisor > (XEN) rax: 0000000000000020 rbx: 0000000000000200 rcx: 00000037bd295580 > (XEN) rdx: 0000000000000003 rsi: 0000000000000000 rdi: 0000000000000002 > (XEN) rbp: 00000000000000c8 rsp: ffff83083d597e90 r8: 00000037bd295580 > (XEN) r9: 00000037bd295580 r10: 0000000000000007 r11: 0000000000000001 > (XEN) r12: 0000000000000002 r13: 0000000000000002 r14: 0000000000000000 > (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000000026e0 > (XEN) cr3: 00000000bfc70000 cr2: 0000000000000020 > (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 > (XEN) Xen stack trace from rsp=ffff83083d597e90: > (XEN) ffff82d0802f4380 0000000000000012 0000000000000000 00000100801ad1e1 > (XEN) ffff82d0802f4380 0000000000000000 00000000000000c8 0000000000000002 > (XEN) 0000000000000002 0000000000000000 0000000000000000 ffff82d08018206c > (XEN) 0000000000000000 0000000000000001 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 > (XEN) 0000000000000000 0000000000000000 0000000000000002 ffff8300bfd0b000 > (XEN) 00000037bd295580 0000000000000000 > (XEN) Xen call trace: > (XEN) [<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340 > (XEN) [<ffff82d08018206c>] start_secondary+0x1bc/0x260 > (XEN) > (XEN) Pagetable walk from 0000000000000020: > (XEN) L4[0x000] = 000000083d5c1063 ffffffffffffffff > (XEN) L3[0x000] = 000000083d5c0063 ffffffffffffffff > (XEN) L2[0x000] = 000000083d5bf063 ffffffffffffffff > (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff > (XEN) > (XEN) **************************************** > (XEN) Panic on CPU 2: > (XEN) FATAL PAGE FAULT > (XEN) [error_code=0002] > (XEN) Faulting linear address: 0000000000000020 > (XEN) **************************************** > (XEN) > (XEN) Reboot in five seconds... > (XEN) Resetting with ACPI MEMORY or I/O RESET_REG. > > > > > _______________________________________________ > CentOS-virt mailing list > CentOS-virt@xxxxxxxxxx > https://lists.centos.org/mailman/listinfo/centos-virt > _______________________________________________ CentOS-virt mailing list CentOS-virt@xxxxxxxxxx https://lists.centos.org/mailman/listinfo/centos-virt