On Sat, 13 Aug 2022 17:45:22 -0700, Andres Freund <andres@xxxxxxxxxxx> wrote: > Hi, > > On 2022-08-12 11:42:50 -0400, Michael S. Tsirkin wrote: > > The following changes since commit 3d7cb6b04c3f3115719235cc6866b10326de34cd: > > > > Linux 5.19 (2022-07-31 14:03:01 -0700) > > > > are available in the Git repository at: > > > > https://git.kernel.org/pub/scm/linux/kernel/git/mst/vhost.git tags/for_linus > > > > for you to fetch changes up to 93e530d2a1c4c0fcce45e01ae6c5c6287a08d3e3: > > > > vdpa/mlx5: Fix possible uninitialized return value (2022-08-11 10:00:36 -0400) > > ---------------------------------------------------------------- > > virtio: fatures, fixes > > > > A huge patchset supporting vq resize using the > > new vq reset capability. > > Features, fixes, cleanups all over the place. > > > > Signed-off-by: Michael S. Tsirkin <mst@xxxxxxxxxx> > > > > ---------------------------------------------------------------- > > I have a script [1] that daily builds google cloud VM images with a fresh vanilla > kernel for postgres CI testing. The last successful image creation was > 7ebfc85e2cd7b08f518b526173e9a33b56b3913b > and the first failing was > 69dac8e431af26173ca0a1ebc87054e01c585bcc > > Since then creating a new kernel boots but network does not come up. > > Looking at the merges between those commit makes me suspect this merge: > > 69dac8e431af Merge tag 'riscv-for-linus-5.20-mw2' of git://git.kernel.org/pub/scm/linux/kernel/git/riscv/linux > 6c833c0581f1 Merge tag 'devicetree-fixes-for-6.0-1' of git://git.kernel.org/pub/scm/linux/kernel/git/robh/linux > 3d076fec5a0c Merge tag 'rtc-6.0' of git://git.kernel.org/pub/scm/linux/kernel/git/abelloni/linux > 4a9350597aff Merge tag 'sound-fix-6.0-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound > 7a53e17accce Merge tag 'for_linus' of git://git.kernel.org/pub/scm/linux/kernel/git/mst/vhost > 999324f58c41 Merge tag 'loongarch-5.20' of git://git.kernel.org/pub/scm/linux/kernel/git/chenhuacai/linux-loongson > f7cdaeeab8ca Merge tag 'for-v6.0' of git://git.kernel.org/pub/scm/linux/kernel/git/sre/linux-power-supply > d16b418fac3d Merge tag 'vfio-v6.0-rc1pt2' of https://github.com/awilliam/linux-vfio > 9801002f76c6 perf: riscv_pmu{,_sbi}: Miscallenous improvement & fixes > c3adefb5baf3 Merge tag 'for-6.0/dm-fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/device-mapper/linux-dm > 7ce2aa6d7fe1 Merge tag 'drm-next-2022-08-12-1' of git://anongit.freedesktop.org/drm/drm > 7ab52f75a9cf RISC-V: Add Sstc extension support > 36fa1cb56ac5 Merge tag 'drm-misc-next-fixes-2022-08-10' of git://anongit.freedesktop.org/drm/drm-misc into drm-next > da06cc5bb600 RISC-V: fixups to work with crash tool > 6de9eb21cd36 Merge 'irq/loongarch', 'pci/ctrl/loongson' and 'pci/header-cleanup-immutable' > 3aefb2ee5bdd riscv: implement Zicbom-based CMO instructions + the t-head variant > 8f2f74b4b6e6 RISC-V: Canaan devicetree fixes > f94ba7039fb4 Merge tag 'at91-reset-sama7g5-signed' into psy-next > > all the drivers/net changes in that commit range were part of this pull > request. > > > excerpt from serial log for debian sid kernel (sorry for the interspersed logs): > > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 cloud-ifupdown-helper: Generated configuration for ens4 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kern[ OK ] Finished Raise network interfaces. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Found device Virtio network device. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Commit a transient machine-id on disk was skipped because of a failed condition check (ConditionPathIsMountPoint[ OK ] Reached target Network. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Started ifup for ens4. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.354044] x86: [ OK ] Reached target Network is Online. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: Internet Systems Consortium DHCP Client 4.4.3 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: Internet Systems Consortium DHCP Client 4.4.3 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: Copyright 2004-2022 Internet Systems Consortium. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: For info, please visit https://www.isc.org/software/dhcp/ > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: Copyright 2004-2022 Internet Systems Consortium. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: For info, please visit https://www.isc.org/software/dhcp/ > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Starting Raise network interfaces... > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 ifup[356]: ifup: waiting for lock on /run/network/ifstate.ens4 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: Listening on LPF/ens4/42:01:0a:a8:00:07 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: Listening on LPF/ens4/42:01:0a:a8:00:07 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: Sending on LPF/ens4/42:01:0a:a8:00:07 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: Sending on LPF/ens4/42:01:0a:a8:00:07 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: DHCPDISCOVER on ens4 to 255.255.255.255 port 67 interval 7 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.400657] NET: Registered PF_NETLINK/PF_ROUTE protocol family > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: DHCPDISCOVER on ens4 to 255.255.255.255 port 67 interval 7 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.408289] audit: initializing netlink subsys (disabled) > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: DHCPOFFER of 10.168.0.7 from 169.254.169.254 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: DHCPOFFER of 10.168.0.7 from 169.254.169.254 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: DHCPREQUEST for 10.168.0.7 on ens4 to 255.255.255.255 port 67 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: DHCPREQUEST for 10.168.0.7 on ens4 to 255.255.255.255 port 67 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 dhclient[354]: DHCPACK of 10.168.0.7 from 169.254.169.254 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[354]: DHCPACK of 10.168.0.7 from 169.254.169.254 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.549954] NetLabel: Initializing > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.550736] NetLabel: domain hash size = 128 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.551480] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.552303] NetLabel: unlabeled traffic allowed by default > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.570445] NET: Registered PF_INET protocol family > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.586842] NET: Registered PF_UNIX/PF_LOCAL protocol family > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.587916] NET: Registered PF_XDP protocol family > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.865585] NET: Registered PF_INET6 protocol family > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 kernel: [ 0.872235] NET: Registered PF_PACKET protocol family > rnel: [ 1.153962] virtio_net virtio1 ens4: renamed from eth0 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 sh[474]: ens4=ens4 > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Finished Raise network interfaces. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Reached target Network. > Aug 13 22:44:15 build-sid-newkernel-2022-08-13t22-41 systemd[1]: Reached target Network is Online. > > rebooting into the new kernel: > > [ 0.475837] NET: Registered PF_NETLINK/PF_ROUTE protocol family > [ 0.476558] audit: initializing netlink subsys (disabled) > [ 0.630598] NetLabel: Initializing > [ 0.631503] NetLabel: domain hash size = 128 > [ 0.632409] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO > [ 0.632515] NetLabel: unlabeled traffic allowed by default > [ 0.654654] NET: Registered PF_INET protocol family > [ 0.672514] NET: Registered PF_UNIX/PF_LOCAL protocol family > [ 0.871362] Initializing XFRM netlink socket > [ 0.872171] NET: Registered PF_INET6 protocol family > [ 0.875791] NET: Registered PF_PACKET protocol family > [ 0.876932] 9pnet: Installing 9P2000 support > [ 0.887570] printk: console [netcon0] enabled > [ 0.888339] netconsole: network logging started > [ 0.943112] virtio_net virtio1 enp0s4: renamed from eth0 > Starting Raise network interfaces... > [ OK ] Found device Virtio network device. > [ 1.876517] IPv6: ADDRCONF(NETDEV_CHANGE): enp0s4: link becomes ready > Aug 13 22:51:16 debian systemd[1]: Starting Raise network interfaces... > Aug 13 22:51:16 debian dhclient[349]: Internet Systems Consortium DHCP Client 4.4.3 > Aug 13 22:51:16 debian ifup[349]: Internet Systems Consortium DHCP Client 4.4.3 > Aug 13 22:51:16 debian ifup[349]: Copyright 2004-2022 Internet Systems Consortium. > Aug 13 22:51:16 debian ifup[349]: For info, please visit https://www.isc.org/software/dhcp/ > Aug 13 22:51:16 debian dhclient[349]: Copyright 2004-2022 Internet Systems Consortium. > Aug 13 22:51:16 debian dhclient[349]: For info, please visit https://www.isc.org/software/dhcp/ > Aug 13 22:51:16 debian kernel: [ 0.475837] NET: Registered PF_NETLINK/PF_ROUTE protocol family > Aug 13 22:51:16 debian kernel: [ 0.476558] audit: initializing netlink subsys (disabled) > Aug 13 22:51:16 debian systemd[1]: Found device Virtio network device. > Aug 13 22:51:16 debian ifup[349]: DHCPDISCOVER on enp0s4 to 255.255.255.255 port 67 interval 6 > Aug 13 22:51:16 debian dhclient[349]: DHCPDISCOVER on enp0s4 to 255.255.255.255 port 67 interval 6 > Aug 13 22:51:16 debian sh[356]: ifup: waiting for lock on /run/network/ifstate.enp0s4 > Aug 13 22:51:16 debian kernel: [ 0.630598] NetLabel: Initializing > Aug 13 22:51:16 debian kernel: [ 0.631503] NetLabel: domain hash size = 128 > Aug 13 22:51:16 debian kernel: [ 0.632409] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO > Aug 13 22:51:16 debian kernel: [ 0.632515] NetLabel: unlabeled traffic allowed by default > Aug 13 22:51:16 debian kernel: [ 0.654654] NET: Registered PF_INET protocol family > Aug 13 22:51:16 debian kernel: [ 0.672514] NET: Registered PF_UNIX/PF_LOCAL protocol family > Aug 13 22:51:16 debian kernel: [ 0.871362] Initializing XFRM netlink socket > Aug 13 22:51:16 debian kernel: [ 0.872171] NET: Registered PF_INET6 protocol family > Aug 13 22:51:16 debian kernel: [ 0.875791] NET: Registered PF_PACKET protocol family > Aug 13 22:51:16 debian kernel: [ 0.876932] 9pnet: Installing 9P2000 support > Aug 13 22:51:16 debian kernel: [ 0.887570] printk: console [netcon0] enabled > Aug 13 22:51:16 debian kernel: [ 0.888339] netconsole: network logging started > Aug 13 22:51:16 debian kernel: [ 0.943112] virtio_net virtio1 enp0s4: renamed from eth0 > Aug 13 22:51:16 debian kernel: [ 1.876517] IPv6: ADDRCONF(NETDEV_CHANGE): enp0s4: link becomes ready > [ *** ] A start job is running for Raise network interfaces (6s / 5min) > Aug 13 22:51:22 debian dhclient[349]: DHCPDISCOVER on enp0s4 to 255.255.255.255 port 67 interval 13 > [*** ] A start job is running for Raise network interfaces (19s / 5min) > Aug 13 22:51:35 debian dhclient[349]: DHCPDISCOVER on enp0s4 to 255.255.255.255 port 67 interval 14 > [*** ] A start job is running for Raise network interfaces (33s / 5min) > ... > Hi, Sorry, I didn't get any valuable information from the logs, can you tell me how to get such an image? Or how your [1] script is executed. Thanks. > > Greetings, > > Andres Freund > > > [1] https://github.com/anarazel/pg-vm-images/blob/main/packer/linux_debian.pkr.hcl#L225