On 14/02/25 10:05, Jon Hunter wrote:
...
> Sorry for the delay, the day got away from me. However, it is still not
> working :-(
Ouch.
> Console log is attached.
Thanks. Did you happen to also collect a corresponding trace?
>
> Jon
>
> --
> nvpublic
> U-Boot 2020.04-g6b630d64fd (Feb 19 2021 - 08:38:59 -0800)
>
> SoC: tegra186
> Model: NVIDIA P2771-0000-500
> Board: NVIDIA P2771-0000
> DRAM: 7.8 GiB
> MMC: sdhci@3400000: 1, sdhci@3460000: 0
> Loading Environment from MMC... *** Warning - bad CRC, using default environment
>
> In: serial
> Out: serial
> Err: serial
> Net:
> Warning: ethernet@2490000 using MAC address from ROM
> eth0: ethernet@2490000
> Hit any key to stop autoboot: 2 1 0
> MMC: no card present
> switch to partitions #0, OK
> mmc0(part 0) is current device
> Scanning mmc 0:1...
> Found /boot/extlinux/extlinux.conf
> Retrieving file: /boot/extlinux/extlinux.conf
> 489 bytes read in 17 ms (27.3 KiB/s)
> 1: primary kernel
> Retrieving file: /boot/initrd
> 7236840 bytes read in 187 ms (36.9 MiB/s)
> Retrieving file: /boot/Image
> 47976960 bytes read in 1147 ms (39.9 MiB/s)
> append: earlycon console=ttyS0,115200n8 fw_devlink=on root=/dev/nfs rw netdevwait ip=192.168.99.2:192.168.99.1:192.168.99.1:255.255.255.0::eth0:off nfsroot=192.168.99.1:/home/ausvrl81104/nfsroot sched_verbose ignore_loglevel console=ttyS0,115200n8 console=tty0 fbcon=map:0 net.ifnames=0 isolcpus=1-2 video=tegrafb no_console_suspend=1 nvdumper_reserved=0x2772e0000 gpt rootfs.slot_suffix= usbcore.old_scheme_first=1 tegraid=18.1.2.0.0 maxcpus=6 boot.slot_suffix= boot.ratchetvalues=0.2031647.1 vpr_resize bl_prof_dataptr=0x10000@0x275840000 sdhci_tegra.en_boot_part_access=1 no_console_suspend root=/dev/nfs rw netdevwait ip=192.168.99.2:192.168.99.1:192.168.99.1:255.255.255.0::eth0:off nfsroot=192.168.99.1:/home/ausvrl81104/nfsroot sched_verbose ignore_loglevel console=ttyS0,115200n8 console=tty0 fbcon=map:0 net.ifnames=0 isolcpus=1-2
> Retrieving file: /boot/dtb/tegra186-p2771-0000.dtb
> 108349 bytes read in 21 ms (4.9 MiB/s)
> ## Flattened Device Tree blob at 88400000
> Booting using the fdt blob at 0x88400000
> Using Device Tree in place at 0000000088400000, end 000000008841d73c
> copying carveout for /host1x@13e00000/display-hub@15200000/display@15200000...
> copying carveout for /host1x@13e00000/display-hub@15200000/display@15210000...
> copying carveout for /host1x@13e00000/display-hub@15200000/display@15220000...
> DT node /trusty missing in source; can't copy status
> DT node /reserved-memory/fb0_carveout missing in source; can't copy
> DT node /reserved-memory/fb1_carveout missing in source; can't copy
> DT node /reserved-memory/fb2_carveout missing in source; can't copy
> DT node /reserved-memory/ramoops_carveout missing in source; can't copy
> DT node /reserved-memory/vpr-carveout missing in source; can't copy
>
> Starting kernel ...
>
> [ 0.000000] Booting Linux on physical CPU 0x0000000100 [0x411fd073]
> [ 0.000000] Linux version 6.13.0-rc6-next-20250110-00006-g8af20d375c86 (jonathanh@goldfinger) (aarch64-linux-gcc.br_real (Buildroot 2022.08) 11.3.0, GNU ld (GNU Binutils) 2.38) #2 SMP PREEMPT Fri Feb 14 01:41:10 PST 2025
> [ 0.000000] rq_attach_root: cpu=0 old_span=NULL new_span=
> [ 0.000000] rq_attach_root: cpu=1 old_span=NULL new_span=0
> [ 0.000000] rq_attach_root: cpu=2 old_span=NULL new_span=0-1
> [ 0.000000] rq_attach_root: cpu=3 old_span=NULL new_span=0-2
> [ 0.000000] rq_attach_root: cpu=4 old_span=NULL new_span=0-3
> [ 0.000000] rq_attach_root: cpu=5 old_span=NULL new_span=0-4
> [ 0.000000] rq_attach_root: cpu=0 old_span=NULL new_span=
> [ 0.000000] rq_attach_root: cpu=1 old_span=NULL new_span=0
> [ 0.000000] rq_attach_root: cpu=2 old_span=NULL new_span=0-1
> [ 0.000000] rq_attach_root: cpu=3 old_span=NULL new_span=0-2
> [ 0.000000] rq_attach_root: cpu=4 old_span=NULL new_span=0-3
> [ 0.000000] rq_attach_root: cpu=5 old_span=NULL new_span=0-4
> [ 0.024665] __dl_add: cpus=1 tsk_bw=52428 total_bw=52428 span=0-5 type=DEF
> [ 0.039973] smp: Bringing up secondary CPUs ...
> [ 0.049237] CPU1: Booted secondary processor 0x0000000000 [0x4e0f0030]
> [ 0.049311] __dl_add: cpus=1 tsk_bw=52428 total_bw=104856 span=0-5 type=DEF
> [ 0.060738] CPU2: Booted secondary processor 0x0000000001 [0x4e0f0030]
> [ 0.060792] __dl_add: cpus=2 tsk_bw=52428 total_bw=157284 span=0-5 type=DEF
> [ 0.068381] Detected PIPT I-cache on CPU3
> [ 0.068475] CPU3: Booted secondary processor 0x0000000101 [0x411fd073]
> [ 0.068501] __dl_add: cpus=3 tsk_bw=52428 total_bw=209712 span=0-5 type=DEF
> [ 0.076341] Detected PIPT I-cache on CPU4
> [ 0.076406] CPU4: Booted secondary processor 0x0000000102 [0x411fd073]
> [ 0.076430] __dl_add: cpus=4 tsk_bw=52428 total_bw=262140 span=0-5 type=DEF
> [ 0.076974] Detected PIPT I-cache on CPU5
> [ 0.077039] CPU5: Booted secondary processor 0x0000000103 [0x411fd073]
> [ 0.077064] __dl_add: cpus=5 tsk_bw=52428 total_bw=314568 span=0-5 type=DEF
> [ 0.077141] smp: Brought up 1 node, 6 CPUs
> [ 0.077177] SMP: Total of 6 processors activated.
> [ 0.077184] CPU: All CPU(s) started at EL2
> [ 0.077196] CPU features: detected: 32-bit EL0 Support
> [ 0.077203] CPU features: detected: 32-bit EL1 Support
> [ 0.077211] CPU features: detected: CRC32 instructions
> [ 0.077300] alternatives: applying system-wide alternatives
> [ 0.085706] CPU0 attaching sched-domain(s):
> [ 0.085726] domain-0: span=0,3-5 level=MC
> [ 0.085741] groups: 0:{ span=0 cap=1020 }, 3:{ span=3 }, 4:{ span=4 }, 5:{ span=5 }
> [ 0.085782] __dl_sub: cpus=6 tsk_bw=52428 total_bw=262140 span=0-5 type=DEF
> [ 0.085789] __dl_server_detach_root: cpu=0 rd_span=0-5 total_bw=262140
> [ 0.085796] rq_attach_root: cpu=0 old_span=NULL new_span=
> [ 0.085801] __dl_add: cpus=1 tsk_bw=52428 total_bw=52428 span=0 type=DYN
> [ 0.085805] __dl_server_attach_root: cpu=0 rd_span=0 total_bw=52428
> [ 0.085809] CPU3 attaching sched-domain(s):
> [ 0.085836] domain-0: span=0,3-5 level=MC
> [ 0.085846] groups: 3:{ span=3 }, 4:{ span=4 }, 5:{ span=5 }, 0:{ span=0 cap=1020 }
> [ 0.085885] __dl_sub: cpus=5 tsk_bw=52428 total_bw=209712 span=1-5 type=DEF
> [ 0.085889] __dl_server_detach_root: cpu=3 rd_span=1-5 total_bw=209712
> [ 0.085894] rq_attach_root: cpu=3 old_span=NULL new_span=0
> [ 0.085897] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=0,3 type=DYN
> [ 0.085900] __dl_server_attach_root: cpu=3 rd_span=0,3 total_bw=104856
> [ 0.085904] CPU4 attaching sched-domain(s):
> [ 0.085930] domain-0: span=0,3-5 level=MC
> [ 0.085940] groups: 4:{ span=4 }, 5:{ span=5 }, 0:{ span=0 cap=1020 }, 3:{ span=3 }
> [ 0.085977] __dl_sub: cpus=4 tsk_bw=52428 total_bw=157284 span=1-2,4-5 type=DEF
> [ 0.085981] __dl_server_detach_root: cpu=4 rd_span=1-2,4-5 total_bw=157284
> [ 0.085985] rq_attach_root: cpu=4 old_span=NULL new_span=0,3
> [ 0.085989] __dl_add: cpus=3 tsk_bw=52428 total_bw=157284 span=0,3-4 type=DYN
> [ 0.085993] __dl_server_attach_root: cpu=4 rd_span=0,3-4 total_bw=157284
> [ 0.085996] CPU5 attaching sched-domain(s):
> [ 0.086023] domain-0: span=0,3-5 level=MC
> [ 0.086033] groups: 5:{ span=5 }, 0:{ span=0 cap=1020 }, 3:{ span=3 }, 4:{ span=4 }
> [ 0.086070] __dl_sub: cpus=3 tsk_bw=52428 total_bw=104856 span=1-2,5 type=DEF
> [ 0.086075] __dl_server_detach_root: cpu=5 rd_span=1-2,5 total_bw=104856
> [ 0.086079] rq_attach_root: cpu=5 old_span=NULL new_span=0,3-4
> [ 0.086082] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 0.086085] __dl_server_attach_root: cpu=5 rd_span=0,3-5 total_bw=209712
> [ 0.086089] root domain span: 0,3-5
> [ 0.086114] default domain span: 1-2
> [ 4.717856] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 1344000 kHz, changing to: 1382400 kHz
> [ 4.728789] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 4.728796] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 4.728802] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 4.728806] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 4.728810] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 4.728815] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 4.769218] dl_clear_root_domain: span=1-2 type=DEF
> [ 4.769222] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 4.769227] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 4.769301] __dl_sub: cpus=4 tsk_bw=104857 total_bw=104855 span=0,3-5 type=DYN
Not sure where this dl_sub is coming from. The stacktrace in the trace
should probably tell. tsk_bw looks similar to sugov, so maybe still a
missing spot where we should ignore that?
> [ 4.769377] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 4.769382] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 4.769387] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 4.769392] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 4.769396] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 4.769400] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 4.835665] dl_clear_root_domain: span=1-2 type=DEF
> [ 4.835669] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 4.835673] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 4.835733] __dl_sub: cpus=4 tsk_bw=104857 total_bw=104855 span=0,3-5 type=DYN
> [ 4.835784] cpufreq: cpufreq_online: CPU3: Running at unlisted initial frequency: 1344000 kHz, changing to: 1382400 kHz
> [ 4.872499] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 4.872504] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 4.872509] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 4.872513] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 4.872517] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 4.872521] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 4.912870] dl_clear_root_domain: span=1-2 type=DEF
> [ 4.912874] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 4.912879] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 4.912973] cpufreq: cpufreq_online: CPU4: Running at unlisted initial frequency: 1344000 kHz, changing to: 1382400 kHz
> [ 4.942474] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 4.942478] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 4.942483] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 4.942487] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 4.942491] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 4.942495] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 4.982819] dl_clear_root_domain: span=1-2 type=DEF
> [ 4.982821] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 4.982824] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 4.982889] cpufreq: cpufreq_online: CPU5: Running at unlisted initial frequency: 1344000 kHz, changing to: 1382400 kHz
> [ 5.012384] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 5.012388] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 5.012393] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 5.012397] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 5.012401] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 5.012405] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 5.052728] dl_clear_root_domain: span=1-2 type=DEF
> [ 5.052730] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 5.052733] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 5.054374] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 5.054380] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 5.054383] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 5.054386] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 5.054389] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 5.054392] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 5.060615] sdhci-tegra 3440000.mmc: Adding to iommu group 4
> [ 5.066085] dl_clear_root_domain: span=1-2 type=DEF
> [ 5.066090] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 5.066092] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
Wonder what is triggering the below rebuild now that cpufreq should be
up and running. Again trace data should hopefully tell.
> [ 16.698922] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 16.698933] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 16.698941] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 16.698946] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 16.698951] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 16.698956] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 16.739375] dl_clear_root_domain: span=1-2 type=DEF
> [ 16.739382] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 16.739386] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 16.758528] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 16.758536] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 16.758541] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 16.758544] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 16.758548] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 16.758551] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 16.799668] dl_clear_root_domain: span=1-2 type=DEF
> [ 16.799676] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 16.799680] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> [ 16.814674] dl_clear_root_domain: span=0,3-5 type=DYN
> [ 16.814681] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> [ 16.814686] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> [ 16.814689] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 16.814692] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> [ 16.814696] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> [ 16.860445] dl_clear_root_domain: span=1-2 type=DEF
> [ 16.860450] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 16.860454] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> Welcome to Ubuntu 18.04.6 LTS (GNU/Linux[ 16.879557] dl_clear_root_domain: span=0,3-5 type=DYN
> 6.13.0-rc6-next-20250110-00006-[ 16.879564] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> g8af20d375c86 aarch64)
>
> * Doc[ 16.879569] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> umentation: https://help.ubuntu[ 16.879572] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> .com
> * Management: [ 16.879575] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> https://landsca[ 16.879578] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> pe.canonical.com
> * Support: https://ubuntu.com/pro
> This system[ 16.934775] dl_clear_root_domain: span=1-2 type=DEF
> [ 16.934781] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> [ 16.934784] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> has been minimized by removing packages[ 16.959842] dl_clear_root_domain: span=0,3-5 type=DYN
> and content that are
> not requi[ 16.959853] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> red on a system that users do no[ 16.959861] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> t log into.
>
> To restor[ 16.959868] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> e this content, [ 16.959873] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> you can run the [ 16.959879] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> 'unminimize' command.
>
> The programs in[ 17.013809] dl_clear_root_domain: span=1-2 type=DEF
> cluded w[ 17.013817] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> ith the [ 17.013822] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
> Ubuntu system are free software;[ 17.026473] dl_clear_root_domain: span=0,3-5 type=DYN
>
> the exact distribution[ 17.026480] __dl_add: cpus=4 tsk_bw=52428 total_bw=52428 span=0,3-5 type=DYN
> terms for each [ 17.026485] __dl_add: cpus=4 tsk_bw=52428 total_bw=104856 span=0,3-5 type=DYN
> program are desc[ 17.026488] __dl_add: cpus=4 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> ribed in the
> in[ 17.026491] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0,3-5 type=DYN
> dividual files i[ 17.026495] rd 0,3-5: Checking EAS, CPUs do not have asymmetric capacities
> n /usr/share/doc/*/copyright.
>
> Ubuntu [ 17.088060] dl_clear_root_domain: span=1-2 type=DEF
> [ 17.088066] __dl_add: cpus=2 tsk_bw=52428 total_bw=52428 span=1-2 type=DEF
> comes wi[ 17.088071] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=1-2 type=DEF
At this point I believe you triggered suspend.
> [ 57.290150] Freezing remaining freezable tasks completed (elapsed 0.001 seconds)
> [ 57.335619] tegra-xusb 3530000.usb: Firmware timestamp: 2020-07-06 13:39:28 UTC
> [ 57.353364] dwc-eth-dwmac 2490000.ethernet eth0: Link is Down
> [ 57.397022] Disabling non-boot CPUs ...
Offlining CPU5.
> [ 57.400904] dl_bw_manage: cpu=5 cap=3072 fair_server_bw=52428 total_bw=209712 dl_bw_cpus=4 type=DYN span=0,3-5
> [ 57.400949] CPU0 attaching NULL sched-domain.
> [ 57.415298] span=1-2
> [ 57.417483] __dl_sub: cpus=3 tsk_bw=52428 total_bw=157284 span=0,3-5 type=DYN
> [ 57.417487] __dl_server_detach_root: cpu=0 rd_span=0,3-5 total_bw=157284
> [ 57.417496] rq_attach_root: cpu=0 old_span=NULL new_span=1-2
> [ 57.417501] __dl_add: cpus=3 tsk_bw=52428 total_bw=157284 span=0-2 type=DEF
> [ 57.417504] __dl_server_attach_root: cpu=0 rd_span=0-2 total_bw=157284
> [ 57.417507] CPU3 attaching NULL sched-domain.
> [ 57.454804] span=0-2
> [ 57.456987] __dl_sub: cpus=2 tsk_bw=52428 total_bw=104856 span=3-5 type=DYN
> [ 57.456990] __dl_server_detach_root: cpu=3 rd_span=3-5 total_bw=104856
> [ 57.456998] rq_attach_root: cpu=3 old_span=NULL new_span=0-2
> [ 57.457000] __dl_add: cpus=4 tsk_bw=52428 total_bw=209712 span=0-3 type=DEF
> [ 57.457003] __dl_server_attach_root: cpu=3 rd_span=0-3 total_bw=209712
> [ 57.457006] CPU4 attaching NULL sched-domain.
> [ 57.493964] span=0-3
> [ 57.496152] __dl_sub: cpus=1 tsk_bw=52428 total_bw=52428 span=4-5 type=DYN
> [ 57.496156] __dl_server_detach_root: cpu=4 rd_span=4-5 total_bw=52428
> [ 57.496162] rq_attach_root: cpu=4 old_span=NULL new_span=0-3
> [ 57.496165] __dl_add: cpus=5 tsk_bw=52428 total_bw=262140 span=0-4 type=DEF
> [ 57.496168] __dl_server_attach_root: cpu=4 rd_span=0-4 total_bw=262140
> [ 57.496171] CPU5 attaching NULL sched-domain.
> [ 57.532952] span=0-4
> [ 57.535143] rq_attach_root: cpu=5 old_span= new_span=0-4
> [ 57.535147] __dl_add: cpus=5 tsk_bw=52428 total_bw=314568 span=0-5 type=DEF
Maybe we shouldn't add the dl_server contribution of a CPU that is going
to be offline.
> [ 57.535149] __dl_server_attach_root: cpu=5 rd_span=0-5 total_bw=314568
> [ 57.535211] CPU0 attaching sched-domain(s):
> [ 57.558178] domain-0: span=0,3-4 level=MC
> [ 57.562276] groups: 0:{ span=0 }, 3:{ span=3 }, 4:{ span=4 }
> [ 57.568126] __dl_sub: cpus=5 tsk_bw=52428 total_bw=262140 span=0-5 type=DEF
> [ 57.568129] __dl_server_detach_root: cpu=0 rd_span=0-5 total_bw=262140
> [ 57.568136] rq_attach_root: cpu=0 old_span=NULL new_span=
> [ 57.568139] __dl_add: cpus=1 tsk_bw=52428 total_bw=52428 span=0 type=DYN
> [ 57.568142] __dl_server_attach_root: cpu=0 rd_span=0 total_bw=52428
> [ 57.568145] CPU3 attaching sched-domain(s):
> [ 57.604141] domain-0: span=0,3-4 level=MC
> [ 57.608242] groups: 3:{ span=3 }, 4:{ span=4 }, 0:{ span=0 }
> [ 57.614088] __dl_sub: cpus=4 tsk_bw=52428 total_bw=209712 span=1-5 type=DEF
> [ 57.614091] __dl_server_detach_root: cpu=3 rd_span=1-5 total_bw=209712
> [ 57.614098] rq_attach_root: cpu=3 old_span=NULL new_span=0
> [ 57.614100] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=0,3 type=DYN
> [ 57.614103] __dl_server_attach_root: cpu=3 rd_span=0,3 total_bw=104856
> [ 57.614106] CPU4 attaching sched-domain(s):
> [ 57.650710] domain-0: span=0,3-4 level=MC
> [ 57.654812] groups: 4:{ span=4 }, 0:{ span=0 }, 3:{ span=3 }
> [ 57.660656] __dl_sub: cpus=3 tsk_bw=52428 total_bw=157284 span=1-2,4-5 type=DEF
> [ 57.660660] __dl_server_detach_root: cpu=4 rd_span=1-2,4-5 total_bw=157284
> [ 57.660666] rq_attach_root: cpu=4 old_span=NULL new_span=0,3
> [ 57.660669] __dl_add: cpus=3 tsk_bw=52428 total_bw=157284 span=0,3-4 type=DYN
> [ 57.660671] __dl_server_attach_root: cpu=4 rd_span=0,3-4 total_bw=157284
> [ 57.660675] root domain span: 0,3-4
> [ 57.697801] default domain span: 1-2,5
> [ 57.701560] rd 0,3-4: Checking EAS, CPUs do not have asymmetric capacities
> [ 57.709917] psci: CPU5 killed (polled 0 ms)
Offlining CPU4.
> [ 57.714734] dl_bw_manage: cpu=4 cap=2048 fair_server_bw=52428 total_bw=157284 dl_bw_cpus=3 type=DYN span=0,3-4
> [ 57.714773] CPU0 attaching NULL sched-domain.
> [ 57.729120] span=1-2,5
> [ 57.731483] __dl_sub: cpus=2 tsk_bw=52428 total_bw=104856 span=0,3-4 type=DYN
> [ 57.731488] __dl_server_detach_root: cpu=0 rd_span=0,3-4 total_bw=104856
> [ 57.731496] rq_attach_root: cpu=0 old_span=NULL new_span=1-2,5
> [ 57.731499] __dl_add: cpus=3 tsk_bw=52428 total_bw=209712 span=0-2,5 type=DEF
> [ 57.731503] __dl_server_attach_root: cpu=0 rd_span=0-2,5 total_bw=209712
> [ 57.731506] CPU3 attaching NULL sched-domain.
> [ 57.769309] span=0-2,5
> [ 57.771670] __dl_sub: cpus=1 tsk_bw=52428 total_bw=52428 span=3-4 type=DYN
> [ 57.771673] __dl_server_detach_root: cpu=3 rd_span=3-4 total_bw=52428
> [ 57.771680] rq_attach_root: cpu=3 old_span=NULL new_span=0-2,5
> [ 57.771682] __dl_add: cpus=4 tsk_bw=52428 total_bw=262140 span=0-3,5 type=DEF
> [ 57.771685] __dl_server_attach_root: cpu=3 rd_span=0-3,5 total_bw=262140
> [ 57.771688] CPU4 attaching NULL sched-domain.
> [ 57.808967] span=0-3,5
> [ 57.811327] rq_attach_root: cpu=4 old_span= new_span=0-3,5
> [ 57.811331] __dl_add: cpus=4 tsk_bw=52428 total_bw=314568 span=0-5 type=DEF
> [ 57.811334] __dl_server_attach_root: cpu=4 rd_span=0-5 total_bw=314568
> [ 57.811378] CPU0 attaching sched-domain(s):
> [ 57.834511] domain-0: span=0,3 level=MC
> [ 57.838437] groups: 0:{ span=0 }, 3:{ span=3 }
> [ 57.843067] __dl_sub: cpus=4 tsk_bw=52428 total_bw=262140 span=0-5 type=DEF
> [ 57.843070] __dl_server_detach_root: cpu=0 rd_span=0-5 total_bw=262140
> [ 57.843075] rq_attach_root: cpu=0 old_span=NULL new_span=
> [ 57.843078] __dl_add: cpus=1 tsk_bw=52428 total_bw=52428 span=0 type=DYN
> [ 57.843080] __dl_server_attach_root: cpu=0 rd_span=0 total_bw=52428
> [ 57.843083] CPU3 attaching sched-domain(s):
> [ 57.879064] domain-0: span=0,3 level=MC
> [ 57.882987] groups: 3:{ span=3 }, 0:{ span=0 }
> [ 57.887613] __dl_sub: cpus=3 tsk_bw=52428 total_bw=209712 span=1-5 type=DEF
> [ 57.887617] __dl_server_detach_root: cpu=3 rd_span=1-5 total_bw=209712
> [ 57.887622] rq_attach_root: cpu=3 old_span=NULL new_span=0
> [ 57.887625] __dl_add: cpus=2 tsk_bw=52428 total_bw=104856 span=0,3 type=DYN
> [ 57.887628] __dl_server_attach_root: cpu=3 rd_span=0,3 total_bw=104856
> [ 57.887632] root domain span: 0,3
> [ 57.923352] default domain span: 1-2,4-5
> [ 57.927282] rd 0,3: Checking EAS, CPUs do not have asymmetric capacities
> [ 57.934554] psci: CPU4 killed (polled 0 ms)
Offlining CPU3.
> [ 57.939539] dl_bw_manage: cpu=3 cap=1024 fair_server_bw=52428 total_bw=104856 dl_bw_cpus=2 type=DYN span=0,3
> [ 57.939579] CPU0 attaching NULL sched-domain.
> [ 57.953763] span=1-2,4-5
> [ 57.956301] __dl_sub: cpus=1 tsk_bw=52428 total_bw=52428 span=0,3 type=DYN
> [ 57.956305] __dl_server_detach_root: cpu=0 rd_span=0,3 total_bw=52428
> [ 57.956313] rq_attach_root: cpu=0 old_span=NULL new_span=1-2,4-5
> [ 57.956317] __dl_add: cpus=3 tsk_bw=52428 total_bw=262140 span=0-2,4-5 type=DEF
> [ 57.956320] __dl_server_attach_root: cpu=0 rd_span=0-2,4-5 total_bw=262140
> [ 57.956322] CPU3 attaching NULL sched-domain.
> [ 57.994121] span=0-2,4-5
> [ 57.996656] rq_attach_root: cpu=3 old_span= new_span=0-2,4-5
> [ 57.996660] __dl_add: cpus=3 tsk_bw=52428 total_bw=314568 span=0-5 type=DEF
> [ 57.996663] __dl_server_attach_root: cpu=3 rd_span=0-5 total_bw=314568
> [ 57.996700] CPU0 attaching NULL sched-domain.
> [ 58.020170] span=0-5
> [ 58.022357] __dl_sub: cpus=3 tsk_bw=52428 total_bw=262140 span=0-5 type=DEF
> [ 58.022361] __dl_server_detach_root: cpu=0 rd_span=0-5 total_bw=262140
> [ 58.022367] rq_attach_root: cpu=0 old_span=NULL new_span=
> [ 58.022370] __dl_add: cpus=1 tsk_bw=52428 total_bw=52428 span=0 type=DYN
> [ 58.022372] __dl_server_attach_root: cpu=0 rd_span=0 total_bw=52428
> [ 58.022375] root domain span: 0
> [ 58.057313] default domain span: 1-5
> [ 58.060900] rd 0: Checking EAS, CPUs do not have asymmetric capacities
> [ 58.068835] psci: CPU3 killed (polled 0 ms)
Offlining CPU2.
> [ 58.073751] dl_bw_manage: cpu=2 cap=1024 fair_server_bw=52428 total_bw=262140 dl_bw_cpus=2 type=DEF span=1-5
> [ 58.073882] dl_clear_root_domain: span=0 type=DYN
> [ 58.073895] __dl_add: cpus=1 tsk_bw=52428 total_bw=52428 span=0 type=DYN
> [ 58.073909] rd 0: Checking EAS, CPUs do not have asymmetric capacities
> [ 58.103900] psci: CPU2 killed (polled 0 ms)
We also probably need to remove isolated CPUs contributions to DEF root
domain when they are offlined (missing __dl_sub).
Offlining CPU1 (fail).
> [ 58.108365] dl_bw_manage: cpu=1 cap=0 fair_server_bw=52428 total_bw=262140 dl_bw_cpus=1 type=DEF span=1-5
> [ 58.108466] Error taking CPU1 down: -16
> [ 58.121881] Non-boot CPUs are not disabled
> [ 58.126007] Enabling non-boot CPUs ...
Revert follows.
Still wondering why it doesn't fail for me, now that it doesn't seem
related to sugov anymore. :/
Anyway, apart from possibly sharing tracing data. Could you please try
to repro with performance governor (from boot)?
Thanks,
Juri
