On Mon, 28 Aug 2023 at 16:13, Greg Kroah-Hartman <gregkh@xxxxxxxxxxxxxxxxxxx> wrote: > > This is the start of the stable review cycle for the 5.15.129 release. > There are 89 patches in this series, all will be posted as a response > to this one. If anyone has any issues with these being applied, please > let me know. > > Responses should be made by Wed, 30 Aug 2023 10:11:30 +0000. > Anything received after that time might be too late. > > The whole patch series can be found in one patch at: > https://www.kernel.org/pub/linux/kernel/v5.x/stable-review/patch-5.15.129-rc1.gz > or in the git tree and branch at: > git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git linux-5.15.y > and the diffstat can be found below. > > thanks, > > greg k-h NOTE: Following kernel deadlock / rcu warnings noticed while booting on arm64 Rpi4 and db401 booting with kselftests merge configs builds. Kernel is built with selftests/*/configs merge. FYI, After this kernel warning the system is stable and ran selftests and got passed. Build and config details provided at the bottom of this email. Boot log: ------ [ 0.000000] Linux version 5.15.129-rc1 (tuxmake@tuxmake) (aarch64-linux-gnu-gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT @1693218307 [ 0.000000] Machine model: Raspberry Pi 4 Model B ... [ 32.487474] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2 [ 32.496495] platform regulatory.0: Falling back to sysfs fallback for: regulatory.db [ 32.509253] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 0 [ 32.513018] [ 32.513049] [ 32.513053] ====================================================== [ 32.513056] WARNING: possible circular locking dependency detected [ 32.513060] 5.15.129-rc1 #1 Not tainted [ 32.513068] ------------------------------------------------------ [ 32.513071] (udev-worker)/241 is trying to acquire lock: [ 32.513078] ffff80000aac6be0 ((console_sem).lock){..-.}-{2:2}, at: down_trylock+0x20/0x50 [ 32.513120] [ 32.513120] but task is already holding lock: [ 32.513122] ffff0000f77d41d8 (&rq->__lock){-.-.}-{2:2}, at: task_rq_lock+0x94/0x1c4 [ 32.513151] [ 32.513151] which lock already depends on the new lock. [ 32.513151] [ 32.513153] [ 32.513153] the existing dependency chain (in reverse order) is: [ 32.513156] [ 32.513156] -> #2 (&rq->__lock){-.-.}-{2:2}: [ 32.513170] _raw_spin_lock_nested+0x74/0xb0 [ 32.513188] raw_spin_rq_lock_nested+0x48/0x160 [ 32.513200] task_fork_fair+0x44/0x180 [ 32.513209] sched_cgroup_fork+0xdc/0x140 [ 32.513218] copy_process+0xdb8/0x2054 [ 32.513227] kernel_clone+0xa4/0x47c [ 32.513234] kernel_thread+0x74/0xa4 [ 32.513241] rest_init+0x3c/0x2e0 [ 32.513254] arch_call_rest_init+0x18/0x24 [ 32.513266] start_kernel+0x734/0x774 [ 32.513275] __primary_switched+0xbc/0xc4 [ 32.513284] [ 32.513284] -> #1 (&p->pi_lock){-.-.}-{2:2}: [ 32.513299] _raw_spin_lock_irqsave+0x84/0xec [ 32.513310] try_to_wake_up+0x5c/0x640 [ 32.513317] wake_up_process+0x20/0x30 [ 32.513324] __up.isra.0+0x58/0x70 [ 32.513333] up+0x64/0x80 [ 32.513342] __up_console_sem+0x48/0x7c [ 32.513355] console_unlock+0x21c/0x630 [ 32.513367] vprintk_emit+0x114/0x2e0 [ 32.513379] vprintk_default+0x40/0x50 [ 32.513391] vprintk+0xdc/0x100 [ 32.513398] _printk+0x64/0x8c [ 32.513410] drm_master_internal_acquire+0x8/0x64 [drm] [ 32.513662] devm_aperture_acquire_from_firmware+0x3c/0x1f0 [drm] [ 32.513891] do_one_initcall+0x90/0x340 [ 32.513902] do_init_module+0x50/0x28c [ 32.513913] load_module+0x2148/0x26f0 [ 32.513922] __do_sys_finit_module+0xa8/0x11c [ 32.513932] __arm64_sys_finit_module+0x28/0x34 [ 32.513941] invoke_syscall+0x78/0x100 [ 32.513954] el0_svc_common.constprop.0+0x68/0x124 [ 32.513967] do_el0_svc+0x2c/0xa0 [ 32.513978] el0_svc+0x54/0x110 [ 32.513990] el0t_64_sync_handler+0xe8/0x114 [ 32.514001] el0t_64_sync+0x1a0/0x1a4 [ 32.514009] [ 32.514009] -> #0 ((console_sem).lock){..-.}-{2:2}: [ 32.514022] __lock_acquire+0x12f0/0x2090 [ 32.514036] lock_acquire+0x208/0x320 [ 32.514048] _raw_spin_lock_irqsave+0x84/0xec [ 32.514059] down_trylock+0x20/0x50 [ 32.514069] __down_trylock_console_sem+0x44/0xc0 [ 32.514082] console_trylock+0x44/0x100 [ 32.514094] vprintk_emit+0x10c/0x2e0 [ 32.514105] vprintk_default+0x40/0x50 [ 32.514117] vprintk+0xdc/0x100 [ 32.514124] _printk+0x64/0x8c [ 32.514135] lockdep_rcu_suspicious+0x34/0x10c [ 32.514146] inc_dl_tasks_cs+0xc0/0xd0 [ 32.514154] switched_to_dl+0x38/0x2dc [ 32.514165] __sched_setscheduler+0x228/0xaf0 [ 32.514174] sched_setattr_nocheck+0x20/0x30 [ 32.514182] sugov_init+0x140/0x370 [ 32.514191] cpufreq_init_governor+0x78/0x120 [ 32.514203] cpufreq_set_policy+0x290/0x430 [ 32.514212] cpufreq_online+0x3a0/0xa70 [ 32.514221] cpufreq_add_dev+0xd0/0xf0 [ 32.514231] subsys_interface_register+0x13c/0x164 [ 32.514242] cpufreq_register_driver+0x17c/0x2e0 [ 32.514251] dt_cpufreq_probe+0x350/0x4b4 [ 32.514265] platform_probe+0x70/0xe0 [ 32.514277] really_probe+0xcc/0x470 [ 32.514286] __driver_probe_device+0x114/0x170 [ 32.514296] driver_probe_device+0x48/0x140 [ 32.514305] __device_attach_driver+0xd8/0x180 [ 32.514314] bus_for_each_drv+0x84/0xe0 [ 32.514322] __device_attach+0xa4/0x1d0 [ 32.514331] device_initial_probe+0x1c/0x30 [ 32.514341] bus_probe_device+0xa4/0xb0 [ 32.514350] device_add+0x3e8/0x920 [ 32.514357] platform_device_add+0x108/0x290 [ 32.514368] platform_device_register_full+0xe4/0x17c [ 32.514381] raspberrypi_cpufreq_probe+0x13c/0x1e0 [raspberrypi_cpufreq] [ 32.514397] platform_probe+0x70/0xe0 [ 32.514408] really_probe+0xcc/0x470 [ 32.514417] __driver_probe_device+0x114/0x170 [ 32.514427] driver_probe_device+0x48/0x140 [ 32.514436] __driver_attach+0x12c/0x220 [ 32.514445] bus_for_each_dev+0x7c/0xdc [ 32.514453] driver_attach+0x2c/0x40 [ 32.514461] bus_add_driver+0x168/0x274 [ 32.514470] driver_register+0x80/0x13c [ 32.514479] __platform_driver_register+0x30/0x40 [ 32.514490] raspberrypi_cpufreq_driver_init+0x28/0x1000 [raspberrypi_cpufreq] [ 32.514506] do_one_initcall+0x90/0x340 [ 32.514514] do_init_module+0x50/0x28c [ 32.514524] load_module+0x2148/0x26f0 [ 32.514533] __do_sys_finit_module+0xa8/0x11c [ 32.514542] __arm64_sys_finit_module+0x28/0x34 [ 32.514551] invoke_syscall+0x78/0x100 [ 32.514563] el0_svc_common.constprop.0+0x104/0x124 [ 32.514575] do_el0_svc+0x2c/0xa0 [ 32.514586] el0_svc+0x54/0x110 [ 32.514596] el0t_64_sync_handler+0xe8/0x114 [ 32.514607] el0t_64_sync+0x1a0/0x1a4 [ 32.514615] [ 32.514615] other info that might help us debug this: [ 32.514615] [ 32.514618] Chain exists of: [ 32.514618] (console_sem).lock --> &p->pi_lock --> &rq->__lock [ 32.514618] [ 32.514634] Possible unsafe locking scenario: [ 32.514634] [ 32.514636] CPU0 CPU1 [ 32.514638] ---- ---- [ 32.514640] lock(&rq->__lock); [ 32.514646] lock(&p->pi_lock); [ 32.514653] lock(&rq->__lock); [ 32.514659] lock((console_sem).lock); [ 32.514665] [ 32.514665] *** DEADLOCK *** [ 32.514665] [ 32.514667] 8 locks held by (udev-worker)/241: [ 32.514673] #0: ffff0000438af188 (&dev->mutex){....}-{3:3}, at: __driver_attach+0x120/0x220 [ 32.514699] #1: ffff0000438ab188 (&dev->mutex){....}-{3:3}, at: __device_attach+0x40/0x1d0 [ 32.514722] #2: ffff80000aab0d68 (cpu_hotplug_lock){++++}-{0:0}, at: cpus_read_lock+0x18/0x24 [ 32.514748] #3: ffff0000409e4918 (subsys mutex#9){+.+.}-{3:3}, at: subsys_interface_register+0x68/0x164 [ 32.514773] #4: ffff000048999bc8 (&policy->rwsem){+.+.}-{3:3}, at: cpufreq_online+0x5e4/0xa70 [ 32.514797] #5: ffff80000ab501d0 (cpuset_mutex){+.+.}-{3:3}, at: cpuset_lock+0x28/0x34 [ 32.514818] #6: ffff00004a7ad608 (&p->pi_lock){-.-.}-{2:2}, at: task_rq_lock+0x50/0x1c4 [ 32.514844] #7: ffff0000f77d41d8 (&rq->__lock){-.-.}-{2:2}, at: task_rq_lock+0x94/0x1c4 [ 32.514867] [ 32.514867] stack backtrace: [ 32.514872] CPU: 2 PID: 241 Comm: (udev-worker) Not tainted 5.15.129-rc1 #1 [ 32.514882] Hardware name: Raspberry Pi 4 Model B (DT) [ 32.514887] Call trace: [ 32.514890] dump_backtrace+0x0/0x200 [ 32.514898] show_stack+0x20/0x30 [ 32.514905] dump_stack_lvl+0x88/0xb4 [ 32.514913] dump_stack+0x18/0x34 [ 32.514920] print_circular_bug+0x1f8/0x200 [ 32.514933] check_noncircular+0x140/0x154 [ 32.514945] __lock_acquire+0x12f0/0x2090 [ 32.514957] lock_acquire+0x208/0x320 [ 32.514968] _raw_spin_lock_irqsave+0x84/0xec [ 32.514980] down_trylock+0x20/0x50 [ 32.514990] __down_trylock_console_sem+0x44/0xc0 [ 32.515003] console_trylock+0x44/0x100 [ 32.515015] vprintk_emit+0x10c/0x2e0 [ 32.515027] vprintk_default+0x40/0x50 [ 32.515039] vprintk+0xdc/0x100 [ 32.515046] _printk+0x64/0x8c [ 32.515057] lockdep_rcu_suspicious+0x34/0x10c [ 32.515068] inc_dl_tasks_cs+0xc0/0xd0 [ 32.515076] switched_to_dl+0x38/0x2dc [ 32.515086] __sched_setscheduler+0x228/0xaf0 [ 32.515096] sched_setattr_nocheck+0x20/0x30 [ 32.515104] sugov_init+0x140/0x370 [ 32.515113] cpufreq_init_governor+0x78/0x120 [ 32.515123] cpufreq_set_policy+0x290/0x430 [ 32.515132] cpufreq_online+0x3a0/0xa70 [ 32.515142] cpufreq_add_dev+0xd0/0xf0 [ 32.515152] subsys_interface_register+0x13c/0x164 [ 32.515161] cpufreq_register_driver+0x17c/0x2e0 [ 32.515170] dt_cpufreq_probe+0x350/0x4b4 [ 32.515182] platform_probe+0x70/0xe0 [ 32.515194] really_probe+0xcc/0x470 [ 32.515203] __driver_probe_device+0x114/0x170 [ 32.515213] driver_probe_device+0x48/0x140 [ 32.515222] __device_attach_driver+0xd8/0x180 [ 32.515232] bus_for_each_drv+0x84/0xe0 [ 32.515240] __device_attach+0xa4/0x1d0 [ 32.515249] device_initial_probe+0x1c/0x30 [ 32.515259] bus_probe_device+0xa4/0xb0 [ 32.515268] device_add+0x3e8/0x920 [ 32.515275] platform_device_add+0x108/0x290 [ 32.515286] platform_device_register_full+0xe4/0x17c [ 32.515298] raspberrypi_cpufreq_probe+0x13c/0x1e0 [raspberrypi_cpufreq] [ 32.515312] platform_probe+0x70/0xe0 [ 32.515324] really_probe+0xcc/0x470 [ 32.515333] __driver_probe_device+0x114/0x170 [ 32.515343] driver_probe_device+0x48/0x140 [ 32.515352] __driver_attach+0x12c/0x220 [ 32.515361] bus_for_each_dev+0x7c/0xdc [ 32.515369] driver_attach+0x2c/0x40 [ 32.515378] bus_add_driver+0x168/0x274 [ 32.515386] driver_register+0x80/0x13c [ 32.515396] __platform_driver_register+0x30/0x40 [ 32.515408] raspberrypi_cpufreq_driver_init+0x28/0x1000 [raspberrypi_cpufreq] [ 32.515421] do_one_initcall+0x90/0x340 [ 32.515430] do_init_module+0x50/0x28c [ 32.515440] load_module+0x2148/0x26f0 [ 32.515449] __do_sys_finit_module+0xa8/0x11c [ 32.515458] __arm64_sys_finit_module+0x28/0x34 [ 32.515468] invoke_syscall+0x78/0x100 [ 32.515480] el0_svc_common.constprop.0+0x104/0x124 [ 32.515492] do_el0_svc+0x2c/0xa0 [ 32.515503] el0_svc+0x54/0x110 [ 32.515514] el0t_64_sync_handler+0xe8/0x114 [ 32.515525] el0t_64_sync+0x1a0/0x1a4 [ 32.519795] vc4-drm gpu: [drm] Cannot find any crtc or sizes [ 32.524928] ============================= [ 32.524933] WARNING: suspicious RCU usage [ 32.524937] 5.15.129-rc1 #1 Not tainted [ 32.524944] ----------------------------- [ 32.524948] include/linux/cgroup.h:495 suspicious rcu_dereference_check() usage! [ 32.524955] [ 32.524955] other info that might help us debug this: [ 32.524955] [ 32.524960] [ 32.524960] rcu_scheduler_active = 2, debug_locks = 1 [ 32.524967] 8 locks held by (udev-worker)/241: [ 32.524974] #0: ffff0000438af188 (&dev->mutex){....}-{3:3}, at: __driver_attach+0x120/0x220 [ 33.499420] #1: ffff0000438ab188 (&dev->mutex){....}-{3:3}, at: __device_attach+0x40/0x1d0 [ 33.499454] #2: ffff80000aab0d68 (cpu_hotplug_lock){++++}-{0:0}, at: cpus_read_lock+0x18/0x24 [ 33.507960] #3: ffff0000409e4918 (subsys mutex#9){+.+.}-{3:3}, at: subsys_interface_register+0x68/0x164 [ 33.516727] #4: ffff000048999bc8 (&policy->rwsem){+.+.}-{3:3}, at: cpufreq_online+0x5e4/0xa70 [ 33.535105] #5: ffff80000ab501d0 (cpuset_mutex){+.+.}-{3:3}, at: cpuset_lock+0x28/0x34 [ 33.535137] #6: ffff00004a7ad608 (&p->pi_lock){-.-.}-{2:2}, at: task_rq_lock+0x50/0x1c4 [ 33.535171] #7: ffff0000f77d41d8 (&rq->__lock){-.-.}-{2:2}, at: task_rq_lock+0x94/0x1c4 [ 33.559715] [ 33.559715] stack backtrace: [ 33.559720] CPU: 2 PID: 241 Comm: (udev-worker) Not tainted 5.15.129-rc1 #1 [ 33.559731] Hardware name: Raspberry Pi 4 Model B (DT) [ 33.559738] Call trace: [ 33.559742] dump_backtrace+0x0/0x200 [ 33.582598] show_stack+0x20/0x30 [ 33.582608] dump_stack_lvl+0x88/0xb4 [ 33.582618] dump_stack+0x18/0x34 [ 33.582626] lockdep_rcu_suspicious+0xf8/0x10c [ 33.597545] inc_dl_tasks_cs+0xc0/0xd0 [ 33.597555] switched_to_dl+0x38/0x2dc [ 33.597569] __sched_setscheduler+0x228/0xaf0 [ 33.609577] sched_setattr_nocheck+0x20/0x30 [ 33.609588] sugov_init+0x140/0x370 [ 33.609600] cpufreq_init_governor+0x78/0x120 [ 33.621874] cpufreq_set_policy+0x290/0x430 [ 33.621886] cpufreq_online+0x3a0/0xa70 [ 33.621897] cpufreq_add_dev+0xd0/0xf0 [ 33.633818] subsys_interface_register+0x13c/0x164 [ 33.633830] cpufreq_register_driver+0x17c/0x2e0 [ 33.633841] dt_cpufreq_probe+0x350/0x4b4 [ 33.647440] platform_probe+0x70/0xe0 [ 33.647454] really_probe+0xcc/0x470 [ 33.647465] __driver_probe_device+0x114/0x170 [ 33.659295] driver_probe_device+0x48/0x140 [ 33.659307] __device_attach_driver+0xd8/0x180 [ 33.659319] bus_for_each_drv+0x84/0xe0 [ 33.671945] __device_attach+0xa4/0x1d0 [ 33.671956] device_initial_probe+0x1c/0x30 [ 33.671968] bus_probe_device+0xa4/0xb0 [ 33.671978] device_add+0x3e8/0x920 [ 33.671987] platform_device_add+0x108/0x290 [ 33.672000] platform_device_register_full+0xe4/0x17c [ 33.696975] raspberrypi_cpufreq_probe+0x13c/0x1e0 [raspberrypi_cpufreq] [ 33.696992] platform_probe+0x70/0xe0 [ 33.707506] really_probe+0xcc/0x470 [ 33.707518] __driver_probe_device+0x114/0x170 [ 33.707529] driver_probe_device+0x48/0x140 [ 33.719888] __driver_attach+0x12c/0x220 [ 33.719899] bus_for_each_dev+0x7c/0xdc [ 33.719909] driver_attach+0x2c/0x40 [ 33.731394] bus_add_driver+0x168/0x274 [ 33.731405] driver_register+0x80/0x13c [ 33.731416] __platform_driver_register+0x30/0x40 [ 33.743954] raspberrypi_cpufreq_driver_init+0x28/0x1000 [raspberrypi_cpufreq] [ 33.743969] do_one_initcall+0x90/0x340 [ 33.743980] do_init_module+0x50/0x28c [ 33.758981] load_module+0x2148/0x26f0 [ 33.758993] __do_sys_finit_module+0xa8/0x11c [ 33.759005] __arm64_sys_finit_module+0x28/0x34 [ 33.759016] invoke_syscall+0x78/0x100 [ 33.775606] el0_svc_common.constprop.0+0x104/0x124 [ 33.775621] do_el0_svc+0x2c/0xa0 [ 33.783932] el0_svc+0x54/0x110 [ 33.783946] el0t_64_sync_handler+0xe8/0x114 [ 33.791460] el0t_64_sync+0x1a0/0x1a4 Links: - https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-5.15.y/build/v5.15.128-90-g948d61e1588b/testrun/19421242/suite/log-parser-boot/tests/ metadata: git_ref: linux-5.15.y git_repo: https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable-rc git_sha: 948d61e1588b9442fe7390e694431478159553bc git_describe: v5.15.128-90-g948d61e1588b kernel_version: 5.15.129-rc1 kernel-config: https://storage.tuxsuite.com/public/linaro/lkft/builds/2Ubp9wnZ2x6rGWiSymzDbRIVGxr/config artifact-location: https://storage.tuxsuite.com/public/linaro/lkft/builds/2Ubp9wnZ2x6rGWiSymzDbRIVGxr/ toolchain: gcc-12 build_name: gcc-12-lkftconfig-kselftest-kernel -- Linaro LKFT https://lkft.linaro.org
