On Thu, Feb 10, 2022 at 07:29:56PM -0700, Orion Poplawski wrote: > On 2/10/22 12:21, Michael Catanzaro wrote: > > On Thu, Feb 10 2022 at 02:09:32 PM -0500, Steven A. Falco > > <stevenfalco@xxxxxxxxx> wrote: > > > g++: fatal error: Killed signal terminated program cc1plus > > > > This indicates the builder ran out of memory. cc1plus received SIGKILL > > from the OOM killer. Try using the %limit_build macro to reduce > > parallelism, and file an infrastructure ticket if that's not enough. > > Example of using %limit_build: > > I'm just manually lowering the max cpus on arm. I've bumped it down again > and resubmitted the build: > > https://koji.fedoraproject.org/koji/taskinfo?taskID=82658703 > > The F37 build finished at the old level, hopefully this one will now. > > I would be really happy to drop armv7hl for the vtk stack. So, just to clarify and provide more info here: There's a bug/issue with 32bit arm using LPAE kernels and xfs/ext4 where it's overeager with OOM killing processes. ( rhbz 1920183 ). The issue does not seem to happen with > 5.16 kernels and btrfs installs. I had reinstalled some small portion of our armv7 builders this way and they seemed tons more stable from this bug at least. So, I have been the last few days replacing all the last xfs ones with btrfs + 5.16.x kernels. That should hopefully be complete later today or early next week. So, I suspect some of what folks are seeing should go away with this change. Of course other things to keep in mind are that these are 32bit processes, so they are never going to be able to use > 3GB just due to address space. The builders themselves have 40GB memory, so that limit shouldn't be hit, but the address space per thread definitely could be. kevin _______________________________________________ devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure