On Sat, Jan 23, 2021 at 02:53:26PM -0800, Kevin Fenzi wrote: > On Sat, Jan 23, 2021 at 11:34:03PM +0100, Jakub Jelinek wrote: > > On Fri, Jan 22, 2021 at 09:27:40AM -0800, Kevin Fenzi wrote: > > > * vm's started 'pausing' (which requires a full reboot). This was > > > tracked to a kernel config change we made in f29 getting lost along > > > the way. A new f33 kernel build fixed this issue. > > > > > > * Then, the vm's seemed to just build things more slowly than before. > > > I tried reducing the memory to 32GB, and then finally back to 24GB and > > > things seem back to where they were before from my simple testing. > > > > Just would like to note that my gcc build after 12 hours of building on > > 32-bit arm got reassigned to another build box and is building from the > > start again, so perhaps it isn't working perfectly yet. > > It's definitely not working yet. ;( > > I've been poking at it more today... > > > https://koji.fedoraproject.org/koji/taskinfo?taskID=60286478 > > Total time 13:19:20 > > Task time 1:11:53 > > Yeah, basically kojid get OOM killed, which causes it to restart and > koji sees the build never finished and restarts it. ;( > > Right now I am going to take them all down and: > > * remove the qemu highmem=off (this is not needed in the lpae case for > us, just non lpae, and might be causing some, but not all issues) > > * reduce their memory to 16GB. At 16GB I was able to get a python3.8 > build cleanly with tests in 40min. Right now with 24GB on the builders > they OOM kojid (as you see with gcc above). > > Hopefully those two things will make them more stable... ok. Done. All of them are up with 16gb and no highmem=off. I really hope this will stablize them before the mass rebuild. kevin
Attachment:
signature.asc
Description: PGP signature
_______________________________________________ devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx
