Hi Miroslav, On Tue, Aug 06, 2024 at 11:44:47AM +0200, Miroslav Suchý wrote: > I am working on > > https://github.com/fedora-copr/copr/issues/3327 > > summary is that dnf-automatic installed security fix on Saturday, but the > new version changed something else too. And part of Copr was down most of > the weekend. This happened already twice. > > In Copr we do not want to repeat this (fool me once...) and I want to change > dnf-automatic to run only on Mon-Thu. I will do that for Copr. And I am > willing to do that for all Fedora's machines. Should I? Opinions? For CKI, we've faced similar problems. To keep reasonable SLOs, we - changed the update mode to offline upgrades, which gets rid of all the really weird failure cases - used a weekly schedule for automated updates - configured different machines of the same set (e.g. all aarch64 builders) for different weekdays, e.g. AZ A updates/reboots on Monday/Wednesday, AZ B on Tuesday/Thursday, ... Together with monitoring, this allows a tradeoff between reliability (the service should only ever be degraded but not down) and time to recover. Cheers Michael -- Michael Hofmann (he/him) | Slack mh21 #team-kernel-cki | 0xE8E1F78D86F24DA1 Red Hat GmbH, Werner von Siemens Ring 12, D-85630 Grasbrunn Amtsgericht Muenchen/Munich, HRB 153243 Managing Directors: Ryan Barnhart, Charles Cachera, Michael O'Neill, Amy Ross
Attachment:
signature.asc
Description: PGP signature
-- _______________________________________________ infrastructure mailing list -- infrastructure@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to infrastructure-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
