On Thu, Jan 07, 2021 at 09:25:44AM -0800, Adam Williamson wrote: > So here's an idea I was thinking about over the RH shutdown: I propose > we gate stable release critical path updates on the openQA tests. YES. > But recently I was editing the Fedora greenwave config and realized > there's actually a simple solution: Bodhi can just make *different > greenwave queries* for critpath and non-critpath updates. We can have > alternate greenwave "decision contexts" for critpath and non-critpath > updates, and have the critpath one require passes for the openQA tests. > That solves the problem neatly, AFAICS. Nice! > I've been monitoring the update test results ever since we started > doing update testing, and I check *every* update test failure. > Sometimes there's a test system issue or a non-bug change that makes > the tests fail, and when that happens, I fix the problem and re-run the > tests. Where the failure is a real bug, I investigate it and file a > report to the appropriate place, then add a comment on the update > explaining the issue, usually with negative karma. So we've been doing > something similar to "gating" for years, just implemented manually :) Yeah, that's not a _great_ use of your time. Let's make the computer do it! -- Matthew Miller <mattdm@xxxxxxxxxxxxxxxxx> Fedora Project Leader _______________________________________________ test mailing list -- test@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to test-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/test@xxxxxxxxxxxxxxxxxxxxxxx
