Re: Proposal: gate stable release critical path updates on openQA test results

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thu, Jan 07, 2021 at 09:25:44AM -0800, Adam Williamson wrote:
> So here's an idea I was thinking about over the RH shutdown: I propose
> we gate stable release critical path updates on the openQA tests.

YES. 


> But recently I was editing the Fedora greenwave config and realized
> there's actually a simple solution: Bodhi can just make *different
> greenwave queries* for critpath and non-critpath updates. We can have
> alternate greenwave "decision contexts" for critpath and non-critpath
> updates, and have the critpath one require passes for the openQA tests.
> That solves the problem neatly, AFAICS.

Nice!

> I've been monitoring the update test results ever since we started
> doing update testing, and I check *every* update test failure.
> Sometimes there's a test system issue or a non-bug change that makes
> the tests fail, and when that happens, I fix the problem and re-run the
> tests. Where the failure is a real bug, I investigate it and file a
> report to the appropriate place, then add a comment on the update
> explaining the issue, usually with negative karma. So we've been doing
> something similar to "gating" for years, just implemented manually :)

Yeah, that's not a _great_ use of your time. Let's make the computer do it!


-- 
Matthew Miller
<mattdm@xxxxxxxxxxxxxxxxx>
Fedora Project Leader
_______________________________________________
devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx




[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Fedora Announce]     [Fedora Users]     [Fedora Kernel]     [Fedora Testing]     [Fedora Formulas]     [Fedora PHP Devel]     [Kernel Development]     [Fedora Legacy]     [Fedora Maintainers]     [Fedora Desktop]     [PAM]     [Red Hat Development]     [Gimp]     [Yosemite News]

  Powered by Linux