V Fri, Jun 09, 2023 at 11:38:51AM -0700, Adam Williamson napsal(a): > On Thu, 2022-06-09 at 12:48 -0700, Adam Williamson wrote: > > Hi folks! > > > > More significantly, I'd also propose that we turn on gating on openQA > > results for Rawhide updates. This would mean Rawhide updates would be > > held from going 'stable' (and included in the next compose) until the > > gating openQA tests had run and passed. We may want to do this a bit > > after turning on the tests; perhaps Fedora 37 branch point would be a > > natural time to do it. > > Hi again folks! A quick update here. Now the Rawhide update testing has > been running in production for over a year - and Kevin and I have been > "shadow gating" Rawhide for several months, untagging updates where > openQA tests indicate genuine bugs - I think it's time to go ahead and > enable gating for Rawhide updates. I've worked to make sure the tests > are reliable and failures are promptly investigated, and that Bodhi > provides accurate information on test and gating status. I've proposed > this as a FESCo ticket just to get some visibility and sign-off on the > idea: > OpenQA update testing are the graphical tests, e.g. update.live_build test <https://openqa.fedoraproject.org/tests/1939328>? I always strugle to understand the results. What does a gray frame mean? In failed (red?) frame, how can I see the expected image? The frame is usually split by a vertical line, so I guess one side is expected, other side is observed. Which one is one? What does mean "Test died: no candidate needle with tag(s) '...' matched" message? And most importantly, who should I contact to help me investigate the failures. As a packager, I need to retract the update or waive it promptly. That means either the packager needs to be able to reproduce the failure locally (how?) or there must be some one else to do it. I would expect answers for these questions to be available in a documentation. Yet, I can any pointer to the documentation from a page with the results. -- Petr
Attachment:
signature.asc
Description: PGP signature
_______________________________________________ devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx Do not reply to spam, report it: https://pagure.io/fedora-infrastructure/new_issue
