On Tue, 2018-01-23 at 18:12 +0000, Richard W.M. Jones wrote: > The problem for the OCaml packages is missing tests or tests that > haven't been run: > > https://bodhi.fedoraproject.org/updates/FEDORA-2018-932548462e > https://bodhi.fedoraproject.org/updates/FEDORA-2018-ecd3541af9 > > BTW these both really need to be pushed as soon as possible because > they fix a license violation. Yes, we're looking into that too - see https://github.com/fedora-infra/bodhi/issues/2133 for some discussion. Basically sometimes Taskotron tests for some package or other just don't run for some transient reason - some bit of the process is down or not working correctly, and because it's all fedmsg-driven, there's really only one shot and if the tests don't trigger correctly at the time they should, nothing goes back and re-triggers them later. Improving this has never been a high priority because it hasn't really mattered a lot to anyone...until now. The policy as currently implemented basically means "the update *only* passes if we can find a 'pass' for each of the required tests". So if one isn't run, the update fails. The initial thought we - we being Tim, Kamil, Josef, Ralph and I - had is to simply invert the policy, if we can, so it becomes "the update passes *unless* we can find a 'fail' for any of the required tests". So all updates would be push-able (so far as this mechanism is concerned, ignoring all the old ones) until one of the gating tests definitely failed. If we can't do that, we're going to just have to disable the gating again until this is sorted out; we're definitely of the opinion that Taskotron doesn't yet provide enough of a solid guarantee that all the tests will be run for a policy which *assumes* that will be the case to be viable. -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora http://www.happyassassin.net _______________________________________________ devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx
