Hey Miro,
Sad to hear that it's been so rough.
On Wed, Apr 7, 2021 at 9:59 AM Miro Hrončok <mhroncok@xxxxxxxxxx> wrote:
Hello,
I was torn whether to share this here or not. I don't want to be the one who
always complains about things, but at the end I've decided that without honest
feedback, there cannot be progress (and I've realized I already am that guy).
Please don't take this feedback personally, I know that building things is hard.
I don't criticize people, but the tools.
Almost 2 years ago, we've decided to be the early adopters of gating in Fedora
with the python-virtualenv package:
https://src.fedoraproject.org/rpms/python-virtualenv/c/66b7533376f
Gating has proved more problematic than useful. It almost never works reliably,
the problems are impossible to decipher and/or debug. Too often we had to ask
for a CI-expert human intervention or straight out waive the results.
The humans we've contacted were always very friendly, helpful and they were able
to solve our issues. However, human-operated CIs unfortunately don't scale very
well.
Heh heh.
At first, we assumed the issues will get ironed out with time, but there seem to
be no visible progress.
Moreover, the gating caught 0 issues, because we already test our changes via
Pull Requests.
I'm not sure if others have similar experience, or if we just got unlucky :(
Martin Pitt recently posted a blog post about how he's been using the same tests and environments upstream in Pull Requests + downstream in Fedora gating. He also talks about "Fedora Gating woes" there. Perhaps similar concerns and pragmatic solutions.
Cheers,
Stef
After a very bumpy ride, we've now removed the (quite incomprehensible) gating
config, because frankly, it just gets in the way:
https://src.fedoraproject.org/rpms/python-virtualenv/pull-request/39
We will continue to run the CI in pull requests (which isn't perfect either but
at least we have redundancy and we see visible progress there over time) and to
run tests in %check (which works perfectly, but has many unfortunate limitations).
Let me be 100% clear: The situation wrt CI is complex and brings many
interesting challenges, but if I compare it with the dark ages before that, I
would not trade. Thank you everybody for making Fedora a better place to
contribute to.
--
Miro Hrončok
--
Phone: +420777974800
IRC: mhroncok
_______________________________________________
CI mailing list -- ci@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to ci-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/ci@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
--
Stef Walter (he / his)
Linux Engineering
Red Hat
Linux Engineering
Red Hat
_______________________________________________ devel mailing list -- devel@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to devel-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@xxxxxxxxxxxxxxxxxxxxxxx Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
