Public facing space for Anaconda CI logs

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,
I would like to ask if it would be possible to allocate some storage
space that would be publically available (eq. fedorapeople.org,
or similar) we could use store logs from our CI so that external
contributors can access them.

Why is this needed ?
Our CI runs in internal vm hosts and internal open stack, both if which
is not accessbile from the public internet, has no public IP or domain.
At the same time we would like the make te test results available,
so that for example an external contributor can see the results of tests we
run on their pull request.

What tests does the Anaconda CI run ?
- unit tests & Pylint we run on all pull requests for Anaconda and related projects
- periodically run kickstart tests[0], a battery of 130+ integration test, where each test is basically
  a full kickstart-configured installation run

What kind of environment would be needed ?
Basically just a simple file/static html storage would be needed, where we can SCP the log files to.
The general idea is that tests results would be uploaded to this space whem the respective
tests finish & there would a periodic cleanup task that would keep last N logs & remove old logs.


What ammount of storage space would be needed for this ?
While the unit tests & pylint runs we do on Pull requests don't produce that much data,
the kickstart test suite is in a different class.

Each of the 130+ tests is a full installation run, which produces a sizeable ammount of data
as we gather a substantial ammount of logs from each test (anaconda logs, dnf logs, lvm & storage logs).
This data is important to debug all the various issues that can happen in what is essentially a full
instrumented installation run.

Our measurements have shown that each full kickstart test run (~130 tests) produces ~800 MB of logs. Therefore
we would like to request 16 GB of space to be available so that we can store ~10 last tests results from kickstart test,
a reasonable number of PR test results & have some room to spare.

Would this be possible ? Requesting 16 GB might seem like a lot but I'm afraid we can't reasonably reduce the space
requirements for logs from kickstart tests runs without at the same time also making test runs harder to debug.

Looking for your feedback & don't be afraid to ask any questions about this proposal. :)

Best Wishes
Martin Kolman



[0] https://github.com/rhinstaller/kickstart-tests
_______________________________________________
infrastructure mailing list -- infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to infrastructure-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx/message/32KZ56SUYA5C5WCKICF6ZZEGR7IIHP45/




[Index of Archives]     [Fedora Development]     [Fedora Users]     [Fedora Desktop]     [Fedora SELinux]     [Yosemite News]     [KDE Users]

  Powered by Linux