On 5/13/19 6:56 PM, Alfredo Deza wrote: > Hi, > > Just a quick note on Jenkins, we are undergoing a major outage which > we are trying to recover from. Our master jenkins was affected with a > malware, a new instance is being worked on and we expect this to be > fully operational tomorrow. > > This means *new* builds and repos, Github PR checks, and formal Ceph > releases are impacted. > > Once all systems are fully working, PRs will have to manually > re-trigger the jobs (I will follow up on how to do that). > > Thanks for your patience while we work on this. > Hi all, The finish line is in sight. Both Jenkins masters have been resurrected on new hosts. There's a lot of manual configuration that needs to be done on these even with Configuration As Code (ansible, plugins, etc.). I will be implementing a monthly CI maintenance to keep Jenkins and its plugins up to date to avoid situations like this in the future. We're still working through a few snags. I don't think wip branches are being built from ceph-ci.git, for example. We'll send an all clear when things are.. all clear. Thanks for your patience.