On 5/14/19 12:21 PM, David Galloway wrote: > > On 5/13/19 6:56 PM, Alfredo Deza wrote: >> Hi, >> >> Just a quick note on Jenkins, we are undergoing a major outage which >> we are trying to recover from. Our master jenkins was affected with a >> malware, a new instance is being worked on and we expect this to be >> fully operational tomorrow. >> >> This means *new* builds and repos, Github PR checks, and formal Ceph >> releases are impacted. >> >> Once all systems are fully working, PRs will have to manually >> re-trigger the jobs (I will follow up on how to do that). >> >> Thanks for your patience while we work on this. >> > > Hi all, > > The finish line is in sight. > > Both Jenkins masters have been resurrected on new hosts. There's a lot > of manual configuration that needs to be done on these even with > Configuration As Code (ansible, plugins, etc.). > > I will be implementing a monthly CI maintenance to keep Jenkins and its > plugins up to date to avoid situations like this in the future. > > We're still working through a few snags. I don't think wip branches are > being built from ceph-ci.git, for example. We'll send an all clear when > things are.. all clear. > > Thanks for your patience. > I believe we've worked out all the kinks. As a reminder, if you need to force a build for a branch in ceph-ci.git, you can simply 'git commit --amend --no-edit && git push -f origin wip-YOURBRANCH' If you run into any issues, please don't hesitate to contact me.
