yesterday, we were seeing new build and teuthology failures related to the 'apache.jfrog.io' repo, which removed its centos/8/ packages in https://github.com/ceph/ceph-container/pull/1990 and https://github.com/ceph/ceph-cm-ansible/pull/667, i removed what i hope are the last remaining references to this repo however, i'm still seeing lots of these failures in shaman and teuthology. it looks like a lot of these machines still have this repo installed, and will need to be cleaned up manually. David, could you please look into this? On Wed, Feb 2, 2022 at 9:31 AM Casey Bodley <cbodley@xxxxxxxxxx> wrote: > > On Tue, Feb 1, 2022 at 5:20 PM Neha Ojha <nojha@xxxxxxxxxx> wrote: > > > > Thanks David and Casey for taking care of the switch! > > > > On Tue, Feb 1, 2022 at 1:05 PM David Galloway <dgallowa@xxxxxxxxxx> wrote: > > > > > > Hi all, > > > > > > The CentOS group moved/disabled their non-Stream repos over the weekend. > > > This resulted in effectively breaking all CentOS 8 installations and > > > caused a lot of failures on Jenkins builders (braggi/adami/etc.) and in > > > teuthology runs. > > > > > > https://lists.centos.org/pipermail/centos-devel/2022-January/120120.html > > > > > > I've spent the last couple days converting our CentOS 8 Jenkins builders > > > to CentOS 8 Stream. In addition, all teuthology runs will now need to > > > use CentOS Stream testnode FOG images for CentOS jobs. (--os-version > > > 8.stream) > > > > > > If you're scheduling a run and still see a lot of job failures only on > > > CentOS 8.X, you will need to apply some variation of > > > https://github.com/ceph/ceph/commit/837d393cbb598e9c6943c96b42f11dfeea371464 > > > to your branch. Backports are https://tracker.ceph.com/issues/54087 > > > > How are we planning to address > > https://github.com/ceph/ceph/pull/44846#issuecomment-1026243525 for > > pacific and octopus? > > looking at the history, i believe > https://github.com/ceph/ceph/pull/41943 was the only extra commit we > needed there. i prepared those backports for octopus and pacific too > > > > > - Neha > > > > > > > > Make sure you're setting the correct branch with --suite-branch when > > > scheduling teuthology runs. > > > > > > CentOS 8 Jenkins builds should be passing again. Let me know if you > > > have a branch you need me to rebuild. > > > > > > Sorry for the disruption. > > > -- > > > David Galloway > > > Principal Systems Administrator > > > Ceph Engineering > > > > > > _______________________________________________ > > > Dev mailing list -- dev@xxxxxxx > > > To unsubscribe send an email to dev-leave@xxxxxxx > > > > > > > _______________________________________________ > > Dev mailing list -- dev@xxxxxxx > > To unsubscribe send an email to dev-leave@xxxxxxx > > _______________________________________________ Dev mailing list -- dev@xxxxxxx To unsubscribe send an email to dev-leave@xxxxxxx