I am going to revert the PR to unblock 16.2.8 - https://github.com/ceph/ceph/pull/46092. Let's investigate https://tracker.ceph.com/issues/55444 in parallel. Thanks, Neha On Fri, Apr 29, 2022 at 7:05 AM Adam King <adking@xxxxxxxxxx> wrote: > > There were some new failures in rados suite due to a change in public network configuration. Testing a reversion. It's in progress but so far haven't seen the same failures. > > https://github.com/ceph/ceph/pull/46085 > https://pulpito.ceph.com/adking-2022-04-29_12:06:52-rados:cephadm-wip-adk3-testing-2022-04-28-2054-pacific-distro-basic-smithi/ > > On Fri, Apr 29, 2022 at 8:01 AM Brett Niver <bniver@xxxxxxxxxx> wrote: >> >> + Adam >> >> >> On Fri, Apr 29, 2022 at 3:02 AM Ilya Dryomov <idryomov@xxxxxxxxx> wrote: >>> >>> On Fri, Apr 29, 2022 at 1:26 AM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote: >>> > >>> > Neha, Ilya >>> > >>> > Latest run: >>> > http://pulpito.front.sepia.ceph.com/yuriw-2022-04-28_23:25:04-upgrade:octopus-x-wip-55444-pacific-distro-default-smithi >>> >>> Yuri's run is now green with the exception of one job and my test case >>> came back all green as well: >>> >>> https://pulpito.ceph.com/dis-2022-04-29_05:11:42-upgrade:octopus-x-wip-55444-pacific-distro-default-smithi/ >>> >>> So the issue is indeed with https://github.com/ceph/ceph/pull/45963. >>> >>> Thanks, >>> >>> Ilya >>> >>> > >>> > >>> > On Thu, Apr 28, 2022 at 3:04 PM Neha Ojha <nojha@xxxxxxxxxx> wrote: >>> >> >>> >> On Thu, Apr 28, 2022 at 2:54 PM Ilya Dryomov <idryomov@xxxxxxxxx> wrote: >>> >> > >>> >> > On Thu, Apr 28, 2022 at 9:27 PM Ilya Dryomov <idryomov@xxxxxxxxx> wrote: >>> >> > > >>> >> > > On Thu, Apr 28, 2022 at 1:06 AM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote: >>> >> > > > >>> >> > > > We are seeing issues during tests, visible in upgrade tests >>> >> > > > (http://pulpito.front.sepia.ceph.com/yuriw-2022-04-27_14:24:25-upgrade:octopus-x-pacific-distro-default-smithi/) >>> >> > > > >>> >> > > > Looks like trackers: >>> >> > > > https://tracker.ceph.com/issues/55444 >>> >> > > > https://tracker.ceph.com/issues/55475 >>> >> > > > >>> >> > > > Casey, Ilya pls advise if they have to be addressed before 16.2.8 release >>> >> > > >>> >> > > The RBD failures are rather puzzling but seem to be reproducible (at >>> >> > > least in teuthology, not locally so far). I doubt it is something new >>> >> > > so probably not a blocker for -rc -- will investigate in parallel. >>> >> > >>> >> > Neha, this looks like a critical omap handling regression on the OSD >>> >> > side to me. Definitely a blocker for 16.2.8. I have reassigned the >>> >> > above RBD ticket to you. >>> >> > >>> >> > Yuri, the natural suspect is https://github.com/ceph/ceph/pull/45963. >>> >> > I would suggest building a pacific branch without it and rerunning my >>> >> > test run: >>> >> >>> >> I am building a revert branch here: >>> >> https://shaman.ceph.com/builds/ceph/wip-55444-pacific/437ed7086a46ae0803b5905bdc071f286df1081e/. >>> >> Can you please rerun the same test using this? >>> >> >>> >> > >>> >> > https://pulpito.ceph.com/dis-2022-04-28_17:15:07-upgrade:octopus-x-pacific-distro-default-smithi/ >>> >> > >>> >> > Thanks, >>> >> > >>> >> > Ilya >>> >> > >>> >> >>> _______________________________________________ >>> Dev mailing list -- dev@xxxxxxx >>> To unsubscribe send an email to dev-leave@xxxxxxx >>> >> _______________________________________________ >> Dev mailing list -- dev@xxxxxxx >> To unsubscribe send an email to dev-leave@xxxxxxx _______________________________________________ Dev mailing list -- dev@xxxxxxx To unsubscribe send an email to dev-leave@xxxxxxx
