Re: 16.2.8 QE testing issues

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



copying dev list for the updates details.

On Wed, May 4, 2022 at 12:55 PM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote:
The PR was merged

I will start running all tests again and we will evaluate based on the results when to declare a public RC

On Tue, May 3, 2022 at 3:39 PM Neha Ojha <nojha@xxxxxxxxxx> wrote:
On Mon, May 2, 2022 at 8:14 AM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote:
>
> I have run lots of tests over the weekend.
>
> Results with the revered PRs => http://pulpito.front.sepia.ceph.com/?sha1=f566756bcbf81a9e17ed272afd5e8555c4ded09b
>
> Also, there are two batches with PRs (ready for review):
> master => https://trello.com/c/foSjnqj3
> pacific => https://trello.com/c/CSnfvv5Z
>
> Neha, we need to decide what to include in to 16.2.8

Yes, let's merge it. I have approved the test results for
https://trello.com/c/CSnfvv5Z.

Thanks,
Neha

>
> Thx
>
> On Fri, Apr 29, 2022 at 3:30 PM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote:
>>
>> https://github.com/ceph/ceph/pull/46085
>> https://github.com/ceph/ceph/pull/46092
>>
>> both merged
>>
>> On Fri, Apr 29, 2022 at 3:16 PM Neha Ojha <nojha@xxxxxxxxxx> wrote:
>>>
>>> On Fri, Apr 29, 2022 at 2:31 PM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote:
>>> >
>>> > Two revert PRs are almost ready for merge:
>>> >
>>> > https://github.com/ceph/ceph/pull/46092
>>>
>>> Let's merge this and run all the suites over the weekend to get
>>> cleaner baseline runs. Adam is working on a fix for
>>> https://tracker.ceph.com/issues/55444. He will include the commits
>>> from https://github.com/ceph/ceph/pull/45963 in his PR, which we will
>>> test in parallel. We'll take a call on merging or not merging it for
>>> 16.2.8 next week.
>>>
>>> > https://github.com/ceph/ceph/pull/46085
>>>
>>> Let's merge this too.
>>>
>>> Thanks,
>>> Neha
>>>
>>> >
>>> > Waiting for Neha's final confirmation.
>>> >
>>> >
>>> > On Fri, Apr 29, 2022 at 10:20 AM David Orman <ormandj@xxxxxxxxxxxx> wrote:
>>> >>
>>> >> Thank you. I will caution against launching 16.2.8 without this PR (with whatever might be causing issues resolved), as autosharding will function properly again on versioned buckets and it is likely to induce quite some pain for those who have large versioned buckets when the deletion tombstones are created.
>>> >>
>>> >> On Fri, Apr 29, 2022 at 10:27 AM Ilya Dryomov <idryomov@xxxxxxxxx> wrote:
>>> >>>
>>> >>> On Fri, Apr 29, 2022 at 2:48 PM David Orman <ormandj@xxxxxxxxxxxx> wrote:
>>> >>> >
>>> >>> > We cannot access this link. Is there an alternative that can be accessed remotely? Additionally, Cory is out until Monday on PTO, so just a head's up that someone else may need to look into this in the meantime.
>>> >>>
>>> >>> Hi David,
>>> >>>
>>> >>> Just strip "front.sepia":
>>> >>>
>>> >>> http://pulpito.ceph.com/yuriw-2022-04-28_23:25:04-upgrade:octopus-x-wip-55444-pacific-distro-default-smithi
>>> >>>
>>> >>> Thanks,
>>> >>>
>>> >>>                 Ilya
>>> >>>
>>> >>> >
>>> >>> > David
>>> >>> >
>>> >>> > On Thu, Apr 28, 2022 at 6:26 PM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote:
>>> >>> >>
>>> >>> >> Neha, Ilya
>>> >>> >>
>>> >>> >> Latest run:
>>> >>> >> http://pulpito.front.sepia.ceph.com/yuriw-2022-04-28_23:25:04-upgrade:octopus-x-wip-55444-pacific-distro-default-smithi
>>> >>> >>
>>> >>> >>
>>> >>> >> On Thu, Apr 28, 2022 at 3:04 PM Neha Ojha <nojha@xxxxxxxxxx> wrote:
>>> >>> >>>
>>> >>> >>> On Thu, Apr 28, 2022 at 2:54 PM Ilya Dryomov <idryomov@xxxxxxxxx> wrote:
>>> >>> >>> >
>>> >>> >>> > On Thu, Apr 28, 2022 at 9:27 PM Ilya Dryomov <idryomov@xxxxxxxxx> wrote:
>>> >>> >>> > >
>>> >>> >>> > > On Thu, Apr 28, 2022 at 1:06 AM Yuri Weinstein <yweinste@xxxxxxxxxx> wrote:
>>> >>> >>> > > >
>>> >>> >>> > > > We are seeing issues during tests, visible in upgrade tests
>>> >>> >>> > > > (http://pulpito.front.sepia.ceph.com/yuriw-2022-04-27_14:24:25-upgrade:octopus-x-pacific-distro-default-smithi/)
>>> >>> >>> > > >
>>> >>> >>> > > > Looks like trackers:
>>> >>> >>> > > > https://tracker.ceph.com/issues/55444
>>> >>> >>> > > > https://tracker.ceph.com/issues/55475
>>> >>> >>> > > >
>>> >>> >>> > > > Casey, Ilya pls advise if they have to be addressed before 16.2.8 release
>>> >>> >>> > >
>>> >>> >>> > > The RBD failures are rather puzzling but seem to be reproducible (at
>>> >>> >>> > > least in teuthology, not locally so far).  I doubt it is something new
>>> >>> >>> > > so probably not a blocker for -rc -- will investigate in parallel.
>>> >>> >>> >
>>> >>> >>> > Neha, this looks like a critical omap handling regression on the OSD
>>> >>> >>> > side to me.  Definitely a blocker for 16.2.8.  I have reassigned the
>>> >>> >>> > above RBD ticket to you.
>>> >>> >>> >
>>> >>> >>> > Yuri, the natural suspect is https://github.com/ceph/ceph/pull/45963.
>>> >>> >>> > I would suggest building a pacific branch without it and rerunning my
>>> >>> >>> > test run:
>>> >>> >>>
>>> >>> >>> I am building a revert branch here:
>>> >>> >>> https://shaman.ceph.com/builds/ceph/wip-55444-pacific/437ed7086a46ae0803b5905bdc071f286df1081e/.
>>> >>> >>> Can you please rerun the same test using this?
>>> >>> >>>
>>> >>> >>> >
>>> >>> >>> >     https://pulpito.ceph.com/dis-2022-04-28_17:15:07-upgrade:octopus-x-pacific-distro-default-smithi/
>>> >>> >>> >
>>> >>> >>> > Thanks,
>>> >>> >>> >
>>> >>> >>> >                 Ilya
>>> >>> >>> >
>>> >>> >>>
>>> >>> >> _______________________________________________
>>> >>> >> Dev mailing list -- dev@xxxxxxx
>>> >>> >> To unsubscribe send an email to dev-leave@xxxxxxx
>>>

_______________________________________________
Dev mailing list -- dev@xxxxxxx
To unsubscribe send an email to dev-leave@xxxxxxx

[Index of Archives]     [CEPH Users]     [Ceph Devel]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux