Re: recent bluestore ceph_test_objectstore regressions

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Sage, if these failures aren't blocking you, I am ok waiting until Monday.
But let us please not merge any bluestore PRs in the meantime.

- Neha

On Fri, Oct 22, 2021 at 7:21 AM Adam Kupczyk <akupczyk@xxxxxxxxxx> wrote:
>
> How about reverting it on Monday, if I do not fix it by then?
>
> On Fri, 22 Oct 2021 at 14:27, Igor Fedotov <ifedotov@xxxxxxx> wrote:
>>
>> I'm fine with both reverting and leaving it as-is for a couple more days.. So up to you guys... ;)
>>
>> On 10/22/2021 5:19 AM, Sage Weil wrote:
>>
>> Should we revert in the meantime?
>>
>> https://github.com/ceph/ceph/pull/43627
>>
>> On Thu, Oct 21, 2021 at 6:32 PM Neha Ojha <nojha@xxxxxxxxxx> wrote:
>>>
>>> Looks like the rados/objectstore tests were passing until 2021-10-13 -
>>> http://pulpito.front.sepia.ceph.com/yuriw-2021-10-13_23:21:13-rados-wip-yuriw-master-10.13.21-distro-basic-smithi/
>>> and started failing on 2021-10-15 -
>>> http://pulpito.front.sepia.ceph.com/yuriw-2021-10-15_22:59:21-rados-wip-yuri-master-10.15.21-distro-basic-smithi/.
>>>
>>> Looking at the bluestore changes merged during this period
>>> (https://github.com/ceph/ceph/commits/master/src/os), I'd suspect
>>> https://github.com/ceph/ceph/pull/42099, but I could be wrong. FWIW,
>>> the ceph_assert(file->fnode.ino) failure showed up in the testing of
>>> that PR, see https://github.com/ceph/ceph/pull/42099#issuecomment-943424310
>>> (https://pulpito.ceph.com/kchai-2021-10-14_09:20:36-rados-wip-kefu-testing-2021-10-14-1507-distro-basic-smithi/6443182/).
>>>
>>> Igor/Adam, I will let you guys dig further.
>>>
>>> Thanks,
>>> Neha
>>>
>>>
>>> On Thu, Oct 21, 2021 at 2:05 PM Sage Weil <sage@xxxxxxxxxxxx> wrote:
>>> >
>>> > I'm seeing two ceph_test_objectstore failures on current master:
>>> >
>>> > ObjectStore/StoreTestSpecificAUSize.SyntheticMatrixCsumVsCompression/2 fails with
>>> > 2021-10-21T19:39:03.941 INFO:teuthology.orchestra.run.smithi166.stderr:/build/ceph-17.0.0-8399-g9fda06aa/src/os/bluestore/BlueFS.cc: In function 'int BlueFS::_replay(bool, bool)' thread 7ff07ab77240 time 2021-10-21T19:39:03.932322+0000
>>> > 2021-10-21T19:39:03.944 INFO:teuthology.orchestra.run.smithi166.stderr:/build/ceph-17.0.0-8399-g9fda06aa/src/os/bluestore/BlueFS.cc: 1301: FAILED ceph_assert(file->fnode.ino)
>>> >
>>> > and ObjectStore/StoreTestSpecificAUSize.SpilloverFixedTest/2 fails with
>>> >
>>> > 2021-10-21T20:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-8399-g9fda06aa/rpm/el8/BUILD/ceph-17.0.0-8399-g9fda06aa/src/test/objectstore/store_test.cc:9375: Failure
>>> > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout:Expected equality of these values:
>>> > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout:  0
>>> > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout:  logger->get(l_bluefs_slow_used_bytes)
>>> > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout:    Which is: 217645056
>>> >
>>> > These seem to trigger reliably:
>>> >
>>> > https://pulpito.ceph.com/sage-2021-10-21_18:03:47-rados:objectstore-master-distro-basic-smithi/
>>> >
>>> > Are these known issues?
>>> > sage
>>> >
>>> > _______________________________________________
>>> > Dev mailing list -- dev@xxxxxxx
>>> > To unsubscribe send an email to dev-leave@xxxxxxx
>>>
>>
>> _______________________________________________
>> Dev mailing list -- dev@xxxxxxx
>> To unsubscribe send an email to dev-leave@xxxxxxx

_______________________________________________
Dev mailing list -- dev@xxxxxxx
To unsubscribe send an email to dev-leave@xxxxxxx



[Index of Archives]     [CEPH Users]     [Ceph Devel]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux