Looks like the rados/objectstore tests were passing until 2021-10-13 - http://pulpito.front.sepia.ceph.com/yuriw-2021-10-13_23:21:13-rados-wip-yuriw-master-10.13.21-distro-basic-smithi/ and started failing on 2021-10-15 - http://pulpito.front.sepia.ceph.com/yuriw-2021-10-15_22:59:21-rados-wip-yuri-master-10.15.21-distro-basic-smithi/. Looking at the bluestore changes merged during this period (https://github.com/ceph/ceph/commits/master/src/os), I'd suspect https://github.com/ceph/ceph/pull/42099, but I could be wrong. FWIW, the ceph_assert(file->fnode.ino) failure showed up in the testing of that PR, see https://github.com/ceph/ceph/pull/42099#issuecomment-943424310 (https://pulpito.ceph.com/kchai-2021-10-14_09:20:36-rados-wip-kefu-testing-2021-10-14-1507-distro-basic-smithi/6443182/). Igor/Adam, I will let you guys dig further. Thanks, Neha On Thu, Oct 21, 2021 at 2:05 PM Sage Weil <sage@xxxxxxxxxxxx> wrote: > > I'm seeing two ceph_test_objectstore failures on current master: > > ObjectStore/StoreTestSpecificAUSize.SyntheticMatrixCsumVsCompression/2 fails with > 2021-10-21T19:39:03.941 INFO:teuthology.orchestra.run.smithi166.stderr:/build/ceph-17.0.0-8399-g9fda06aa/src/os/bluestore/BlueFS.cc: In function 'int BlueFS::_replay(bool, bool)' thread 7ff07ab77240 time 2021-10-21T19:39:03.932322+0000 > 2021-10-21T19:39:03.944 INFO:teuthology.orchestra.run.smithi166.stderr:/build/ceph-17.0.0-8399-g9fda06aa/src/os/bluestore/BlueFS.cc: 1301: FAILED ceph_assert(file->fnode.ino) > > and ObjectStore/StoreTestSpecificAUSize.SpilloverFixedTest/2 fails with > > 2021-10-21T20:38:56.731 INFO:teuthology.orchestra.run.smithi102.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-8399-g9fda06aa/rpm/el8/BUILD/ceph-17.0.0-8399-g9fda06aa/src/test/objectstore/store_test.cc:9375: Failure > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout:Expected equality of these values: > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: 0 > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: logger->get(l_bluefs_slow_used_bytes) > 2021-10-21T20:38:56.732 INFO:teuthology.orchestra.run.smithi102.stdout: Which is: 217645056 > > These seem to trigger reliably: > > https://pulpito.ceph.com/sage-2021-10-21_18:03:47-rados:objectstore-master-distro-basic-smithi/ > > Are these known issues? > sage > > _______________________________________________ > Dev mailing list -- dev@xxxxxxx > To unsubscribe send an email to dev-leave@xxxxxxx _______________________________________________ Dev mailing list -- dev@xxxxxxx To unsubscribe send an email to dev-leave@xxxxxxx
