Re: Failure to repair an omap digest

[David Zafman <dzafman@xxxxxxxxxx>]

Look at https://github.com/ceph/ceph/pull/9032 to see pending doc 
changes which were already in the works.

David


On 1/9/17 1:09 PM, Samuel Just wrote:
> Sounds like this should be added to the docs!
> -Sam
>
> On Mon, Jan 9, 2017 at 1:05 PM, David Zafman <dzafman@xxxxxxxxxx> wrote:
> > ceph version 11.1.0-6147-g12706d7 (12706d76225fa1491d00362d3bc04e0541dead73)
> >
> > A failure to repair occurred because without a digest in the object info the
> > code doesn't attempt to decide which omap is wrong.   Here we only have an
> > omap_digest_mismatch error.  Had the "selected_object_info" included "od"
> > presuambly of 1fff04c0 then "omap_digest_mismatch_oi" would have been set on
> > osd.47 and it would be repaired.
> >
> > The way to fix this particular case is to stop osd.47, remove the object
> > with ceph-objectstore-tool, then restart osd.47 and the repair should then
> > re-create a correct object and omap there.  As you can see the object name
> > is 100011cf577.00000000 in pool 1 (metadata).
> >
> > $  sudo rados list-inconsistent-pg metadata
> > ["1.25"]
> >
> > $ sudo rados list-inconsistent-obj 1.25 --format=json-pretty
> > {
> >      "epoch": 767566,
> >      "inconsistents": [
> >          {
> >              "object": {
> >                  "name": "100011cf577.00000000",
> >                  "nspace": "",
> >                  "locator": "",
> >                  "snap": "head",
> >                  "version": 9023143
> >              },
> >              "errors": [
> >                  "omap_digest_mismatch"
> >              ],
> >              "union_shard_errors": [],
> >              "selected_object_info":
> > "1:a7f0f16e:::100011cf577.00000000:head(768083'9023143 mds.0.94887:9732381
> > dirty|omap|data_digest s 0 uv 9023143 dd ffffffff alloc_hint [0 0 0])",
> >              "shards": [
> >                  {
> >                      "osd": 7,
> >                      "errors": [],
> >                      "size": 0,
> >                      "omap_digest": "0x1fff04c0",
> >                      "data_digest": "0xffffffff"
> >                  },
> >                  {
> >                      "osd": 47,
> >                      "errors": [],
> >                      "size": 0,
> >                      "omap_digest": "0xc2c5ddcd",
> >                      "data_digest": "0xffffffff"
> >                  },
> >                  {
> >                      "osd": 60,
> >                      "errors": [],
> >                      "size": 0,
> >                      "omap_digest": "0x1fff04c0",
> >                      "data_digest": "0xffffffff"
> >                  },
> >                  {
> >                      "osd": 72,
> >                      "errors": [],
> >                      "size": 0,
> >                      "omap_digest": "0x1fff04c0",
> >                      "data_digest": "0xffffffff"
> >                  }
> >              ]
> >          }
> >      ]
> > }
> >
> >
> > David
> >
> > --
> > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> > the body of a message to majordomo@xxxxxxxxxxxxxxx
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html