On Tue, Mar 17, 2015 at 6:55 PM, David Zafman <dzafman@xxxxxxxxxx> wrote:
>
> During upgrade testing an error occurred because ceph-objectstore-tool found
> during import on a Firefly node the compat_features from a export from
> Hammer.
>
> There are 2 new feature bits set as shown in the error message:
>
> Export has incompatible features set
> compat={},rocompat={},incompat={12=transaction hints,13=pg meta object}
>
> In this case as far as I can tell these osd incompatible changes wouldn't
> make the export data in any way incompatible. So we may have to check
> compatibility bits on a case by case basis, if we want to allow the tool to
> work in the most cases possible.
>
> During upgrade testing it is interesting that one node has the transaction
> hints feature, but other nodes still running firefly don't. Is this a case
> where we don't have to wait for all OSDs to update before the cluster can
> start handling OP_COLL_HINT operations?
Mmm, I wasn't much involved in any of it but I think the tricky bit
about transaction hints are that they get encoded into the journal.
I'm not sure this handling is quite right though — if they're not
recognized can't they just get skipped in the decoding stages?
In any case, hammer OSDs are supposed to make use of hints without
upgrading all OSDs, IIRC by checking with their peers on every
interval to decide if everybody supports the needed encoding or not
(since during backfill they just transfer objects, it's not a problem
to later include an old OSD). But it looks from a distance like there
may still be some design work to do here.
-Greg
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
