Hello,
i'm trying to fix a cluster where one pg is in
active+clean+inconsistent+snaptrim
state.
The log says:
2017-08-05 08:57:43.240030 osd.20 [ERR] 3.61a repair 0 missing, 1
inconsistent objects
2017-08-05 08:57:43.240044 osd.20 [ERR] 3.61a repair 4 errors, 2 fixed
2017-08-05 08:57:43.242828 osd.20 [ERR] trim_object Snap 9d455 not in clones
find says:
osd.20]# find . -name "*9d455*" -exec ls -la "{}" \;
-rw-r--r-- 1 ceph ceph 0 Aug 5 08:57
./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d455_BCB2A61A__3
find . -name "*9d455*" -exec ls -la "{}" \;
osd.70]# -rw-r--r-- 1 ceph ceph 4194304 Aug 5 08:57
./current/3.61a_head/DIR_A/DIR_1/DIR_6/DIR_A/rbd\udata.106dd406b8b4567.000000000000018c__9d455_BCB2A61A__3
osd.57]# find . -name "*9d455*" -exec ls -la "{}" \;
# no file found
I tried the following stuff to solve this issue.
stop osd.y
copy file from osd.x to osd.y
start osd.y
But all that does not help. It stays in this state.
The output of a ceph pg repair is:
2017-08-05 08:57:25.715812 osd.20 [ERR] 3.61a shard 20: soid
3:58654d3d:::rbd_data.106dd406b8b4567.000000000000018c:9d455 data_digest
0xffffffff != data_digest 0xbd9585ca from auth oi
3:58654d3d:::rbd_data.106dd406b8b4567.000000000000018c:9d455(818765'26612094
osd.20.0:562819 [9d455] dirty|data_digest|omap_digest s 4194304 uv
26585239 dd bd9585ca od ffffffff alloc_hint [0 0]), size 0 != size
4194304 from auth oi
3:58654d3d:::rbd_data.106dd406b8b4567.000000000000018c:9d455(818765'26612094
osd.20.0:562819 [9d455] dirty|data_digest|omap_digest s 4194304 uv
26585239 dd bd9585ca od ffffffff alloc_hint [0 0])
2017-08-05 08:57:25.715817 osd.20 [ERR] 3.61a shard 70: soid
3:58654d3d:::rbd_data.106dd406b8b4567.000000000000018c:9d455 data_digest
0x43d61c5d != data_digest 0xffffffff from shard 20, data_digest
0x43d61c5d != data_digest 0xbd9585ca from auth oi
3:58654d3d:::rbd_data.106dd406b8b4567.000000000000018c:9d455(818765'26612094
osd.20.0:562819 [9d455] dirty|data_digest|omap_digest s 4194304 uv
26585239 dd bd9585ca od ffffffff alloc_hint [0 0]), size 4194304 != size
0 from shard 20
2017-08-05 08:57:25.715903 osd.20 [ERR] repair 3.61a
3:58654d3d:::rbd_data.106dd406b8b4567.000000000000018c:9d455 is an
unexpected clone
How to get this fixed?
Greets,
Stefan
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
