On Fri, Jul 22, 2011 at 8:27 AM, Fyodor Ustinov <ufm@xxxxxx> wrote: > On 07/19/2011 05:29 PM, Sage Weil wrote: >> >> On Tue, 19 Jul 2011, Fyodor Ustinov wrote: >>> >>> Hi! >>> >>> 2011-07-19 14:00:39.509391 log 2011-07-19 14:00:34.185718 osd5 >>> 10.5.51.145:6803/19737 1563 : [ERR] 0.f8 scrub stat mismatch, got >>> 2074/2074 >>> objects, 0/0 clones, 8624991435/8590119115 bytes, 8422853/8388798 kb. >>> 2011-07-19 14:00:39.509391 log 2011-07-19 14:00:34.185732 osd5 >>> 10.5.51.145:6803/19737 1564 : [ERR] 0.f8 scrub 1 errors >>> >>> How to respond to this message? >> >> $ ceph pg repair 0.f8 >> >> should do the trick! >> >> sage > > Hmm... But today I seen again: > > 2011-07-22 17:26:51.134596 log 2011-07-22 17:26:51.010146 osd5 > 10.5.51.145:6803/19737 2120 : [ERR] 0.f8 scrub stat mismatch, got 2095/2095 > objects, 0/0 clones, 8678199499/8713071819 bytes, 8474814/8508869 kb. > 2011-07-22 17:26:51.134596 log 2011-07-22 17:26:51.010159 osd5 > 10.5.51.145:6803/19737 2121 : [ERR] 0.f8 scrub 1 errors > > And 'ceph pg repair 0.f8' again fix: > > 2011-07-22 18:18:31.158248 log 2011-07-22 18:18:24.316646 osd5 > 10.5.51.145:6803/19737 2122 : [ERR] 0.f8 repair stat mismatch, got 2095/2095 > objects, 0/0 clones, 8678199499/8713071819 bytes, 8474814/8508869 kb. > 2011-07-22 18:18:31.158248 log 2011-07-22 18:18:24.316680 osd5 > 10.5.51.145:6803/19737 2123 : [ERR] 0.f8 repair 1 errors, 1 fixed > > WBR, > Fyodor. Hmmm, what are you doing with this PG? Have you been doing any snapshots? I discussed this issue with Sam and it turns out that there's actually a bug in the scrubbing code because it doesn't handle cloned data well. That's probably what's happening here; I've created bug http://tracker.newdream.net/issues/1338 to deal with it. -Greg -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html