It's just because the PG hadn't been scrubbed since the error occurred; then you upgraded, it scrubbed, and the error was found. You can deep-scrub all your PGs to check them if you like, but as I've said elsewhere this issue -- while scary! -- shouldn't actually damage any of your user data, so just letting it come up in the normal scrub schedule and running a repair to fix any differences found ought to be fine. -Greg On Friday, July 18, 2014, Randy Smith <rbsmith at adams.edu> wrote: > Greg, > > This error occurred AFTER the upgrade. I upgraded to 0.80.4 last night and > this error cropped up this afternoon. I ran `ceph pg repair 3.7f` (after I > copied the pgs) which returned the cluster to health. However, I'm > concerned that this showed up again so soon after I upgraded to 0.80.4. > > Is there something I need to do to ensure that there are no lingering > errors waiting for a scrub to find or just wait it out for a couple of days > and hope that my data is safe? > > > On Fri, Jul 18, 2014 at 4:01 PM, Gregory Farnum <greg at inktank.com > <javascript:_e(%7B%7D,'cvml','greg at inktank.com');>> wrote: > >> The config option change in the upgrade will prevent *new* scrub >> errors from occurring, but it won't resolve existing ones. You'll need >> to run a scrub repair to fix those up. >> -Greg >> Software Engineer #42 @ http://inktank.com | http://ceph.com >> >> >> On Fri, Jul 18, 2014 at 2:59 PM, Randy Smith <rbsmith at adams.edu >> <javascript:_e(%7B%7D,'cvml','rbsmith at adams.edu');>> wrote: >> > Greetings, >> > >> > I upgraded to 0.80.4 last night to resolve the inconsistent pg scrub >> errors >> > I was seeing. Unfortunately, they are continuing. >> > >> > $ ceph health detail >> > HEALTH_ERR 1 pgs inconsistent; 1 scrub errors >> > pg 3.7f is active+clean+inconsistent, acting [0,4] >> > >> > And here's the relevant log entries. >> > >> > 2014-07-18 15:04:29.005110 osd.0 192.168.253.92:6800/11023 61 : [ERR] >> 3.7f >> > shard 0: soid db656f7f/rb.0.233d.5832ae11.000000001bb3/head//3 digest >> > 474812490 != known digest 3411276363 >> > 2014-07-18 15:04:30.736750 osd.0 192.168.253.92:6800/11023 62 : [ERR] >> 3.7f >> > deep-scrub 0 missing, 1 inconsistent objects >> > 2014-07-18 15:04:30.736756 osd.0 192.168.253.92:6800/11023 63 : [ERR] >> 3.7f >> > deep-scrub 1 errors >> > >> > A tarball containing the pgs is at >> > http://people.adams.edu/~rbsmith/osd-2014-07-18.tar.gz >> > >> > The servers are running Ubuntu precise. >> > >> > $ lsb_release -a >> > LSB Version: >> > >> core-2.0-amd64:core-2.0-noarch:core-3.0-amd64:core-3.0-noarch:core-3.1-amd64:core-3.1-noarch:core-3.2-amd64:core-3.2-noarch:core-4.0-amd64:core-4.0-noarch >> > Distributor ID: Ubuntu >> > Description: Ubuntu 12.04.4 LTS >> > Release: 12.04 >> > Codename: precise >> > >> > $ uname -a >> > Linux scooby 3.2.0-64-generic #97-Ubuntu SMP Wed Jun 4 22:04:21 UTC 2014 >> > x86_64 x86_64 x86_64 GNU/Linux >> > >> > Just to confirm the osd versions: >> > >> > $ ceph tell osd.0 version >> > { "version": "ceph version 0.80.4 >> > (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)"} >> > >> > $ ceph tell osd.4 version >> > { "version": "ceph version 0.80.4 >> > (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)"} >> > >> > -- >> > Randall Smith >> > Computing Services >> > Adams State University >> > http://www.adams.edu/ >> > 719-587-7741 >> > >> > _______________________________________________ >> > ceph-users mailing list >> > ceph-users at lists.ceph.com >> <javascript:_e(%7B%7D,'cvml','ceph-users at lists.ceph.com');> >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > >> > > > > -- > Randall Smith > Computing Services > Adams State University > http://www.adams.edu/ > 719-587-7741 > -- Software Engineer #42 @ http://inktank.com | http://ceph.com -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140718/ec6123dc/attachment.htm>