Greg, This error occurred AFTER the upgrade. I upgraded to 0.80.4 last night and this error cropped up this afternoon. I ran `ceph pg repair 3.7f` (after I copied the pgs) which returned the cluster to health. However, I'm concerned that this showed up again so soon after I upgraded to 0.80.4. Is there something I need to do to ensure that there are no lingering errors waiting for a scrub to find or just wait it out for a couple of days and hope that my data is safe? On Fri, Jul 18, 2014 at 4:01 PM, Gregory Farnum <greg at inktank.com> wrote: > The config option change in the upgrade will prevent *new* scrub > errors from occurring, but it won't resolve existing ones. You'll need > to run a scrub repair to fix those up. > -Greg > Software Engineer #42 @ http://inktank.com | http://ceph.com > > > On Fri, Jul 18, 2014 at 2:59 PM, Randy Smith <rbsmith at adams.edu> wrote: > > Greetings, > > > > I upgraded to 0.80.4 last night to resolve the inconsistent pg scrub > errors > > I was seeing. Unfortunately, they are continuing. > > > > $ ceph health detail > > HEALTH_ERR 1 pgs inconsistent; 1 scrub errors > > pg 3.7f is active+clean+inconsistent, acting [0,4] > > > > And here's the relevant log entries. > > > > 2014-07-18 15:04:29.005110 osd.0 192.168.253.92:6800/11023 61 : [ERR] > 3.7f > > shard 0: soid db656f7f/rb.0.233d.5832ae11.000000001bb3/head//3 digest > > 474812490 != known digest 3411276363 > > 2014-07-18 15:04:30.736750 osd.0 192.168.253.92:6800/11023 62 : [ERR] > 3.7f > > deep-scrub 0 missing, 1 inconsistent objects > > 2014-07-18 15:04:30.736756 osd.0 192.168.253.92:6800/11023 63 : [ERR] > 3.7f > > deep-scrub 1 errors > > > > A tarball containing the pgs is at > > http://people.adams.edu/~rbsmith/osd-2014-07-18.tar.gz > > > > The servers are running Ubuntu precise. > > > > $ lsb_release -a > > LSB Version: > > > core-2.0-amd64:core-2.0-noarch:core-3.0-amd64:core-3.0-noarch:core-3.1-amd64:core-3.1-noarch:core-3.2-amd64:core-3.2-noarch:core-4.0-amd64:core-4.0-noarch > > Distributor ID: Ubuntu > > Description: Ubuntu 12.04.4 LTS > > Release: 12.04 > > Codename: precise > > > > $ uname -a > > Linux scooby 3.2.0-64-generic #97-Ubuntu SMP Wed Jun 4 22:04:21 UTC 2014 > > x86_64 x86_64 x86_64 GNU/Linux > > > > Just to confirm the osd versions: > > > > $ ceph tell osd.0 version > > { "version": "ceph version 0.80.4 > > (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)"} > > > > $ ceph tell osd.4 version > > { "version": "ceph version 0.80.4 > > (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)"} > > > > -- > > Randall Smith > > Computing Services > > Adams State University > > http://www.adams.edu/ > > 719-587-7741 > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users at lists.ceph.com > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > -- Randall Smith Computing Services Adams State University http://www.adams.edu/ 719-587-7741 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140718/e9879d7e/attachment.htm>