Greetings, I upgraded to 0.80.4 last night to resolve the inconsistent pg scrub errors I was seeing. Unfortunately, they are continuing. $ ceph health detail HEALTH_ERR 1 pgs inconsistent; 1 scrub errors pg 3.7f is active+clean+inconsistent, acting [0,4] And here's the relevant log entries. 2014-07-18 15:04:29.005110 osd.0 192.168.253.92:6800/11023 61 : [ERR] 3.7f shard 0: soid db656f7f/rb.0.233d.5832ae11.000000001bb3/head//3 digest 474812490 != known digest 3411276363 2014-07-18 15:04:30.736750 osd.0 192.168.253.92:6800/11023 62 : [ERR] 3.7f deep-scrub 0 missing, 1 inconsistent objects 2014-07-18 15:04:30.736756 osd.0 192.168.253.92:6800/11023 63 : [ERR] 3.7f deep-scrub 1 errors A tarball containing the pgs is at http://people.adams.edu/~rbsmith/osd-2014-07-18.tar.gz The servers are running Ubuntu precise. $ lsb_release -a LSB Version: core-2.0-amd64:core-2.0-noarch:core-3.0-amd64:core-3.0-noarch:core-3.1-amd64:core-3.1-noarch:core-3.2-amd64:core-3.2-noarch:core-4.0-amd64:core-4.0-noarch Distributor ID: Ubuntu Description: Ubuntu 12.04.4 LTS Release: 12.04 Codename: precise $ uname -a Linux scooby 3.2.0-64-generic #97-Ubuntu SMP Wed Jun 4 22:04:21 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Just to confirm the osd versions: $ ceph tell osd.0 version { "version": "ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)"} $ ceph tell osd.4 version { "version": "ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)"} -- Randall Smith Computing Services Adams State University http://www.adams.edu/ 719-587-7741 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140718/2d691f8b/attachment.htm>