-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 I set debug_osd = 20/20 and restarted the primary osd. The logs are at http://162.144.87.113/files/ceph-osd.110.log.xz . The PG in question is 9.e3 and it is one of 15 that have this same behavior. The cluster is currently idle. - ---------------- Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Sun, Oct 25, 2015 at 5:51 PM, Robert LeBlanc wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > I have a 0.94.4 cluster that when I repair/deep-scrub a PG, it comes > back clean, but as soon as I restart any OSD that hosts it, it goes > back to inconsistent. If I deep-scrub that PG it clears up. > > I determined that the bad copy was not on the primary and issued a pg > repair command. I have shut down and deleted the PG folder on each OSD > in turn and let it back fill. I tried taking the primary OSD down and > issuing a repair command then. I took an m5sum of all files in the PG > directory and compared all files across the OSDs and it came back > clean. I shut down each OSD in turn and removed any PG_TEMP > directories. I'm just not sure why the cluster is so confused as to > the status of this PG. > > Any ideas? > > - ---------------- > Robert LeBlanc > PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 > -----BEGIN PGP SIGNATURE----- > Version: Mailvelope v1.2.2 > Comment: https://www.mailvelope.com > > wsFcBAEBCAAQBQJWLWr3CRDmVDuy+mK58QAA4HEP/361NhUXujdrKr9xa4d/ > Lr/zMCbppT7uof3BueLkkIF2erun19ENNLZV5ehyzcbeWlHVA3UEzJaZlaew > eQrmFN0TKk2BFtQAnXp66KhBVco05tiLKZthkGH9AzwQT33ftf8ErVwT4GXs > aEXDdQLctLGxvqfoyys9woNqalYjG9JtZxJHTWfaVU+t3yXEme3GBJBmMlVE > GSSk8KAyEil8DP1q4PMQJrScQxqYFpfBi1UGnbiQj02pan16OtbkaUkJNLMB > o8XlHdiNfPWmMoyAuOPBMoKSPo1diLBP3uEJN8u3Mw4+9kLZSeMDMRHdkMF0 > kmhGA26ihRHcHWVsC+4wevCGJoq7vvPmf8892z+hEjC5vm4eWGAD7UPBjqjl > 5BL282XI+AYLbw4VkiDrP4tTL4neOr6IW50mnG8SPVSAvMN+cFJnlMZRpQ/6 > SQB4Tv5fr1SEMZDZqC//RacWZYCsBd1XZi6M0VhOhOrGjqmlr/41P2dmrdI1 > ldHEyl3l07mJdBANQ0AgIMAeMyuD3dGQ4q0IpJgVMbrfxq8m/lLp/jddOWq3 > MhNGT5J1K4Qg3eFlqhuTIw7yLmERACYHlMUBCHGq/8jGCjEQOe6uhuePyH/6 > ugUoZ+J4Y+Fxsu1Jsoj+GQtDSSkOTGjUpGhXPp/gqMhxZRlGdsZL5LIEs7hm > Us8M > =gnRK > -----END PGP SIGNATURE----- -----BEGIN PGP SIGNATURE----- Version: Mailvelope v1.2.2 Comment: https://www.mailvelope.com wsFcBAEBCAAQBQJWLaAwCRDmVDuy+mK58QAAAMkP/iJ+OpklHB/O2wgj2Le1 Wudniy7KzpDVaS+kXpPZ8Bhbn+rxXCuN9ySUf1sxM37SdqZBCWHpPdx7GTbC QDaO2Bucn53iNG6FDcXHf0TDAUuw7f5u381B2+qfuUbc6Q7iJeJRIjrzQsce 1ieBDytn+DKis1YEOY5Rlbj80CBB5MhkiokJlxjNjaj2AZJAORwoLbqoCSSI u8YnzsbxhkpYxCcCqM3lHf36dsP40vkyXXyqjVWgaW9qThFx9N67ERG/hQSU VTBWXqY8glAQmbeuvlT/zAhl0e2qEsEOBUBn5r/ydL5M2x+3dFHsLp92ewwt pyrEeq6n8Wt1mmYklesDZQCgex47uWAy5mDFOWQjzWBbeO7ji8jwM+PpXxW9 h/mRJZFLLTScFHTOONDXfF41GXFV3ZtdukpHdT46k++RRHmlFVRZgcTym3/b g0pLQKZ8ynKvFzAora2/r9IlN7dDPJEw2jpN2pAYda0GlY8wc6h5i/qUQoGE VN6b5SNURyw53OMPv6yOx2bvc7RKmpLGWjhnTEHjydI0w+kmbqvAnbT2mG/O eHeEyteK4m3+Jtf/s+wN9ULr1pNr++37Zt2igfTtvPm4OceqiU4Y02YgrPu+ LgOWGduVSmEmmRRnBE8+gZYU6gSgpOV3JWqP0AQMavujZmQpGs55DjnfMwdv v8IJ =4TOB -----END PGP SIGNATURE----- _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com