Hello Sage, Thanks for the response. I new fairly new to ceph. Is there any commands that would help confirm the issue? Kind regards, Glen Baars T 1300 733 328 NZ +64 9280 3561 MOB +61 447 991 234 This e-mail may contain confidential and/or privileged information.If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. -----Original Message----- From: Sage Weil <sage@xxxxxxxxxxxx> Sent: Wednesday, 18 July 2018 10:38 PM To: Glen Baars <glen@xxxxxxxxxxxxxxxxxxxxxx> Cc: ceph-users@xxxxxxxxxxxxxx Subject: Re: 10.2.6 upgrade On Wed, 18 Jul 2018, Glen Baars wrote: > Hello Ceph Users, > > We installed 12.2.6 on a single node in the cluster ( new node added, > 80TB moved ) Disabled scrub/deepscrub once the issues with 12.2.6 were discovered. > > > Today we upgrade the one affected node to 12.2.7 today, set osd skip data digest = true and re enabled the scrubs. It's a 500TB all bluestore cluster. > > > We are now seeing inconsistent PGs and scrub errors now the scrubbing has resumed. It is likely the inconsistencies were tehre from teh period running 12.2.6, not due ot 12.2.7. I would suggest continuing the upgrade. The scrub errors will either go away on their own or need to wait until 12.2.8 for scrub to learn how to repair them for you. Can you share the scrub error you got to confirm it is the digest issue in 12.2.6 that is to blame? sage > What is the best way forward? > > > 1. Upgrade all nodes to 12.2.7? > 2. Remove the 12.2.7 node and rebuild? > Kind regards, > Glen Baars > BackOnline Manager > This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately. > This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately. _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |