I finally managed to fix the problem with the radosgw upgrade to jewel with the help of the script from Yehuda (https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/). I tested the whole upgrade on our staging cluster first. As already mentioned I removed the '_' in the "filter_json" function. I also replaced: """ $RADOS mkpool .rgw.root """ with: """ ceph osd pool create .rgw.root <pg num of the current .rgw.root pool> """ After running the script I had to restart all the radosgw instances. Which left me with one error in the radosgw.log : """ 2016-05-23 17:37:59.488478 7f6375719900 -1 rgw period pusher: The new period does not contain my zonegroup! """ I executed the following to fix this issue: $> radosgw-admin period update --commit After another restart of all radosgw instances I had no error messages in the radosgw.log anymore. On production I executed all the stuff during a downtime of all radosgw instances to be safe :-) The cluster looks good now and all user operations (like bucket creation, quota change, etc) are possible again. Cheers Nick On Monday, May 23, 2016 10:41:12 AM Ben Hines wrote: > I for one am terrified of upgrading due to these messages (and indications > that the problem still may not be resolved even in 10.2.1) - holding off > until a clean upgrade is possible without running any hacky scripts. > > -Ben > > On Mon, May 23, 2016 at 2:23 AM, nick <nick@xxxxxxx> wrote: > > Hi, > > we ran into the same rgw problem when updating from infernalis to jewel > > (version 10.2.1). Now I would like to run the script from Yehuda, but I am > > a > > bit scared by > > > > >I can create and get new buckets and objects but I've "lost" all my > > > > > > old buckets. > > > > As I understood so far we do not need the trailing underscores from the > > script > > when upgrading directly to 10.2.1. Is this correct? > > > > I guess the trailing underscore gets created in that script line > > (filter_json > > function): > > """ > > echo \"$key\": \"${val}_\", >> $out_file > > """ > > > > Should I remove the 'underscore' there? > > > > Thanks for any help :-) > > > > Cheers > > Nick > > > > On Friday, May 20, 2016 01:28:07 PM Jonathan D. Proulx wrote: > > > On Fri, May 20, 2016 at 09:21:58AM -0700, Yehuda Sadeh-Weinraub wrote: > > > :On Fri, May 20, 2016 at 9:03 AM, Jonathan D. Proulx <jon@xxxxxxxxxxxxx> > > > > wrote: > > > :> Hi All, > > > :> > > > :> I saw the previous thread on this related to > > > :> http://tracker.ceph.com/issues/15597 > > > :> > > > :> and Yehuda's fix script > > > > https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/ > > > > > :> fix-zone > > > :> > > > :> Running this seems to have landed me in a weird state. > > > :> > > > :> I can create and get new buckets and objects but I've "lost" all my > > > :> old buckets. I'm fairly confident the "lost" data is in the > > > :> .rgw.buckets pool but my current zone is set to use .rgw.buckets_ > > > > > > <snip> > > > > > > :> Should I just adjust the zone to use the pools without trailing > > > :> slashes? I'm a bit lost. the last I could see from running the > > > : > > > :Yes. The trailing slashes were needed when upgrading for 10.2.0, as > > > :there was another bug, and I needed to add these to compensate for it. > > > :I should update the script now to reflect that fix. You should just > > > :update the json and set the zone appropriately. > > > : > > > :Yehuda > > > > > > That did the trick (though obviously we both meant trailing > > > underscores '_') > > > > > > Thanks, > > > -Jon > > > _______________________________________________ > > > ceph-users mailing list > > > ceph-users@xxxxxxxxxxxxxx > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > -- > > Sebastian Nickel > > Nine Internet Solutions AG, Albisriederstr. 243a, CH-8047 Zuerich > > Tel +41 44 637 40 00 | Support +41 44 637 40 40 | www.nine.ch > > _______________________________________________ > > ceph-users mailing list > > ceph-users@xxxxxxxxxxxxxx > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Sebastian Nickel Nine Internet Solutions AG, Albisriederstr. 243a, CH-8047 Zuerich Tel +41 44 637 40 00 | Support +41 44 637 40 40 | www.nine.ch
Attachment:
signature.asc
Description: This is a digitally signed message part.
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
