It's hard to say, we don't really test your specific scenario so use it with your own risk. There was a change in cls_refcount that we had issues with in the upgrade suite, but looking at it I'm not sure it'll actually be a problem for you (you'll still hit the original problem though). Other problematic area is the osd limit on large omap operations, for which we added 'truncated' flag for the relevant objclass operations. Running older rgw against newer osds might cause issues when listing omaps. You should make sure that bucket listing works correctly, but there may be other issues (garbage collector, listing of user's buckets, multipart upload completion). It could be that you can configure that osd limit to be a higher number, so that you won't hit that issue (RGW probably never requests more than 1000 entries off omap, so setting it to 1k should be fine). Yehuda On Wed, Dec 6, 2017 at 2:09 PM, Wido den Hollander <wido@xxxxxxxx> wrote: > >> Op 6 december 2017 om 10:25 schreef Yehuda Sadeh-Weinraub <yehuda@xxxxxxxxxx>: >> >> >> Are you using rgw? There are certain compatibility issues that you >> might hit if you run mixed versions. >> > > Yes, it is. So would it hurt if OSDs are running Luminous but the RGW is still Jewel? > > Multisite isn't used, it's just a local RGW. > > Wido > >> Yehuda >> >> On Tue, Dec 5, 2017 at 3:20 PM, Wido den Hollander <wido@xxxxxxxx> wrote: >> > Hi, >> > >> > I haven't tried this before but I expect it to work, but I wanted to check before proceeding. >> > >> > I have a Ceph cluster which is running with manually formatted FileStore XFS disks, Jewel, sysvinit and Ubuntu 14.04. >> > >> > I would like to upgrade this system to Luminous, but since I have to re-install all servers and re-format all disks I'd like to move it to BlueStore at the same time. >> > >> > This system however has 768 3TB disks and has a utilization of about 60%. You can guess, it will take a long time before all the backfills complete. >> > >> > The idea is to take a machine down, wipe all disks, re-install it with Ubuntu 16.04 and Luminous and re-format the disks with BlueStore. >> > >> > The OSDs get back, start to backfill and we wait. >> > >> > My estimation is that we can do one machine per day, but we have 48 machines to do. Realistically this will take ~60 days to complete. >> > >> > Afaik running Jewel (10.2.10) mixed with Luminous (12.2.2) should work just fine I wanted to check if there are any caveats I don't know about. >> > >> > I'll upgrade the MONs to Luminous first before starting to upgrade the OSDs. Between each machine I'll wait for a HEALTH_OK before proceeding allowing the MONs to trim their datastore. >> > >> > The question is: Does it hurt to run Jewel and Luminous mixed for ~60 days? >> > >> > I think it won't, but I wanted to double-check. >> > >> > Wido >> > _______________________________________________ >> > ceph-users mailing list >> > ceph-users@xxxxxxxxxxxxxx >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |