Cool. Glad you made it through. ;-) Regards, Frédéric. ----- Le 9 Oct 24, à 16:46, Alex Rydzewski rydzewski.al@xxxxxxxxx a écrit : > Great thanks, Frédéric! > > It seems that --yes-i-really-mean-it helped. The cluster rebuilding now > and I can access my data on it! > > On 09.10.24 15:48, Frédéric Nass wrote: >> There's this --yes-i-really-mean-it option you could try but only after making >> sure that all OSDs are actually running Pacific. >> >> What does a 'ceph versions' says? Did you restart all OSDs after the upgrade? >> >> Regards, >> Frédéric. >> >> ----- Le 9 Oct 24, à 14:39, Alex Rydzewski rydzewski.al@xxxxxxxxx a écrit : >> >>> I thought so too, Frédéric >>> >>> But when I try change it, I get this error: >>> >>> root@helper:~# ceph osd require-osd-release pacific >>> Error EPERM: not all up OSDs have CEPH_FEATURE_SERVER_PACIFIC feature >>> >>> root@helper:~# ceph osd require-osd-release help >>> Invalid command: help not in luminous|mimic|nautilus|octopus|pacific >>> osd require-osd-release luminous|mimic|nautilus|octopus|pacific >>> [--yes-i-really-mean-it] : set the minimum allowed OSD release to >>> participate in the cluster >>> Error EINVAL: invalid command >>> root@helper:~# ceph osd require-osd-release mimic >>> Error EPERM: not all up OSDs have CEPH_FEATURE_SERVER_MIMIC feature >>> >>> On 09.10.24 15:18, Frédéric Nass wrote: >>>> Here's an example of what a Pacific cluster upgraded from Hammer shows: >>>> >>>> $ ceph osd dump | head -13 >>>> epoch 186733 >>>> fsid e02xxxx9-4xx0-4xx9-axx9-57xxxxxxxx35 >>>> created 2016-02-29T16:23:21.035599+0000 >>>> modified 2024-10-09T11:30:10.916414+0000 >>>> flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit >>>> crush_version 1298 >>>> full_ratio 0.95 >>>> backfillfull_ratio 0.9 >>>> nearfull_ratio 0.85 >>>> require_min_compat_client luminous >>>> min_compat_client jewel >>>> require_osd_release pacific >>>> stretch_mode_enabled false >>>> >>>> I think a 'ceph osd require-osd-release pacific' should get you out of this. >>>> >>>> But maybe someone can confirm? >>>> >>>> Regards, >>>> Frédéric. >>>> >>>> ----- Le 9 Oct 24, à 14:07, Alex Rydzewski rydzewski.al@xxxxxxxxx a écrit : >>>> >>>>> Of course, Frédéric, >>>>> >>>>> root@helper:~# ceph osd dump | head -13 >>>>> epoch 45887 >>>>> fsid 96b6ff1d-25bf-403f-be3d-78c2fb0ff747 >>>>> created 2018-06-02T13:12:54.207727+0300 >>>>> modified 2024-10-09T11:08:53.638661+0300 >>>>> flags sortbitwise,recovery_deletes,purged_snapdirs >>>>> crush_version 82 >>>>> full_ratio 0.95 >>>>> backfillfull_ratio 0.9 >>>>> nearfull_ratio 0.85 >>>>> require_min_compat_client jewel >>>>> min_compat_client jewel >>>>> require_osd_release luminous >>>>> stretch_mode_enabled false >>>>> >>>>> You are right, I did't run such commands. This is because I have two >>>>> other clusters that I have gradulally upgraded to Quincy from Luminous, >>>>> but following the proxmox instructions, and I don't see there any such. >>>>> >>>>> On 09.10.24 14:49, Frédéric Nass wrote: >>>>>> ceph osd dump | head -13 >>>>> -- >>>>> Олександр Ридзевський >>> -- >>> Олександр Ридзевський > > -- > Олександр Ридзевський _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |