Thanks Stefan, i played with bluefs_buffered_io but i think the impact is not great since the nvmes are so fast. I think buffered IO on increased cpu load while buffered io off increase nvme load. Problem was with both settings. I am not sure if require-osd-release was run. What do you think ceph osd require-osd-release pacific will do and is there a risk when running the command that the cluster might become unavailable ? I think all osds are running 16.2.6 anyway and so it would not change anything if i set the force to run Pacific ? On Wed, Nov 10, 2021 at 04:22:14PM +0100, Stefan Kooman wrote: > On 11/10/21 16:14, Christoph Adomeit wrote: > > I have upgraded my ceph cluster to pacific in August and updated to pacific 16.2.6 in September without problems. > > Have you set "ceph osd require-osd-release pacific" when you finished > upgrading (this sometimes gets forgotten)? > > Is "bluefs_buffered_io" set to true on the OSDs? > > Gr. Stefan > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx -- Hard times create strong men. Strong men create good times.Good times create weak men. And weak men create hard times. Christoph Adomeit GATWORKS GmbH Metzenweg 78 41068 Moenchengladbach Sitz: Moenchengladbach Amtsgericht Moenchengladbach, HRB 6303 Geschaeftsfuehrer: Christoph Adomeit, Hans Wilhelm Terstappen Christoph.Adomeit@xxxxxxxxxxx Internetloesungen vom Feinsten Fon. +49 2161 68464-32 Fax. +49 2161 68464-10 _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx