What's the output of "ceph daemon osd.<X> status" on one of the OSDs while it's starting? Is the OSD crashing and being restarted all the time? Anything weird in the log files? Was there recovery or backfill during the upgrade? Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Mon, Jan 14, 2019 at 8:35 PM Stefan Priebe - Profihost AG <s.priebe@xxxxxxxxxxxx> wrote: > > Hi, > > while trying to upgrade a cluster from 12.2.8 to 12.2.10 i'm experience > issues with bluestore osds - so i canceled the upgrade and all bluestore > osds are stopped now. > > After starting a bluestore osd i'm seeing a lot of slow requests caused > by very high read rates. > > > Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s > avgrq-sz avgqu-sz await r_await w_await svctm %util > sda 45,00 187,00 767,00 39,00 482040,00 8660,00 > 1217,62 58,16 74,60 73,85 89,23 1,24 100,00 > > it reads permanently with 500MB/s from the disk and can't service client > requests. Overall client read rate is at 10.9MiB/s rd > > I can't reproduce this with 12.2.8. Is this a known bug / regression? > > Greets, > Stefan > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |