Common problem for FileStore and really no point in debugging this: upgrade everything to a recent version and migrate to BlueStore. 99% of random latency spikes are just fixed by doing that. Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Wed, May 27, 2020 at 3:26 PM Bence Szabo <szabo.bence@xxxxxxxxx> wrote: > Hi, > We experienced random and relative high latency spikes (around 0.5-10 sec) > in our ceph cluster which consists 6 osd nodes, all osd nodes have 6 osd-s. > One osd built with one spinning disk and two nvme device. > We use a bcache device for osd back end (mixed with hdd and an nvme > partition as caching device) and one nvme partition for journal. > This synthetic command can be use for check io and latency: > rados bench -p rbd 10 write -b 4000 -t 64 > With this parameters we often got about 1.5 sec or higher for maximum > latency. > We cannot decide if our cluster is misconfigured or just this is a natural > ceph behavior. > Any help, suggestion would be appreciated. > Regards, > Bence > > -- > --Szabo Bence > --<szabo.bence@xxxxxxxxx> > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |