Can confirm that disabling power saving helps. I've also seen latency improvements with sysctl -w net.ipv4.tcp_low_latency=1 Another thing that sometimes helps is disabling the write cache of your SSDs (hdparm -W 0), depends on the disk model, though. Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Thu, Nov 28, 2019 at 7:59 PM David Majchrzak, ODERLAND Webbhotell AB <david@xxxxxxxxxxx> wrote: > > Paul, > > Absolutely, I said I was looking at those settings and most didn't make > any sense to me in a production environment (we've been running ceph > since Dumpling). > > However we only have 1 cluster on Bluestore and I wanted to get some > opinions if anything other than the defaults in ceph.conf or sysctl or > things like Wido suggested with c-states would make any differences. > (Thank you Wido!) > > Yes, running benchmarks is great, and we're already doing that > ourselves. > > Cheers and have a nice evening! > > -- > David Majchrzak > > > On tor, 2019-11-28 at 17:46 +0100, Paul Emmerich wrote: > > Please don't run this config in production. > > Disabling checksumming is a bad idea, disabling authentication is > > also > > pretty bad. > > > > There are also a few options in there that no longer exist (osd op > > threads) or are no longer relevant (max open files), in general, you > > should not blindly copy config files you find on the Internet. Only > > set an option to its non-default value after carefully checking what > > it does and whether it applies to your use case. > > > > Also, run benchmarks yourself. Use benchmarks that are relevant to > > your use case. > > > > Paul > > > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |