On Wed, Oct 16, 2019 at 11:23 PM Robert LeBlanc <robert@xxxxxxxxxxxxx> wrote: > > On Tue, Oct 15, 2019 at 8:05 AM Robert LeBlanc <robert@xxxxxxxxxxxxx> wrote: > > > > On Mon, Oct 14, 2019 at 2:58 PM Paul Emmerich <paul.emmerich@xxxxxxxx> wrote: > > > > > > Could the 4 GB GET limit saturate the connection from rgw to Ceph? > > > Simple to test: just rate-limit the health check GET > > > > I don't think so, we have dual 25Gbp in a LAG, so Ceph to RGW has > > multiple paths, but we aren't balancing on port yet, so RGW to HAProxy > > is probably limited to one link. > > > > > Did you increase "objecter inflight ops" and "objecter inflight op bytes"? > > > You absolutely should adjust these settings for large RGW setups, > > > defaults of 1024 and 100 MB are way too low for many RGW setups, we > > > default to 8192 and 800MB > > On Nautilus the defaults already seem to be: > objecter_inflight_op_bytes 104857600 > default = 100MiB > objecter_inflight_ops 24576 > default not sure where you got this from, but the default is still 1024 even in master: https://github.com/ceph/ceph/blob/4774808cb2923f65f6919fe8be5f98917075cdd7/src/common/options.cc#L2288 Paul > > > > Sometimes "ms async op threads" and "ms async max op threads" might > > > help as well (we adjust them by default, but for other reasons) > > > > Thanks, I'll look into these options and see if they help. > > Is it possible that I may be running into something like this? > > https://github.com/boostorg/beast/issues/1077 > > ---------------- > Robert LeBlanc > PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |