The odd thing is: the network interfaces on the gateways dont seem to be at 100% capacity and the OSD disks dont seem to be at 100% utilization. so I'm confused where this could be getting held up. ----- Original Message ----- From: "Wido den Hollander" <wido@xxxxxxxx> To: "Philip Brown" <pbrown@xxxxxxxxxx>, "ceph-users" <ceph-users@xxxxxxxxxxxxxx> Sent: Tuesday, January 14, 2020 12:42:48 AM Subject: Re: where does 100% RBD utilization come from? The util is calculated based on average waits, see: https://coderwall.com/p/utc42q/understanding-iostat Just improving performance isn't just turning a knob and it will happen. It seems like your RBD can't flush it's I/O fast enough and that causes the iowait to go up. This can be all kinds of things: - Network (latency) - CPU on the OSDs Wido _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com