On Wed, 2020-06-10 at 16:38 +0800, norman wrote: > Hi guys, > > I want to setup a ceph cluster for teams, using fs and s3 interface. I > met a problem about the QoS: How can I limit the > > bw or qps of a client to avoid the someone blocking others by running > lots of threads? > (this is probably a better question for ceph-users mailing list. cc'ed...) It's not clear to me which one concerns you most: 1/ parceling out a single client's resources between different tasks (e.g. multiple programs interacting on a kcephfs mount). 2/ parceling out resources of the entire cluster between different clients ...both turn out to be pretty thorny problems, and ceph doesn't really have much in the way of mechanisms for addressing either. The Ceph MDS can do things like recall caps to manage resources but I don't believe it does that in response to (e.g.) excess activity vs. a single OSD. It's more focused on its own memory consumption. -- Jeff Layton <jlayton@xxxxxxxxxx>