Thanks a lot, Eugen! we are using dynamic subtree pinning, we have another cluster using manual pinning, but we have many directory , and we need pin each dir for each request. so in our new cluster, we want to try dynamic subtree pinning. we don’t want to human kick in every time. Because some A directory hot, and sometimes B directory hot.. each directory has many subdirectory and sub-subdirectory... But we found the load not balance on all mds when we using dynamic subtree pinning. So we want to know if any config we can tune for the dynamic subtree pinning. Thanks again! Thanks, xz > 2023年8月9日 17:40，Eugen Block <eblock@xxxxxx> 写道： > > Hi, > > you could benefit from directory pinning [1] or dynamic subtree pinning [2]. We had great results with manual pinning in an older Nautilus cluster, didn't have a chance to test the dynamic subtree pinning yet though. It's difficult to tell in advance which option would suit best your use-case, so you'll probably have to try. > > Regards, > Eugen > > [1] https://docs.ceph.com/en/reef/cephfs/multimds/#manually-pinning-directory-trees-to-a-particular-rank > [2] https://docs.ceph.com/en/reef/cephfs/multimds/#dynamic-subtree-partitioning-with-balancer-on-specific-ranks > > Zitat von zxcs <zhuxiongcs@xxxxxxx <mailto:zhuxiongcs@xxxxxxx>>: > >> Hi, experts, >> >> we have a product env build with ceph version 16.2.11 pacific, and using CephFS. >> Also enable multi active mds(more than 10), but we usually see load unbalance on our client request with these mds. >> see below picture. the top 1 mds has 32.2k client request. and the last one only 331. >> >> this always lead our cluster into very bad situation. say many MDS report slow requests… >> ... >> 7 MDSs report slow requests >> 1 MDSs behind on trimming >> … >> >> >> So our question is how to set those mdss load balance? Could any one please help to shed some light here? >> Thanks a ton! >> >> >> Thanks, >> xz >> >> _______________________________________________ >> ceph-users mailing list -- ceph-users@xxxxxxx <mailto:ceph-users@xxxxxxx> >> To unsubscribe send an email to ceph-users-leave@xxxxxxx <mailto:ceph-users-leave@xxxxxxx> > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx <mailto:ceph-users@xxxxxxx> > To unsubscribe send an email to ceph-users-leave@xxxxxxx <mailto:ceph-users-leave@xxxxxxx> _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |