Re: ls operation is too slow in cephfs

[Ronny Aasen <ronny+ceph-users@xxxxxxxx>]

What are you talking about when you say you have mds in a region, afaik only radosgw supports multisite and regions.
it sounds like you have a cluster spread out over a geographical area. and this will have a massive impact on latency

what is the latency between all servers in the cluster ?

kind regards
Ronny Aasen

On 25.07.2018 12:03, Surya Bala wrote:

time got reduced when MDS from the same region became active

Each region we have a MDS. OSD nodes are in one region and active MDS is in another region . So that this delay. 

On Tue, Jul 17, 2018 at 6:23 PM, John Spray <jspray@xxxxxxxxxx> wrote:

On Tue, Jul 17, 2018 at 8:26 AM Surya Bala <sooriya.balan@xxxxxxxxx> wrote:
>
> Hi folks,
>
> We have production cluster with 8 nodes and each node has 60 disks of size 6TB each. We are using cephfs and FUSE client with global mount point. We are doing rsync from our old server to this cluster rsync is slow compared to normal server
>
> when we do 'ls' inside some folder, which has many more number of files like 1lakhs and 2lakhs, the response is too slow.

The first thing to check is what kind of "ls" you're doing.  Some
systems colorize ls by default, and that involves statting every file
in addition to listing the directory.  Try with "ls --color=never".

It also helps to be more specific about what "too slow" means.  How
many seconds, and how many files?

John

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com