Re: Firefly, cephfs issues: different unix rights depending on the client and ls are slow

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I'm sorry to revive my post but I can't to solve my problems
and I see anything in the log. I have tried with Hammer version
and I found the same phenomena.

In fact, first, I have tried the same installation (ie the same
conf via puppet) of my cluster but in "virtualbox" environment
and I have the same phenomena. Second, I have reinstalled my
"virtualbox" environment but with the Hammer version of Ceph (ie
the testing version 0.93-1trusty) and I have the same issues too.

Le 04/03/2015 14:15, Francois Lafont wrote :

[...]

> ~# mkdir /cephfs
> ~# mount -t ceph 10.0.2.150,10.0.2.151,10.0.2.152:/ /cephfs/ -o name=cephfs,secretfile=/etc/ceph/ceph.client.cephfs.secret
> 
> Then in ceph-testfs, I do:
> 
> root@test-cephfs:~# mkdir /cephfs/d1
> root@test-cephfs:~# ll /cephfs/
> total 4
> drwxr-xr-x  1 root root    0 Mar  4 11:45 ./
> drwxr-xr-x 24 root root 4096 Mar  4 11:42 ../
> drwxr-xr-x  1 root root    0 Mar  4 11:45 d1/
> 
> After, in test-cephfs2, I do:
> 
> root@test-cephfs2:~# ll /cephfs/
> total 4
> drwxr-xr-x  1 root root    0 Mar  4 11:45 ./
> drwxr-xr-x 24 root root 4096 Mar  4 11:42 ../
> drwxrwxrwx  1 root root    0 Mar  4 11:45 d1/
> 
> 1) Why the unix rights of d1/ are different when I'm in test-cephfs
> and when I'm in test-cephfs2? It should be the same, isn't it?

This problem is not random and I can reproduce it indefinitely.

> 2) If I create 100 files in /cephfs/d1/ with test-cephfs:
> 
> for i in $(seq 100)
> do
>     echo "$(date +%s.%N)" >/cephfs/d1/f_$i
> done
> 
> sometimes, in test-cephfs2, when I do a simple:
> 
> root@test-cephfs2:~# time \ls -la /cephfs

Sorry error of copy and paste, of course it was:

root@test-cephfs2:~# time \ls -la /cephfs/d1/

> the command can take 2 or 3 seconds which seems to me very long
> for a directory with just 100 files. Generally, if I repeat the
> command on test-cephfs2 just after, it's immediate but not always.
> I can not reproduce the problem in a determinist way. Sometimes,
> to reproduce the problem, I must remove all the files in /cephfs/
> on test-cepfs and recreate them. It's very strange. Sometimes and
> randomly, something seems to be stalled but I don't know what. I
> suspect a problem of mds tuning but, In fact, I don't know what
> to do.

I have the same problem with hammer too.
But someone can confirm me that 3s (not always) for "ls -la" in
a cephfs directory which contains 100 file it's pathological? After
all, maybe is it normal? I don't have much experience with cephfs.

Thanks for your help.

-- 
François Lafont
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux