----- Original Message ----- > From: "Niklas Hambüchen" <mail@xxxxxx> > To: "Ben Turner" <bturner@xxxxxxxxxx> > Cc: "Gluster Users" <gluster-users@xxxxxxxxxxx> > Sent: Monday, September 18, 2017 11:27:33 AM > Subject: Re: Confusing lstat() performance > > On 18/09/17 17:23, Ben Turner wrote: > > Do you want tuned or untuned? If tuned I'd like to try one of my tunings > > for metadata, but I will use yours if you want. > > (Re-CC'd list) > > I would be interested in both, if possible: To confirm that it's not > only my machines that exhibit this behaviour given my settings, and to > see what can be achieved with your tuned settings. I was just gonna get the details from you and post results back to list, just didn't want to spam people while we worked out the details. Here is untuned + quota enabled: strace -f -w -c rsync -a --dry-run ./ /tmp/ strace: Process 21797 attached strace: Process 21827 attached % time seconds usecs/call calls errors syscall ------ ----------- ----------- --------- --------- ---------------- 60.34 7.525567 4849 1552 3 select 28.63 3.571200 821 4351 getdents 10.85 1.352934 7 200003 100000 lstat 0.05 0.006722 9 733 write 0.05 0.005798 7 817 read 0.04 0.005001 2501 2 openat 0.01 0.001722 1722 1 execve 0.01 0.001627 26 63 munmap 0.00 0.000552 9 61 mmap 0.00 0.000228 114 2 clone 0.00 0.000224 12 19 close 0.00 0.000123 7 18 fcntl 0.00 0.000090 10 9 2 open 0.00 0.000070 7 10 mprotect 0.00 0.000066 7 10 5 wait4 0.00 0.000063 5 12 rt_sigaction 0.00 0.000060 15 4 mremap 0.00 0.000037 6 6 brk 0.00 0.000036 5 7 fstat 0.00 0.000033 11 3 socketpair 0.00 0.000031 10 3 1 stat 0.00 0.000029 15 2 dup2 0.00 0.000011 11 1 kill 0.00 0.000010 5 2 2 rt_sigreturn 0.00 0.000008 8 1 getcwd 0.00 0.000007 7 1 1 access 0.00 0.000007 7 1 chdir 0.00 0.000006 6 1 rt_sigprocmask 0.00 0.000005 5 1 umask 0.00 0.000005 5 1 geteuid 0.00 0.000005 5 1 arch_prctl ------ ----------- ----------- --------- --------- ---------------- 100.00 12.472277 207698 100014 total And BUP: strace: Process 103678 detached strace: Process 103679 detached % time seconds usecs/call calls errors syscall ------ ----------- ----------- --------- --------- ---------------- 80.56 1627.233677 26201 62106 read 9.02 182.162398 6 30924134 lseek 7.46 150.672844 225 670684 2 lstat 1.21 24.461651 300 81647 10513 open 0.83 16.696162 190 87869 1019 close 0.25 4.993062 318 15702 llistxattr 0.19 3.874752 165 23548 msync 0.18 3.630711 23 159461 write 0.06 1.284745 6 200003 getcwd 0.04 0.880300 112 7850 rename 0.04 0.800025 6 134108 fstat 0.04 0.725158 15 47288 munmap 0.03 0.549348 14 37922 select 0.02 0.361083 8 47593 mmap 0.02 0.349493 22 15699 7850 unlink 0.01 0.275029 6 47116 fcntl 0.01 0.253821 32 7895 7879 ioctl 0.01 0.243284 31 7851 7851 getxattr 0.01 0.215476 27 7851 7851 lgetxattr 0.01 0.136050 15 8832 8707 stat 0.00 0.091960 6 15701 dup 0.00 0.024955 8318 3 execve 0.00 0.004210 8 524 brk 0.00 0.001756 8 210 mprotect 0.00 0.001450 725 2 setsid 0.00 0.001162 6 205 rt_sigaction 0.00 0.000670 335 2 clone 0.00 0.000200 17 12 getdents 0.00 0.000070 12 6 openat 0.00 0.000054 8 7 5 access 0.00 0.000046 8 6 6 readlink 0.00 0.000043 11 4 dup2 0.00 0.000042 11 4 4 connect 0.00 0.000042 6 7 getrlimit 0.00 0.000039 10 4 4 statfs 0.00 0.000039 8 5 set_robust_list 0.00 0.000035 9 4 socket 0.00 0.000032 16 2 mremap 0.00 0.000025 8 3 pipe 0.00 0.000020 7 3 futex 0.00 0.000019 6 3 geteuid 0.00 0.000018 6 3 getegid 0.00 0.000018 6 3 set_tid_address 0.00 0.000017 6 3 rt_sigprocmask 0.00 0.000017 6 3 getuid 0.00 0.000017 6 3 getgid 0.00 0.000017 6 3 arch_prctl ------ ----------- ----------- --------- --------- ---------------- 100.00 2019.926042 32611894 51691 total This is on my quota only tune. -b > > Thank you! > _______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://lists.gluster.org/mailman/listinfo/gluster-users
