Anand Avati <anand.avati@xxxxxxxxx> wrote:
> I'm wondering if this is because of the fsync() patch in AFR. Can you check
> if you are seeing similar perf fluctuations in a non-replicated volume?
It seems much faster. Here are the result so far. I will post an update later.
Brick: hangar:/export/vnd0a
---------------------------
Cumulative Stats:
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 0 0 0
No. of Writes: 1 1 2
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 0 0 0
No. of Writes: 5 2 47
Block Size: 65536b+ 131072b+
No. of Reads: 0 65
No. of Writes: 78 1159
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 1727 RELEASE
0.00 60.47 us 32.00 us 216.00 us 34 STATFS
0.03 1127.82 us 25.00 us 8867.00 us 11 FSTAT
0.12 2500.20 us 271.00 us 14200.00 us 20 READ
0.15 3920.88 us 99.00 us 20410.00 us 16 WRITE
2.24 657.38 us 52.00 us 255498.00 us 1413 SETATTR
4.10 2578.57 us 49.00 us 208953.00 us 660 FTRUNCATE
4.70 24092.91 us 9606.00 us 56360.00 us 81 MKDIR
7.06 4435.32 us 300.00 us 74128.00 us 660 FSYNC
10.16 6346.30 us 1473.00 us 178159.00 us 664 RENAME
15.61 1426.32 us 49.00 us 262185.00 us 4542 LOOKUP
55.82 34827.41 us 19510.00 us 370173.00 us 665 CREATE
Duration: 209 seconds
Data Read: 8519680 bytes
Data Written: 159207590 bytes
Interval 1 Stats:
Block Size: 1024b+ 2048b+ 8192b+
No. of Reads: 0 0 0
No. of Writes: 1 1 1
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 0 0 18
No. of Writes: 5 5 0
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 443 RELEASE
0.00 63.35 us 32.00 us 216.00 us 20 STATFS
0.04 1335.00 us 25.00 us 8867.00 us 8 FSTAT
0.18 3776.15 us 99.00 us 20410.00 us 13 WRITE
0.18 2744.67 us 271.00 us 14200.00 us 18 READ
2.80 818.98 us 52.00 us 255498.00 us 943 SETATTR
4.64 2889.87 us 49.00 us 208953.00 us 442 FTRUNCATE
4.87 23509.79 us 10116.00 us 49732.00 us 57 MKDIR
7.21 4484.30 us 300.00 us 56846.00 us 443 FSYNC
10.01 6239.40 us 1473.00 us 178159.00 us 442 RENAME
15.79 1443.45 us 55.00 us 255467.00 us 3013 LOOKUP
54.28 33823.68 us 19510.00 us 295720.00 us 442 CREATE
Duration: 20 seconds
Data Read: 2359296 bytes
Data Written: 667763 bytes
Brick: silo:/export/vnd0a
-------------------------
Cumulative Stats:
Block Size: 2b+ 4b+ 8b+
No. of Reads: 0 0 0
No. of Writes: 14 20 50
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 198 199 51
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 97 127 260
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 0 0 0
No. of Writes: 247 392 190
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 0 0 0
No. of Writes: 148 149 104
Block Size: 65536b+ 131072b+
No. of Reads: 0 66
No. of Writes: 96 1157
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 1727 RELEASE
0.01 97.52 us 33.00 us 659.00 us 31 STATFS
0.09 2214.95 us 178.00 us 13524.00 us 20 READ
0.11 5761.20 us 20.00 us 41315.00 us 10 FSTAT
0.77 273.54 us 49.00 us 18969.00 us 1426 SETATTR
1.35 8713.90 us 3466.00 us 33052.00 us 79 SETXATTR
3.34 21291.04 us 10804.00 us 53328.00 us 80 MKDIR
4.10 2516.93 us 26.00 us 172302.00 us 829 WRITE
6.16 4957.96 us 1059.00 us 141002.00 us 633 FSYNC
6.45 5195.89 us 45.00 us 188696.00 us 632 FTRUNCATE
11.67 1375.47 us 59.00 us 255769.00 us 4320 LOOKUP
11.70 9400.69 us 1500.00 us 386711.00 us 634 RENAME
54.25 43712.48 us 23248.00 us 411301.00 us 632 CREATE
Duration: 207 seconds
Data Read: 8650752 bytes
Data Written: 169875331 bytes
Interval 1 Stats:
Block Size: 2b+ 4b+ 8b+
No. of Reads: 0 0 0
No. of Writes: 1 1 7
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 49 32 10
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 21 23 72
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 0 0 0
No. of Writes: 70 142 42
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 0 0 0
No. of Writes: 42 73 21
Block Size: 65536b+ 131072b+
No. of Reads: 0 17
No. of Writes: 7 0
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 443 RELEASE
0.01 101.80 us 33.00 us 659.00 us 20 STATFS
0.05 1155.71 us 178.00 us 10497.00 us 17 READ
0.15 6848.88 us 20.00 us 41315.00 us 8 FSTAT
0.87 321.40 us 49.00 us 18969.00 us 1000 SETATTR
1.26 8166.32 us 3466.00 us 33052.00 us 57 SETXATTR
3.37 21510.48 us 10804.00 us 53328.00 us 58 MKDIR
4.42 2669.93 us 26.00 us 172302.00 us 613 WRITE
6.15 5143.16 us 1111.00 us 141002.00 us 443 FSYNC
6.36 5331.42 us 45.00 us 188696.00 us 442 FTRUNCATE
11.37 1398.46 us 59.00 us 255769.00 us 3012 LOOKUP
11.75 9825.16 us 1500.00 us 386711.00 us 443 RENAME
54.27 45498.66 us 23248.00 us 411301.00 us 442 CREATE
Duration: 20 seconds
Data Read: 2228224 bytes
Data Written: 4203459 bytes
--
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
manu@xxxxxxxxxx
