Anand Avati <anand.avati@xxxxxxxxx> wrote:
> Just _ONE_ fxattrop took 64 SECONDS to complete?? Are you certain
> hangar:/export/wd3a
> is on healthy hardware?
Hardware seems okay, but here is something else:
May 1 05:43:39 hangar /netbsd: file: table is full -
increase kern.maxfiles or MAXFILES
I increased, restarted hangar, but I get similar result
Brick: hotstuff:/export/wd1a
----------------------------
Cumulative Stats:
Block Size: 4b+ 8b+ 16b+
No. of Reads: 0 0 0
No. of Writes: 1 10 283
Block Size: 32b+ 64b+ 128b+
No. of Reads: 0 0 0
No. of Writes: 315 191 308
Block Size: 256b+ 512b+ 1024b+
No. of Reads: 0 0 0
No. of Writes: 462 585 426
Block Size: 2048b+ 4096b+ 8192b+
No. of Reads: 0 0 0
No. of Writes: 614 333 208
Block Size: 16384b+ 32768b+ 65536b+
No. of Reads: 0 0 0
No. of Writes: 90 65 4
Block Size: 131072b+
No. of Reads: 15
No. of Writes: 3
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 3239 RELEASE
0.00 23.67 us 16.00 us 39.00 us 3 FSTAT
0.00 78.50 us 31.00 us 126.00 us 2 OPEN
0.00 31.50 us 14.00 us 74.00 us 6 GETXATTR
0.00 120.33 us 107.00 us 132.00 us 3 OPENDIR
0.00 236.87 us 139.00 us 374.00 us 15 READ
0.01 26.42 us 10.00 us 5744.00 us 4577 STATFS
0.17 306.86 us 5.00 us 1658884.00 us 6509 FINODELK
0.47 9525.08 us 229.00 us 4244747.00 us 591 SETXATTR
0.89 319.59 us 2.00 us 9061633.00 us 33737 ENTRYLK
1.03 3829.81 us 201.00 us 3886673.00 us 3239 FSYNC
2.21 45052.57 us 670.00 us 6965015.00 us 591 MKDIR
2.78 23895.02 us 44.00 us 9886240.00 us 1404 LINK
4.18 28241.07 us 45.00 us 7782383.00 us 1784 UNLINK
5.83 21684.66 us 18.00 us 9837105.00 us 3239 FTRUNCATE
6.47 11852.74 us 948.00 us 8926689.00 us 6575 FXATTROP
6.58 20327.13 us 12.00 us 9835607.00 us 3898 WRITE
7.33 26793.26 us 59.00 us 9956275.00 us 3297 RENAME
8.55 61897.56 us 969.00 us 12295239.00 us 1664 MKNOD
9.32 956.35 us 38.00 us 9061658.00 us 117413 LOOKUP
10.75 17949.45 us 24.00 us 10573485.00 us 7213 SETATTR
14.97 55693.86 us 358.00 us 12294448.00 us 3239 CREATE
18.47 11971.64 us 4.00 us 11206826.00 us 18585 INODELK
Duration: 30433 seconds
Data Read: 1966080 bytes
Data Written: 11500414 bytes
Interval 2 Stats:
Block Size: 16b+ 32b+ 128b+
No. of Reads: 0 0 0
No. of Writes: 1 1 1
Block Size: 256b+ 1024b+
No. of Reads: 0 0
No. of Writes: 3 2
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 7 RELEASE
0.01 21.50 us 14.00 us 27.00 us 4 GETXATTR
0.04 31.88 us 23.00 us 37.00 us 8 WRITE
0.04 87.33 us 80.00 us 92.00 us 3 LINK
0.04 18.87 us 9.00 us 33.00 us 15 FINODELK
0.05 46.75 us 26.00 us 64.00 us 8 FTRUNCATE
0.07 22.64 us 10.00 us 34.00 us 22 STATFS
0.14 59.81 us 40.00 us 66.00 us 16 SETATTR
0.22 764.50 us 622.00 us 907.00 us 2 SETXATTR
0.27 373.00 us 56.00 us 972.00 us 5 UNLINK
0.57 246.19 us 62.00 us 1022.00 us 16 RENAME
0.97 838.88 us 314.00 us 1445.00 us 8 FSYNC
4.60 15873.00 us 13199.00 us 18547.00 us 2 MKDIR
5.55 246.99 us 3.00 us 36406.00 us 155 ENTRYLK
7.12 3073.50 us 1535.00 us 4274.00 us 16 FXATTROP
14.27 12309.25 us 824.00 us 17972.00 us 8 CREATE
15.58 213.86 us 39.00 us 14053.00 us 503 LOOKUP
22.63 11155.57 us 1909.00 us 17735.00 us 14 MKNOD
27.82 4364.43 us 7.00 us 98648.00 us 44 INODELK
Duration: 91 seconds
Data Read: 0 bytes
Data Written: 4959 bytes
Brick: silo:/export/wd3a
------------------------
Cumulative Stats:
Block Size: 2b+ 4b+ 8b+
No. of Reads: 0 0 0
No. of Writes: 2 1 7
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 292 339 195
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 278 482 614
Block Size: 1024b+ 2048b+ 4096b+
No. of Reads: 0 0 0
No. of Writes: 414 623 354
Block Size: 8192b+ 16384b+ 32768b+
No. of Reads: 0 0 0
No. of Writes: 179 103 65
Block Size: 65536b+ 131072b+
No. of Reads: 0 105
No. of Writes: 2 0
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 3289 RELEASE
0.00 0.00 us 0.00 us 0.00 us 1 RELEASEDIR
0.00 59.71 us 29.00 us 179.00 us 7 GETXATTR
0.00 204.25 us 55.00 us 332.00 us 4 OPEN
0.00 253.25 us 40.00 us 383.00 us 4 OPENDIR
0.00 9772.48 us 19.00 us 170784.00 us 23 FSTAT
0.01 292781.43 us 58861.00 us 983783.00 us 7 XATTROP
0.02 858.43 us 22.00 us 1423882.00 us 4575 STATFS
0.09 80373.14 us 24.00 us 7204353.00 us 238 READDIRP
0.12 245112.80 us 203.00 us 3456394.00 us 105 READ
0.34 10815.75 us 14.00 us 12661132.00 us 6592 FINODELK
0.65 3964.91 us 10.00 us 12225722.00 us 34548 ENTRYLK
1.25 180252.86 us 105.00 us 10449565.00 us 1463 LINK
1.26 450155.34 us 170.00 us 10124179.00 us 592 SETXATTR
2.20 785072.88 us 1137.00 us 15596933.00 us 591 MKDIR
2.44 285011.66 us 74.00 us 10029407.00 us 1812 UNLINK
4.15 221844.23 us 27.00 us 13358349.00 us 3948 WRITE
4.32 282996.95 us 157.00 us 14647542.00 us 3225 RENAME
5.22 336151.14 us 48.00 us 16346960.00 us 3283 FTRUNCATE
5.57 70169.94 us 13.00 us 19847510.00 us 16764 INODELK
5.78 372149.82 us 225.00 us 43142880.00 us 3282 FSYNC
6.20 179245.19 us 54.00 us 12333383.00 us 7306 SETATTR
6.98 942204.72 us 2013.00 us 21824933.00 us 1566 MKNOD
11.11 714415.27 us 1133.00 us 54704114.00 us 3285 CREATE
15.31 26953.27 us 81.00 us 43129248.00 us 119970 LOOKUP
26.98 792829.66 us 1857.00 us 74906287.00 us 7189 FXATTROP
Duration: 30418 seconds
Data Read: 13762560 bytes
Data Written: 11007371 bytes
Interval 2 Stats:
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 1 3 9
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 1 3 3
Block Size: 1024b+
No. of Reads: 0
No. of Writes: 1
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 22 RELEASE
0.00 40.25 us 29.00 us 45.00 us 4 GETXATTR
0.00 60.24 us 36.00 us 175.00 us 21 STATFS
0.16 23974.75 us 31.00 us 94722.00 us 4 READDIRP
0.53 161070.00 us 93377.00 us 228763.00 us 2 MKDIR
1.10 51083.00 us 85.00 us 631704.00 us 13 UNLINK
1.34 67739.50 us 129.00 us 789136.00 us 12 LINK
1.59 87786.09 us 197.00 us 521494.00 us 11 RENAME
1.98 599473.00 us 26016.00 us 1172930.00 us 2 SETXATTR
1.99 30895.54 us 21.00 us 472810.00 us 39 FINODELK
2.88 45894.39 us 66.00 us 1049614.00 us 38 SETATTR
3.56 538438.50 us 142162.00 us 1580503.00 us 4 MKNOD
4.24 16464.58 us 15.00 us 521614.00 us 156 ENTRYLK
4.72 150455.74 us 76.00 us 2711304.00 us 19 FTRUNCATE
5.45 173643.05 us 47.00 us 2103721.00 us 19 WRITE
6.40 44038.34 us 17.00 us 2757965.00 us 88 INODELK
11.19 376593.89 us 5260.00 us 2985174.00 us 18 FSYNC
13.07 15699.44 us 93.00 us 2862343.00 us 504 LOOKUP
14.87 473825.11 us 78743.00 us 1968988.00 us 19 CREATE
24.94 351199.56 us 100021.00 us 2889095.00 us 43 FXATTROP
Duration: 91 seconds
Data Read: 0 bytes
Data Written: 6327 bytes
Brick: hangar:/export/wd1a
--------------------------
Cumulative Stats:
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 2 2 3
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 1 5 1
Block Size: 1024b+
No. of Reads: 0
No. of Writes: 2
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 15 RELEASE
0.00 120.00 us 120.00 us 120.00 us 1 OPEN
0.00 332.00 us 332.00 us 332.00 us 1 STAT
0.00 146.00 us 43.00 us 291.00 us 4 GETXATTR
0.01 419.33 us 230.00 us 527.00 us 3 OPENDIR
0.01 214.33 us 126.00 us 644.00 us 9 LINK
0.02 133.48 us 25.00 us 2311.00 us 31 FINODELK
0.03 148.74 us 65.00 us 860.00 us 34 SETATTR
0.05 503.56 us 48.00 us 7125.00 us 16 WRITE
0.09 1474.55 us 105.00 us 13024.00 us 11 UNLINK
0.11 538.08 us 36.00 us 11462.00 us 37 STATFS
0.18 1624.20 us 172.00 us 23558.00 us 20 RENAME
0.19 376.79 us 19.00 us 23151.00 us 89 INODELK
0.48 21046.50 us 14439.00 us 27719.00 us 4 SETXATTR
0.49 2773.48 us 28.00 us 57042.00 us 31 READDIRP
0.67 7371.56 us 91.00 us 115637.00 us 16 FTRUNCATE
1.57 69412.75 us 30349.00 us 114982.00 us 4 MKDIR
1.99 1588.54 us 15.00 us 151829.00 us 222 ENTRYLK
5.64 62378.25 us 23983.00 us 164708.00 us 16 MKNOD
6.48 71566.31 us 30931.00 us 143835.00 us 16 CREATE
12.09 142550.93 us 261.00 us 693449.00 us 15 FSYNC
26.35 5660.48 us 97.00 us 713547.00 us 823 LOOKUP
43.55 248377.29 us 94023.00 us 787050.00 us 31 FXATTROP
Duration: 199 seconds
Data Read: 0 bytes
Data Written: 7169 bytes
Interval 1 Stats:
Block Size: 16b+ 32b+ 128b+
No. of Reads: 0 0 0
No. of Writes: 1 1 1
Block Size: 256b+ 1024b+
No. of Reads: 0 0
No. of Writes: 3 2
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 7 RELEASE
0.00 332.00 us 332.00 us 332.00 us 1 STAT
0.01 63.62 us 48.00 us 90.00 us 8 WRITE
0.01 176.00 us 43.00 us 291.00 us 3 GETXATTR
0.01 338.33 us 178.00 us 644.00 us 3 LINK
0.02 177.12 us 91.00 us 457.00 us 8 FTRUNCATE
0.02 129.31 us 71.00 us 433.00 us 16 SETATTR
0.04 226.20 us 25.00 us 2311.00 us 15 FINODELK
0.06 256.71 us 37.00 us 2046.00 us 21 STATFS
0.18 3042.60 us 133.00 us 13024.00 us 5 UNLINK
0.35 1991.73 us 172.00 us 23558.00 us 15 RENAME
0.36 690.59 us 19.00 us 23151.00 us 44 INODELK
0.49 21079.00 us 14439.00 us 27719.00 us 2 SETXATTR
0.95 5107.69 us 30.00 us 57042.00 us 16 READDIRP
2.26 96547.50 us 78113.00 us 114982.00 us 2 MKDIR
2.37 1390.34 us 15.00 us 151829.00 us 146 ENTRYLK
7.80 83477.88 us 48786.00 us 143835.00 us 8 CREATE
9.62 63325.31 us 23983.00 us 164708.00 us 13 MKNOD
11.61 142004.86 us 261.00 us 432654.00 us 7 FSYNC
21.82 3907.10 us 98.00 us 713547.00 us 478 LOOKUP
42.01 239695.80 us 94781.00 us 544048.00 us 15 FXATTROP
Duration: 91 seconds
Data Read: 0 bytes
Data Written: 4959 bytes
Brick: hangar:/export/wd3a
--------------------------
Cumulative Stats:
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 3 6 12
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 1 5 4
Block Size: 1024b+
No. of Reads: 0
No. of Writes: 2
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 33 RELEASE
0.00 18.00 us 18.00 us 18.00 us 1 STAT
0.00 104.00 us 101.00 us 107.00 us 2 OPEN
0.00 96.00 us 25.00 us 277.00 us 4 GETXATTR
0.00 385.00 us 235.00 us 536.00 us 3 OPENDIR
0.00 213.25 us 19.00 us 6205.00 us 36 STATFS
0.40 470758.00 us 23965.00 us 657106.00 us 4 SETXATTR
0.52 98096.64 us 186.00 us 782446.00 us 25 RENAME
0.66 174536.61 us 26.00 us 3003407.00 us 18 READDIRP
0.70 53486.74 us 15.00 us 1317168.00 us 62 FINODELK
0.90 1065442.75 us 295587.00 us 2325505.00 us 4 MKDIR
0.94 16065.84 us 10.00 us 1288908.00 us 278 ENTRYLK
1.57 48556.51 us 13.00 us 4469895.00 us 154 INODELK
1.62 512730.93 us 122.00 us 7095768.00 us 15 LINK
2.94 465880.93 us 46.00 us 4199068.00 us 30 WRITE
3.10 920477.69 us 107.00 us 8226711.00 us 16 UNLINK
7.51 1190910.80 us 8782.00 us 7100435.00 us 30 FSYNC
8.15 1337393.45 us 73.00 us 11040338.00 us 29 FTRUNCATE
8.26 3931236.60 us 1160176.00 us 11799900.00 us 10 MKNOD
10.18 756842.80 us 58.00 us 8942157.00 us 64 SETATTR
12.95 1988265.23 us 160647.00 us 9624455.00 us 31 CREATE
17.61 93018.77 us 86.00 us 6997332.00 us 901 LOOKUP
22.00 1661772.75 us 52204.00 us 11623451.00 us 63 FXATTROP
Duration: 199 seconds
Data Read: 0 bytes
Data Written: 9465 bytes
Interval 1 Stats:
Block Size: 16b+ 32b+ 64b+
No. of Reads: 0 0 0
No. of Writes: 1 3 9
Block Size: 128b+ 256b+ 512b+
No. of Reads: 0 0 0
No. of Writes: 1 3 3
Block Size: 1024b+
No. of Reads: 0
No. of Writes: 1
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 22 RELEASE
0.00 18.00 us 18.00 us 18.00 us 1 STAT
0.00 111.67 us 25.00 us 277.00 us 3 GETXATTR
0.00 27.06 us 13.00 us 332.00 us 89 INODELK
0.00 344.95 us 19.00 us 6205.00 us 20 STATFS
0.00 200.08 us 15.00 us 6433.00 us 39 FINODELK
0.05 10699.62 us 26.00 us 83529.00 us 8 READDIRP
0.11 1134.90 us 10.00 us 109655.00 us 156 ENTRYLK
0.36 301742.50 us 23965.00 us 579520.00 us 2 SETXATTR
0.99 820339.50 us 745984.00 us 894695.00 us 2 MKDIR
1.15 159219.58 us 190.00 us 782446.00 us 12 RENAME
1.24 121411.00 us 73.00 us 639391.00 us 17 FTRUNCATE
1.73 159973.33 us 46.00 us 639493.00 us 18 WRITE
3.41 436451.92 us 107.00 us 3961082.00 us 13 UNLINK
3.49 1451494.00 us 1160176.00 us 1880744.00 us 4 MKNOD
4.62 640178.25 us 122.00 us 7095768.00 us 12 LINK
11.63 496365.44 us 58.00 us 8928091.00 us 39 SETATTR
12.08 39948.95 us 86.00 us 1708220.00 us 503 LOOKUP
12.15 1064254.32 us 160647.00 us 6150859.00 us 19 CREATE
15.16 1327983.68 us 9170.00 us 7100435.00 us 19 FSYNC
31.82 1323944.45 us 52204.00 us 6925255.00 us 40 FXATTROP
Duration: 91 seconds
Data Read: 0 bytes
Data Written: 6327 bytes
--
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
manu@xxxxxxxxxx
