I thought I would at least chime in here about read performance on small files. Seems to me that this problem should more likely be solved with Squid. Nginx, or some caching software. If I'm understanding the problem, the files are mostly read-only .html files which would react well to being cached by a well configured cache that shouldn't be too hard to set up. Hope info helps in some way. Larry Bates vitalEsafe, Inc. ------------------------------ Message: 3 Date: Tue, 4 May 2010 14:24:44 -0400 From: "Burnash, James" <jburnash at knight.com> Subject: Re: Performance Issue with Webserver To: "gluster-users at gluster.org" <gluster-users at gluster.org> Message-ID: <9AD565C4A8561349B7227B79DDB988733179EA485D at EXCHANGE3.global.knight.com> Content-Type: text/plain; charset="us-ascii" Hi Jenn, You may not have seen the posts, but small files do not, as a general rule, do well on parallel file systems. There are numerous posts on this subject on this list concerning this subject, and the Gluster developers have devoted a good bit of energy into trying to address this, but ... this is not a general purpose file system. It is designed to be efficient with large(r) file sizes. Throughput is (hopefully) limited by the bandwidth available - but latency comes is a factor as well in determining throughput. Others on this list can give you much better details. James -----Original Message----- From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of Jenn Fountain Sent: Tuesday, May 04, 2010 1:32 PM To: gluster-users at gluster.org Subject: Performance Issue with Webserver We are running our webapp on a gluster mount. We are finding that performance is a lot slower than local disk. We expected it to be slower but not this much slower. So, I am looking to you for some guidance on what to do. IE: Not run off the gluster mount or change config settings, etc. Here are some numbers on performance: Gluster Mount html: Document Path: /tmp/test.html Document Length: 17 bytes Concurrency Level: 1 Time taken for tests: 0.269 seconds Complete requests: 1 Failed requests: 0 Write errors: 0 Total transferred: 302 bytes HTML transferred: 17 bytes Requests per second: 3.72 [#/sec] (mean) Time per request: 268.621 [ms] (mean) Time per request: 268.621 [ms] (mean, across all concurrent requests) Transfer rate: 1.10 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 16 16 0.0 16 16 Processing: 253 253 0.0 253 253 Waiting: 253 253 0.0 253 253 Total: 269 269 0.0 269 269 Local disk html: Document Path: /tmp2/test.html Document Length: 16 bytes Concurrency Level: 1 Time taken for tests: 0.035 seconds Complete requests: 1 Failed requests: 0 Write errors: 0 Total transferred: 301 bytes HTML transferred: 16 bytes Requests per second: 28.24 [#/sec] (mean) Time per request: 35.409 [ms] (mean) Time per request: 35.409 [ms] (mean, across all concurrent requests) Transfer rate: 8.30 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 20 20 0.0 20 20 Processing: 16 16 0.0 16 16 Waiting: 16 16 0.0 16 16 Total: 35 35 0.0 35 35
