I am seeing about a 10 percent improvement with htree and these are without any further tweaking which I hope to improve a bit more. I am real curious to see how it performs over NFS which is in my queue of tests I want to run.
Without htree:
PostMark v1.5 : 3/27/01 pm>set number 50000 pm>set transactions 30000 pm>set location /mnt/scsi pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 663 seconds total 455 seconds of transactions (65 per second)
Files: 65003 created (98 per second) Creation alone: 50000 files (253 per second) Mixed with transactions: 15003 files (32 per second) 14944 read (32 per second) 15051 appended (33 per second) 65003 deleted (98 per second) Deletion alone: 50006 files (4546 per second) Mixed with transactions: 14997 files (32 per second)
With htree:
PostMark v1.5 : 3/27/01 pm>set number 50000 pm>set transactions 30000 pm>set location /mnt/scsi pm>run Creating files...Done Performing transactions..........Done Deleting files...Done Time: 601 seconds total 403 seconds of transactions (74 per second)
Files: 65003 created (108 per second) Creation alone: 50000 files (265 per second) Mixed with transactions: 15003 files (37 per second) 14944 read (37 per second) 15051 appended (37 per second) 65003 deleted (108 per second) Deletion alone: 50006 files (5000 per second) Mixed with transactions: 14997 files (37 per second)
So far I am happy with the results but I will continue to test.
Steve
Stephen C. Tweedie wrote:
Hi,
On Wed, 2003-06-18 at 12:02, glen wrote:
Files spread over 100 directories:
Create : 1764, N/A, 1078 Remove : 611, N/A, 1310
Ok so results are not that great - better to use more directories.
Files spread over 1000 directories:
Create: 409, 305, 284
Remove: 138, 96, 141
Why use more directories? That just means that you spend more time updating more metadata for more directories. The point of htree is to let the fs do this work itself, as efficiently as possible: if you try with _1_ directory, you should see the best benefit from htree.
However, the performance still doesn't look that good, especially on the 100 dirs case (10,000 files per dir) --- are you sure you set the dir-index flag on the filesystem to enable htree operation?
Cheers, Stephen
_______________________________________________ Ext3-users@redhat.com https://www.redhat.com/mailman/listinfo/ext3-users
_______________________________________________ Ext3-users@redhat.com https://www.redhat.com/mailman/listinfo/ext3-users
