Result for a single ls on a dir with 10k directories inside (16*3 volume)
Hi All,
I have been working on POC to improve readdirp performance improvement. At the end of the experiment, The results are showing promising result in performance, overall there is a 104% improvement for full filesystem crawl compared to the existing solution. Here is the short test numbers. The tests were carried out in 16*3 setup with 1.5 Million dentries (Both files and dir). The system also contains some empty directories. In the result the proposed solution is 287% faster than the plane volume and 104% faster than the parallel-readdir based solution.
In short, the basic idea behind the proposal is the efficient managing of readdir buffer in gluster along with prefetching the dentries for intelligent switch-over to the next buffer. The detailed problem description, deign description and results are available in the doc.https://docs.google.com/document/d/10z4T5Sd_-wCFrmDrzyQtlWOGLang1_g17wO8VUxSiJ8/edit
https://review.gluster.org/24469
https://review.gluster.org/24470
Regards
Rafi KC
_______________________________________________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-devel
_______________________________________________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-devel
