This is a small patch series on top of cc/perf-aggregate-sort, which is next, to add scripts that make it much easier to bisect performance regressions. For example if you ran perf test using the perf.conf config file that contains a "with libpcre", then using: $ ./aggregate.perl --subsection "with libpcre" --sort-by=regression v2.15.1 v2.16.2 v2.17.0 you can get a line in the output like: +8.2% p5302-pack-index.6 14.33(44.50+0.77) 15.50(43.83+0.94) v2.16.2 v2.17.0 and you can now use this output line to bisect where the regression comes from using: echo "+8.2% p5302-pack-index.6 14.33(44.50+0.77) 15.50(43.83+0.94) v2.16.2 v2.17.0" | ./bisect_regression --config perf.conf --subsection "with libpcre" Caveats: You must make sure that the times are consistent between runs and that there is a significant time difference between the "good" runs and the "bad" runs. For example the following is not easily bisectable: +100.0% p0000-perf-lib-sanity.2 0.01(0.01+0.01) 0.02(0.02+0.00) v2.15.1 v2.16.2 as the rtime went from 0.01 s to 0.02 s and we only have 0.01 s precision. Christian Couder (2): perf/run: add --subsection option t/perf: add scripts to bisect performance regressions t/perf/bisect_regression | 73 ++++++++++++++++++++++++++++++++++++++++ t/perf/bisect_run_script | 47 ++++++++++++++++++++++++++ t/perf/run | 56 ++++++++++++++++++++++++------ 3 files changed, 166 insertions(+), 10 deletions(-) create mode 100755 t/perf/bisect_regression create mode 100755 t/perf/bisect_run_script -- 2.17.0.rc1.36.g098d832c9.dirty
