On 25 February 2018 at 04:48, Kaartic Sivaraam <kaartic.sivaraam@xxxxxxxxx> wrote: > On Wednesday 21 February 2018 02:14 AM, Martin Ågren wrote: >> To sum up: I probably won't be looking into Travis-ing such a blacklist >> in the near future. >> > > Just thinking out loud, how about having a white-list instead of a > black-list and using it to run only those tests in the white list. > Something like, > > t/white_list > ------------ > t0000 > t0001 > > To run > ------ > > cd t/ > for test in $(cat white_list) > do > white_list_tests="$white_list_tests $test*" > done > make SANITIZE=leak $white_list_tests Yeah, that would also work. An incomplete whitelist can't cause errors for those running other tests, as an incomplete blacklist could. So that's good. At some point, the whitelist would need to be turned into a blacklist. At the very latest when the whitelist is the full set of tests, in order to flip the default of new tests. ;-) Right now, I think whitelists and blacklists are about equally useful. Let's hope we're heading for a future where a blacklist gets more and more feasible, whereas a whitelist would get longer and longer. ;-) Martin