On Wed, Aug 3, 2016 at 4:30 PM, Michael Haggerty <mhagger@xxxxxxxxxxxx> wrote: > This is an important point for the optimization, but less so for the > implementation of the heuristic here. I was dynamically optimizing the > ten other variables, and everything that goes into the bonus includes > one of those factors. If I had also let this factor of 10 vary, then the > net behavior of the algorithm would be completely unchanged if I would, > say, double all eleven parameters. This is bad for optimization, because > (1) it increases the search space unnecessarily, and (2) it means that > whole lines in the parameter space give identical behavior, making the > algorithm waste time searching along those lines for a minimum. > >> So another way to write it >> would be >> >> score - bonus/10; >> >> assuming the values of score and bonus are large enough. > > Score is the number of columns that some line is indented, so it can be > 0 or 1 or any other positive integer. It is not "large enough", which is > why the "10" can't be "1". Right, I should have made it more clear that it was a hypothetical rewrite, just to point out we are looking at only one of score or bonus. >> but if I look at the boni definitions ranging from -63..50 they are scaled up >> so much that the bonus may become larger than '1' unit of 'score', i.e. >> it is not an epsilon any more. Or to put it another way: >> If we were to s/10/100/ the results would be worse. > > If you would change s/10/100/ and simultaneously multiply the other > constants by 10, the end results would be unchanged. Right, so maybe a good name would be CONSTANT_SCALE_OF_ONE_INDENT as it has the meaning that a bonus of 10 is equivalent of "one indent" in the weighting. Speaking of which, do we want to "over-optimize" to make that constant a power of 2 as that is a supposedly faster multiplication? (Just asking, feel free to reject; as I can imagine the numbers itself are already magic, so why scale them with 42?^H^H^H 16?) > >> Rather the 10 describes the ratio of "advanced magic" to pure indentation >> based scoring in my understanding. > > No, it's basically just a number against which the other constants are > compared. E.g., if another bonus wants to balance out against exactly > one space of indentation, its constant needs to be 10. If it wants to > balance out against exactly 5 spaces, its constant needs to be 50. Etc. So another interpretation is that the 10 gives the resolution for all other constants, i.e. if we keep 10, then we can only give weights in 1/10 of "one indent". But the "ideal" weight may not be a multiple of 1/10, so we approximate them to the nearest multiple of 1/10. If we were to use 1000 here, we could have a higher accuracy of the other constants, but probably we do not care about the 3rd decimal place for these because they are created heuristically from a corpus that may not warrant a precision of constants with a 3rd decimal place. Stefan -- To unsubscribe from this list: send the line "unsubscribe git" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html