Working fine after 26hrs+ of testing, plus another 24hrs of the previous version of this patch.
Sorry if there are multiple replies, I had to figure out how to properly reply to a mailing list, such that the reply is picked up by patchwork (1st time doing this).