The drift is very small. In my test recording the drift is only 53 milliseconds over the course of an hour. My stretch factor is 0.99998525762821
I'd tried to drop some samples in this case. Not by a large chunk, but one by one periodically. Yes, it's not correct but it may work out if you carefully choose when to drop (for example, in silence).
