Re: OT(ish): Strange coding problem (audio related)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Fri, 2011-01-28 at 12:28 +0100, Philipp Ãberbacher wrote:

> Interesting.. would you mind explaining how this can be?
> How can 11-11 yield 4.80518e-16? 

Because, rather than 11, log(2048)/log(2.0) is actually (to 40 d.p.)

7.6246189861593984035895533360399422488305 /
0.6931471805599453094172321214581765680755

But doubles don't contain 40 d.p.; it is approximately 16. Thus some
rounding errors may occur...

Peter.

_______________________________________________
Linux-audio-user mailing list
Linux-audio-user@xxxxxxxxxxxxxxxxxxxx
http://lists.linuxaudio.org/listinfo/linux-audio-user



[Index of Archives]     [Linux Sound]     [ALSA Users]     [Pulse Audio]     [ALSA Devel]     [Sox Users]     [Linux Media]     [Kernel]     [Photo Sharing]     [Gimp]     [Yosemite News]     [Linux Media]

  Powered by Linux