iio scale precision

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



What's the best way to handle scale values for very high precision ADC's.

eg a 24 or even a 32 bit dac with a 2.5v full scale range.

Even using the nV conversion param it looses a fair bit of precision.

Would a option to return a rational number would be better?

Or am I doing something wrong.

--
Regards
Phil



[Index of Archives]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Input]     [Linux Kernel]     [Linux SCSI]     [X.org]

  Powered by Linux