OK. Thanks you. Found it.
In base to the code is feasible in a couple of weeks.
I-ll implement a second order kahan algorithm. Third order would be overkill ( I don't think anyone is gonna use it for high precision calculus ).
But it's not only sum and average, variance (stats) and any other formula with sums is affected. That's why I need time to track it.
And by the way, what about using long double for intermediate steps, to improve precision. For what I know glibc or whatever uses gcc on fedora uses it, or at least exp((double)10) returns the same as exp((long double)10.
El mié, 9 dic 2020 a las 23:00, Eike Rathke (<erack@xxxxxxxxxx>) escribió:
Hi,
On Wednesday, 2020-12-09 20:25:17 +0100, Dante Doménech wrote:
> Does anyone know where are implemented the calc formulas?
Regina already gave pointers. Ask if you need more.
> I'd like to check out if it uses the kahan algorithm, pairwise sum or
> something else.
Kahan is not used, but there's
https://bugs.documentfoundation.org/show_bug.cgi?id=137679
to implement it. I thought Roman would start on that but maybe
I misunderstood. So if you'd like to tackle that you're welcome.
The current approach is quite simple, it just remembers one value to add
that later.
Eike
--
GPG key 0x6A6CD5B765632D3A - 2265 D7F3 A7B0 95CC 3918 630B 6A6C D5B7 6563 2D3A
_______________________________________________ LibreOffice mailing list LibreOffice@xxxxxxxxxxxxxxxxxxxxx https://lists.freedesktop.org/mailman/listinfo/libreoffice