Re: LO calc formulas

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



OK. Thanks you. Found it.
In base to the code is feasible in a couple of weeks.
I-ll implement a second order kahan algorithm. Third order would be overkill ( I don't think anyone is gonna use it for high precision calculus  ).
But it's not only sum and average, variance (stats) and any other formula with sums is affected. That's why I need time to track it.
And by the way, what about using long double for intermediate steps, to improve precision. For what I know glibc or whatever uses gcc on fedora uses it, or at least exp((double)10) returns the same as exp((long double)10.

El mié, 9 dic 2020 a las 23:00, Eike Rathke (<erack@xxxxxxxxxx>) escribió:
Hi,

On Wednesday, 2020-12-09 20:25:17 +0100, Dante Doménech wrote:

> Does anyone know where are implemented the calc formulas?

Regina already gave pointers. Ask if you need more.

> I'd like to check out if it uses the kahan algorithm, pairwise sum or
> something else.

Kahan is not used, but there's
https://bugs.documentfoundation.org/show_bug.cgi?id=137679
to implement it. I thought Roman would start on that but maybe
I misunderstood. So if you'd like to tackle that you're welcome.

The current approach is quite simple, it just remembers one value to add
that later.

  Eike

--
GPG key 0x6A6CD5B765632D3A - 2265 D7F3 A7B0 95CC 3918  630B 6A6C D5B7 6563 2D3A
_______________________________________________
LibreOffice mailing list
LibreOffice@xxxxxxxxxxxxxxxxxxxxx
https://lists.freedesktop.org/mailman/listinfo/libreoffice

[Index of Archives]     [LARTC]     [Bugtraq]     [Yosemite Forum]     [Photo]

  Powered by Linux