Kaydet (Commit) d5bff122 authored tarafından Łukasz Hryniuk's avatar Łukasz Hryniuk Kaydeden (comit) Eike Rathke

tdf#89387 related, fix SumSquare bug in SumMXMY2

SumSquare returns IterateResult, which, because of rounding errors, store
first value in mfFirst and rest in mfRest. They should be added to get
the full sum of square of matrices difference.

Change-Id: I9bc435801d94206960b0b4fe4a9149ef1abeb3be
Reviewed-on: https://gerrit.libreoffice.org/17592Reviewed-by: 's avatarEike Rathke <erack@redhat.com>
Tested-by: 's avatarEike Rathke <erack@redhat.com>
üst 4532ea42
......@@ -1791,7 +1791,7 @@ void ScInterpreter::ScSumXMY2()
else
{
ScMatrix::IterateResult aRes = pResMat->SumSquare(false);
double fSum = aRes.mfRest;
double fSum = aRes.mfFirst + aRes.mfRest;
PushDouble(fSum);
}
}
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment