Mercurial > octave
diff libinterp/corefcn/det.cc @ 23886:6d73cb87591a
Avoid underflow in explicit floating point calculating det (bug #39014)
* DET.h (det::operator *=): Renormalize mantissa after multiplication,
not multiplier before.
* det.cc: New test.
| author | Stephen Montgomery-Smith <stephen@missouri.edu> |
|---|---|
| date | Fri, 01 Jul 2016 22:16:14 +1000 |
| parents | 980f39c3ab90 |
| children | 194eb4bd202b |
line wrap: on
line diff
--- a/libinterp/corefcn/det.cc Wed Feb 08 09:01:27 2017 -0500 +++ b/libinterp/corefcn/det.cc Fri Jul 01 22:16:14 2016 +1000 @@ -226,6 +226,7 @@ /* %!assert (det ([1, 2; 3, 4]), -2, 10*eps) %!assert (det (single ([1, 2; 3, 4])), single (-2), 10*eps ("single")) +%!assert (det (eye (2000)), 1) %!error det () %!error det (1, 2) %!error <must be a square matrix> det ([1, 2; 3, 4; 5, 6])