|
From: | Scott Lamb |
Subject: | Re: polyfit weirdness |
Date: | Tue, 11 Feb 2003 10:25:12 -0600 |
User-agent: | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.0.1) Gecko/20020826 |
Etienne Grossmann wrote:
A problem with order of magnitude of f1 and floating-point limitations? octave:63> f1 /= 1e14; octave:64> [p1,cv1] = polyfit(f1,v1,1)' p1 = 0.41679 -1.49481 cv1 = 0.66528 0.79417 1.37189 1.59260 1.92606 Is that more like what you expected?
Yes, it is, thanks.I'm a little disappointed Octave has this problem; I'd assumed it would be using gmp or something for arbitrary precision. Oh well.
Thanks, Scott Lamb ------------------------------------------------------------- Octave is freely available under the terms of the GNU GPL. Octave's home on the web: http://www.octave.org How to fund new projects: http://www.octave.org/funding.html Subscription information: http://www.octave.org/archive.html -------------------------------------------------------------
[Prev in Thread] | Current Thread | [Next in Thread] |