help-octave
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: variable precision arithmetic (vpa) errant results in windows 10, o


From: Jordi Gutiérrez Hermoso
Subject: Re: variable precision arithmetic (vpa) errant results in windows 10, octave-4.0.1
Date: Wed, 22 Jun 2016 14:04:06 -0400

On Wed, 2016-06-22 at 08:31 -0700, Colin Macdonald wrote:

> Whereas vpa(1/3, 64) first creates the a double precision floating
> point number near 1/3 and then converts it to have 64 digits, which
> must be lossy.

"Lossy" is a funny word to use here, as vpa("1/3", 64) is also lossy,
but you are prescribing how much you want to lose. :-)

- Jordi G. H.





reply via email to

[Prev in Thread] Current Thread [Next in Thread]