[Octave-bug-tracker] [bug #64692] colon range includes an extra value

[Nicholas Jankowski]

Follow-up Comment #13, bug #64692 (project octave):


How MATLAB Stores Floating-Point Numbers
MATLAB constructs its double and single floating-point data types according to
IEEE format and follows the round to nearest, ties to even rounding mode by
default.

A floating-point number x has the form:

x=−1^s * (1+f) * 2^e

where:

s determines the sign.

f is the fraction, or mantissa, which satisfies 0 ≤ f < 1.

e is the exponent.

s, f, and e are each determined by a finite number of bits in memory, with f
and e depending on the precision of the data type.

https://www.mathworks.com/help/matlab/matlab_prog/floating-point-numbers.html

i don't know if "MATLAB constructs its double and single floating-point data
types according to IEEE format and follows the round to nearest, ties to even
rounding mode by default." means anything related to what we're discussing
here.


    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?64692>

_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/