[Octave-bug-tracker] [bug #65495] nchoosek error "gcd: all values must be integers"

[John W. Eaton]

Follow-up Comment #16, bug #65495 (group octave):

In Octave (and Matlab), large literal integer values are preserved exactly as
integers if they appear as the argument to the int64 or uint64 functions.  In
Octave, this behavior is implemented by storing a special integer value type
that is either converted to a double value when it is first stored in a
variable OR converted to an int64 or uint64 value by the int64/uint64
functions.

See bug #45945 and related patches.  This behavior probably does deserve some
mention in the documentation.  Unfortunately, I don't see anything about it in
a NEWS file either.  Oops, that's probably my fault.

See also https://hg.savannah.gnu.org/hgweb/octave/rev/96e7dc4c2214 for a
change related to specifying the type of literal integer values.  Maybe there
was one, but I haven't located an associated bug report.  That change in
syntax and behavior was mentioned in the NEWS file for version 7, but may not
be described in the manual.  It would probably be worth adding at least the
info from the NEWS file to the section in the manual that covers literal
values.


    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?65495>

_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/