help-octave
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: determinant of integer values


From: Mike Miller
Subject: Re: determinant of integer values
Date: Tue, 28 Feb 2006 23:46:19 -0600 (CST)

On Wed, 1 Mar 2006, Peter Lempel Søndergaard wrote:

the following code

A=[1 0; 1 12];
det(A)

produces:

ans = 12.000

instead of the better result ans = 12 .

I am using Fedora 4 with the lastest rpms installed, Octave 2.1.72 and
Octave-forge.

This is slightly annoying, because gcd will not work with 12.000, so I
have to round the number. Matlab gets this one correctly.


I see the same 12.000 on version 2.1.71 compiled on Red Hat, but on an old version 2.0.14 on Solaris I see 12. I'm sure someone will know what's going on with that.

Mike

reply via email to

[Prev in Thread] Current Thread [Next in Thread]