[Octave-bug-tracker] [bug #56541] [octave forge] (tisean) BIST failures in windows

[John Donoghue]

URL:
  <https://savannah.gnu.org/bugs/?56541>

                 Summary: [octave forge] (tisean) BIST failures in windows
                 Project: GNU Octave
            Submitted by: lostbard
            Submitted on: Mon 24 Jun 2019 04:06:36 PM UTC
                Category: Octave Forge Package
                Severity: 3 - Normal
                Priority: 5 - Normal
              Item Group: Incorrect Result
                  Status: None
             Assigned to: None
         Originator Name: lostbard
        Originator Email: 
             Open/Closed: Open
         Discussion Lock: Any
                 Release: 5.1.0
        Operating System: Microsoft Windows

    _______________________________________________________

Details:


When running the tests for tisean 0.2.3 in windows 64, using the mxe installer
I get 10 failures for the tests:


>>>>> processing
C:\Octave\OC328E~1.2\mingw64\share\octave\packages\tisean-0.2.3\av_d2.m
***** test
 av_d2_res = [2.227339 0.02227155;2.077224 0.07391772;1.937226
0.2742541;1.806664 0.482474;1.684901 0.603453;1.571344 0.598633;1.465441
0.5230358;1.366675 0.4940035;1.274566 0.4025534;1.188664 0.4291942;1.108552
0.720235;1.033839 0.9861274;0.9641622 1.036355;0.8991808 0.8166605;0.8385791
0.6758107;0.7820616 0.6766519;0.7293533 0.7019168;0.6801973
0.7465489;0.6343543 0.7729089;0.5916009 0.7865262;0.551729 0.7587416;0.5145443
0.7644434;0.4798658 0.8011066;0.4475244 0.8391553;0.4173628
0.9049456;0.3892339 0.9205563;0.3630009 0.949196;0.3385358 0.9231388;0.3157196
0.9548996;0.2944412 0.9584774;0.2745968 0.9921522;0.2560899
0.9393911;0.2388303 0.9163786;0.2227339 0.8300805;0.2077224
0.8629162;0.1937226 0.865825;0.1806664 0.8647303;0.1684901 0.8767034;0.1571344
0.9034054;0.1465441 0.9768383];
 res = av_d2 (val);
 assert (cell2mat({res.d2}.')(1:length(av_d2_res),:), av_d2_res, -1e-6);
!!!!! test failed
ASSERT errors for:  assert (cell2mat ({res.d2}.') (1:length (av_d2_res),
:),av_d2_res,-1e-6)

  Location  |  Observed  |  Expected  |  Reason
   (1,2)       0.11731      0.022272     Rel err 4.2672 exceeds tol 1e-06 by
4
   (2,2)       0.12413      0.073918     Rel err 0.67927 exceeds tol 1e-06 by
0.7
   (3,2)       0.20589      0.27425      Rel err 0.24929 exceeds tol 1e-06 by
0.2
   (4,2)       0.34203      0.48247      Rel err 0.29109 exceeds tol 1e-06 by
0.3
   (5,2)        0.5021      0.60345      Rel err 0.16795 exceeds tol 1e-06 by
0.2
   (6,2)       0.57273      0.59863      Rel err 0.043275 exceeds tol 1e-06 by
0.04
   (7,2)       0.52025      0.52304      Rel err 0.0053256 exceeds tol 1e-06
by 0.005
   (8,2)       0.56711       0.494       Rel err 0.14799 exceeds tol 1e-06 by
0.1
   (9,2)       0.53054      0.40255      Rel err 0.31793 exceeds tol 1e-06 by
0.3
   (10,2)      0.62249      0.42919      Rel err 0.45036 exceeds tol 1e-06 by
0.5
   (11,2)      0.57009      0.72023      Rel err 0.20847 exceeds tol 1e-06 by
0.2
   (12,2)       0.6133      0.98613      Rel err 0.37807 exceeds tol 1e-06 by
0.4
   (13,2)      0.71159       1.0364      Rel err 0.31337 exceeds tol 1e-06 by
0.3
   (14,2)      0.72074      0.81666      Rel err 0.11745 exceeds tol 1e-06 by
0.1
   (15,2)      0.75801      0.67581      Rel err 0.12163 exceeds tol 1e-06 by
0.1
   (16,2)      0.68048      0.67665      Rel err 0.0056627 exceeds tol 1e-06
by 0.006
   (17,2)      0.67993      0.70192      Rel err 0.031319 exceeds tol 1e-06 by
0.03
   (18,2)      0.70543      0.74655      Rel err 0.055083 exceeds tol 1e-06 by
0.06
   (19,2)      0.85072      0.77291      Rel err 0.10068 exceeds tol 1e-06 by
0.1
   (20,2)      0.96862      0.78653      Rel err 0.23152 exceeds tol 1e-06 by
0.2
   (21,2)      0.92209      0.75874      Rel err 0.21529 exceeds tol 1e-06 by
0.2
   (22,2)      0.83271      0.76444      Rel err 0.089303 exceeds tol 1e-06 by
0.09
   (23,2)      0.82439      0.80111      Rel err 0.029066 exceeds tol 1e-06 by
0.03
   (24,2)      0.85831      0.83916      Rel err 0.022832 exceeds tol 1e-06 by
0.02
   (25,2)       0.8987      0.90495      Rel err 0.0068987 exceeds tol 1e-06
by 0.007
   (26,2)      0.94809      0.92056      Rel err 0.029905 exceeds tol 1e-06 by
0.03
   (27,2)       1.0606       0.9492      Rel err 0.11735 exceeds tol 1e-06 by
0.1
   (28,2)      0.93506      0.92314      Rel err 0.012912 exceeds tol 1e-06 by
0.01
   (29,2)      0.84373       0.9549      Rel err 0.11642 exceeds tol 1e-06 by
0.1
   (30,2)      0.79794      0.95848      Rel err 0.16749 exceeds tol 1e-06 by
0.2
   (31,2)       0.9104      0.99215      Rel err 0.082403 exceeds tol 1e-06 by
0.08
   (32,2)      0.96272      0.93939      Rel err 0.024829 exceeds tol 1e-06 by
0.02
   (33,2)       1.0368      0.91638      Rel err 0.1314 exceeds tol 1e-06 by
0.1
   (34,2)      0.99423      0.83008      Rel err 0.19776 exceeds tol 1e-06 by
0.2
   (35,2)       1.0314      0.86292      Rel err 0.19528 exceeds tol 1e-06 by
0.2
   (36,2)      0.98104      0.86582      Rel err 0.13307 exceeds tol 1e-06 by
0.1
   (37,2)      0.99293      0.86473      Rel err 0.14826 exceeds tol 1e-06 by
0.1
   (38,2)      0.94942       0.8767      Rel err 0.082946 exceeds tol 1e-06 by
0.08
   (39,2)      0.86051      0.90341      Rel err 0.04748 exceeds tol 1e-06 by
0.05
   (40,2)      0.85778      0.97684      Rel err 0.12188 exceeds tol 1e-06 by
0.1
shared variables   scalar structure containing the fields:

    val =

      10x1 struct array containing the fields:

        dim
        c2
        d2
        h2

    c2d_res = [](0x0)
    c1_res = [](0x0)
***** test
 av_d2_res_h2 = [1.965624 0.0536151;1.833148 0.07254237;1.7096
0.09431121;1.594379 0.1214435;1.486923 0.1495628;1.386709 0.1786416;1.29325
0.2090021;1.206089 0.2400019;1.124803 0.2694222;1.048995 0.2958831;0.978296
0.3231978;0.912362 0.3510871;0.8508719 0.3752123;0.7935261 0.3983067;0.740045
0.4201098;0.6901685 0.4411169;0.6436534 0.462419;0.6002733 0.4845437;0.5598169
0.5095501;0.5220871 0.5324418;0.4869002 0.55473;0.4540848 0.5774259;0.423481
0.6002299;0.3949398 0.6220529;0.3683222 0.6453185;0.3434985
0.6653961;0.3203478 0.6852458;0.2987574 0.706009;0.2786222 0.7280725;0.259844
0.7495944;0.2423314 0.7692112;0.225999 0.7882578;0.2107675 0.8074904;0.1965624
0.8228356;0.1833148 0.8381825];
 res = av_d2 (val, 'mindim', 2, 'maxdim', 7, 'a',4,'smoothall');
 assert (cell2mat({res.h2}.')(1:length(av_d2_res_h2),:), av_d2_res_h2,-1e-6);
 c2d_res = c2d (c1 (henon (1000)), 2);
!!!!! test failed
ASSERT errors for:  assert (cell2mat ({res.h2}.') (1:length (av_d2_res_h2),
:),av_d2_res_h2,-1e-6)

  Location  |  Observed  |  Expected  |  Reason
   (1,2)       0.079127     0.053615     Rel err 0.47584 exceeds tol 1e-06 by
0.5
   (2,2)       0.10331      0.072542     Rel err 0.42411 exceeds tol 1e-06 by
0.4
   (3,2)       0.13024      0.094311     Rel err 0.381 exceeds tol 1e-06 by
0.4
   (4,2)         0.16       0.12144      Rel err 0.31749 exceeds tol 1e-06 by
0.3
   (5,2)       0.19073      0.14956      Rel err 0.27527 exceeds tol 1e-06 by
0.3
   (6,2)       0.22051      0.17864      Rel err 0.23435 exceeds tol 1e-06 by
0.2
   (7,2)        0.2519       0.209       Rel err 0.20525 exceeds tol 1e-06 by
0.2
   (8,2)       0.28101        0.24       Rel err 0.17085 exceeds tol 1e-06 by
0.2
   (9,2)       0.30876      0.26942      Rel err 0.146 exceeds tol 1e-06 by
0.1
   (10,2)      0.33706      0.29588      Rel err 0.13916 exceeds tol 1e-06 by
0.1
   (11,2)      0.36356       0.3232      Rel err 0.1249 exceeds tol 1e-06 by
0.1
   (12,2)       0.388       0.35109      Rel err 0.10515 exceeds tol 1e-06 by
0.1
   (13,2)       0.4113      0.37521      Rel err 0.096167 exceeds tol 1e-06 by
0.1
   (14,2)      0.43338      0.39831      Rel err 0.088053 exceeds tol 1e-06 by
0.09
   (15,2)      0.45463      0.42011      Rel err 0.08216 exceeds tol 1e-06 by
0.08
   (16,2)      0.47525      0.44112      Rel err 0.07738 exceeds tol 1e-06 by
0.08
   (17,2)      0.49657      0.46242      Rel err 0.073857 exceeds tol 1e-06 by
0.07
   (18,2)      0.51673      0.48454      Rel err 0.066428 exceeds tol 1e-06 by
0.07
   (19,2)      0.53564      0.50955      Rel err 0.051195 exceeds tol 1e-06 by
0.05
   (20,2)      0.55489      0.53244      Rel err 0.042153 exceeds tol 1e-06 by
0.04
   (21,2)      0.57633      0.55473      Rel err 0.038946 exceeds tol 1e-06 by
0.04
   (22,2)      0.59816      0.57743      Rel err 0.0359 exceeds tol 1e-06 by
0.04
   (23,2)      0.61961      0.60023      Rel err 0.032283 exceeds tol 1e-06 by
0.03
   (24,2)      0.64256      0.62205      Rel err 0.032966 exceeds tol 1e-06 by
0.03
   (25,2)      0.66539      0.64532      Rel err 0.031109 exceeds tol 1e-06 by
0.03
   (26,2)       0.6876       0.6654      Rel err 0.033371 exceeds tol 1e-06 by
0.03
   (27,2)      0.70788      0.68525      Rel err 0.03303 exceeds tol 1e-06 by
0.03
   (28,2)      0.72732      0.70601      Rel err 0.030182 exceeds tol 1e-06 by
0.03
   (29,2)      0.74665      0.72807      Rel err 0.025514 exceeds tol 1e-06 by
0.03
   (30,2)      0.76392      0.74959      Rel err 0.019107 exceeds tol 1e-06 by
0.02
   (31,2)      0.77778      0.76921      Rel err 0.011145 exceeds tol 1e-06 by
0.01
   (32,2)      0.79059      0.78826      Rel err 0.0029577 exceeds tol 1e-06
by 0.003
   (33,2)      0.80399      0.80749      Rel err 0.0043406 exceeds tol 1e-06
by 0.004
   (34,2)      0.81765      0.82284      Rel err 0.0062993 exceeds tol 1e-06
by 0.006
   (35,2)      0.83035      0.83818      Rel err 0.0093484 exceeds tol 1e-06
by 0.009
shared variables   scalar structure containing the fields:

    val =

      10x1 struct array containing the fields:

        dim
        c2
        d2
        h2

    c2d_res = [](0x0)
    c1_res = [](0x0)
***** test assert (!isequal(av_d2 (c2d_res),c2d_res(1)));
 c1_res = c1 (henon (1000));
!!!!! test failed
d2_c2d_c1_out must be the output of d2 or c2d
shared variables   scalar structure containing the fields:

    val =

      10x1 struct array containing the fields:

        dim
        c2
        d2
        h2

    c2d_res = [](0x0)
    c1_res = [](0x0)
***** test assert (!isequal(av_d2 (c1_res),c1_res(1)));
!!!!! test failed
d2_c2d_c1_out must be the output of d2 or c2d
shared variables   scalar structure containing the fields:

    val =

      10x1 struct array containing the fields:

        dim
        c2
        d2
        h2

    c2d_res = [](0x0)
    c1_res = [](0x0)
***** error <one field> warning("error", "Octave:tisean"); ...
                av_d2 (c2d_res,'smoothall');
!!!!! error failed.
Expected <one field>, but got <d2_c2d_c1_out must be the output of d2 or c2d>

***** error <one field> warning("error", "Octave:tisean"); ...
                av_d2 (c1_res,'smoothall');
!!!!! error failed.
Expected <one field>, but got <d2_c2d_c1_out must be the output of d2 or c2d>



>>>>> processing
C:\Octave\OC328E~1.2\mingw64\share\octave\packages\tisean-0.2.3\c2g.m
***** test
 c2g_res = [0.00255674845539033 0.00262371218 1.56393838;0.00274151703342795
0.00291572767 1.46379328;0.00293963821604848 0.00321952766
1.37964845;0.00315207871608436 0.00353588979 1.30904245;0.00337987160310149
0.00386583689 1.2498455;0.00362412468530238 0.00421059737
1.20023394;0.00388602935709059 0.00457157521 1.1586616;0.00416686292737722
0.00495032407 1.12383032;0.00446798978373408 0.00534852408
1.09465814;0.00479088025167584 0.00576799177 1.07024431;0.00513710314407945
0.00621065963 1.04983807;0.00550834601745009 0.00667859521
1.03281331;0.00590642029419541 0.00717399921 1.01864672;0.00633325986564159
0.00769920321 1.00690293;0.00679094903171062 0.00825670082
0.997214317;0.00728171039372683 0.00884913001 0.989262819;0.00780794164165854
0.00947930664 0.982763529;0.00837219785898924 0.0101501858
0.977451086;0.00897723622620106 0.0108648958 0.973080397;0.00962599366903305
0.011626686 0.969439983];
 val = d2 (henon (1000), 'd', 1, 't', 50, 'm', 5);
 res = c2g (val);
 assert (cell2mat ({res.g}.')(1:rows(c2g_res),:), c2g_res, -1e-5);
!!!!! test failed
ASSERT errors for:  assert (cell2mat ({res.g}.') (1:rows (c2g_res),
:),c2g_res,-1e-5)

  Location  |  Observed  |  Expected  |  Reason
   (19,3)      0.97309      0.97308      Rel err 1.0245e-05 exceeds tol 1e-05
by 2e-07
   (20,3)      0.96948      0.96944      Rel err 3.7241e-05 exceeds tol 1e-05
by 3e-05


>>>>> processing
C:\Octave\OC328E~1.2\mingw64\share\octave\packages\tisean-0.2.3\ikeda.m
***** test
 ikd = [0.28571947432035805 0.64340009417266342;0.50841625820931591
-0.39972597757561129;0.87547944209544659
0.56858743316662752;0.70057389172681206
-0.89053147224601548;-1.9710645882970557E-002
-1.0429004993745194E-002;0.99222205960974108
-1.8501225510088638E-002;0.21620211688366087
-0.42823693940249830;1.3295528700280905 0.27892721893609196;1.0842998438472966
-1.2197367054961652;0.28153619668028618 -1.2810993040439602];
 res = ikeda (10);
 assert (res, ikd, 1e-16);
!!!!! test failed
ASSERT errors for:  assert (res,ikd,1e-16)

  Location  |  Observed  |  Expected  |  Reason
   (1,1)        1.0558      0.28572      Abs err 0.77008 exceeds tol 1e-16 by
0.8
   (2,1)       0.74872      0.50842      Abs err 0.2403 exceeds tol 1e-16 by
0.2
   (3,1)       -0.08221     0.87548      Abs err 0.95769 exceeds tol 1e-16 by
1
   (4,1)        1.2175      0.70057      Abs err 0.5169 exceeds tol 1e-16 by
0.5
   (5,1)       0.41677     -0.019711     Abs err 0.43648 exceeds tol 1e-16 by
0.4
   (6,1)       0.20145      0.99222      Abs err 0.79078 exceeds tol 1e-16 by
0.8
   (7,1)        0.5431       0.2162      Abs err 0.3269 exceeds tol 1e-16 by
0.3
   (8,1)        0.751        1.3296      Abs err 0.57855 exceeds tol 1e-16 by
0.6
   (9,1)       0.36374       1.0843      Abs err 0.72056 exceeds tol 1e-16 by
0.7
   (10,1)       1.1464      0.28154      Abs err 0.86491 exceeds tol 1e-16 by
0.9
   (1,2)       0.43243       0.6434      Abs err 0.21097 exceeds tol 1e-16 by
0.2
   (2,2)       -0.99561     -0.39973     Abs err 0.59589 exceeds tol 1e-16 by
0.6
   (3,2)       -0.2929      0.56859      Abs err 0.86149 exceeds tol 1e-16 by
0.9
   (4,2)       -0.16635     -0.89053     Abs err 0.72418 exceeds tol 1e-16 by
0.7
   (5,2)       -0.93961    -0.010429     Abs err 0.92918 exceeds tol 1e-16 by
0.9
   (6,2)       0.46704     -0.018501     Abs err 0.48554 exceeds tol 1e-16 by
0.5
   (7,2)       0.028187     -0.42824     Abs err 0.45642 exceeds tol 1e-16 by
0.5
   (8,2)       0.42137      0.27893      Abs err 0.14245 exceeds tol 1e-16 by
0.1
   (9,2)       -0.44253     -1.2197      Abs err 0.77721 exceeds tol 1e-16 by
0.8
   (10,2)      0.49432      -1.2811      Abs err 1.7754 exceeds tol 1e-16 by
2

>>>>> processing
C:\Octave\OC328E~1.2\mingw64\share\octave\packages\tisean-0.2.3\lyap_spec.m
***** test
 hen = henon(1000)(:,1);
 lyap_spec_res = [97 1.475854e+00 4.569062e-01 -4.080476e-01 -9.133782e-01];
 res = lyap_spec (hen, 'm', 4, 'n', 100, 'k', 50, 'invert');
 assert (res, lyap_spec_res, -1e-6);
!!!!! test failed
ASSERT errors for:  assert (res,lyap_spec_res,-1e-6)

  Location  |  Observed  |  Expected  |  Reason
    (2)         1.4757       1.4759      Rel err 9.3901e-05 exceeds tol 1e-06
by 9e-05
    (3)        0.44349      0.45691      Rel err 0.029359 exceeds tol 1e-06 by
0.03
    (4)        -0.39322     -0.40805     Rel err 0.03634 exceeds tol 1e-06 by
0.04
    (5)        -0.91465     -0.91338     Rel err 0.0013961 exceeds tol 1e-06
by 0.001
***** test
 ik = ikeda(1000);
 [lyap, pars] = lyap_spec (ik, 'm',4, 'n',100, 'k', 50,'invert');
 res = {lyap, pars.rel_err, pars.abs_err, pars.nsize, pars.nno, pars.ky_dim};
 assert (res, tisean_res, 1e-6);
!!!!! test failed
ASSERT errors for:  assert (cond {i},expected {i},tol)

  Location  |  Observed  |  Expected  |  Reason
    (2)         2.0453       1.7247      Abs err 0.32055 exceeds tol 1e-06 by
0.3
    (3)         1.4319       1.3443      Abs err 0.087588 exceeds tol 1e-06 by
0.09
    (4)        0.50466      0.60553      Abs err 0.10087 exceeds tol 1e-06 by
0.1
    (5)        0.073399     0.11075      Abs err 0.037347 exceeds tol 1e-06 by
0.04
    (6)        -0.2113      -0.16793     Abs err 0.043373 exceeds tol 1e-06 by
0.04
    (7)        -0.39715     -0.48399     Abs err 0.086844 exceeds tol 1e-06 by
0.09
    (8)        -0.63888     -0.68313     Abs err 0.044249 exceeds tol 1e-06 by
0.04
    (9)        -1.3454      -1.2791      Abs err 0.066241 exceeds tol 1e-06 by
0.07

ASSERT errors for:  assert (cond {i},expected {i},tol)

  Location  |  Observed  |  Expected  |  Reason
    (1)        0.096786     0.098795     Abs err 0.0020091 exceeds tol 1e-06
by 0.002
    (2)        0.049795     0.056064     Abs err 0.0062684 exceeds tol 1e-06
by 0.006

ASSERT errors for:  assert (cond {i},expected {i},tol)

  Location  |  Observed  |  Expected  |  Reason
    (1)        0.048269     0.046455     Abs err 0.0018141 exceeds tol 1e-06
by 0.002
    (2)        0.03738      0.039155     Abs err 0.001775 exceeds tol 1e-06 by
0.002

ASSERT errors for:  assert (cond {i},expected {i},tol)

  Location  |  Observed  |  Expected  |  Reason
     ()        0.90642      0.70356      Abs err 0.20286 exceeds tol 1e-06 by
0.2
shared variables   scalar structure containing the fields:

    tisean_res =
    {
      [1,1] =

         97.00000    1.72473    1.34430    0.60553    0.11075   -0.16793  
-0.48399   -0.68313   -1.27913

      [1,2] =

         0.098795   0.056064

      [1,3] =

         0.046455   0.039155

      [1,4] =  0.70356
      [1,5] =  50
      [1,6] =  8
    }


On my ubuntu machine I don't get the failures.

Some are obviously just tolerance differences, some seem larger than that.






    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?56541>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/