Results of running tests with GNU make 3.81beta2

[Jerker Bäck]

Hello make users

I made several attempts to run the GNU test scripts with my builds. Sorry to
say I just can't get it to work. I have found that make.exe MUST be in the
same dir as sh.exe whatever your path environment, otherwise it crashes
right away. My Unix environment skills are rudimentary though. I also found
that there's no difference running the tests from the NT prompt or from
within the Cygwin shell. 

Comments:
I do not know what value these tests give, if any, since none of my tests
completed successfully.

It really bothers me that my build is different from the Cygwin build. Do
Cygwin have their own code? Or more important: Is there such a difference
between the GCC and Microsoft compiler? If so, there is a major bug for the
MS compiler somewhere.

Note: Identical results between Intel and Microsoft builds
------------------------------------------
Release binaries 3.81 beta2:
HAVE_CYGWIN_SHELL and HAVE_CASE_INSENSITIVE_FS
Dynamic linking to msvcrt.dll
make.exe (ms: 109 kB, intel: 130 kB)

Test 3.80:        6 Tests Failed
Test 3.81beta2:   12 Tests in 36 Categories Failed
                  (Look down for output of test)
------------------------------------------
Reference build:
Cygwin make (latest 3.80 - may 2003)

Test 3.80:        1 Test Failed
Test 3.81beta2:   37 Tests in 43 Categories Failed
------------------------------------------
Other approach:
Microsoft SFU 3.5 (2004) - posix NT subsystem
Interix Korn shell / C Shell
The GNU make supplied (no version) is a NT binary with no exe prefix
(according to depends.exe: Links to psxdll.dll instead of kernel32.dll,
linker version 5.12). I guess that Interix is popped out from NT4 (OpenNT?).
This make could then be rather old.

Test 3.81beta2: 204 tests in 73 categories failed

Interix Korn shell + my make.exe build:
crash
------------------------------------------

Output from 

address@hidden /CygDrive/g/library/GNU/make/3.81beta2/tests
$ perl run_make_tests.pl
Det går inte att hitta sökvägen.
----------------------------------------------------------------------------
--
    Running tests for GNU make on CYGWIN_NT-5.2 max 1.5.15(0.127/4/2) i686

----------------------------------------------------------------------------
--

Clearing work...
Finding tests...

features/comments ....................................... ok     (1 passed)
features/conditionals ................................... ok     (2 passed)
features/default_names ..................................
*** Test died (features/default_names): test_driver.pl: 423: abort at
test_driver.pl line
608.

ok     (2 passed)
features/double_colon ................................... ok     (9 passed)
features/echoing ........................................ ok     (4 passed)
features/errors ......................................... ok     (2 passed)
features/escape ......................................... Error running
G:/library/cygwin/
bin/make.exe (expected 512; got 0): G:/library/cygwin/bin/make.exe -f
work/features/escape
.mk 'path=p\\:'
Error running G:/library/cygwin/bin/make.exe (expected 0; got 512):
G:/library/cygwin/bin/
make.exe -f work/features/escape.mk 'foo bar'
FAILED (3/6 passed)
features/export ......................................... FAILED (9/10
passed)
features/include ........................................ ok     (5 passed)
features/mult_rules ..................................... ok     (2 passed)
features/mult_targets ................................... ok     (2 passed)
features/order_only ..................................... ok     (9 passed)
features/override ....................................... ok     (1 passed)
features/parallelism .................................... FAILED (2/3
passed)
features/patspecific_vars ............................... Error running
G:/library/cygwin/
bin/make.exe (expected 0; got 512): G:/library/cygwin/bin/make.exe -f
work/features/patspe
cific_vars.mk
FAILED (6/7 passed)
features/patternrules ................................... ok     (1 passed)
features/quoting ........................................ Error running
G:/library/cygwin/
bin/make.exe (expected 0; got 512): G:/library/cygwin/bin/make.exe -f
work/features/quotin
g.mk
FAILED (0/1 passed)
features/recursion ...................................... FAILED (1/2
passed)
features/reinvoke ....................................... ok     (3 passed)
features/statipattrules ................................. ok     (4 passed)
features/targetvars ..................................... ok     (18 passed)
features/varnesting ..................................... ok     (1 passed)
features/vpath .......................................... ok     (1 passed)
features/vpath2 ......................................... ok     (1 passed)
features/vpathgpath ..................................... ok     (1 passed)
features/vpathplus ...................................... ok     (4 passed)
functions/abspath ....................................... Error running
G:/library/cygwin/
bin/make.exe (expected 0; got 512): G:/library/cygwin/bin/make.exe -f
work/functions/abspa
th.mk
FAILED (0/1 passed)
functions/addprefix ..................................... ok     (1 passed)
functions/addsuffix ..................................... ok     (2 passed)
functions/basename ...................................... ok     (1 passed)
functions/call .......................................... ok     (2 passed)
functions/dir ........................................... ok     (1 passed)
functions/error ......................................... ok     (4 passed)
functions/eval .......................................... FAILED (7/8
passed)
functions/filter-out .................................... ok     (1 passed)
functions/findstring .................................... ok     (1 passed)
functions/foreach ....................................... ok     (1 passed)
functions/if ............................................ ok     (1 passed)
functions/join .......................................... ok     (1 passed)
functions/notdir ........................................ ok     (1 passed)
functions/origin ........................................ ok     (1 passed)
functions/realpath ...................................... ok     (1 passed)
functions/sort .......................................... ok     (1 passed)
functions/strip ......................................... ok     (2 passed)
functions/substitution .................................. ok     (3 passed)
functions/suffix ........................................ ok     (1 passed)
functions/value ......................................... ok     (1 passed)
functions/warning ....................................... ok     (4 passed)
functions/wildcard ...................................... ok     (3 passed)
functions/word .......................................... ok     (9 passed)
misc/general1 ........................................... ok     (1 passed)
misc/general2 ........................................... ok     (1 passed)
misc/general3 ........................................... ok     (2 passed)
misc/general4 ........................................... ok     (1 passed)
options/dash-B .......................................... ok     (3 passed)
options/dash-C ..........................................
*** Test died (options/dash-C): scripts/options/dash-C: 41 ->
test_driver.pl: 637: Couldn't open work/options/dash-C.base: No such file or
directory

ok     (3 passed)
...
12 Tests in 36 Categories Failed (See .diff files in work dir for details)
:-(

Kind regards
Jerker Bäck