Re: testsuite on master

[Jim Meyering]

Stefano Lattarini wrote:
> On Thursday 20 October 2011, Jim Meyering wrote:
>> Stefano Lattarini wrote:
>>
>> > Feel free to push the patch to master.
>>
>> Done.
>>
> Thank you.
>
>> I saw 5 other "make check" failures on master this morning.
>> I suppose it's not worth investigating them, given how much
>> is happening in testsuite-work.
>>
> If you want to report them, I'll take a look.  I've been somewhat

Thanks.
Here you go, this is with the very latest autoconf early in my path,
but that seems not to matter.  These are all due to lack of yylex.

> sloppy for what concerns the testsuite behaviour on master lately,
> but this is not a truly acceptable behaviour, at least until we
> have a clear decision or roadmap of when and how merge testsuite-work
> back to master.


==============================================
   GNU Automake 1.11a: tests/test-suite.log
==============================================

5 of 1021 tests failed.  (93 tests were not run).

FAIL: cond35.test (exit: 2)
===========================

/h/j/w/co/automake/tests:/sbin:/usr/sbin:/bin:/usr/bin:/usr/local:/usr/local/bin
cond35: running flex --version
flex 2.5.35
cond35: running bison --version
bison (GNU Bison) 2.5
Written by Robert Corbett and Richard Stallman.

Copyright (C) 2011 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
cond35: running gcc --version
gcc (GCC) 4.6.1 20111003 (Red Hat 4.6.1-10)
Copyright (C) 2011 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

cond35: running gcc -v
Using built-in specs.
COLLECT_GCC=/usr/bin/gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.6.1/lto-wrapper
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man 
--infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla 
--enable-bootstrap --enable-shared --enable-threads=posix 
--enable-checking=release --with-system-zlib --enable-__cxa_atexit 
--disable-libunwind-exceptions --enable-gnu-unique-object 
--enable-linker-build-id 
--enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin 
--enable-java-awt=gtk --disable-dssi 
--with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre 
--enable-libgcj-multifile --enable-java-maintainer-mode 
--with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib 
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 
--build=x86_64-redhat-linux
Thread model: posix
gcc version 4.6.1 20111003 (Red Hat 4.6.1-10) (GCC)
++ set -e
++ pwd
/h/j/w/co/automake/tests/cond35.dir
+ cat
+ cat
+ aclocal-1.11a -Werror
+ autoconf
+ automake-1.11a --foreign -Werror -Wall --add-missing
configure.in: installing `./ylwrap'
++ grep tparse.h: Makefile.in
++ wc -l
+ test 1 = 1
+ cat
+ cat
+ cat
+ cp ta.c tb.c
+ ./configure
checking for a BSD-compatible install... /p/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /p/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking for flex... flex
checking lex output file root... lex.yy
checking lex library... none needed
checking whether yytext is a pointer... no
checking for bison... bison -y
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: executing depfiles commands
+ make
/bin/sh ./ylwrap tparse.y y.tab.c tparse.c y.tab.h tparse.h y.output 
tparse.output -- bison -y -d
updating tparse.h
make  all-am
make[1]: Entering directory `/h/j/w/co/automake/tests/cond35.dir'
gcc -DPACKAGE_NAME=\"cond35\" -DPACKAGE_TARNAME=\"cond35\" 
-DPACKAGE_VERSION=\"1.0\" -DPACKAGE_STRING=\"cond35\ 1.0\" 
-DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"cond35\" 
-DVERSION=\"1.0\" -I.     -g -O2 -MT ta.o -MD -MP -MF .deps/ta.Tpo -c -o ta.o 
ta.c
mv -f .deps/ta.Tpo .deps/ta.Po
/bin/sh ./ylwrap tscan.l lex.yy.c tscan.c -- flex
gcc -DPACKAGE_NAME=\"cond35\" -DPACKAGE_TARNAME=\"cond35\" 
-DPACKAGE_VERSION=\"1.0\" -DPACKAGE_STRING=\"cond35\ 1.0\" 
-DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"cond35\" 
-DVERSION=\"1.0\" -I.     -g -O2 -MT tscan.o -MD -MP -MF .deps/tscan.Tpo -c -o 
tscan.o tscan.c
mv -f .deps/tscan.Tpo .deps/tscan.Po
gcc -DPACKAGE_NAME=\"cond35\" -DPACKAGE_TARNAME=\"cond35\" 
-DPACKAGE_VERSION=\"1.0\" -DPACKAGE_STRING=\"cond35\ 1.0\" 
-DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"cond35\" 
-DVERSION=\"1.0\" -I.     -g -O2 -MT tparse.o -MD -MP -MF .deps/tparse.Tpo -c 
-o tparse.o tparse.c
mv -f .deps/tparse.Tpo .deps/tparse.Po
gcc  -g -O2   -o ta ta.o tscan.o tparse.o
tscan.o: In function `yylex':
/h/j/w/co/automake/tests/cond35.dir/tscan.c:805: undefined reference to `yywrap'
collect2: ld returned 1 exit status
make[1]: *** [ta] Error 1
make[1]: Leaving directory `/h/j/w/co/automake/tests/cond35.dir'
make: *** [all] Error 2
+ exit_status=2
+ set +e
+ cd /h/j/w/co/automake/tests
+ case $exit_status,$keep_testdirs in
+ test 0 '!=' 0
+ echo 'cond35: exit 2'
cond35: exit 2
+ exit 2

FAIL: lex3.test (exit: 2)
=========================

/h/j/w/co/automake/tests:/sbin:/usr/sbin:/bin:/usr/bin:/usr/local:/usr/local/bin
lex3: running gcc --version
gcc (GCC) 4.6.1 20111003 (Red Hat 4.6.1-10)
Copyright (C) 2011 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

lex3: running gcc -v
Using built-in specs.
COLLECT_GCC=/usr/bin/gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.6.1/lto-wrapper
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man 
--infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla 
--enable-bootstrap --enable-shared --enable-threads=posix 
--enable-checking=release --with-system-zlib --enable-__cxa_atexit 
--disable-libunwind-exceptions --enable-gnu-unique-object 
--enable-linker-build-id 
--enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin 
--enable-java-awt=gtk --disable-dssi 
--with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre 
--enable-libgcj-multifile --enable-java-maintainer-mode 
--with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib 
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 
--build=x86_64-redhat-linux
Thread model: posix
gcc version 4.6.1 20111003 (Red Hat 4.6.1-10) (GCC)
lex3: running flex --version
flex 2.5.35
lex3: determine if make is GNU make
GNU Make 3.82
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
++ set -e
++ pwd
/h/j/w/co/automake/tests/lex3.dir
+ CFLAGS=
+ export CFLAGS
+ cat
+ cat
+ cat
+ aclocal-1.11a -Werror
+ autoconf
+ automake-1.11a --foreign -Werror -Wall -a
configure.in: installing `./ylwrap'
+ ./configure
checking for a BSD-compatible install... /p/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /p/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking for flex... flex
checking lex output file root... lex.yy
checking lex library... none needed
checking whether yytext is a pointer... no
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: executing depfiles commands
+ make
/bin/sh ./ylwrap foo.l lex.yy.c foo.c -- flex
gcc -DPACKAGE_NAME=\"lex3\" -DPACKAGE_TARNAME=\"lex3\" 
-DPACKAGE_VERSION=\"1.0\" -DPACKAGE_STRING=\"lex3\ 1.0\" 
-DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"lex3\" 
-DVERSION=\"1.0\" -I.      -MT foo.o -MD -MP -MF .deps/foo.Tpo -c -o foo.o foo.c
mv -f .deps/foo.Tpo .deps/foo.Po
gcc     -o foo foo.o
foo.o: In function `yylex':
foo.c:(.text+0x3d4): undefined reference to `yywrap'
foo.o: In function `input':
foo.c:(.text+0xf15): undefined reference to `yywrap'
collect2: ld returned 1 exit status
make: *** [foo] Error 1
+ exit_status=2
+ set +e
+ cd /h/j/w/co/automake/tests
+ case $exit_status,$keep_testdirs in
+ test 0 '!=' 0
+ echo 'lex3: exit 2'
lex3: exit 2
+ exit 2

FAIL: lexvpath.test (exit: 2)
=============================

/h/j/w/co/automake/tests:/sbin:/usr/sbin:/bin:/usr/bin:/usr/local:/usr/local/bin
lexvpath: running gcc --version
gcc (GCC) 4.6.1 20111003 (Red Hat 4.6.1-10)
Copyright (C) 2011 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

lexvpath: running gcc -v
Using built-in specs.
COLLECT_GCC=/usr/bin/gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.6.1/lto-wrapper
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man 
--infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla 
--enable-bootstrap --enable-shared --enable-threads=posix 
--enable-checking=release --with-system-zlib --enable-__cxa_atexit 
--disable-libunwind-exceptions --enable-gnu-unique-object 
--enable-linker-build-id 
--enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin 
--enable-java-awt=gtk --disable-dssi 
--with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre 
--enable-libgcj-multifile --enable-java-maintainer-mode 
--with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib 
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 
--build=x86_64-redhat-linux
Thread model: posix
gcc version 4.6.1 20111003 (Red Hat 4.6.1-10) (GCC)
lexvpath: running flex --version
flex 2.5.35
++ set -e
++ pwd
/h/j/w/co/automake/tests/lexvpath.dir
+ cat
+ cat
+ cat
+ cat
+ cat
+ aclocal-1.11a -Werror
+ autoconf
+ automake-1.11a --foreign -Werror -Wall -a
configure.in: installing `./ylwrap'
+ mkdir sub
+ cd sub
+ ../configure
checking for a BSD-compatible install... /p/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /p/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking for flex... flex
checking lex output file root... lex.yy
checking lex library... none needed
checking whether yytext is a pointer... no
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating lexoutroot
config.status: executing depfiles commands
+ . ./lexoutroot
++ LEX_OUTPUT_ROOT=lex.yy
+ test -n lex.yy
+ cd ..
+ flex lexer.l
+ mv lex.yy.c lexer.c
+ cd sub
+ sleep 2
+ cat
+ make
/bin/sh ../ylwrap ../lexer.l lex.yy.c lexer.c -- flex
gcc -DPACKAGE_NAME=\"lexvpath\" -DPACKAGE_TARNAME=\"lexvpath\" 
-DPACKAGE_VERSION=\"1.0\" -DPACKAGE_STRING=\"lexvpath\ 1.0\" 
-DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"lexvpath\" 
-DVERSION=\"1.0\" -I. -I..     -g -O2 -MT lexer.o -MD -MP -MF .deps/lexer.Tpo 
-c -o lexer.o lexer.c
mv -f .deps/lexer.Tpo .deps/lexer.Po
gcc -DPACKAGE_NAME=\"lexvpath\" -DPACKAGE_TARNAME=\"lexvpath\" 
-DPACKAGE_VERSION=\"1.0\" -DPACKAGE_STRING=\"lexvpath\ 1.0\" 
-DPACKAGE_BUGREPORT=\"\" -DPACKAGE_URL=\"\" -DPACKAGE=\"lexvpath\" 
-DVERSION=\"1.0\" -I. -I..     -g -O2 -MT foo.o -MD -MP -MF .deps/foo.Tpo -c -o 
foo.o ../foo.c
mv -f .deps/foo.Tpo .deps/foo.Po
gcc  -g -O2   -o foo lexer.o foo.o
lexer.o: In function `yylex':
/h/j/w/co/automake/tests/lexvpath.dir/sub/lexer.c:812: undefined reference to 
`yywrap'
collect2: ld returned 1 exit status
make: *** [foo] Error 1
+ exit_status=2
+ set +e
+ cd /h/j/w/co/automake/tests
+ case $exit_status,$keep_testdirs in
+ test 0 '!=' 0
+ echo 'lexvpath: exit 2'
lexvpath: exit 2
+ exit 2

FAIL: silent-lex-gcc.test (exit: 1)
===================================

/h/j/w/co/automake/tests:/sbin:/usr/sbin:/bin:/usr/bin:/usr/local:/usr/local/bin
silent-lex-gcc: running flex --version
flex 2.5.35
silent-lex-gcc: running gcc --version
gcc (GCC) 4.6.1 20111003 (Red Hat 4.6.1-10)
Copyright (C) 2011 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

silent-lex-gcc: running gcc -v
Using built-in specs.
COLLECT_GCC=/usr/bin/gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.6.1/lto-wrapper
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man 
--infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla 
--enable-bootstrap --enable-shared --enable-threads=posix 
--enable-checking=release --with-system-zlib --enable-__cxa_atexit 
--disable-libunwind-exceptions --enable-gnu-unique-object 
--enable-linker-build-id 
--enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin 
--enable-java-awt=gtk --disable-dssi 
--with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre 
--enable-libgcj-multifile --enable-java-maintainer-mode 
--with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib 
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 
--build=x86_64-redhat-linux
Thread model: posix
gcc version 4.6.1 20111003 (Red Hat 4.6.1-10) (GCC)
++ set -e
++ pwd
/h/j/w/co/automake/tests/silent-lex-gcc.dir
+ mkdir sub
+ cat
+ cat
+ cat
+ cat
+ cp foo.l sub/bar.l
+ aclocal-1.11a -Werror
+ automake-1.11a --foreign -Werror -Wall --add-missing
configure.in:5: installing `./compile'
configure.in: installing `./ylwrap'
+ autoconf
+ for config_args in am_cv_CC_dependencies_compiler_type=gcc
+ ./configure am_cv_CC_dependencies_compiler_type=gcc --enable-silent-rules
checking for a BSD-compatible install... /p/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /p/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for style of include used by make... GNU
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking dependency style of gcc... (cached) gcc
checking whether gcc and cc understand -c and -o together... yes
checking for flex... flex
checking lex output file root... lex.yy
checking lex library... none needed
checking whether yytext is a pointer... no
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating sub/Makefile
config.status: executing depfiles commands
+ make
/usr/lib/gcc/x86_64-redhat-linux/4.6.1/../../../../lib64/crt1.o: In function 
`_start':
(.text+0x20): undefined reference to `main'
bar.o: In function `yylex':
/h/j/w/co/automake/tests/silent-lex-gcc.dir/sub/bar.c:812: undefined reference 
to `yywrap'
collect2: ld returned 1 exit status
make[1]: *** [bar1] Error 1
make: *** [all-recursive] Error 1
+ cat stdout
Making all in sub
make[1]: Entering directory `/h/j/w/co/automake/tests/silent-lex-gcc.dir/sub'
  LEX      bar.c
  CC       bar.o
  CCLD     bar1
make[1]: Leaving directory `/h/j/w/co/automake/tests/silent-lex-gcc.dir/sub'
+ Exit 1
+ set +e
+ exit 1
+ exit 1
+ exit_status=1
+ set +e
+ cd /h/j/w/co/automake/tests
+ case $exit_status,$keep_testdirs in
+ test 0 '!=' 0
+ echo 'silent-lex-gcc: exit 1'
silent-lex-gcc: exit 1
+ exit 1

FAIL: silent-lex-generic.test (exit: 1)
=======================================

/h/j/w/co/automake/tests:/sbin:/usr/sbin:/bin:/usr/bin:/usr/local:/usr/local/bin
silent-lex-generic: running flex --version
flex 2.5.35
++ set -e
++ pwd
/h/j/w/co/automake/tests/silent-lex-generic.dir
+ mkdir sub
+ cat
+ cat
+ cat
+ cat
+ cp foo.l sub/bar.l
+ aclocal-1.11a -Werror
+ automake-1.11a --foreign -Werror -Wall --add-missing
configure.in:5: installing `./compile'
configure.in: installing `./ylwrap'
+ autoconf
+ for config_args in --enable-dependency-tracking --disable-dependency-tracking
+ ./configure --enable-dependency-tracking --enable-silent-rules
checking for a BSD-compatible install... /p/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /p/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for style of include used by make... GNU
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking dependency style of gcc... gcc3
checking whether gcc and cc understand -c and -o together... yes
checking for flex... flex
checking lex output file root... lex.yy
checking lex library... none needed
checking whether yytext is a pointer... no
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating sub/Makefile
config.status: executing depfiles commands
+ make
/usr/lib/gcc/x86_64-redhat-linux/4.6.1/../../../../lib64/crt1.o: In function 
`_start':
(.text+0x20): undefined reference to `main'
bar.o: In function `yylex':
/h/j/w/co/automake/tests/silent-lex-generic.dir/sub/bar.c:812: undefined 
reference to `yywrap'
collect2: ld returned 1 exit status
make[1]: *** [bar1] Error 1
make: *** [all-recursive] Error 1
+ cat stdout
Making all in sub
make[1]: Entering directory 
`/h/j/w/co/automake/tests/silent-lex-generic.dir/sub'
  LEX      bar.c
  CC       bar.o
  CCLD     bar1
make[1]: Leaving directory `/h/j/w/co/automake/tests/silent-lex-generic.dir/sub'
+ Exit 1
+ set +e
+ exit 1
+ exit 1
+ exit_status=1
+ set +e
+ cd /h/j/w/co/automake/tests
+ case $exit_status,$keep_testdirs in
+ test 0 '!=' 0
+ echo 'silent-lex-generic: exit 1'
silent-lex-generic: exit 1
+ exit 1