[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[FYI] New public temporary branch, about improved handling and parsing o
From: |
Stefano Lattarini |
Subject: |
[FYI] New public temporary branch, about improved handling and parsing of test results |
Date: |
Thu, 30 Jun 2011 16:52:20 +0200 |
User-agent: |
KMail/1.13.3 (Linux/2.6.30-2-686; KDE/4.4.4; i686; ; ) |
On Wednesday 29 June 2011, Stefano Lattarini wrote:
> Reference:
> <http://lists.gnu.org/archive/html/automake-patches/2011-06/msg00199.html>
>
> The new code for parsing the testsuite-generated `.log' files,
> as introduced in commit `v1.11-872-gc96b881', considers each
> `:test-result:' field anywhere in a `.log' file as a declaration
> of a test result, and accounts for it as such in the testsuite
> summary. Unfortunately this could easily cause spurious test
> failures being reported in the testsuite summary. This happened
> in practice with the Automake's own testsuite; for example:
>
> $ make check TESTS='check12-p.test'; echo exit: $?
> ...
> PASS: check12-p.test
> =====================================
> 4 of 5 tests failed
> See tests/test-suite.log
> Please report to address@hidden
> =====================================
> make[2]: *** [test-suite.log] Error 1
> make: *** [check-am] Error 2
> exit: 2
>
> This change introduces a new special `:test-result:' "END", that,
> when seen, prevents the rest of the log file from being parsed.
>
> OK for the 'test-protocols' branch?
>
> Regards,
> Stefano
>
For the moment, since I need to write more patches on the top of this,
I've pushed this patch to a new temporary public branch:
- GSoC/experimental/test-results-work
Notice that this branch is bound to be amended and rebased, and finally
deleted (it won't be merged in the 'test-protocols' branch, rather its
changes will be re-applied on the top of that). As usual, reviews are
welcome.
Regards,
Stefano
- [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite, Stefano Lattarini, 2011/06/22
- Re: [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite, Ralf Wildenhues, 2011/06/22
- Re: [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite, Stefano Lattarini, 2011/06/23
- Re: [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite, Ralf Wildenhues, 2011/06/23
- Re: [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite, Stefano Lattarini, 2011/06/23
- Re: [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite, Stefano Lattarini, 2011/06/24
- [PATCH] parallel-tests: make parsing of test results safer (was: Re: [PATCH] {test-protocols} parallel-tests: fix bug in Automake's own testsuite), Stefano Lattarini, 2011/06/29
- [FYI] New public temporary branch, about improved handling and parsing of test results,
Stefano Lattarini <=