Re: script suggestion: 'check_program' to easily run multiple tests

[Pádraig Brady]

On 01/24/2014 07:05 PM, Assaf Gordon wrote:
> Hello,
> 
> Attached is a small script I've been using.
> It helps running multiple tests for a given program.
> 
> example:
>   ./scripts/check_program sort
> 
> Will find all sort-related tests (based on filename) and run them.
> Adding "-e" or "-v" also runs expensive and very expensive tests:
> 
> examle:
>   ./scripts/check_program -v sort
> 
> is equivalent to:
>    make check VERBOSE=yes SUBDIRS=. \
>               RUN_EXPENSIVE_TESTS=yes \ RUN_VERY_EXPENSIVE_TESTS=yes \
>               TESTS="./tests/misc/sort-NaN-infloop.sh
>                  ./tests/misc/sort-benchmark-random.sh
>                  ./tests/misc/sort-compress-hang.sh
>                  ./tests/misc/sort-compress-proc.sh
>                  ./tests/misc/sort-compress.sh
>                  ./tests/misc/sort-continue.sh
>                  ./tests/misc/sort-debug-keys.sh
>                  ./tests/misc/sort-debug-warn.sh
>                  ./tests/misc/sort-discrim.sh
>                  ./tests/misc/sort-exit-early.sh
>                  ./tests/misc/sort-files0-from.pl
>                  ./tests/misc/sort-float.sh
>                  ./tests/misc/sort-merge-fdlimit.sh
>                  ./tests/misc/sort-merge.pl
>                  ./tests/misc/sort-month.sh
>                  ./tests/misc/sort-rand.sh
>                  ./tests/misc/sort-spinlock-abuse.sh
>                  ./tests/misc/sort-stale-thread-mem.sh
>                  ./tests/misc/sort-u-FMR.sh
>                  ./tests/misc/sort-unique-segv.sh
>                  ./tests/misc/sort-unique.sh
>                  ./tests/misc/sort-version.sh
>                  ./tests/misc/sort.pl"
> 
> 
> If others find it useful, you're welcomed to add this.

This is a good idea.
I have something similar (attached) where I can pass a test or a test directory 
or program.
The most common use I have for that is: ./make --test tests/misc/test-name.sh

Since there are multiple --test modes, I suppose we could merge both
our scripts to a ./check script?

The other modes in my `make` script would probably be best as make targets.

thanks,
Pádraig.

make
Description: Text document