[bug-recutils] recutils 1.3.90 testing - test failures

[Bruno Haible]

Hi José,

"All 8 tests passed" was only seen on one platform: Linux/MIPS.

1) "1 of 8 tests failed"
FAIL: recfix.sh
seen on Linux/x86_64, Linux/hppa, Linux/ia64, Linux/PowerPC, Linux/SPARC,
MacOS X 10.5 in 32-bit mode, FreeBSD 6.4, IRIX 6.5.

For example on Linux/x86_64:

Running recfix test(s): 
  recfix-with-operation ok
  recfix-type-int-valid ok
  recfix-type-int-invalid xfail
  recfix-type-real-valid ok
  recfix-type-real-invalid xfail
  recfix-duplicated-keys xfail
  recfix-missing-mandatory xfail
  recfix-several-unique xfail
  recfix-referred-type ok
  recfix-hidden-type ok
  recfix-ranges-ok ok
  recfix-ranges-xfail-1 xfail
  recfix-ranges-xfail-2 xfail
  recfix-one-rec ok
  recfix-multiple-rec-in-descriptor xfail
  recfix-enum-valid ok
  recfix-enum-invalid-1 xfail
  recfix-enum-invalid-2 xfail
  recfix-prohibited-fields-ok ok
  recfix-prohibited-fields-fail xfail
  recfix-auto-int ok
  recfix-auto-range ok
  recfix-auto-date ok
  recfix-auto-notype xfail
  recfix-auto-nofex xfail
  recfix-size-invalid-1 xfail
  recfix-size-invalid-2 xfail
  recfix-size-exact-zero ok
  recfix-size-exact-zero-invalid xfail
  recfix-size-exact ok
  recfix-size-exact-invalid xfail
  recfix-size-less ok
  recfix-size-less-invalid xfail
  recfix-size-less-equal ok
  recfix-size-less-equal-invalid xfail
  recfix-size-bigger ok
  recfix-size-bigger-invalid xfail
  recfix-size-bigger-equal ok
  recfix-size-bigger-equal-invalid xfail
  recfix-size-several xfail
  recfix-typedef-valid ok
  recfix-typedef-valid-xfail xfail
  recfix-typedef-valid-with-blanks ok
  recfix-typedef-valid-with-blanks-xfail xfail
  recfix-typedef-valid-order ok
  recfix-typedef-valid-order-xfail xfail
  recfix-typedef-valid-chain ok
  recfix-typedef-valid-chain-xfail xfail
  recfix-typedef-valid-multiple ok
  recfix-typedef-valid-multiple-xfail xfail
  recfix-typedef-invalid-bad-type xfail
  recfix-typedef-invalid-chain-undefined xfail
  recfix-typedef-invalid-chain-loop xfail
  recfix-sortcheck-valid ok
  recfix-sortcheck-with-blanks ok
  recfix-sortcheck-invalid-empty xfail
  recfix-sortcheck-invalid-field-name xfail
  recfix-confidential ok
  recfix-confidential-several ok
  recfix-confidential-with-unencrypted-fields error (expected failure)
  recfix-encrypt error (see recfix-encrypt.err)
  recfix-encrypt-password-long error (see recfix-encrypt-password-long.err)
  recfix-encrypt-without-password xfail
  recfix-encrypt-password-before-operation xfail
  recfix-encrypt-already-encrypted xfail
  recfix-encrypt-already-encrypted-force error (see 
recfix-encrypt-already-encrypted-force.err)
  recfix-decrypt error (see recfix-decrypt.err)
  recfix-decrypt-invalid-password error (see 
recfix-decrypt-invalid-password.err)
  recfix-sort-several-fields-invalid xfail
  recfix-sort-ints ok
  recfix-sort-ranges ok
  recfix-sort-reals ok
  recfix-sort-lex ok
  recfix-sort-dates ok
  recfix-sort-booleans ok
FAIL: recfix.sh

Here's the files recfix-decrypt.err, recfix-decrypt-invalid-password.err:
/tmp/recutils-1.3.90/utils/.libs/recfix: unrecognized option '--decrypt'

Here's the files recfix-encrypt.err, 
recfix-encrypt-already-encrypted-force.err, recfix-encrypt-password-long.err:
/tmp/recutils-1.3.90/utils/.libs/recfix: unrecognized option '--encrypt'


2) "2 of 8 tests failed"
seen on MacOS X 10.5 in 64-bit mode,

FAIL: recfix.sh (see above)

Running recdel test(s): 
  recdel-first ./testutils.sh: line 104: 99784 Done                    cat 
multiple-records.in
     99785 Segmentation fault      | recdel -n 0 > recdel-first.out 2> 
recdel-first.err
error (see recdel-first.err)
  recdel-second ./testutils.sh: line 104:   263 Done                    cat 
multiple-records.in
       264 Segmentation fault      | recdel -n 1 > recdel-second.out 2> 
recdel-second.err
error (see recdel-second.err)
  recdel-last ./testutils.sh: line 104:   504 Done                    cat 
multiple-records.in
       506 Segmentation fault      | recdel -n 2 > recdel-last.out 2> 
recdel-last.err
error (see recdel-last.err)
  recdel-comment ./testutils.sh: line 104:   742 Done                    cat 
multiple-records.in
       744 Segmentation fault      | recdel -n 1 -c > recdel-comment.out 2> 
recdel-comment.err
error (see recdel-comment.err)
  recdel-sex ./testutils.sh: line 104:   990 Done                    cat 
multiple-records.in
       991 Segmentation fault      | recdel -e "field2 = 'value22'" > 
recdel-sex.out 2> recdel-sex.err
error (see recdel-sex.err)
  recdel-try-type ./testutils.sh: line 104:  1218 Done                    cat 
multiple-named.in
      1220 Segmentation fault      | recdel -t Type2 > recdel-try-type.out 2> 
recdel-try-type.err
xfail
  recdel-type ./testutils.sh: line 104:  1454 Done                    cat 
multiple-named.in
      1455 Segmentation fault      | recdel --force -t Type2 > recdel-type.out 
2> recdel-type.err
error (see recdel-type.err)
  recdel-request-all xfail
  recdel-force-all ok
  recdel-integrity-fail ./testutils.sh: line 104:  1762 Done                    
cat integrity-fail.in
      1763 Segmentation fault      | recdel -t IntegrityFail -n 0 > 
recdel-integrity-fail.out 2> recdel-integrity-fail.err
xfail
  recdel-force-restrictions ./testutils.sh: line 104:  2000 Done                
    cat integrity-fail.in
      2002 Segmentation fault      | recdel --force -t IntegrityFail -n 0 > 
recdel-force-restrictions.out 2> recdel-force-restrictions.err
error (see recdel-force-restrictions.err)
  recdel-external-fail ./testutils.sh: line 104:  2220 Done                    
cat external.in
      2221 Segmentation fault      | recdel -t External -n 0 > 
recdel-external-fail.out 2> recdel-external-fail.err
xfail
  recdel-no-external ./testutils.sh: line 104:  2476 Done                    
cat external.in
      2477 Segmentation fault      | recdel --no-external -t External -n 0 > 
recdel-no-external.out 2> recdel-no-external.err
error (see recdel-no-external.err)
FAIL: recdel.sh


Reminder that on this platform we have the gcc warnings:

recdel.c: In function 'recdel_parse_args':
recdel.c:250: warning: implicit declaration of function 'xstrdup'
recdel.c:250: warning: assignment makes pointer from integer without a cast
recdel.c:250: warning: assignment makes pointer from integer without a cast
recdel.c:250: warning: assignment makes pointer from integer without a cast


3) "8 of 8 tests failed"
seen on Cygwin 1.5, mingw (with Cygwin as build environment).

Running recinf test(s): 
  recinf-empty error (see recinf-empty.err)
  recinf-one-record error (see recinf-one-record.err)
  recinf-multiple-records error (see recinf-multiple-records.err)
  recinf-multiple-named error (see recinf-multiple-named.err)
  recinf-multiple-named-descriptors error (see 
recinf-multiple-named-descriptors.err)
  recinf-multiple-types error (see recinf-multiple-types.err)
  recinf-names-only error (see recinf-names-only.err)
FAIL: recinf.sh
Running recsel test(s): 
  recsel-all-fields error (see recsel-all-fields.err)
  recsel-one-field error (see recsel-one-field.err)
  recsel-two-fields error (see recsel-two-fields.err)
  recsel-values error (see recsel-values.err)
  recsel-multiple-values error (see recsel-multiple-values.err)
  recsel-collapsed error (see recsel-collapsed.err)
  recsel-values-collapsed error (see recsel-values-collapsed.err)
  recsel-row error (see recsel-row.err)
  recsel-collapsed-row error (see recsel-collapsed-row.err)
  recsel-multi-all-fields error (see recsel-multi-all-fields.err)
  recsel-multi-values error (see recsel-multi-values.err)
  recsel-multi-collapsed-values error (see recsel-multi-collapsed-values.err)
  recsel-count error (see recsel-count.err)
  recsel-subs error (see recsel-subs.err)
  recsel-subs-2 error (see recsel-subs-2.err)
  recsel-index error (see recsel-index.err)
  recsel-index error (see recsel-index.err)
  recsel-type error (see recsel-type.err)
  recsel-type-2 error (see recsel-type-2.err)
  recsel-type-3 error (see recsel-type-3.err)
  recsel-type-4 error (see recsel-type-4.err)
  recsel-sex-field-names error (see recsel-sex-field-names.err)
  recsel-sex-field-names-2 error (see recsel-sex-field-names-2.err)
  recsel-sex-integer-equal error (see recsel-sex-integer-equal.err)
  recsel-sex-integer-nonequal error (see recsel-sex-integer-nonequal.err)
  recsel-sex-integer-lessthan error (see recsel-sex-integer-lessthan.err)
  recsel-sex-integer-biggerthan error (see recsel-sex-integer-biggerthan.err)
  recsel-sex-integer-plus error (see recsel-sex-integer-plus.err)
  recsel-sex-integer-minus error (see recsel-sex-integer-minus.err)
  recsel-sex-integer-mul error (see recsel-sex-integer-mul.err)
  recsel-sex-integer-div error (see recsel-sex-integer-div.err)
  recsel-sex-integer-mod error (see recsel-sex-integer-mod.err)
  recsel-sex-integer-not error (see recsel-sex-integer-not.err)
  recsel-sex-integer-and error (see recsel-sex-integer-and.err)
  recsel-sex-integer-or error (see recsel-sex-integer-or.err)
  recsel-sex-real-equal error (see recsel-sex-real-equal.err)
  recsel-sex-real-nonequal error (see recsel-sex-real-nonequal.err)
  recsel-sex-real-lessthan error (see recsel-sex-real-lessthan.err)
  recsel-sex-real-biggerthan error (see recsel-sex-real-biggerthan.err)
  recsel-sex-real-plus error (see recsel-sex-real-plus.err)
  recsel-sex-real-mul error (see recsel-sex-real-mul.err)
  recsel-sex-sharp-zero error (see recsel-sex-sharp-zero.err)
  recsel-sex-sharp-one error (see recsel-sex-sharp-one.err)
  recsel-sex-sharp-multiple error (see recsel-sex-sharp-multiple.err)
  recsel-sex-match error (see recsel-sex-match.err)
  recsel-sex-date-sametime error (see recsel-sex-date-sametime.err)
  recsel-sex-date-before error (see recsel-sex-date-before.err)
  recsel-sex-date-after error (see recsel-sex-date-after.err)
  recsel-sex-conditional-1 error (see recsel-sex-conditional-1.err)
  recsel-sex-conditional-2 error (see recsel-sex-conditional-2.err)
  recsel-sex-string-single-quote error (see recsel-sex-string-single-quote.err)
  recsel-sex-string-double-quote error (see recsel-sex-string-double-quote.err)
  recsel-sex-string-multiline error (see recsel-sex-string-multiline.err)
FAIL: recsel.sh
Running recdel test(s): 
  recdel-first error (see recdel-first.err)
  recdel-second error (see recdel-second.err)
  recdel-last error (see recdel-last.err)
  recdel-comment error (see recdel-comment.err)
  recdel-sex error (see recdel-sex.err)
  recdel-try-type xfail
  recdel-type error (see recdel-type.err)
  recdel-request-all xfail
  recdel-force-all error (see recdel-force-all.err)
  recdel-integrity-fail xfail
  recdel-force-restrictions error (see recdel-force-restrictions.err)
  recdel-external-fail xfail
  recdel-no-external error (see recdel-no-external.err)
FAIL: recdel.sh
Running recins test(s): 
  recins-empty error (see recins-empty.err)
  recins-empty-with-type error (see recins-empty-with-type.err)
  recins-several-fields error (see recins-several-fields.err)
  recins-append error (see recins-append.err)
  recins-append-in-type error (see recins-append-in-type.err)
  recins-append-new-type error (see recins-append-new-type.err)
  recins-replace error (see recins-replace.err)
  recins-replace-sex error (see recins-replace-sex.err)
  recins-violate-restrictions xfail
  recins-force-restrictions error (see recins-force-restrictions.err)
  recins-only-descriptor error (see recins-only-descriptor.err)
  recins-comments-and-descriptor error (see recins-comments-and-descriptor.err)
  recins-external-descriptor error (see recins-external-descriptor.err)
  recins-auto-fields error (see recins-auto-fields.err)
  recins-auto-fields-several error (see recins-auto-fields-several.err)
  recins-no-auto error (see recins-no-auto.err)
  recins-auto-range-overflow xfail
  recins-auto-range-overflow-force error (see 
recins-auto-range-overflow-force.err)
FAIL: recins.sh
Running recset test(s): 
  recset-append-field error (see recset-append-field.err)
  recset-set-field error (see recset-set-field.err)
  recset-delete-field error (see recset-delete-field.err)
  recset-comment-out-field error (see recset-comment-out-field.err)
  recset-delete-non-existant error (see recset-delete-non-existant.err)
  recset-comment-out-fex-first error (see recset-comment-out-fex-first.err)
  recset-comment-out-fex-last error (see recset-comment-out-fex-last.err)
  recset-violate-integrity xfail
  recset-force-integrity error (see recset-force-integrity.err)
  recset-rename error (see recset-rename.err)
  recset-rename-first error (see recset-rename-first.err)
  recset-rename-middle error (see recset-rename-middle.err)
  recset-rename-last error (see recset-rename-last.err)
  recset-rename-range-first error (see recset-rename-range-first.err)
  recset-rename-range-last error (see recset-rename-range-last.err)
  recset-rename-range-all error (see recset-rename-range-all.err)
  recset-rename-all error (see recset-rename-all.err)
  recset-rename-all-descriptor error (see recset-rename-all-descriptor.err)
  recset-rename-all-key error (see recset-rename-all-key.err)
  recset-rename-invalid-fex xfail
  recset-set-add-1 error (see recset-set-add-1.err)
  recset-set-add-2 error (see recset-set-add-2.err)
  recset-set-add-3 error (see recset-set-add-3.err)
FAIL: recset.sh
Running recfix test(s): 
  recfix-with-operation error (see recfix-with-operation.err)
  recfix-type-int-valid error (see recfix-type-int-valid.err)
  recfix-type-int-invalid xfail
  recfix-type-real-valid error (see recfix-type-real-valid.err)
  recfix-type-real-invalid xfail
  recfix-duplicated-keys xfail
  recfix-missing-mandatory xfail
  recfix-several-unique xfail
  recfix-referred-type error (see recfix-referred-type.err)
  recfix-hidden-type error (see recfix-hidden-type.err)
  recfix-ranges-ok error (see recfix-ranges-ok.err)
  recfix-ranges-xfail-1 xfail
  recfix-ranges-xfail-2 xfail
  recfix-one-rec error (see recfix-one-rec.err)
  recfix-multiple-rec-in-descriptor xfail
  recfix-enum-valid error (see recfix-enum-valid.err)
  recfix-enum-invalid-1 xfail
  recfix-enum-invalid-2 xfail
  recfix-prohibited-fields-ok error (see recfix-prohibited-fields-ok.err)
  recfix-prohibited-fields-fail xfail
  recfix-auto-int error (see recfix-auto-int.err)
  recfix-auto-range error (see recfix-auto-range.err)
  recfix-auto-date error (see recfix-auto-date.err)
  recfix-auto-notype xfail
  recfix-auto-nofex xfail
  recfix-size-invalid-1 xfail
  recfix-size-invalid-2 xfail
  recfix-size-exact-zero error (see recfix-size-exact-zero.err)
  recfix-size-exact-zero-invalid xfail
  recfix-size-exact error (see recfix-size-exact.err)
  recfix-size-exact-invalid xfail
  recfix-size-less error (see recfix-size-less.err)
  recfix-size-less-invalid xfail
  recfix-size-less-equal error (see recfix-size-less-equal.err)
  recfix-size-less-equal-invalid xfail
  recfix-size-bigger error (see recfix-size-bigger.err)
  recfix-size-bigger-invalid xfail
  recfix-size-bigger-equal error (see recfix-size-bigger-equal.err)
  recfix-size-bigger-equal-invalid xfail
  recfix-size-several xfail
  recfix-typedef-valid error (see recfix-typedef-valid.err)
  recfix-typedef-valid-xfail xfail
  recfix-typedef-valid-with-blanks error (see 
recfix-typedef-valid-with-blanks.err)
  recfix-typedef-valid-with-blanks-xfail xfail
  recfix-typedef-valid-order error (see recfix-typedef-valid-order.err)
  recfix-typedef-valid-order-xfail xfail
  recfix-typedef-valid-chain error (see recfix-typedef-valid-chain.err)
  recfix-typedef-valid-chain-xfail xfail
  recfix-typedef-valid-multiple error (see recfix-typedef-valid-multiple.err)
  recfix-typedef-valid-multiple-xfail xfail
  recfix-typedef-invalid-bad-type xfail
  recfix-typedef-invalid-chain-undefined xfail
  recfix-typedef-invalid-chain-loop xfail
  recfix-sortcheck-valid error (see recfix-sortcheck-valid.err)
  recfix-sortcheck-with-blanks error (see recfix-sortcheck-with-blanks.err)
  recfix-sortcheck-invalid-empty xfail
  recfix-sortcheck-invalid-field-name xfail
  recfix-confidential error (see recfix-confidential.err)
  recfix-confidential-several error (see recfix-confidential-several.err)
  recfix-confidential-with-unencrypted-fields xfail
  recfix-encrypt error (see recfix-encrypt.err)
  recfix-encrypt-password-long error (see recfix-encrypt-password-long.err)
  recfix-encrypt-without-password xfail
  recfix-encrypt-password-before-operation xfail
  recfix-encrypt-already-encrypted xfail
  recfix-encrypt-already-encrypted-force error (see 
recfix-encrypt-already-encrypted-force.err)
  recfix-decrypt error (see recfix-decrypt.err)
  recfix-decrypt-invalid-password error (see 
recfix-decrypt-invalid-password.err)
  recfix-sort-several-fields-invalid xfail
  recfix-sort-ints error (see recfix-sort-ints.err)
  recfix-sort-ranges error (see recfix-sort-ranges.err)
  recfix-sort-reals error (see recfix-sort-reals.err)
  recfix-sort-lex error (see recfix-sort-lex.err)
  recfix-sort-dates error (see recfix-sort-dates.err)
  recfix-sort-booleans error (see recfix-sort-booleans.err)
FAIL: recfix.sh
Running recfmt test(s): 
  recfmt-empty-template error (see recfmt-empty-template.err)
  recfmt-empty-file error (see recfmt-empty-file.err)
  recfmt-all-records error (see recfmt-all-records.err)
  recfmt-slot-beginning error (see recfmt-slot-beginning.err)
  recfmt-no-prolog error (see recfmt-no-prolog.err)
  recfmt-subscripts error (see recfmt-subscripts.err)
  recfmt-non-matching-records error (see recfmt-non-matching-records.err)
  recfmt-concat error (see recfmt-concat.err)
  recfmt-empty-slot xfail
  recfmt-invalid-slot xfail
FAIL: recfmt.sh
Running rec2csv test(s): 
  rec2csv-default-record error (see rec2csv-default-record.err)
  rec2csv-missing-fields error (see rec2csv-missing-fields.err)
  rec2csv-missing-fields-first error (see rec2csv-missing-fields-first.err)
  rec2csv-multi-line error (see rec2csv-multi-line.err)
  rec2csv-escape-quotes error (see rec2csv-escape-quotes.err)
  rec2csv-repeated-fields error (see rec2csv-repeated-fields.err)
  rec2csv-repeated-missing error (see rec2csv-repeated-missing.err)
  rec2csv-default-type error (see rec2csv-default-type.err)
  rec2csv-with-type error (see rec2csv-with-type.err)
  rec2csv-nonexistant-type error (see rec2csv-nonexistant-type.err)
FAIL: rec2csv.sh

Every single test appears to fail. But all *.err files are empty.

It smells like a test suite framework problem (testutils.sh or so).

Bruno
-- 
In memoriam Bernhard Schwentner 
<http://en.wikipedia.org/wiki/Bernhard_Schwentner>