kc3-lang/automake/tests/parallel-tests-empty-testlogs.test

• Show log

  Commit

• Hash : eaac33fe
  Author :
  Date : 2011-07-01T11:12:31
  

  parallel-tests: simplify testsuite summary
  
  Prefer a more deterministic, "tabular" format for the testsuite
  summary, always listing the numbers of passed, failed, xfailed,
  xpassed, skipped and errored tests, even when these numbers are
  zero.  This simplify the logic of testsuite summary creation,
  makes it more easily machine-parseable, and will probably allow
  for easier addition of new kinds of test results in the future.
  
  * lib/am/check.am (am__tty_colors_dummy): New make variable, to
  reduce code duplication.  Extracted from previous versions of
  $(am__tty_colors), and extended by defining two new variables
  `$mgn' and `$brg'.
  [%?COLOR%, %!?COLOR%] (am__tty_colors): Use that new variable.
  (am__text_box): Delete, is not needed anymore.
  ($(TEST_SUITE_LOG)): Rewrite associated rules to implement the
  new testsuite summary format.
  * NEWS: Update.
  * tests/check10.test: Don't run with the parallel-tests harness
  too, that makes no sense anymore.
  * tests/color.test: Update and adjust.
  * tests/color2.test: Likewise.
  * tests/parallel-tests.test: Likewise.
  * tests/parallel-tests3.test: Likewise.
  * tests/parallel-tests6.test: Likewise.
  * tests/parallel-tests9.test: Likewise.
  * tests/parallel-tests-unreadable-log.test: Likewise.
  * tests/parallel-tests-empty-testlogs.test: Likewise.
  * tests/parallel-tests-log-override-recheck.test: Likewise.
  * tests/parallel-tests-no-spurious-summary.test: Likewise.
  * tests/test-driver-custom-multitest.test: Likewise.
  * tests/test-driver-end-test-results.test: Likewise.
  * tests/parallel-tests-no-color-in-log.test: New test.
  * tests/testsuite-summary-color.test: Likewise.
  * tests/testsuite-summary-count.test: Likewise.
  * tests/testsuite-summary-count-many.test: Likewise.
  * tests/testsuite-summary-reference-log.test: Likewise.
  * tests/testsuite-summary-checks.sh: New auxiliary script, used
  by the new tests above.
  * tests/extract-testsuite-summary: Likewise.
  * tests/trivial-test-driver: Optimize for speed when there are
  lots of of tests.
  * tests/Makefile.am (EXTRA_DIST): Distribute them.
  (testsuite-summary-color.log, testsuite-summary-count.log): Depend
  on them.
  (testsuite-summary-count-many.log): Depend on the auxiliary scripts
  'trivial-test-driver' and 'extract-testsuite-summary'.
  (TESTS): Update.
  

Download

• tests/parallel-tests-empty-testlogs.test

• #! /bin/sh
  # Copyright (C) 2011 Free Software Foundation, Inc.
  #
  # This program is free software; you can redistribute it and/or modify
  # it under the terms of the GNU General Public License as published by
  # the Free Software Foundation; either version 2, or (at your option)
  # any later version.
  #
  # This program is distributed in the hope that it will be useful,
  # but WITHOUT ANY WARRANTY; without even the implied warranty of
  # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  # GNU General Public License for more details.
  #
  # You should have received a copy of the GNU General Public License
  # along with this program.  If not, see <http://www.gnu.org/licenses/>.
  
  # Check parallel-tests features:
  # - empty TESTS
  # - empty TEST_LOGS
  
  parallel_tests=yes
  . ./defs || Exit 1
  
  cat >> configure.in << 'END'
  AC_CONFIG_FILES([sub1/Makefile sub2/Makefile])
  AC_OUTPUT
  END
  
  cat > Makefile.am << 'END'
  SUBDIRS = sub1 sub2
  END
  
  mkdir sub1 sub2
  
  cat > sub1/Makefile.am << 'END'
  TESTS =
  check-local:
  	echo $(TEST_LOGS) | grep . && exit 1; exit 0
  END
  
  cat > sub2/Makefile.am << 'END'
  TESTS = foo.test
  END
  
  cat > sub2/foo.test <<'END'
  #! /bin/sh
  exit 0
  END
  chmod a+x sub2/foo.test
  
  $ACLOCAL
  $AUTOCONF
  $AUTOMAKE -a
  
  no_test_has_run ()
  {
    ls -1 *.log | grep -v '^test-suite\.log$' | grep . && Exit 1
    grep '^# TOTAL: *0$' test-suite.log
    :
  }
  
  for vpath in : false; do
    if $vpath; then
      mkdir build
      cd build
      srcdir=..
    else
      srcdir=.
    fi
    $srcdir/configure
    cd sub1
    VERBOSE=yes $MAKE check
    no_test_has_run
    cd ../sub2
    VERBOSE=yes TESTS='' $MAKE -e check
    no_test_has_run
    VERBOSE=yes TEST_LOGS='' $MAKE -e check
    no_test_has_run
    cd ..
    $MAKE check
    cat sub2/foo.log
    $MAKE distclean
    cd $srcdir
  done
  
  :
  

Download