kc3-lang/automake/tests/parallel-tests3.test

• Show log

  Commit

• Hash : eaac33fe
  Author :
  Date : 2011-07-01T11:12:31
  

  parallel-tests: simplify testsuite summary
  
  Prefer a more deterministic, "tabular" format for the testsuite
  summary, always listing the numbers of passed, failed, xfailed,
  xpassed, skipped and errored tests, even when these numbers are
  zero.  This simplify the logic of testsuite summary creation,
  makes it more easily machine-parseable, and will probably allow
  for easier addition of new kinds of test results in the future.
  
  * lib/am/check.am (am__tty_colors_dummy): New make variable, to
  reduce code duplication.  Extracted from previous versions of
  $(am__tty_colors), and extended by defining two new variables
  `$mgn' and `$brg'.
  [%?COLOR%, %!?COLOR%] (am__tty_colors): Use that new variable.
  (am__text_box): Delete, is not needed anymore.
  ($(TEST_SUITE_LOG)): Rewrite associated rules to implement the
  new testsuite summary format.
  * NEWS: Update.
  * tests/check10.test: Don't run with the parallel-tests harness
  too, that makes no sense anymore.
  * tests/color.test: Update and adjust.
  * tests/color2.test: Likewise.
  * tests/parallel-tests.test: Likewise.
  * tests/parallel-tests3.test: Likewise.
  * tests/parallel-tests6.test: Likewise.
  * tests/parallel-tests9.test: Likewise.
  * tests/parallel-tests-unreadable-log.test: Likewise.
  * tests/parallel-tests-empty-testlogs.test: Likewise.
  * tests/parallel-tests-log-override-recheck.test: Likewise.
  * tests/parallel-tests-no-spurious-summary.test: Likewise.
  * tests/test-driver-custom-multitest.test: Likewise.
  * tests/test-driver-end-test-results.test: Likewise.
  * tests/parallel-tests-no-color-in-log.test: New test.
  * tests/testsuite-summary-color.test: Likewise.
  * tests/testsuite-summary-count.test: Likewise.
  * tests/testsuite-summary-count-many.test: Likewise.
  * tests/testsuite-summary-reference-log.test: Likewise.
  * tests/testsuite-summary-checks.sh: New auxiliary script, used
  by the new tests above.
  * tests/extract-testsuite-summary: Likewise.
  * tests/trivial-test-driver: Optimize for speed when there are
  lots of of tests.
  * tests/Makefile.am (EXTRA_DIST): Distribute them.
  (testsuite-summary-color.log, testsuite-summary-count.log): Depend
  on them.
  (testsuite-summary-count-many.log): Depend on the auxiliary scripts
  'trivial-test-driver' and 'extract-testsuite-summary'.
  (TESTS): Update.
  

Download

• tests/parallel-tests3.test

• #! /bin/sh
  # Copyright (C) 2009, 2010, 2011 Free Software Foundation, Inc.
  #
  # This program is free software; you can redistribute it and/or modify
  # it under the terms of the GNU General Public License as published by
  # the Free Software Foundation; either version 2, or (at your option)
  # any later version.
  #
  # This program is distributed in the hope that it will be useful,
  # but WITHOUT ANY WARRANTY; without even the implied warranty of
  # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  # GNU General Public License for more details.
  #
  # You should have received a copy of the GNU General Public License
  # along with this program.  If not, see <http://www.gnu.org/licenses/>.
  
  # Check parallel-tests features:
  # - concurrent parallel execution
  
  parallel_tests=yes
  required=GNUmake
  . ./defs || Exit 1
  
  # This test does not work well if $MAKE contains -j.
  case $MAKE in
  *\ -j*) Exit 77 ;;
  esac
  
  cat >> configure.in << 'END'
  AC_OUTPUT
  END
  
  cat > Makefile.am << 'END'
  TESTS =
  END
  
  for i in 1 2 3 4 5 6 7 8; do
    echo "TESTS += foo$i.test" >> Makefile.am
    cat >foo$i.test <<'END'
  #! /bin/sh
  echo "this is $0"
  # hack around maintainer-check check:
  sleep='sleep '1
  $sleep
  exit 0
  END
    chmod a+x foo$i.test
  done
  
  $ACLOCAL
  $AUTOCONF
  $AUTOMAKE -a
  
  for build in serial parallel; do
    mkdir $build
    cd $build
    ../configure
    $MAKE
    cd ..
  done
  
  cd serial
  $MAKE -j1 check &
  cd ../parallel
  $sleep
  # Use append mode here to avoid dropping output.
  # Yes, this actually happens.
  : >stdout
  $MAKE -j4 check >> stdout
  cd ..
  kill $!
  cat parallel/stdout
  test `grep -c '^PASS:' parallel/stdout` -eq 8
  
  # Wait long enough so that there are no open files any more
  # when the post-test cleanup runs.
  while test ! -f serial/test-suite.log
  do
    $sleep
  done
  $sleep
  :
  

Download