kc3-lang/automake/tests/testsuite-summary-reference-log.test

• Show log

  Commit

• Hash : eaac33fe
  Author :
  Date : 2011-07-01T11:12:31
  

  parallel-tests: simplify testsuite summary
  
  Prefer a more deterministic, "tabular" format for the testsuite
  summary, always listing the numbers of passed, failed, xfailed,
  xpassed, skipped and errored tests, even when these numbers are
  zero.  This simplify the logic of testsuite summary creation,
  makes it more easily machine-parseable, and will probably allow
  for easier addition of new kinds of test results in the future.
  
  * lib/am/check.am (am__tty_colors_dummy): New make variable, to
  reduce code duplication.  Extracted from previous versions of
  $(am__tty_colors), and extended by defining two new variables
  `$mgn' and `$brg'.
  [%?COLOR%, %!?COLOR%] (am__tty_colors): Use that new variable.
  (am__text_box): Delete, is not needed anymore.
  ($(TEST_SUITE_LOG)): Rewrite associated rules to implement the
  new testsuite summary format.
  * NEWS: Update.
  * tests/check10.test: Don't run with the parallel-tests harness
  too, that makes no sense anymore.
  * tests/color.test: Update and adjust.
  * tests/color2.test: Likewise.
  * tests/parallel-tests.test: Likewise.
  * tests/parallel-tests3.test: Likewise.
  * tests/parallel-tests6.test: Likewise.
  * tests/parallel-tests9.test: Likewise.
  * tests/parallel-tests-unreadable-log.test: Likewise.
  * tests/parallel-tests-empty-testlogs.test: Likewise.
  * tests/parallel-tests-log-override-recheck.test: Likewise.
  * tests/parallel-tests-no-spurious-summary.test: Likewise.
  * tests/test-driver-custom-multitest.test: Likewise.
  * tests/test-driver-end-test-results.test: Likewise.
  * tests/parallel-tests-no-color-in-log.test: New test.
  * tests/testsuite-summary-color.test: Likewise.
  * tests/testsuite-summary-count.test: Likewise.
  * tests/testsuite-summary-count-many.test: Likewise.
  * tests/testsuite-summary-reference-log.test: Likewise.
  * tests/testsuite-summary-checks.sh: New auxiliary script, used
  by the new tests above.
  * tests/extract-testsuite-summary: Likewise.
  * tests/trivial-test-driver: Optimize for speed when there are
  lots of of tests.
  * tests/Makefile.am (EXTRA_DIST): Distribute them.
  (testsuite-summary-color.log, testsuite-summary-count.log): Depend
  on them.
  (testsuite-summary-count-many.log): Depend on the auxiliary scripts
  'trivial-test-driver' and 'extract-testsuite-summary'.
  (TESTS): Update.
  

Download

• tests/testsuite-summary-reference-log.test

• #! /bin/sh
  # Copyright (C) 2011 Free Software Foundation, Inc.
  #
  # This program is free software; you can redistribute it and/or modify
  # it under the terms of the GNU General Public License as published by
  # the Free Software Foundation; either version 2, or (at your option)
  # any later version.
  #
  # This program is distributed in the hope that it will be useful,
  # but WITHOUT ANY WARRANTY; without even the implied warranty of
  # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  # GNU General Public License for more details.
  #
  # You should have received a copy of the GNU General Public License
  # along with this program.  If not, see <http://www.gnu.org/licenses/>.
  
  # Check that the global testsuite log file referenced in the testsuite
  # summary and in the global testsuite log itself is correct.
  
  parallel_tests=yes
  . ./defs || Exit 1
  
  mv configure.in configure.stub
  
  cat > fail << 'END'
  #!/bin/sh
  exit 1
  END
  chmod a+x fail
  
  cat configure.stub - > configure.in <<'END'
  AC_OUTPUT
  END
  
  cat > Makefile.am << 'END'
  TEST_SUITE_LOG = my_test_suite.log
  TESTS = fail
  END
  
  $ACLOCAL
  $AUTOCONF
  $AUTOMAKE -a
  
  mkdir build
  cd build
  
  ../configure
  
  $MAKE check >stdout && { cat stdout; Exit 1; }
  cat stdout
  grep '^See \./my_test_suite\.log$' stdout
  
  mkdir bar
  TEST_SUITE_LOG=bar/bar.log $MAKE -e check >stdout && { cat stdout; Exit 1; }
  cat stdout
  grep '^See \./bar/bar\.log$' stdout
  
  cd ..
  
  echo SUBDIRS = sub > Makefile.am
  mkdir sub
  echo TESTS = fail > sub/Makefile.am
  mv fail sub
  
  cat configure.stub - > configure.in <<'END'
  AC_CONFIG_FILES([sub/Makefile])
  AC_OUTPUT
  END
  
  $ACLOCAL --force
  $AUTOCONF --force
  $AUTOMAKE
  
  ./configure
  $MAKE check >stdout && { cat stdout; Exit 1; }
  cat stdout
  grep '^See sub/test-suite\.log$' stdout
  cd sub
  $MAKE check >stdout && { cat stdout; Exit 1; }
  cat stdout
  grep '^See sub/test-suite\.log$' stdout
  cd ..
  
  TEST_SUITE_LOG=foo.log $MAKE -e check >stdout && { cat stdout; Exit 1; }
  cat stdout
  grep '^See sub/foo\.log$' stdout
  
  :
  

Download