kc3-lang/automake/tests/parallel-tests-no-spurious-summary.test

• Show log

  Commit

• Hash : 1bb5974d
  Author :
  Date : 2011-07-04T18:12:07
  

  test defs: new auxiliary function 'count_test_results'
  
  * tests/defs (count_test_results): New function.
  * tests/check11.test: Use it.
  * tests/test-driver-custom-multitest.test: Likewise.
  * tests/test-driver-custom-multitest-recheck.test: Likewise.
  * tests/test-driver-custom-multitest-recheck2.test: Likewise.
  * tests/parallel-tests-log-override-recheck.test: Likewise.
  * tests/parallel-tests-log-override-recheck.test: Likewise.
  * tests/parallel-tests-no-spurious-summary.test: Likewise, and
  slightly improve debugging output.
  * tests/parallel-tests.test: Make use of `count_test_results'.
  Also, make grepping of "make check" output slightly stricter
  * tests/parallel-tests9.test: Likewise.
  * tests/parallel-tests-log-override-2.test: Likewise, and throw
  in a small optimization.
  

Download

• tests/parallel-tests-no-spurious-summary.test

• #! /bin/sh
  # Copyright (C) 2009, 2010, 2011 Free Software Foundation, Inc.
  #
  # This program is free software; you can redistribute it and/or modify
  # it under the terms of the GNU General Public License as published by
  # the Free Software Foundation; either version 2, or (at your option)
  # any later version.
  #
  # This program is distributed in the hope that it will be useful,
  # but WITHOUT ANY WARRANTY; without even the implied warranty of
  # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  # GNU General Public License for more details.
  #
  # You should have received a copy of the GNU General Public License
  # along with this program.  If not, see <http://www.gnu.org/licenses/>.
  
  # Check that `:test-results:' directives in test scripts' output doesn't
  # originate spurious results in the testsuite summary.
  
  parallel_tests=yes
  . ./defs || Exit 1
  
  cat >> configure.in << 'END'
  AC_OUTPUT
  END
  
  cat > Makefile.am << 'END'
  TESTS = foo.test bar.test
  END
  
  cat > foo.test <<'END'
  #! /bin/sh
  echo :test-result:XFAIL
  echo :test-result: SKIP
  echo :test-result:ERROR
  exit 0
  END
  cat > bar.test <<'END'
  #! /bin/sh
  echo :test-result: ERROR
  echo :test-result:FAIL
  echo :test-result: XPASS
  exit 0
  END
  chmod a+x foo.test bar.test
  
  $ACLOCAL
  $AUTOCONF
  $AUTOMAKE -a
  
  ./configure
  
  st=0
  $MAKE check >stdout || st=$?
  cat stdout
  cat test-suite.log
  cat foo.log
  cat bar.log
  test $st -eq 0 || Exit $st
  
  grep '^:test-result:XFAIL$'  foo.log
  grep '^:test-result: SKIP$'  foo.log
  grep '^:test-result:FAIL$'   bar.log
  grep '^:test-result: XPASS$' bar.log
  
  count_test_results total=2 pass=2 fail=0 skip=0 xfail=0 xpass=0 error=0
  
  :
  

Download