kc3-lang/automake/tests/parallel-tests7.test

• Show log

  Commit

• Hash : c96b881f
  Author :
  Date : 2011-06-03T22:50:56
  

  parallel-tests: allow each test to have multiple results
  
  With this change, we improve the code creating the `test-suite.log'
  global log and the console testsuite summary to make it	able to
  grasp multiple results per test script.  This is required in order
  to introduce the planned support for test protocols, like TAP and
  SubUnit, which can indeed run multiple tests per test script, each
  with its individual result.
  
  The implementation makes use of a custom reStructuredText field
  `:test-result:'.
  
  Note that no new documentation is added by this change; that is
  be left for follow-up changes.
  
  * lib/check.am ($(TEST_SUITE_LOG)): When processing .log files,
  recognize a report of a test's result only if it is declared with
  the custom `:test-result:' reStructuredText field placed at the
  beginning of a line.  Extend and add explanatory comments.
  (recheck, recheck-html): Add explanatory comments.
  * lib/test-driver: Write an appropriate reStructuredText field
  `:test-result:' in the generated log file.  Use a reStructuredText
  transition to better separate the test outcome report from the
  test script's registered output.  Improve comments.
  * tests/test-driver-custom-xfail-tests.test: Adjust.
  * tests/parallel-tests7.test: Adjust.
  * tests/parallel-tests-empty-testlogs.test: New test.
  * tests/parallel-tests-recheck-override.test: Likewise.
  * tests/parallel-tests2.test: Extend and keep more in-sync with ...
  * tests/test-driver-custom-html.test: ... this new related test.
  * tests/test-driver-custom-no-html.test: New test.
  * tests/test-driver-custom-multitest.test: Likewise.
  * tests/test-driver-custom-multitest-recheck.test: Likewise.
  * tests/test-driver-custom-multitest-recheck2.test: Likewise.
  * tests/trivial-test-driver: New file, used by the last four tests
  above.
  * tests/Makefile.am (TESTS): Update.
  (EXTRA_DIST): Distribute `trivial-test-driver'.
  (test-driver-custom-multitest.log): Depend on `trivial-test-driver'.
  (test-driver-custom-multitest-recheck.log): Likewise.
  (test-driver-custom-multitest-recheck2.log): Likewise.
  (test-driver-custom-html.log): Likewise.
  

Download

• tests/parallel-tests7.test

• #! /bin/sh
  # Copyright (C) 2009, 2010, 2011 Free Software Foundation, Inc.
  #
  # This program is free software; you can redistribute it and/or modify
  # it under the terms of the GNU General Public License as published by
  # the Free Software Foundation; either version 2, or (at your option)
  # any later version.
  #
  # This program is distributed in the hope that it will be useful,
  # but WITHOUT ANY WARRANTY; without even the implied warranty of
  # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  # GNU General Public License for more details.
  #
  # You should have received a copy of the GNU General Public License
  # along with this program.  If not, see <http://www.gnu.org/licenses/>.
  
  # Check parallel-tests features:
  # - per-extension test drivers
  
  parallel_tests=yes
  . ./defs || Exit 1
  cat >> configure.in << 'END'
  AC_PROG_CC
  AC_OUTPUT
  END
  
  cat > Makefile.am << 'END'
  ## Note that automake should not match the '/test' part
  ## of 'sub/test' as '.test' suffix.
  TESTS = foo.chk bar.test $(check_PROGRAMS) sub/test
  check_PROGRAMS = baz bla.test bli.suff
  TEST_EXTENSIONS = .chk .test
  CHK_LOG_COMPILER = ./chk-compiler
  TEST_LOG_COMPILER = ./test-compiler
  LOG_COMPILER = ./noext-compiler
  AM_CHK_LOG_FLAGS = 1
  CHK_LOG_FLAGS = 2
  AM_TEST_LOG_FLAGS = 3
  TEST_LOG_FLAGS = 4
  AM_LOG_FLAGS = 5
  LOG_FLAGS = 6
  END
  
  mkdir sub
  
  cat >chk-compiler <<'END'
  #! /bin/sh
  echo $0 "$@"
  shift
  shift
  exec "$@"
  exit 127
  END
  chmod a+x chk-compiler
  cp chk-compiler test-compiler
  cp chk-compiler noext-compiler
  
  cat >foo.chk << 'END'
  #! /bin/sh
  exit 0
  END
  chmod a+x foo.chk
  cp foo.chk bar.test
  cp foo.chk sub/test
  
  cat >baz.c << 'END'
  int main (void)
  {
    return 0;
  }
  END
  cp baz.c bla.c
  cp baz.c bli.c
  
  $ACLOCAL
  $AUTOCONF
  $AUTOMAKE -a
  
  ./configure
  $MAKE
  $MAKE check
  grep 'chk-compiler  *1  *2' foo.log
  grep 'test-compiler  *3  *4' bar.log
  grep 'noext-compiler  *5  *6' baz.log
  grep 'test-compiler  *3  *4' bla.log
  grep 'noext-compiler  *5  *6' bli.suff.log
  grep 'noext-compiler  *5  *6' sub/test.log
  :
  

Download