kc3-lang/automake/t/parallel-tests9.sh

• Show log

  Commit

• Hash : 19d84bc3
  Author :
  Date : 2012-07-06T14:35:04
  

  tests: ignore minor 'recheck' regression for BSD make
  
  It turns out that, with NetBSD 5.1 make and FreeBSD 9 make, running
  "make recheck" two times in a row quickly fails to correctly re-run
  the failed tests in the second run.
  
  That issue has been introduced likely introduced in commit
  'v1.12.1-95-gd5443e4' of 20102-07-01, "parallel-tests: reimplement
  fix for bug#11791".
  
  Anyway, the use case that has been broken is not realistic (who is
  going to run "make recheck" two times in one second, without modifying
  any of the tests or the tested programs in the meantime?), so we believe
  the best fix is to simply work around the issue in the affected test
  cases, rather than risking to slow down or uglify the 'recheck' rule.
  
  * t/parallel-tests9.sh: Enhance a little.
  * t/tap-recheck.sh: Adjust adding proper '$sleep' calls were required.
  * t/parallel-tests-log-override-recheck.sh: Likewise.
  * t/test-driver-custom-multitest-recheck.sh: Likewise.
  * t/test-driver-custom-multitest-recheck2.sh: Likewise.
  
  Signed-off-by: Stefano Lattarini <stefano.lattarini@gmail.com>
  

Download

• t/parallel-tests9.sh

• #! /bin/sh
  # Copyright (C) 2009-2012 Free Software Foundation, Inc.
  #
  # This program is free software; you can redistribute it and/or modify
  # it under the terms of the GNU General Public License as published by
  # the Free Software Foundation; either version 2, or (at your option)
  # any later version.
  #
  # This program is distributed in the hope that it will be useful,
  # but WITHOUT ANY WARRANTY; without even the implied warranty of
  # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
  # GNU General Public License for more details.
  #
  # You should have received a copy of the GNU General Public License
  # along with this program.  If not, see <http://www.gnu.org/licenses/>.
  
  # Check parallel-tests features:
  # - recheck
  
  . ./defs || exit 1
  
  cat >> configure.ac << 'END'
  AC_OUTPUT
  END
  
  cat > Makefile.am << 'END'
  TEST_SUITE_LOG = mylog.log
  TESTS = foo.test bar.test baz.test
  check_SCRIPTS = bla
  CLEANFILES = bla
  bla:
  	echo bla > $@
  END
  
  cat > foo.test <<'END'
  #! /bin/sh
  echo "this is $0"
  test -f bla || exit 1
  exit 0
  END
  cat > bar.test <<'END'
  #! /bin/sh
  echo "this is $0"
  exit 99
  END
  cat > baz.test <<'END'
  #! /bin/sh
  echo "this is $0"
  exit 1
  END
  chmod a+x foo.test bar.test baz.test
  
  $ACLOCAL
  $AUTOCONF
  $AUTOMAKE -a
  
  ./configure
  $MAKE check >stdout && { cat stdout; exit 1; }
  cat stdout
  count_test_results total=3 pass=1 fail=1 skip=0 xfail=0 xpass=0 error=1
  
  # Running this two times in a row should produce the same results the
  # second time.
  for i in 1 2; do
    using_gmake || $sleep # Required by BSD make.
    $MAKE recheck >stdout && { cat stdout; exit 1; }
    cat stdout
    count_test_results total=2 pass=0 fail=1 skip=0 xfail=0 xpass=0 error=1
    grep 'foo\.test' stdout && exit 1
    grep '^ERROR: bar\.test$' stdout
    grep '^FAIL: baz\.test$' stdout
  done
  
  # Ensure that recheck builds check_SCRIPTS, and that
  # recheck reruns nothing if check has not been run.
  $MAKE clean
  $MAKE recheck
  test -f bla
  test ! -e foo.log
  test ! -e bar.log
  test ! -e baz.log
  test -f mylog.log
  
  :
  

Download