• Show log

    Commit

  • Hash : 0c81b43f
    Author : Stefano Lattarini
    Date : 2011-07-28T12:25:22

    test harness: use new `.trs' files to hold test metadata
    
    With this change, the test harness will keep test metadata in
    dedicated `.trs' files, instead of having them embedded into the
    `.log' files.  This allows for easier forward-compatibility and
    extension of test metadata, and for more flexibility in the
    format of the `.log' files.  Note that this change makes the
    `:end-metadata:' field obsolete.
    
    * doc/automake.texi (Parallel Test Harness, Log files generation
    and test results recording): Document the new APIs and behaviour;
    some related minor rewordings and fixlets.
    * NEWS: Update.
    * automake.in (handle_tests): When bringing in the content of
    `check2.am', substitute %BASE% with the basename of the `.log'
    file being created by a rule.  Add the generated `.trs' files
    to the list of files to be cleaned by "make mostlyclean".
    * lib/am/check.am (am__test_driver_flags): Rename ...
    (am__common_driver_flags): ... to this, and remove the flags
    `--test-name' and `--log-file' from it: they are now define in
    the proper rules in `check2.am'.
    (am__TEST_BASES): New internal variable, holding the names of
    the tests, with any registered extension removed.
    (am__stealth_MAKE): New internal variable, can be used instead of
    $(MAKE) in recipes requiring a recursive call to make, but which
    are not intended to be executed by "make -n".
    (.log.trs): New suffix rule, to recover from deletion of `.trs'
    files.
    ($(TEST_SUITE_LOG)): Almost completely rewritten to follow the
    new API of "test logs in `.log' files, test metadata in `.trs'
    files".  It goes to some length to work correctly in face of
    unreadable or missing `.log' and `.trs' files, and to error out
    with proper error messages when this is not possible.
    [%?PARALLEL_TESTS%] (check-TESTS): Also remove relevant "stale"
    `.trs' files (in addition to `.log files) before remaking the
    $(TEST_SUITE_LOG).
    (recheck, recheck-html): Look for the `:recheck:' field in the
    `.trs' files, not in the `.log' files.
    * lib/am/check2.am (?GENERIC?%EXT%.log, ?!GENERIC?%OBJ%): Adjust
    the call to the test driver, in particularly passing the new
    option `--trs-file'.
    [%am__EXEEXT%] (?GENERIC?%EXT%$(EXEEXT).log): Likewise.
    * lib/tap-driver ($USAGE): Adjust the help screen.
    (Getopt::Long::GetOptions): Handle the `--trs-file' option,
    through the use of ...
    ($trs_file): ... this new global variable.
    (finish): Write metadata for the test run to `$trs_file' rather
    then to `$log_file', through the use of ...
    (write_test_results): ... this new function.
    * lib/test-driver (print_usage): Update the help screen.
    (Option parsing): Handle the `--trs-file' option, through the
    use of ...
    ($resfile): ... this new global variable.
    (Main code): Write metadata for the test run to `$trsfile' rather
    than to `$logfile'.
    Minor related adjustments to comments.
    * tests/.gitignore: Ignore `*.trs' files.
    * tests/parallel-tests-unreadable-log.test: Moved ...
    * tests/parallel-tests-unreadable.test: ... to this, and extended
    to also check the semantics for unreadable `.trs' files.
    * tests/test-driver-end-metadata.test: Deleted as obsolete.
    * tests/test-driver-metadata-no-leading-space.test: Likewise.
    * tests/test-driver-global-log.test: Renamed ...
    * tests/test-metadata-global-log.test: ... to this, and modified
    as to verify the new APIs and semantics.
    * tests/test-driver-recheck: Renamed ...
    * tests/test-metadata-recheck.test: ... to this, and modified
    likewise.
    * tests/parallel-tests-once.test: New test.
    * tests/parallel-tests-make-n.test: Likewise.
    * test-metadata-results.test: Likewise.
    * test-missing.test: Likewise.
    * test-missing2.test: Likewise.
    * test-trs-basic.test: Likewise.
    * test-trs-recover.test: Likewise.
    * test-trs-recover2.test: Likewise.
    * tests/Makefile.am (TESTS): Update.
    

  • README

  • This is Automake, a Makefile generator.  It was inspired by the 4.4BSD
    make and include files, but aims to be portable and to conform to the
    GNU Coding Standards for Makefile variables and targets.
    
    Automake is a Perl script.  The input files are called Makefile.am.
    The output files are called Makefile.in; they are intended for use
    with Autoconf.  Automake requires certain things to be done in your
    configure.ac.
    
    Variable assignment lines in Makefile.am pull in defaults from various
    little *.am files.
    
    To use Automake, replace your Makefile.in files with Makefile.am
    files.  Read the documentation to see what to do.
    
    This package also includes the "aclocal" program.  aclocal is a
    program to generate an `aclocal.m4' based on the contents of
    `configure.ac'.  It is useful as an extensible, maintainable mechanism
    for augmenting autoconf.  It is intended that other package authors
    will write m4 macros which can be automatically used by aclocal.
    
    Automake has a test suite.  Use
    
    	make check
    
    to run it.  Capture its output in case of failing tests.  For more
    information, please see the file tests/README.
    
    Automake has a page on the web.  See:
    
    	http://sources.redhat.com/automake/
    
    The mailing list automake@gnu.org is for discussion of Automake and
    its interactions with other configuration/portability tools like
    Autoconf or Libtool.  Write to automake-request@gnu.org if you want to
    join.
    
    Mail suggestions and bug reports to bug-automake@gnu.org, patches
    to automake-patches@gnu.org.
    
    New releases are announced to autotools-announce@gnu.org.  Write to
    autotools-announce-request@gnu.org if you want to receive them.
    
    -----
    
    Copyright (C) 1994, 1995, 1996, 1997, 1998, 2001, 2003, 2008, 2009, 2011
      Free Software Foundation, Inc.
    
    This program is free software; you can redistribute it and/or modify
    it under the terms of the GNU General Public License as published by
    the Free Software Foundation; either version 2, or (at your option)
    any later version.
    
    This program is distributed in the hope that it will be useful,
    but WITHOUT ANY WARRANTY; without even the implied warranty of
    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    GNU General Public License for more details.
    
    You should have received a copy of the GNU General Public License
    along with this program.  If not, see <http://www.gnu.org/licenses/>.