xref: /freebsd/contrib/atf/NEWS (revision dfdc97ae)
1c243e490SMarcel MoolenaarMajor changes between releases                  Automated Testing Framework
2c243e490SMarcel Moolenaar===========================================================================
3c243e490SMarcel Moolenaar
4c243e490SMarcel MoolenaarChanges in version 0.22
51a61beb0SJulio Merino***********************
61a61beb0SJulio Merino
71a61beb0SJulio MerinoSTILL UNDER DEVELOPMENT; NOT RELEASED YET.
81a61beb0SJulio MerinoDON'T FORGET TO BUMP THE -version-info PRE-RELEASE IF NECESSARY!
91a61beb0SJulio Merino
101a61beb0SJulio Merino* Issue #23: Fix double-free triggered by atf_map_insert in low memory
111a61beb0SJulio Merino  scenarios, caused by an overlook in the atf_list code.
121a61beb0SJulio Merino
131a61beb0SJulio Merino* Issue #29: Fixed various typos and formatting errors in manual pages.
141a61beb0SJulio Merino
151a61beb0SJulio Merino* Issue #31: Added require.progs metadata properties to the tests that
161a61beb0SJulio Merino  need a compiler to run.
17dfdc97aeSCraig Rodrigues
18dfdc97aeSCraig Rodrigues* Added the atf_check_not_equal function to atf-sh to check for
19dfdc97aeSCraig Rodrigues  unequal values.
201a61beb0SJulio Merino
211a61beb0SJulio Merino
221a61beb0SJulio MerinoChanges in version 0.21
231a61beb0SJulio Merino***********************
241a61beb0SJulio Merino
251a61beb0SJulio MerinoReleased on October 23rd, 2014.
261a61beb0SJulio Merino
271a61beb0SJulio Merino* Restored the atf(7) manual page to serve as a reference to all the other
281a61beb0SJulio Merino  manual pages shipped by ATF.
291a61beb0SJulio Merino
301a61beb0SJulio Merino* Added the -s flag to atf-sh to support specifying the shell interpreter
311a61beb0SJulio Merino  to be used.
321a61beb0SJulio Merino
331a61beb0SJulio Merino* Removed ATF_WORKDIR.  The only remaining consumers have been converted to
341a61beb0SJulio Merino  use the standard TMPDIR environment variable.  As a benefit, and because
351a61beb0SJulio Merino  Kyua forces the TMPDIR to live within the test case's work directory,
361a61beb0SJulio Merino  any stale files left behind by ATF will be automatically cleaned up.
371a61beb0SJulio Merino
381a61beb0SJulio Merino* Documented the environment variables recognized by each component in the
391a61beb0SJulio Merino  relevant manual pages.  This information was lost with the atf-config(1)
401a61beb0SJulio Merino  removal.
411a61beb0SJulio Merino
421a61beb0SJulio Merino* Added a new "require.diskspace" metadata property to test cases so that
431a61beb0SJulio Merino  they can specify the minimum amount of disk space required for the test
441a61beb0SJulio Merino  to run.
451a61beb0SJulio Merino
461a61beb0SJulio Merino* Renamed the atf-{c,c++,sh}-api(3) manual pages to atf-{c,c++,sh}(3) for
471a61beb0SJulio Merino  discoverability purposes.  Symbolic links are provided for the time
481a61beb0SJulio Merino  being to still make the old names visible.
491a61beb0SJulio Merino
501a61beb0SJulio Merino* Issue #5: Recommend the (expected, actual) idiom for calls to the test
511a61beb0SJulio Merino  macros in the manual pages.
521a61beb0SJulio Merino
53a18eacbeSJulio Merino* Issue #7: Stopped catching unhandled exceptions in atf-c++ tests.  This
54a18eacbeSJulio Merino  propagates the crash to the caller, which in turn allows it to obtain
55a18eacbeSJulio Merino  proper debugging information.  In particular, Kyua should now be able to
56a18eacbeSJulio Merino  extract a stacktrace pinpointing the problem.
57a18eacbeSJulio Merino
58a18eacbeSJulio Merino* Issue #8: Fixed atf-c/macros_test:use test failures spotted by the clang
59a18eacbeSJulio Merino  that ships with FreeBSD 11.0-CURRENT.
60a18eacbeSJulio Merino
61a18eacbeSJulio Merino* Issue #12: Improved documentation of atf-sh(3) and atf-check(1) by better
62a18eacbeSJulio Merino  explaining how they relate to each other.
63a18eacbeSJulio Merino
64a18eacbeSJulio Merino* Issue #14: Stopped setting 'set -e' in atf-sh.  This setting was
65a18eacbeSJulio Merino  initially added as a way to enable a "strict" mode in the library and to
66a18eacbeSJulio Merino  make test cases fail fast when they run unprotected commands.  However,
67a18eacbeSJulio Merino  doing so in the library is surprising as the responsibility of enabling
68a18eacbeSJulio Merino  'set -e' should be on the user's code.  Also, 'set -e' introduces
69a18eacbeSJulio Merino  inconsistent behavior on subshells and users do not expect that.
70a18eacbeSJulio Merino
71a18eacbeSJulio Merino* Issue #15: Fixed atf_utils_{fork,wait} to support nested calls.
72a18eacbeSJulio Merino
73a18eacbeSJulio Merino* Issue #16: Fixed test failures (by removing a long-standing hack) on
74a18eacbeSJulio Merino  systems that lack \e support in printf(1).
75a18eacbeSJulio Merino
76a18eacbeSJulio Merino* Issue #19: Removed stale references to atf-config and atf-run.
77a18eacbeSJulio Merino
78a18eacbeSJulio Merino
79a18eacbeSJulio MerinoChanges in version 0.20
80a18eacbeSJulio Merino***********************
81a18eacbeSJulio Merino
82a18eacbeSJulio MerinoExperimental version released on February 7th, 2014.
83a18eacbeSJulio Merino
84a18eacbeSJulio MerinoThis is the first release without the code for the deprecated tools.  If
85a18eacbeSJulio Merinoyou require such code, please fetch a copy of the 0.19 release and extract
86a18eacbeSJulio Merinothe 'tools' directory for your own consumption.
87a18eacbeSJulio Merino
88a18eacbeSJulio Merino* Removed the deprecated tools.  This includes atf-config, atf-report,
89a18eacbeSJulio Merino  atf-run and atf-version.
90a18eacbeSJulio Merino
91a18eacbeSJulio Merino* Issue #8: Fixed atf-c/macros_test:use test failures spotted by the clang
92a18eacbeSJulio Merino  that ships with FreeBSD 11.0-CURRENT.
93a18eacbeSJulio Merino
94a18eacbeSJulio Merino
95a18eacbeSJulio MerinoChanges in version 0.19
96a18eacbeSJulio Merino***********************
97a18eacbeSJulio Merino
98a18eacbeSJulio MerinoExperimental version released on February 7th, 2014.
99a18eacbeSJulio Merino
100a18eacbeSJulio MerinoThis is the last release to bundle the code for the deprecated tools.
101a18eacbeSJulio MerinoThe next release will drop their code and will stop worrying about
102a18eacbeSJulio Merinobackwards compatibility between the ATF libraries and what the old tools
103a18eacbeSJulio Merinomay or may not support.
104a18eacbeSJulio Merino
105c243e490SMarcel MoolenaarIf you still require the old tools for some reason, grab a copy of the
106c243e490SMarcel Moolenaar'tools' directory now.  The code in this directory is standalone and
107c243e490SMarcel Moolenaardoes not depend on any internal details of atf-c++ any longer.
108c243e490SMarcel Moolenaar
109c243e490SMarcel Moolenaar* Various fixes and improvements to support running as part of the FreeBSD
110c243e490SMarcel Moolenaar  test suite.
111c243e490SMarcel Moolenaar
112c243e490SMarcel Moolenaar* Project hosting moved from Google Code (as a subproject of Kyua) to
113c243e490SMarcel Moolenaar  GitHub (as a first-class project).  The main reason for the change is
114c243e490SMarcel Moolenaar  the suppression of binary downloads in Google Code on Jan 15th, 2014.
115c243e490SMarcel Moolenaar  See https://github.com/jmmv/atf/
116c243e490SMarcel Moolenaar
117c243e490SMarcel Moolenaar* Removed builtin help from atf-sh(1) and atf-check(1) for simplicity
118c243e490SMarcel Moolenaar  reasons.  In other words, their -h option is gone.
119c243e490SMarcel Moolenaar
120c243e490SMarcel Moolenaar* Moved the code of the deprecated tools into a 'tools' directory and
121c243e490SMarcel Moolenaar  completely decoupled their code from the internals of atf-c++.  The
122c243e490SMarcel Moolenaar  reason for this is to painlessly allow a third-party to maintain a
123c243e490SMarcel Moolenaar  copy of these tools after we delete them because upcoming changes to
124c243e490SMarcel Moolenaar  atf-c++ would break the stale tools.
125c243e490SMarcel Moolenaar
126c243e490SMarcel Moolenaar
127c243e490SMarcel MoolenaarChanges in version 0.18
128c243e490SMarcel Moolenaar***********************
129c243e490SMarcel Moolenaar
130c243e490SMarcel MoolenaarExperimental version released on November 16th, 2013.
131c243e490SMarcel Moolenaar
132c243e490SMarcel Moolenaar* Issue 45: Added require.memory support in atf-run for FreeBSD.
133c243e490SMarcel Moolenaar
134c243e490SMarcel Moolenaar* Fixed an issue with the handling of cin with libc++.
135c243e490SMarcel Moolenaar
136c243e490SMarcel Moolenaar* Issue 64: Fixed various mandoc formatting warnings.
137c243e490SMarcel Moolenaar
138c243e490SMarcel Moolenaar* NetBSD PR bin/48284: Made atf-check flush its progress message to
139c243e490SMarcel Moolenaar  stdout so that an interrupted test case always shows the last message
140c243e490SMarcel Moolenaar  being executed.
141c243e490SMarcel Moolenaar
142c243e490SMarcel Moolenaar* NetBSD PR bin/48285: Fixed atf_check examples in atf-sh-api(3).
143c243e490SMarcel Moolenaar
144c243e490SMarcel Moolenaar
145c243e490SMarcel MoolenaarChanges in version 0.17
146c243e490SMarcel Moolenaar***********************
147c243e490SMarcel Moolenaar
148c243e490SMarcel MoolenaarExperimental version released on February 14th, 2013.
149c243e490SMarcel Moolenaar
150c243e490SMarcel Moolenaar* Added the atf_utils_cat_file, atf_utils_compare_file,
151c243e490SMarcel Moolenaar  atf_utils_copy_file, atf_utils_create_file, atf_utils_file_exists,
152c243e490SMarcel Moolenaar  atf_utils_fork, atf_utils_grep_file, atf_utils_grep_string,
153c243e490SMarcel Moolenaar  atf_utils_readline, atf_utils_redirect and atf_utils_wait utility
154c243e490SMarcel Moolenaar  functions to atf-c-api.  Documented the already-public
155c243e490SMarcel Moolenaar  atf_utils_free_charpp function.
156c243e490SMarcel Moolenaar
157c243e490SMarcel Moolenaar* Added the cat_file, compare_file, copy_file, create_file, file_exists,
158c243e490SMarcel Moolenaar  fork, grep_collection, grep_file, grep_string, redirect and wait
159c243e490SMarcel Moolenaar  functions to the atf::utils namespace of atf-c++-api.  These are
160c243e490SMarcel Moolenaar  wrappers around the same functions added to the atf-c-api library.
161c243e490SMarcel Moolenaar
162c243e490SMarcel Moolenaar* Added the ATF_CHECK_MATCH, ATF_CHECK_MATCH_MSG, ATF_REQUIRE_MATCH and
163c243e490SMarcel Moolenaar  ATF_REQUIRE_MATCH_MSG macros to atf-c to simplify the validation of a
164c243e490SMarcel Moolenaar  string against a regular expression.
165c243e490SMarcel Moolenaar
166c243e490SMarcel Moolenaar* Miscellaneous fixes for manpage typos and compilation problems with
167c243e490SMarcel Moolenaar  clang.
168c243e490SMarcel Moolenaar
169c243e490SMarcel Moolenaar* Added caching of the results of those configure tests that rely on
170c243e490SMarcel Moolenaar  executing a test program.  This should help crossbuild systems by
171c243e490SMarcel Moolenaar  providing a mechanism to pre-specify what the results should be.
172c243e490SMarcel Moolenaar
173c243e490SMarcel Moolenaar* PR bin/45690: Make atf-report convert any non-printable characters to
174c243e490SMarcel Moolenaar  a plain-text representation (matching their corresponding hexadecimal
175c243e490SMarcel Moolenaar  entities) in XML output files.  This is to prevent the output of test
176c243e490SMarcel Moolenaar  cases from breaking xsltproc later.
177c243e490SMarcel Moolenaar
178c243e490SMarcel Moolenaar
179c243e490SMarcel MoolenaarChanges in version 0.16
180c243e490SMarcel Moolenaar***********************
181c243e490SMarcel Moolenaar
182c243e490SMarcel MoolenaarExperimental version released on July 10th, 2012.
183c243e490SMarcel Moolenaar
184c243e490SMarcel Moolenaar* Added a --enable-tools flag to configure to request the build of the
185c243e490SMarcel Moolenaar  deprecated ATF tools, whose build is now disabled by default.  In order
186c243e490SMarcel Moolenaar  to continue running tests, you should migrate to Kyua instead of enabling
187c243e490SMarcel Moolenaar  the build of the deprecated tools.  The kyua-atf-compat package provides
188c243e490SMarcel Moolenaar  transitional compatibility versions of atf-run and atf-report built on
189c243e490SMarcel Moolenaar  top of Kyua.
190c243e490SMarcel Moolenaar
191c243e490SMarcel Moolenaar* Tweaked the ATF_TEST_CASE macro of atf-c++ so that the compiler can
192c243e490SMarcel Moolenaar  detect defined but unused test cases.
193c243e490SMarcel Moolenaar
194c243e490SMarcel Moolenaar* PR bin/45859: Fixed some XSLT bugs that resulted in the tc-time and
195c243e490SMarcel Moolenaar  tp-time XML tags leaking into the generated HTML file.  Also improved
196c243e490SMarcel Moolenaar  the CSS file slightly to correct alignment and color issues with the
197c243e490SMarcel Moolenaar  timestamps column.
198c243e490SMarcel Moolenaar
199c243e490SMarcel Moolenaar* Optimized atf-c++/macros.hpp so that GNU G++ consumes less memory during
200c243e490SMarcel Moolenaar  compilation with GNU G++.
201c243e490SMarcel Moolenaar
202c243e490SMarcel Moolenaar* Flipped the default to building shared libraries for atf-c and atf-c++,
203c243e490SMarcel Moolenaar  and started versioning them.  As a side-effect, this removes the
204c243e490SMarcel Moolenaar  --enable-unstable-shared flag from configure that appears to not work any
205c243e490SMarcel Moolenaar  more (under NetBSD).  Additionally, some distributions require the use of
206c243e490SMarcel Moolenaar  shared libraries for proper dependency tracking (e.g. Fedora), so it is
207c243e490SMarcel Moolenaar  better if we do the right versioning upstream.
208c243e490SMarcel Moolenaar
209c243e490SMarcel Moolenaar* Project hosting moved from an adhoc solution (custom web site and
210c243e490SMarcel Moolenaar  Monotone repository) to Google Code (standard wiki and Git).  ATF now
211c243e490SMarcel Moolenaar  lives in a subcomponent of the Kyua project.
212c243e490SMarcel Moolenaar
213c243e490SMarcel Moolenaar
214c243e490SMarcel MoolenaarChanges in version 0.15
215c243e490SMarcel Moolenaar***********************
216c243e490SMarcel Moolenaar
217c243e490SMarcel MoolenaarExperimental version released on January 16th, 2012.
218c243e490SMarcel Moolenaar
219c243e490SMarcel Moolenaar* Respect stdin in atf-check.  The previous release silenced stdin for any
220c243e490SMarcel Moolenaar  processes spawned by atf, not only test programs, which caused breakage
221c243e490SMarcel Moolenaar  in tests that pipe data through atf-check.
222c243e490SMarcel Moolenaar
223c243e490SMarcel Moolenaar* Performance improvements to atf-sh.
224c243e490SMarcel Moolenaar
225c243e490SMarcel Moolenaar* Enabled detection of unused parameters and variables in the code and
226c243e490SMarcel Moolenaar  fixed all warnings.
227c243e490SMarcel Moolenaar
228c243e490SMarcel Moolenaar* Changed the behavior of "developer mode".  Compiler warnings are now
229c243e490SMarcel Moolenaar  enabled unconditionally regardless of whether we are in developer mode or
230c243e490SMarcel Moolenaar  not; developer mode is now only used to perform strict warning checks and
231c243e490SMarcel Moolenaar  to enable assertions.  Additionally, developer mode is now only
232c243e490SMarcel Moolenaar  automatically enabled when building from the repository, not for formal
233c243e490SMarcel Moolenaar  releases.
234c243e490SMarcel Moolenaar
235c243e490SMarcel Moolenaar* Added new Autoconf M4 macros (ATF_ARG_WITH, ATF_CHECK_C and
236c243e490SMarcel Moolenaar  ATF_CHECK_CXX) to provide a consistent way of defining a --with-arg flag
237c243e490SMarcel Moolenaar  in configure scripts and detecting the presence of any of the ATF
238c243e490SMarcel Moolenaar  bindings.  Note that ATF_CHECK_SH was already introduced in 0.14, but it
239c243e490SMarcel Moolenaar  has now been modified to also honor --with-atf if instantiated.
240c243e490SMarcel Moolenaar
241c243e490SMarcel Moolenaar* Added timing support to atf-run / atf-report.
242c243e490SMarcel Moolenaar
243c243e490SMarcel Moolenaar* Added support for a 'require.memory' property, to specify the minimum
244c243e490SMarcel Moolenaar  amount of physical memory needed by the test case to yield valid results.
245c243e490SMarcel Moolenaar
246c243e490SMarcel Moolenaar* PR bin/45690: Force an ISO-8859-1 encoding in the XML files generated by
247c243e490SMarcel Moolenaar  atf-report so that invalid data in the output of test cases does not
248c243e490SMarcel Moolenaar  mangle our report.
249c243e490SMarcel Moolenaar
250c243e490SMarcel Moolenaar
251c243e490SMarcel MoolenaarChanges in version 0.14
252c243e490SMarcel Moolenaar***********************
253c243e490SMarcel Moolenaar
254c243e490SMarcel MoolenaarExperimental version released on June 14th, 2011.
255c243e490SMarcel Moolenaar
256c243e490SMarcel Moolenaar* Added a pkg-config file for atf-sh and an aclocal file to ease the
257c243e490SMarcel Moolenaar  detection of atf-sh from autoconf scripts.
258c243e490SMarcel Moolenaar
259c243e490SMarcel Moolenaar* Made the default test case body defined by atf_sh fail.  This is to
260c243e490SMarcel Moolenaar  ensure that test cases are properly defined in test programs and helps
261c243e490SMarcel Moolenaar  in catching typos in the names of the body functions.
262c243e490SMarcel Moolenaar
263c243e490SMarcel Moolenaar* PR bin/44882: Made atf-run connect the stdin of test cases to /dev/zero.
264c243e490SMarcel Moolenaar  This provides more consistent results with "normal" execution (in
265c243e490SMarcel Moolenaar  particular, when tests are executed detached from a terminal).
266c243e490SMarcel Moolenaar
267c243e490SMarcel Moolenaar* Made atf-run hardcode TZ=UTC for test cases.  It used to undefine TZ, but
268c243e490SMarcel Moolenaar  that does not take into account that libc determines the current timezone
269c243e490SMarcel Moolenaar  from a configuration file.
270c243e490SMarcel Moolenaar
271c243e490SMarcel Moolenaar* All test programs will now print a warning when they are not run through
272c243e490SMarcel Moolenaar  atf-run(1) stating that this is unsupported and may deliver incorrect
273c243e490SMarcel Moolenaar  results.
274c243e490SMarcel Moolenaar
275c243e490SMarcel Moolenaar* Added support for the 'require.files' test-case property.  This allows
276c243e490SMarcel Moolenaar  test cases to specify installed files that must be present for the test
277c243e490SMarcel Moolenaar  case to run.
278c243e490SMarcel Moolenaar
279c243e490SMarcel Moolenaar
280c243e490SMarcel MoolenaarChanges in version 0.13
281c243e490SMarcel Moolenaar***********************
282c243e490SMarcel Moolenaar
283c243e490SMarcel MoolenaarExperimental version released on March 31st, 2011.
284c243e490SMarcel Moolenaar
285c243e490SMarcel MoolenaarThis is the first release after the creation of the Kyua project, a more
286c243e490SMarcel Moolenaarmodular and reliable replacement for ATF.  From now on, ATF will change to
287c243e490SMarcel Moolenaaraccomodate the transition to this new codebase, but ATF will still continue
288c243e490SMarcel Moolenaarto see development in the short/medium term.  Check out the project page at
289c243e490SMarcel Moolenaarhttp://code.google.com/p/kyua/ for more details.
290c243e490SMarcel Moolenaar
291c243e490SMarcel MoolenaarThe changes in this release are:
292c243e490SMarcel Moolenaar
293c243e490SMarcel Moolenaar* Added support to run the tests with the Kyua runtime engine (kyua-cli), a
294c243e490SMarcel Moolenaar  new package that aims to replace atf-run and atf-report.  The ATF tests
295c243e490SMarcel Moolenaar  can be run with the new system by issuing a 'make installcheck-kyua' from
296c243e490SMarcel Moolenaar  the top-level directory of the project (assuming the 'kyua' binary is
297c243e490SMarcel Moolenaar  available during the configuration stage of ATF).
298c243e490SMarcel Moolenaar
299c243e490SMarcel Moolenaar* atf-run and atf-report are now in maintenance mode (but *not* deprecated
300c243e490SMarcel Moolenaar  yet!).  Kyua already implements a new, much more reliable runtime engine
301c243e490SMarcel Moolenaar  that provides similar features to these tools.  That said, it is not
302c243e490SMarcel Moolenaar  complete yet so all development efforts should go towards it.
303c243e490SMarcel Moolenaar
304c243e490SMarcel Moolenaar* If GDB is installed, atf-run dumps the stack trace of crashing test
305c243e490SMarcel Moolenaar  programs in an attempt to aid debugging.  Contributed by Antti Kantee.
306c243e490SMarcel Moolenaar
307c243e490SMarcel Moolenaar* Reverted default timeout change in previous release and reset its value
308c243e490SMarcel Moolenaar  to 5 minutes.  This was causing several issues, specially when running
309c243e490SMarcel Moolenaar  the existing NetBSD test suite in qemu.
310c243e490SMarcel Moolenaar
311c243e490SMarcel Moolenaar* Fixed the 'match' output checker in atf-check to properly validate the
312c243e490SMarcel Moolenaar  last line of a file even if it does not have a newline.
313c243e490SMarcel Moolenaar
314c243e490SMarcel Moolenaar* Added the ATF_REQUIRE_IN and ATF_REQUIRE_NOT_IN macros to atf-c++ to
315c243e490SMarcel Moolenaar  check for the presence (or lack thereof) of an element in a collection.
316c243e490SMarcel Moolenaar
317c243e490SMarcel Moolenaar* PR bin/44176: Fixed a race condition in atf-run that would crash atf-run
318c243e490SMarcel Moolenaar  when the cleanup of a test case triggered asynchronous modifications to
319c243e490SMarcel Moolenaar  its work directory (e.g. killing a daemon process that cleans up a pid
320c243e490SMarcel Moolenaar  file in the work directory).
321c243e490SMarcel Moolenaar
322c243e490SMarcel Moolenaar* PR bin/44301: Fixed the sample XSLT file to report bogus test programs
323c243e490SMarcel Moolenaar  instead of just listing them as having 0 test cases.
324c243e490SMarcel Moolenaar
325c243e490SMarcel Moolenaar
326c243e490SMarcel MoolenaarChanges in version 0.12
327c243e490SMarcel Moolenaar***********************
328c243e490SMarcel Moolenaar
329c243e490SMarcel MoolenaarExperimental version released on November 7th, 2010.
330c243e490SMarcel Moolenaar
331c243e490SMarcel Moolenaar* Added the ATF_REQUIRE_THROW_RE to atf-c++, which is the same as
332c243e490SMarcel Moolenaar  ATF_REQUIRE_THROW but allows checking for the validity of the exception's
333c243e490SMarcel Moolenaar  error message by means of a regular expression.
334c243e490SMarcel Moolenaar
335c243e490SMarcel Moolenaar* Added the ATF_REQUIRE_MATCH to atf-c++, which allows checking for a
336c243e490SMarcel Moolenaar  regular expression match in a string.
337c243e490SMarcel Moolenaar
338c243e490SMarcel Moolenaar* Changed the default timeout for test cases from 5 minutes to 30 seconds.
339c243e490SMarcel Moolenaar  30 seconds is long enough for virtually all tests to complete, and 5
340c243e490SMarcel Moolenaar  minutes is a way too long pause in a test suite where a single test case
341c243e490SMarcel Moolenaar  stalls.
342c243e490SMarcel Moolenaar
343c243e490SMarcel Moolenaar* Deprecated the use.fs property.  While this seemed like a good idea in
344c243e490SMarcel Moolenaar  the first place to impose more control on what test cases can do, it
345c243e490SMarcel Moolenaar  turns out to be bad.  First, use.fs=false prevents bogus test cases
346c243e490SMarcel Moolenaar  from dumping core so after-the-fact debugging is harder.  Second,
347c243e490SMarcel Moolenaar  supporting use.fs adds a lot of unnecessary complexity.  atf-run will
348c243e490SMarcel Moolenaar  now ignore any value provided to use.fs and will allow test cases to
349c243e490SMarcel Moolenaar  freely access the file system if they wish to.
350c243e490SMarcel Moolenaar
351c243e490SMarcel Moolenaar* Added the atf_tc_get_config_var_as_{bool,long}{,_wd} functions to the atf-c
352c243e490SMarcel Moolenaar  library.  The 'text' module became private in 0.11 but was being used
353c243e490SMarcel Moolenaar  externally to simplify the parsing of configuration variables.
354c243e490SMarcel Moolenaar
355c243e490SMarcel Moolenaar* Made atf-run recognize the 'unprivileged-user' configuration variable
356c243e490SMarcel Moolenaar  and automatically drop root privileges when a test case sets
357c243e490SMarcel Moolenaar  require.user=unprivileged.  Note that this is, by no means, done for
358c243e490SMarcel Moolenaar  security purposes; this is just for user convenience; tests should, in
359c243e490SMarcel Moolenaar  general, not be blindly run as root in the first place.
360c243e490SMarcel Moolenaar
361c243e490SMarcel Moolenaar
362c243e490SMarcel MoolenaarChanges in version 0.11
363c243e490SMarcel Moolenaar***********************
364c243e490SMarcel Moolenaar
365c243e490SMarcel MoolenaarExperimental version released on October 20th, 2010.
366c243e490SMarcel Moolenaar
367c243e490SMarcel Moolenaar* The ATF_CHECK* macros in atf-c++ were renamed to ATF_REQUIRE* to match
368c243e490SMarcel Moolenaar  their counterparts in atf-c.
369c243e490SMarcel Moolenaar
370c243e490SMarcel Moolenaar* Clearly separated the modules in atf-c that are supposed to be public
371c243e490SMarcel Moolenaar  from those that are implementation details.  The header files for the
372c243e490SMarcel Moolenaar  internal modules are not installed any more.
373c243e490SMarcel Moolenaar
374c243e490SMarcel Moolenaar* Made the atf-check tool private.  It is only required by atf-sh and being
375c243e490SMarcel Moolenaar  public has the danger of causing confusion.  Also, making it private
376c243e490SMarcel Moolenaar  simplifies the public API of atf.
377c243e490SMarcel Moolenaar
378c243e490SMarcel Moolenaar* Changed atf-sh to enable per-command error checking (set -e) by default.
379c243e490SMarcel Moolenaar  This catches many cases in which a test case is broken but it is not
380c243e490SMarcel Moolenaar  reported as such because execution continues.
381c243e490SMarcel Moolenaar
382c243e490SMarcel Moolenaar* Fixed the XSTL and CSS stylesheets to support expected failures.
383c243e490SMarcel Moolenaar
384c243e490SMarcel Moolenaar
385c243e490SMarcel MoolenaarChanges in version 0.10
386c243e490SMarcel Moolenaar***********************
387c243e490SMarcel Moolenaar
388c243e490SMarcel MoolenaarExperimental version released on July 2nd, 2010.
389c243e490SMarcel Moolenaar
390c243e490SMarcel MoolenaarMiscellaneous features
391c243e490SMarcel Moolenaar
392c243e490SMarcel Moolenaar* Added expected failures support to test cases and atf-run.  These
393c243e490SMarcel Moolenaar  include, for example, expected clean exits, expected reception of fatal
394c243e490SMarcel Moolenaar  signals, expected timeouts and expected errors in condition checks.
395c243e490SMarcel Moolenaar  These statuses can be used to denote test cases that are known to fail
396c243e490SMarcel Moolenaar  due to a bug in the code they are testing.  atf-report reports these
397c243e490SMarcel Moolenaar  tests separately but they do not count towards the failed test cases
398c243e490SMarcel Moolenaar  amount.
399c243e490SMarcel Moolenaar
400c243e490SMarcel Moolenaar* Added the ATF_CHECK_ERRNO and ATF_REQUIRE_ERRNO to the C library to
401c243e490SMarcel Moolenaar  allow easy checking of call failures that update errno.
402c243e490SMarcel Moolenaar
403c243e490SMarcel Moolenaar* Added the has.cleanup meta-data property to test caes that specifies
404c243e490SMarcel Moolenaar  whether the test case has a cleanup routine or not; its value is
405c243e490SMarcel Moolenaar  automatically set.  This property is read by atf-run to know if it has to
406c243e490SMarcel Moolenaar  run the cleanup routine; skipping this run for every test case
407c243e490SMarcel Moolenaar  significantly speeds up the run time of test suites.
408c243e490SMarcel Moolenaar
409c243e490SMarcel Moolenaar* Reversed the order of the ATF_CHECK_THROW macro in the C++ binding to
410c243e490SMarcel Moolenaar  take the expected exception as the first argument and the statement to
411c243e490SMarcel Moolenaar  execute as the second argument.
412c243e490SMarcel Moolenaar
413c243e490SMarcel MoolenaarChanges in atf-check
414c243e490SMarcel Moolenaar
415c243e490SMarcel Moolenaar* Changed atf-check to support negating the status and output checks by
416c243e490SMarcel Moolenaar  prefixing them with not- and added support to specify multiple checkers
417c243e490SMarcel Moolenaar  for stdout and stderr, not only one.
418c243e490SMarcel Moolenaar
419c243e490SMarcel Moolenaar* Added the match output checker to atf-check to look for regular
420c243e490SMarcel Moolenaar  expressions in the stdout and stderr of commands.
421c243e490SMarcel Moolenaar
422c243e490SMarcel Moolenaar* Modified the exit checks in atf-check to support checking for the
423c243e490SMarcel Moolenaar  reception of signals.
424c243e490SMarcel Moolenaar
425c243e490SMarcel MoolenaarCode simplifications and cleanups
426c243e490SMarcel Moolenaar
427c243e490SMarcel Moolenaar* Removed usage messages from test programs to simplify the
428c243e490SMarcel Moolenaar  implementation of every binding by a significant amount.  They just now
429c243e490SMarcel Moolenaar  refer the user to the appropriate manual page and do not attempt to wrap
430c243e490SMarcel Moolenaar  lines on terminal boundaries.  Test programs are not supposed to be run
431c243e490SMarcel Moolenaar  by users directly so this minor interface regression is not important.
432c243e490SMarcel Moolenaar
433c243e490SMarcel Moolenaar* Removed the atf-format internal utility, which is unused after the
434c243e490SMarcel Moolenaar  change documented above.
435c243e490SMarcel Moolenaar
436c243e490SMarcel Moolenaar* Removed the atf-cleanup internal utility.  It has been unused since the
437c243e490SMarcel Moolenaar  test case isolation was moved to atf-run in 0.8
438c243e490SMarcel Moolenaar
439c243e490SMarcel Moolenaar* Splitted the Makefile.am into smaller files for easier maintenance and
440c243e490SMarcel Moolenaar  dropped the use of M4.  Only affects users building from the repository
441c243e490SMarcel Moolenaar  sources.
442c243e490SMarcel Moolenaar
443c243e490SMarcel Moolenaar* Intermixed tests with the source files in the source tree to provide
444c243e490SMarcel Moolenaar  them more visibility and easier access.  The tests directory is gone from
445c243e490SMarcel Moolenaar  the source tree and tests are now suffixed by _test, not prefixed by t_.
446c243e490SMarcel Moolenaar
447c243e490SMarcel Moolenaar* Simplifications to the atf-c library: removed the io, tcr and ui
448c243e490SMarcel Moolenaar  modules as they had become unnecessary after all simplifications
449c243e490SMarcel Moolenaar  introduced since the 0.8 release.
450c243e490SMarcel Moolenaar
451c243e490SMarcel Moolenaar* Removed the application/X-atf-tcr format introduced in 0.8 release.
452c243e490SMarcel Moolenaar  Tests now print a much simplified format that is easy to parse and nicer
453c243e490SMarcel Moolenaar  to read by end users.  As a side effect, the default for test cases is
454c243e490SMarcel Moolenaar  now to print their results to stdout unless otherwise stated by providing
455c243e490SMarcel Moolenaar  the -r flag.
456c243e490SMarcel Moolenaar
457c243e490SMarcel Moolenaar* Removed XML distribution documents and replaced them with plain-text
458c243e490SMarcel Moolenaar  documents.  They provided little value and introduced a lot of complexity
459c243e490SMarcel Moolenaar  to the build system.
460c243e490SMarcel Moolenaar
461c243e490SMarcel Moolenaar* Simplified the output of atf-version by not attempting to print a
462c243e490SMarcel Moolenaar  revision number when building form a distfile.  Makes the build system
463c243e490SMarcel Moolenaar  easier to maintain.
464c243e490SMarcel Moolenaar
465c243e490SMarcel Moolenaar
466c243e490SMarcel MoolenaarChanges in version 0.9
467c243e490SMarcel Moolenaar**********************
468c243e490SMarcel Moolenaar
469c243e490SMarcel MoolenaarExperimental version released on June 3rd, 2010.
470c243e490SMarcel Moolenaar
471c243e490SMarcel Moolenaar* Added atf-sh, an interpreter to process test programs written using
472c243e490SMarcel Moolenaar  the shell API.  This is not really a shell interpreter by itself though:
473c243e490SMarcel Moolenaar  it is just a wrapper around the system shell that eases the loading of
474c243e490SMarcel Moolenaar  the necessary ATF libraries.
475c243e490SMarcel Moolenaar
476c243e490SMarcel Moolenaar* Removed atf-compile in favour of atf-sh.
477c243e490SMarcel Moolenaar
478c243e490SMarcel Moolenaar* Added the use.fs metadata property to test case, which is used to
479c243e490SMarcel Moolenaar  specify which test cases require file system access.  This is to
480c243e490SMarcel Moolenaar  highlight dependencies on external resources more clearly and to speed up
481c243e490SMarcel Moolenaar  the execution of test suites by skipping the creation of many unnecessary
482c243e490SMarcel Moolenaar  work directories.
483c243e490SMarcel Moolenaar
484c243e490SMarcel Moolenaar* Fixed test programs to get a sane default value for their source
485c243e490SMarcel Moolenaar  directory.  This means that it should not be necessary any more to pass
486c243e490SMarcel Moolenaar  -s when running test programs that do not live in the current directory.
487c243e490SMarcel Moolenaar
488c243e490SMarcel Moolenaar* Defining test case headers became optional.  This is trivial to achieve
489c243e490SMarcel Moolenaar  in shell-based tests but a bit ugly in C and C++.  In C, use the new
490c243e490SMarcel Moolenaar  ATF_TC_WITHOUT_HEAD macro to define the test case, and in C++ use
491c243e490SMarcel Moolenaar  ATF_TEST_CASE_WITHOUT_HEAD.
492c243e490SMarcel Moolenaar
493c243e490SMarcel Moolenaar
494c243e490SMarcel MoolenaarChanges in version 0.8
495c243e490SMarcel Moolenaar**********************
496c243e490SMarcel Moolenaar
497c243e490SMarcel MoolenaarExperimental version released on May 7th, 2010.
498c243e490SMarcel Moolenaar
499c243e490SMarcel Moolenaar* Test programs no longer run several test cases in a row.  The execution
500c243e490SMarcel Moolenaar  of a test program now requires a test case name, and that single test
501c243e490SMarcel Moolenaar  case is executed.  To execute several test cases, use the atf-run utility
502c243e490SMarcel Moolenaar  as usual.
503c243e490SMarcel Moolenaar
504c243e490SMarcel Moolenaar* Test programs no longer fork a subprocess to isolate the execution of
505c243e490SMarcel Moolenaar  test cases.  They run the test case code in-process, and a crash of the
506c243e490SMarcel Moolenaar  test case will result in a crash of the test program.  This is to ease
507c243e490SMarcel Moolenaar  debugging of faulty test cases.
508c243e490SMarcel Moolenaar
509c243e490SMarcel Moolenaar* Test programs no longer isolate their test cases.  This means that they
510c243e490SMarcel Moolenaar  will not create temporary directories nor sanitize the environment any
511c243e490SMarcel Moolenaar  more.  Yes: running a test case that depends on system state by hand will
512c243e490SMarcel Moolenaar  most likely yield different results depending on where (machine,
513c243e490SMarcel Moolenaar  directory, user environment, etc.) it is run.  Isolation has been moved
514c243e490SMarcel Moolenaar  to atf-run.
515c243e490SMarcel Moolenaar
516c243e490SMarcel Moolenaar* Test programs no longer print a cryptic format (application/X-atf-tcs)
517c243e490SMarcel Moolenaar  on a special file channel.  They can now print whatever they want on the
518c243e490SMarcel Moolenaar  screen.  Because test programs can now only run one test case every time,
519c243e490SMarcel Moolenaar  providing controlled output is not necessary any more.
520c243e490SMarcel Moolenaar
521c243e490SMarcel Moolenaar* Test programs no longer write their status into a special file
522c243e490SMarcel Moolenaar  descriptor.  Instead, they create a file with the results, which is later
523c243e490SMarcel Moolenaar  parsed by atf-run.  This changes the semantics of the -r flag.
524c243e490SMarcel Moolenaar
525c243e490SMarcel Moolenaar* atf-run has been adjusted to perform the test case isolation.  As a
526c243e490SMarcel Moolenaar  result, there is now a single canonical place that implements the
527c243e490SMarcel Moolenaar  isolation of test caes.  In previous releases, the three language
528c243e490SMarcel Moolenaar  bindings (C, C++ and shell) had to be kept in sync with each other (read:
529c243e490SMarcel Moolenaar  not a nice thing to do at all).  As a side effect of this change, writing
530c243e490SMarcel Moolenaar  bindings for other languages will be much, much easier from now on.
531c243e490SMarcel Moolenaar
532c243e490SMarcel Moolenaar* atf-run forks test programs on a test case basis, instead of on a test
533c243e490SMarcel Moolenaar  program basis as it did before.  This is to provide the test case
534c243e490SMarcel Moolenaar  isolation that was before implemented by the test programs themselves.
535c243e490SMarcel Moolenaar
536c243e490SMarcel Moolenaar* Removed the atf-exec tool.  This was used to implement test case
537c243e490SMarcel Moolenaar  isolation in atf-sh, but it is now unnecessary.
538c243e490SMarcel Moolenaar
539c243e490SMarcel Moolenaar* It is now optional to define the descr meta-data property.  It has been
540c243e490SMarcel Moolenaar  proven to be mostly useless, because test cases often carry a descriptive
541c243e490SMarcel Moolenaar  name of their own.
542c243e490SMarcel Moolenaar
543c243e490SMarcel Moolenaar
544c243e490SMarcel MoolenaarChanges in version 0.7
545c243e490SMarcel Moolenaar**********************
546c243e490SMarcel Moolenaar
547c243e490SMarcel MoolenaarExperimental version released on December 22nd, 2009.
548c243e490SMarcel Moolenaar
549c243e490SMarcel Moolenaar* Added build-time checks to atf-c and atf-c++.  A binding for atf-sh
550c243e490SMarcel Moolenaar  will come later.
551c243e490SMarcel Moolenaar
552c243e490SMarcel Moolenaar* Migrated all build-time checks for header files to proper ATF tests.
553c243e490SMarcel Moolenaar  This demonstrates the use of the new feature described above.
554c243e490SMarcel Moolenaar
555c243e490SMarcel Moolenaar* Added an internal API for child process management.
556c243e490SMarcel Moolenaar
557c243e490SMarcel Moolenaar* Converted all plain-text distribution documents to a Docbook canonical
558c243e490SMarcel Moolenaar  version, and include pre-generated plain text and HTML copies in the
559c243e490SMarcel Moolenaar  distribution file.
560c243e490SMarcel Moolenaar
561c243e490SMarcel Moolenaar* Simplified the contents of the Makefile.am by regenerating it from a
562c243e490SMarcel Moolenaar  canonical Makefile.am.m4 source.  As a side-effect, some dependency
563c243e490SMarcel Moolenaar  specifications were fixed.
564c243e490SMarcel Moolenaar
565c243e490SMarcel Moolenaar* Migrated all checks from the check target to installcheck, as these
566c243e490SMarcel Moolenaar  require ATF to be installed.
567c243e490SMarcel Moolenaar
568c243e490SMarcel Moolenaar* Fixed sign comparison mismatches triggered by the now-enabled
569c243e490SMarcel Moolenaar  -Wsign-compare.
570c243e490SMarcel Moolenaar
571c243e490SMarcel Moolenaar* Fixed many memory and object leaks.
572c243e490SMarcel Moolenaar
573c243e490SMarcel Moolenaar
574c243e490SMarcel MoolenaarChanges in version 0.6
575c243e490SMarcel Moolenaar**********************
576c243e490SMarcel Moolenaar
577c243e490SMarcel MoolenaarExperimental version released on January 18th, 2009.
578c243e490SMarcel Moolenaar
579c243e490SMarcel Moolenaar* Make atf-exec be able to kill its child process after a certain period
580c243e490SMarcel Moolenaar  of time; this is controlled through the new -t option.
581c243e490SMarcel Moolenaar
582c243e490SMarcel Moolenaar* Change atf-sh to use atf-exec's -t option to control the test case's
583c243e490SMarcel Moolenaar  timeouts, instead of doing it internally.  Same behavior as before, but
584c243e490SMarcel Moolenaar  noticeably faster.
585c243e490SMarcel Moolenaar
586c243e490SMarcel Moolenaar* atf-exec's -g option and atf-killpg are gone due to the previous
587c243e490SMarcel Moolenaar  change.
588c243e490SMarcel Moolenaar
589c243e490SMarcel Moolenaar* Added the atf-check(1) tool, a program that executes a given command
590c243e490SMarcel Moolenaar  and checks its exit code against a known value and allows the management
591c243e490SMarcel Moolenaar  of stdout and stderr in multiple ways.  This replaces the previous
592c243e490SMarcel Moolenaar  atf_check function in the atf-sh library and exposes this functionality
593c243e490SMarcel Moolenaar  to both atf-c and atf-c++.
594c243e490SMarcel Moolenaar
595c243e490SMarcel Moolenaar* Added the ATF_REQUIRE family of macros to the C interface.  These help
596c243e490SMarcel Moolenaar  in checking for fatal test conditions.  The old ATF_CHECK macros now
597c243e490SMarcel Moolenaar  perform non-fatal checks only.  I.e. by using ATF_CHECK, the test case
598c243e490SMarcel Moolenaar  can now continue its execution and the failures will not be reported
599c243e490SMarcel Moolenaar  until the end of the whole run.
600c243e490SMarcel Moolenaar
601c243e490SMarcel Moolenaar* Extended the amount of ATF_CHECK_* C macros with new ones to provide
602c243e490SMarcel Moolenaar  more features to the developer.  These also have their corresponding
603c243e490SMarcel Moolenaar  counterparts in the ATF_REQUIRE_* family.  The new macros (listing the
604c243e490SMarcel Moolenaar  suffixes only) are: _EQ (replaces _EQUAL), _EQ_MSG, _STREQ and
605c243e490SMarcel Moolenaar  _STREQ_MSG.
606c243e490SMarcel Moolenaar
607c243e490SMarcel Moolenaar
608c243e490SMarcel MoolenaarChanges in version 0.5
609c243e490SMarcel Moolenaar**********************
610c243e490SMarcel Moolenaar
611c243e490SMarcel MoolenaarExperimental version released on May 1st, 2008.
612c243e490SMarcel Moolenaar
613c243e490SMarcel Moolenaar* Clauses 3 and 4 of the BSD license used by the project were dropped.
614c243e490SMarcel Moolenaar  All the code is now under a 2-clause BSD license compatible with the GNU
615c243e490SMarcel Moolenaar  General Public License (GPL).
616c243e490SMarcel Moolenaar
617c243e490SMarcel Moolenaar* Added a C-only binding so that binary test programs do not need to be
618c243e490SMarcel Moolenaar  tied to C++ at all.  This binding is now known as the atf-c library.
619c243e490SMarcel Moolenaar
620c243e490SMarcel Moolenaar* Renamed the C++ binding to atf-c++ for consistency with the new atf-c.
621c243e490SMarcel Moolenaar
622c243e490SMarcel Moolenaar* Renamed the POSIX shell binding to atf-sh for consistency with the new
623c243e490SMarcel Moolenaar  atf-c and atf-c++.
624c243e490SMarcel Moolenaar
625c243e490SMarcel Moolenaar* Added a -w flag to test programs through which it is possible to
626c243e490SMarcel Moolenaar  specify the work directory to be used.  This was possible in prior
627c243e490SMarcel Moolenaar  releases by defining the workdir configuration variable (-v workdir=...),
628c243e490SMarcel Moolenaar  but was a conceptually incorrect mechanism.
629c243e490SMarcel Moolenaar
630c243e490SMarcel Moolenaar* Test programs now preserve the execution order of test cases when they
631c243e490SMarcel Moolenaar  are given in the command line.  Even those mentioned more than once are
632c243e490SMarcel Moolenaar  executed multiple times to comply with the user's requests.
633c243e490SMarcel Moolenaar
634c243e490SMarcel Moolenaar
635c243e490SMarcel MoolenaarChanges in version 0.4
636c243e490SMarcel Moolenaar**********************
637c243e490SMarcel Moolenaar
638c243e490SMarcel MoolenaarExperimental version released on February 4th, 2008.
639c243e490SMarcel Moolenaar
640c243e490SMarcel Moolenaar* Added two new manual pages, atf-c++-api and atf-sh-api, describing the
641c243e490SMarcel Moolenaar  C++ and POSIX shell interfaces used to write test programs.
642c243e490SMarcel Moolenaar
643c243e490SMarcel Moolenaar* Added a pkg-config file, useful to get the flags to build against the
644c243e490SMarcel Moolenaar  C++ library or to easily detect the presence of ATF.
645c243e490SMarcel Moolenaar
646c243e490SMarcel Moolenaar* Added a way for test cases to require a specific architecture and/or
647c243e490SMarcel Moolenaar  machine type through the new 'require.arch' and 'require.machine'
648c243e490SMarcel Moolenaar  meta-data properties, respectively.
649c243e490SMarcel Moolenaar
650c243e490SMarcel Moolenaar* Added the 'timeout' property to test cases, useful to set an
651c243e490SMarcel Moolenaar  upper-bound limit for the test's run time and thus prevent global test
652c243e490SMarcel Moolenaar  program stalls due to the test case's misbehavior.
653c243e490SMarcel Moolenaar
654c243e490SMarcel Moolenaar* Added the atf-exec(1) internal utility, used to execute a command
655c243e490SMarcel Moolenaar  after changing the process group it belongs to.
656c243e490SMarcel Moolenaar
657c243e490SMarcel Moolenaar* Added the atf-killpg(1) internal utility, used to kill process groups.
658c243e490SMarcel Moolenaar
659c243e490SMarcel Moolenaar* Multiple portability fixes.  Of special interest, full support for
660c243e490SMarcel Moolenaar  SunOS (Solaris Express Developer Edition 2007/09) using the Sun Studio 12
661c243e490SMarcel Moolenaar  C++ compiler.
662c243e490SMarcel Moolenaar
663c243e490SMarcel Moolenaar* Fixed a serious bug that prevented atf-run(1) from working at all
664c243e490SMarcel Moolenaar  under Fedora 8 x86_64.  Due to the nature of the bug, other platforms
665c243e490SMarcel Moolenaar  were likely affected too.
666c243e490SMarcel Moolenaar
667c243e490SMarcel Moolenaar
668c243e490SMarcel MoolenaarChanges in version 0.3
669c243e490SMarcel Moolenaar**********************
670c243e490SMarcel Moolenaar
671Experimental version released on November 11th, 2007.
672
673* Added XML output support to atf-report.  This is accompanied by a DTD
674  for the format's structure and sample XSLT/CSS files to post-process this
675  output and convert it to a plain HTML report.
676
677* Changed atf-run to add system information to the report it generates.
678  This is currently used by atf-report's XML output only, and is later
679  printed in the HTML reports in a nice and useful summary table.  The user
680  and system administrator are allowed to tune this feature by means of
681  hooks.
682
683* Removed the test cases' 'isolated' property.  This was intended to
684  avoid touching the file system at all when running the related test case,
685  but this has not been true for a long while: some control files are
686  unconditionally required for several purposes, and we cannot easily get
687  rid of them.  This way we remove several critical and delicate pieces of
688  code.
689
690* Improved atf-report's CSV output format to include information about
691  test programs too.
692
693* Fixed the tests that used atf-compile to not require this tool as a
694  helper.  Avoids systems without build-time utilities to skip many tests
695  that could otherwise be run.  (E.g. NetBSD without the comp.tgz set
696  installed.)
697
698* Many general cleanups: Fixed many pieces of code marked as ugly and/or
699  incomplete.
700
701
702Changes in version 0.2
703**********************
704
705Experimental version released on September 20th, 2007.
706
707* Test cases now get a known umask on entry.
708
709* atf-run now detects many unexpected failures caused by test programs and
710  reports them as bogus tests.  atf-report is able to handle these new
711  errors and nicely reports them to the user.
712
713* All the data formats read and written by the tools have been
714  documented and cleaned up.  These include those grammars that define how
715  the different components communicate with each other as well as the
716  format of files written by the developers and users: the Atffiles and the
717  configuration files.
718
719* Added the atf-version tool, a utility that displays information about
720  the currently installed version of ATF.
721
722* Test cases can now define an optional cleanup routine to undo their
723  actions regardless of their exit status.
724
725* atf-report now summarizes the list of failed (bogus) test programs
726  when using the ticker output format.
727
728* Test programs now capture some termination signals and clean up any
729  temporary files before exiting the program.
730
731* Multiple bug fixes and improvements all around.
732
733
734Changes in version 0.1
735**********************
736
737Experimental version released on August 20th, 2007.
738
739* First public version.  This was released coinciding with the end of the
740  Google Summer of Code 2007 program.
741
742
743===========================================================================
744vim: filetype=text:textwidth=75:expandtab:shiftwidth=2:softtabstop=2
745