Commit Graph

365 Commits

Author SHA1 Message Date
Antoine Pitrou 5bd8b8d80f A warning doesn't equate a failed test
(this broken -F with e.g. test_multiprocessing)
2011-08-23 19:32:26 +02:00
Antoine Pitrou b9c73e8cf0 Issue #12626: In regrtest, allow to filter tests using a glob filter
with the `-m` (or `--match`) option.  This works with all test cases
using the unittest module.  This is useful with long test suites
such as test_io or test_subprocess.
2011-07-29 23:53:38 +02:00
Antoine Pitrou 216a3bc36d Issue #12624: It is now possible to fail after the first failure when
running in verbose mode (`-v` or `-W`), by using the `--failfast`
(or `-G`) option to regrtest.  This is useful with long test suites
such as test_io or test_subprocess.
2011-07-23 22:33:39 +02:00
Antoine Pitrou c081c0c6a0 Issue #12573: Add resource checks for dangling Thread and Process objects. 2011-07-15 22:12:24 +02:00
Victor Stinner fcc2a21fae Issue #12400: regrtest.runtest() uses stream.seek(0) before .truncate()
.truncate(0) doesn't rewind.
2011-06-29 20:01:29 +02:00
Victor Stinner 85b3a492d6 Issue #12400: runtest() truncates the StringIO stream before a new test 2011-06-29 17:26:38 +02:00
Victor Stinner ea95de75dd Issue #12400: regrtest, force verbose mode to True with option -W
If verbose is False, the output is empty. Fix also a typo in a variable name.
2011-06-29 15:34:48 +02:00
Victor Stinner 8313d6aef8 Issue #12400: runtest() reuses the same io.StringIO instance for all calls
* Don't force verbose to True with option -W
 * Rename rerun_failed variable to output_on_failure
2011-06-29 15:22:26 +02:00
Victor Stinner bd98f9367c Issue #12400: remove unused variable 2011-06-29 13:24:28 +02:00
Victor Stinner a7c33e5168 Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures
the output and displays it on failure instead. regrtest -v doesn't print the
error twice anymore if there is only one error.
2011-06-29 13:00:54 +02:00
Ezio Melotti 84f75c680c #12074: remove the /0 when there are no failures. 2011-05-24 01:00:10 +03:00
Victor Stinner a2a895c46c Issue #12074: regrtest displays also the current number of failures 2011-05-23 23:14:05 +02:00
Antoine Pitrou ee4293400c Fix possible "file already exists" error when running the tests in parallel.
This is a perfect example of LBYL going wrong: that code could be executed
by several workers in parallel, and os.mkdir() attempted on the same
path by multiple processes.
2011-04-16 18:53:59 +02:00
Ross Lagerwall 226580e6dc Merge with 3.1 2011-04-09 20:05:04 +02:00
Ross Lagerwall e620d10701 Issue #11719: Fix message about unexpected test_msilib skip.
Patch by Nadeem Vawda.
2011-04-09 19:30:03 +02:00
Antoine Pitrou 293954dd76 Issue #11653: fix -W with -j in regrtest 2011-03-23 23:01:49 +01:00
Antoine Pitrou 779a5b0b3a Always print out the traceback when a test "crashed" 2011-03-21 19:55:16 +01:00
Ezio Melotti 0123e055fa Add a check for sys.warnoptions in regrtest. 2011-03-20 15:09:26 +02:00
Brett Cannon 63eef1e0dd Get --coverage to be an acceptable flag for test.regrtest again. 2011-01-06 22:32:41 +00:00
Georg Brandl be41a48fb8 On Py3k, -tt and -3 are no-op and unsupported respectively. 2011-01-05 21:47:47 +00:00
Victor Stinner 4b2b43d988 regrtest: close the new stdout and restore the original stdout at exit
Fix a ResourceWarning(unclosed file).
2011-01-05 03:54:26 +00:00
Antoine Pitrou 41d5866e56 Merged revisions 87704-87705 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r87704 | antoine.pitrou | 2011-01-03 21:38:52 +0100 (lun., 03 janv. 2011) | 5 lines

  Issue #6293: Have regrtest.py echo back sys.flags.  This is done by default
  in whole runs and enabled selectively using `--header` when running an
  explicit list of tests.  Original patch by Collin Winter.
........
  r87705 | antoine.pitrou | 2011-01-03 21:40:07 +0100 (lun., 03 janv. 2011) | 3 lines

  Mention --randseed in option list
........
2011-01-03 20:47:02 +00:00
Antoine Pitrou 68530ac3c0 Mention --randseed in option list 2011-01-03 20:40:07 +00:00
Antoine Pitrou 3c4402f879 Issue #6293: Have regrtest.py echo back sys.flags. This is done by default
in whole runs and enabled selectively using `--header` when running an
explicit list of tests.  Original patch by Collin Winter.
2011-01-03 20:38:52 +00:00
R. David Murray 8e286c472b #7056: runtest and runtest_inner don't use testdir, so drop it from their sigs
I've only tested regular runs and -j runs.  If I've broken anything
else I'm sure I'll hear about it sooner or later.
2010-12-27 20:09:32 +00:00
Nick Coghlan 7bd5dbe9a0 More fine-grained monitoring of alterations to logging state 2010-12-05 07:17:25 +00:00
Nick Coghlan 7d8197516a Issue 10626 investigation: regrtest now checks for alterations to the logging state in the current process (and yes, test_pydoc alters it) 2010-12-05 06:45:03 +00:00
R. David Murray cd4f758407 Merged revisions 85086 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r85086 | r.david.murray | 2010-09-28 21:08:05 -0400 (Tue, 28 Sep 2010) | 4 lines

  #7110: have regrtest print test failures and tracebacks to stderr not stdout.

  Patch by Sandro Tosi.
........
2010-12-04 17:15:21 +00:00
Michael Foord 3ab34ccae3 Factor out common code from lib/test/__main__.py and lib/test/regrtest.py into a function. 2010-12-03 12:27:40 +00:00
Nick Coghlan 4c4c0f2fe6 Partially revert r78719 - it removed a check that is still needed in some cases (i.e. this will allow Michael to add the test.__main__ support that broke the buildbots previously) 2010-12-03 07:44:33 +00:00
Antoine Pitrou d95c7b5f8a Issue #10347: ignore leading test count ("[ 1/340]") when using the -f option to regrtest. 2010-11-07 20:50:51 +00:00
Antoine Pitrou a4f1afa640 Merged revisions 85935-85936 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r85935 | antoine.pitrou | 2010-10-29 21:34:45 +0200 (ven., 29 oct. 2010) | 4 lines

  Make a GC run before trying to clean up files left over by
  the latest test run.
........
  r85936 | antoine.pitrou | 2010-10-29 21:36:37 +0200 (ven., 29 oct. 2010) | 3 lines

  Fix typo
........
2010-10-31 13:15:20 +00:00
Benjamin Peterson 54ad0beae0 set literals and unions are our friends 2010-10-29 21:33:10 +00:00
Benjamin Peterson 65c66ab255 make gdb skip expected 2010-10-29 21:31:35 +00:00
Antoine Pitrou 2b40efdfe8 Fix typo 2010-10-29 19:36:37 +00:00
Antoine Pitrou c14efc4e80 Make a GC run before trying to clean up files left over by
the latest test run.
2010-10-29 19:34:45 +00:00
Antoine Pitrou aa8796598a Actually restore the original asyncore socket map by making a copy of the dict 2010-10-29 11:54:38 +00:00
Skip Montanaro 97019ff665 test_gdb should be skipped on darwin (not up to v7 yet) 2010-10-25 01:35:48 +00:00
Antoine Pitrou ba8071241b Revert debug printout 2010-10-15 13:52:53 +00:00
Antoine Pitrou fe9791365d Enable debug output at the start of the regression suite instead.
Sorry for the ephemeral inconvenience.
2010-10-15 13:47:00 +00:00
Antoine Pitrou 2731494720 Merged revisions 85482 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/branches/py3k

........
  r85482 | antoine.pitrou | 2010-10-14 17:34:31 +0200 (jeu., 14 oct. 2010) | 4 lines

  Replace the "compiler" resource with the more generic "cpu", so
  as to mark CPU-heavy tests.
........
2010-10-14 15:41:23 +00:00
Antoine Pitrou 5bc4fa7a49 Replace the "compiler" resource with the more generic "cpu", so
as to mark CPU-heavy tests.
2010-10-14 15:34:31 +00:00
Antoine Pitrou 1b03f2ca83 Inherit interpreter flags in parallel testing 2010-10-14 11:12:00 +00:00
R. David Murray 11cabcf73d #7110: have regrtest print test failures and tracebacks to stderr not stdout.
Patch by Sandro Tosi.
2010-09-29 01:08:05 +00:00
Florent Xicluna dc69e7217a Make test.regrtest.__file__ absolute, this was not always the case when running profile or trace, for example. (issue #9323) 2010-09-13 16:35:02 +00:00
Antoine Pitrou 36e778ef02 Issue #9433: The "-j" option to regrtest now works under Windows too.
It is not sure it will be beneficial, though, since process launching is
more expensive under Windows than it is under Linux.
2010-08-18 20:44:14 +00:00
Antoine Pitrou b14ac8c2b0 Save and restore the global asyncore.socket_map, and warn if a test modified it 2010-08-16 00:28:05 +00:00
Florent Xicluna ec882214fe Merged manually from 2.7 branch to 3.x trunk.
------------------------------------------------------------------------
  r80411 | florent.xicluna | 2010-04-23 19:59:10 +0200 (ven. 23 avril 2010) | 2 lignes

  Remove ImportWarnings filters.  They become obsolete after r79310, issue #8205.
  ------------------------------------------------------------------------
  r80412 | florent.xicluna | 2010-04-23 20:10:12 +0200 (ven. 23 avril 2010) | 2 lignes

  Fix the "regrtest -s" switch.
  ------------------------------------------------------------------------
  r81140 | florent.xicluna | 2010-05-13 19:05:29 +0200 (jeu. 13 mai 2010) | 3 lignes

  Add sensible information about the OS X platform to diagnose issue #8423:
  test_pep277 fails on "x86 Tiger" buildbot but not on "PPC Tiger".
  ------------------------------------------------------------------------
  r81141 | florent.xicluna | 2010-05-13 20:16:06 +0200 (jeu. 13 mai 2010) | 2 lignes

  Revert the additional OS X information (r81140).  Keep the endianness information.
  ------------------------------------------------------------------------
2010-08-09 16:56:43 +00:00
Georg Brandl e8e02e3b5b Fix regrtest -F. 2010-08-03 07:56:50 +00:00
Georg Brandl dee7b8503d #8560: add progress indicator to regrtest. 2010-08-02 18:59:52 +00:00