Antoine Pitrou
b9c73e8cf0
Issue #12626 : In regrtest, allow to filter tests using a glob filter
...
with the `-m` (or `--match`) option. This works with all test cases
using the unittest module. This is useful with long test suites
such as test_io or test_subprocess.
2011-07-29 23:53:38 +02:00
Eli Bendersky
d18a047d58
Issue #11049 : added test_support to regrtest.STDTESTS list
2011-07-27 20:21:45 +03:00
Antoine Pitrou
8dbd8573e5
Issue #12624 : It is now possible to fail after the first failure when
...
running in verbose mode (`-v` or `-W`), by using the `--failfast`
(or `-G`) option to regrtest. This is useful with long test suites
such as test_io or test_subprocess.
2011-07-23 22:37:52 +02:00
Antoine Pitrou
216a3bc36d
Issue #12624 : It is now possible to fail after the first failure when
...
running in verbose mode (`-v` or `-W`), by using the `--failfast`
(or `-G`) option to regrtest. This is useful with long test suites
such as test_io or test_subprocess.
2011-07-23 22:33:39 +02:00
Antoine Pitrou
428bc6c48f
Issue #12573 : Add resource checks for dangling Thread and Process objects.
2011-07-15 22:15:38 +02:00
Antoine Pitrou
c081c0c6a0
Issue #12573 : Add resource checks for dangling Thread and Process objects.
2011-07-15 22:12:24 +02:00
Victor Stinner
cb41cda8e3
Issue #12550 : regrtest displays the Python traceback on SIGALRM or SIGUSR1
2011-07-13 23:47:21 +02:00
Victor Stinner
e15bfeb8ce
(merge 3.2) Issue #12400 : regrtest.runtest() uses stream.seek(0) before .truncate()
...
.truncate(0) doesn't rewind.
2011-06-29 20:03:13 +02:00
Victor Stinner
fcc2a21fae
Issue #12400 : regrtest.runtest() uses stream.seek(0) before .truncate()
...
.truncate(0) doesn't rewind.
2011-06-29 20:01:29 +02:00
Victor Stinner
fa832dea2a
(merge 3.2) Issue #12400 : runtest() truncates the StringIO stream before a new
...
test
2011-06-29 17:29:22 +02:00
Victor Stinner
85b3a492d6
Issue #12400 : runtest() truncates the StringIO stream before a new test
2011-06-29 17:26:38 +02:00
Victor Stinner
ba08905062
(merge 3.2) Issue #12400 : regrtest, force verbose mode to True with option -W
...
If verbose is False, the output is empty. Fix also a typo in a variable name.
2011-06-29 15:38:18 +02:00
Victor Stinner
ea95de75dd
Issue #12400 : regrtest, force verbose mode to True with option -W
...
If verbose is False, the output is empty. Fix also a typo in a variable name.
2011-06-29 15:34:48 +02:00
Victor Stinner
d71bd9a9a4
(merge 3.2) Issue #12400 : runtest() reuses the same io.StringIO instance for
...
all calls
* Don't force verbose to True with option -W
* Rename rerun_failed variable to output_on_failure
2011-06-29 15:25:40 +02:00
Victor Stinner
8313d6aef8
Issue #12400 : runtest() reuses the same io.StringIO instance for all calls
...
* Don't force verbose to True with option -W
* Rename rerun_failed variable to output_on_failure
2011-06-29 15:22:26 +02:00
Victor Stinner
0b8f0c2766
(merge 3.2) Issue #12400 : remove unused import
2011-06-29 13:24:58 +02:00
Victor Stinner
bd98f9367c
Issue #12400 : remove unused variable
2011-06-29 13:24:28 +02:00
Victor Stinner
e2185d714b
(merge 3.2) Issue #12400 : regrtest -W doesn't rerun the tests twice anymore,
...
but captures the output and displays it on failure instead. regrtest -v doesn't
print the error twice anymore if there is only one error.
2011-06-29 13:04:35 +02:00
Victor Stinner
a7c33e5168
Issue #12400 : regrtest -W doesn't rerun the tests twice anymore, but captures
...
the output and displays it on failure instead. regrtest -v doesn't print the
error twice anymore if there is only one error.
2011-06-29 13:00:54 +02:00
Victor Stinner
883456833c
Issue #12250 : regrtest --timeout displays a warning instead of failing with an
...
error if faulthandler.dump_tracebacks_later() is missing (e.g. if Python is
compiled without threads).
2011-06-06 12:14:23 +02:00
Victor Stinner
9e586c2b35
Issue #12250 : modify "make buildbottest" command line instead of TESTOPTS
...
Add TESTTIMEOUT variable (default: 3600 seconds). Use TESTTIMEOUT=0 to disable
the timeout.
***
fix
2011-06-06 12:04:36 +02:00
Victor Stinner
301968874b
Close #12250 : Disable the regrtest timeout by default
...
Keep a timeout of 1 hour for buildbots.
2011-06-03 12:53:26 +02:00
Victor Stinner
d976098e3b
Close #12089 : Remove outdated and unused code from regrtest.
2011-05-30 22:58:13 +02:00
Victor Stinner
be6210363e
Issue #8533 : regrtest replaces also sys.stdout on Windows
...
Replace sys.stdout to use backslashreplace. Use '\n' newline on all operating
systems.
2011-05-25 02:01:55 +02:00
Ezio Melotti
64af7c0d36
#12074 : merge with 3.2.
2011-05-24 01:01:08 +03:00
Ezio Melotti
84f75c680c
#12074 : remove the /0 when there are no failures.
2011-05-24 01:00:10 +03:00
Victor Stinner
08c719eb95
(Merge 3.2) Issue #12074 : regrtest displays also the current number of failures
2011-05-23 23:16:09 +02:00
Victor Stinner
a2a895c46c
Issue #12074 : regrtest displays also the current number of failures
2011-05-23 23:14:05 +02:00
Victor Stinner
3c18f259ee
regrtest: enable faulthandler in main() instead of if __name__ == '__main__':
...
So it's also enabled when using "./python -m test".
2011-05-22 15:27:14 +02:00
Victor Stinner
55b5fa76a7
regrtest: dump all threads on a crash, not only the current thread
2011-05-04 11:02:12 +02:00
Victor Stinner
571e8fda9b
regrtest: add the name of the failing test on a child error (-j option)
2011-05-01 22:57:43 +02:00
Brian Curtin
f664345981
Implement #11832 . Add an option to start regrtest and wait for input
...
before continuing.
This is useful for starting up the test suite to attach a debugger such
as Visual Studio or others.
2011-04-28 17:45:17 -05:00
Antoine Pitrou
a4eb194ea6
Merge from 3.2
2011-04-16 18:55:16 +02:00
Antoine Pitrou
ee4293400c
Fix possible "file already exists" error when running the tests in parallel.
...
This is a perfect example of LBYL going wrong: that code could be executed
by several workers in parallel, and os.mkdir() attempted on the same
path by multiple processes.
2011-04-16 18:53:59 +02:00
Victor Stinner
9bf133ca31
Fix #11825 : disable regrtest timeout if Python doesn't support threads
2011-04-13 01:06:27 +02:00
Ross Lagerwall
b2a290c329
Merge with 3.2
2011-04-09 20:12:43 +02:00
Ross Lagerwall
226580e6dc
Merge with 3.1
2011-04-09 20:05:04 +02:00
Ross Lagerwall
e620d10701
Issue #11719 : Fix message about unexpected test_msilib skip.
...
Patch by Nadeem Vawda.
2011-04-09 19:30:03 +02:00
Antoine Pitrou
b1eb660270
Fix faulthandler timeout to avoid breaking buildbots
2011-04-07 23:22:28 +02:00
Victor Stinner
f7ec1698a2
Reenable regrtest.py timeout (30 min): #11738 and #11753 looks to be fixed
2011-04-04 12:54:33 +02:00
Victor Stinner
d7edf3b82d
Issue #11727 , issue #11753 , issue #11755 : disable regrtest timeout
...
Disable regrtest timeout until #11753 and #11755 are fixed
2011-04-03 23:46:42 +02:00
Victor Stinner
d91a5caf0d
Issue #11727 : set regrtest default timeout to 30 minutes
2011-04-01 18:16:36 +02:00
Victor Stinner
305bff1ef5
Issue #11727 : set regrtest default timeout to 15 minutes
2011-04-01 15:59:59 +02:00
Victor Stinner
7d648a0cec
Issue #11727 : Antoine and Arfrever don't like "0 < timeout" style (regrtest.py)
2011-03-31 18:27:50 +02:00
Victor Stinner
0cc8d59069
Issue #11727 : add --timeout option to regrtest (disabled by default).
2011-03-31 18:10:13 +02:00
Victor Stinner
4b73988122
regrtest.py checks that child process exit code is zero
2011-03-31 18:02:36 +02:00
Victor Stinner
bb14b37044
Issue #11393 : reenable all tests in regrtest.py (wooops, sorry Antoine)
2011-03-31 01:34:22 +02:00
Victor Stinner
024e37adcc
Issue #11393 : Add the new faulthandler module
2011-03-31 01:31:06 +02:00
R David Murray
576483085c
#11093 : make NOTTESTS empty by renaming confusingly named files in test dir.
...
Patch by Sandro Tosi.
2011-03-24 14:57:05 -04:00
R David Murray
b588f8dd9f
#11031 : Add --testdir to specify where to find tests
...
Patch by Sandro Tosi. The main purpose of this option is to allow
an alternate set of tests files to be used when running tests
of the regrtest tool itself.
2011-03-24 14:42:58 -04:00
R David Murray
03504fc2fb
#11030 : make --coverdir work for relative directories again.
2011-03-24 14:35:30 -04:00
Antoine Pitrou
f3c524d535
Issue #11653 : fix -W with -j in regrtest.
2011-03-23 23:05:07 +01:00
Antoine Pitrou
293954dd76
Issue #11653 : fix -W with -j in regrtest
2011-03-23 23:01:49 +01:00
Antoine Pitrou
6ab79d9d5b
Allow "-j0" as an argument to regrtest, to automatically select an
...
appropriate number of parallel workers.
2011-03-23 20:17:45 +01:00
R David Murray
661720e7f7
Make regrtest recognize test packages as well as test modules.
2011-03-21 15:14:34 -04:00
Antoine Pitrou
c107fb1b59
Always print out the traceback when a test "crashed"
2011-03-21 19:55:58 +01:00
Antoine Pitrou
779a5b0b3a
Always print out the traceback when a test "crashed"
2011-03-21 19:55:16 +01:00
Ezio Melotti
45763d0d12
Merge with 3.2.
2011-03-20 15:34:28 +02:00
Ezio Melotti
0123e055fa
Add a check for sys.warnoptions in regrtest.
2011-03-20 15:09:26 +02:00
Raymond Hettinger
158c9c26fc
Issue #11085 : Moved collections abstract base classes into a separate module
...
called collections.abc, following the pattern used by importlib.abc. For
backwards compatibility, the names continue to also be imported into the
collections module.
2011-02-22 00:41:50 +00:00
Brett Cannon
31f5929c1e
Issue #10990 : Prevent tests from clobbering a set trace function.
...
Many tests simply didn't care if they unset a pre-existing trace function. This
made test coverage impossible. This patch fixes various tests to put back any
pre-existing trace function. It also introduces test.support.no_tracing as a
decorator which will temporarily unset the trace function for tests which
simply fail otherwise.
Thanks to Kristian Vlaardingerbroek for helping to find the cause of various
trace function unsets.
2011-02-21 19:29:56 +00:00
Brett Cannon
63eef1e0dd
Get --coverage to be an acceptable flag for test.regrtest again.
2011-01-06 22:32:41 +00:00
Georg Brandl
be41a48fb8
On Py3k, -tt and -3 are no-op and unsupported respectively.
2011-01-05 21:47:47 +00:00
Victor Stinner
4b2b43d988
regrtest: close the new stdout and restore the original stdout at exit
...
Fix a ResourceWarning(unclosed file).
2011-01-05 03:54:26 +00:00
Antoine Pitrou
41d5866e56
Merged revisions 87704-87705 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r87704 | antoine.pitrou | 2011-01-03 21:38:52 +0100 (lun., 03 janv. 2011) | 5 lines
Issue #6293 : Have regrtest.py echo back sys.flags. This is done by default
in whole runs and enabled selectively using `--header` when running an
explicit list of tests. Original patch by Collin Winter.
........
r87705 | antoine.pitrou | 2011-01-03 21:40:07 +0100 (lun., 03 janv. 2011) | 3 lines
Mention --randseed in option list
........
2011-01-03 20:47:02 +00:00
Antoine Pitrou
68530ac3c0
Mention --randseed in option list
2011-01-03 20:40:07 +00:00
Antoine Pitrou
3c4402f879
Issue #6293 : Have regrtest.py echo back sys.flags. This is done by default
...
in whole runs and enabled selectively using `--header` when running an
explicit list of tests. Original patch by Collin Winter.
2011-01-03 20:38:52 +00:00
R. David Murray
8e286c472b
#7056 : runtest and runtest_inner don't use testdir, so drop it from their sigs
...
I've only tested regular runs and -j runs. If I've broken anything
else I'm sure I'll hear about it sooner or later.
2010-12-27 20:09:32 +00:00
Nick Coghlan
7bd5dbe9a0
More fine-grained monitoring of alterations to logging state
2010-12-05 07:17:25 +00:00
Nick Coghlan
7d8197516a
Issue 10626 investigation: regrtest now checks for alterations to the logging state in the current process (and yes, test_pydoc alters it)
2010-12-05 06:45:03 +00:00
R. David Murray
cd4f758407
Merged revisions 85086 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r85086 | r.david.murray | 2010-09-28 21:08:05 -0400 (Tue, 28 Sep 2010) | 4 lines
#7110 : have regrtest print test failures and tracebacks to stderr not stdout.
Patch by Sandro Tosi.
........
2010-12-04 17:15:21 +00:00
Michael Foord
3ab34ccae3
Factor out common code from lib/test/__main__.py and lib/test/regrtest.py into a function.
2010-12-03 12:27:40 +00:00
Nick Coghlan
4c4c0f2fe6
Partially revert r78719 - it removed a check that is still needed in some cases (i.e. this will allow Michael to add the test.__main__ support that broke the buildbots previously)
2010-12-03 07:44:33 +00:00
Antoine Pitrou
d95c7b5f8a
Issue #10347 : ignore leading test count ("[ 1/340]") when using the -f option to regrtest.
2010-11-07 20:50:51 +00:00
Antoine Pitrou
a4f1afa640
Merged revisions 85935-85936 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r85935 | antoine.pitrou | 2010-10-29 21:34:45 +0200 (ven., 29 oct. 2010) | 4 lines
Make a GC run before trying to clean up files left over by
the latest test run.
........
r85936 | antoine.pitrou | 2010-10-29 21:36:37 +0200 (ven., 29 oct. 2010) | 3 lines
Fix typo
........
2010-10-31 13:15:20 +00:00
Benjamin Peterson
54ad0beae0
set literals and unions are our friends
2010-10-29 21:33:10 +00:00
Benjamin Peterson
65c66ab255
make gdb skip expected
2010-10-29 21:31:35 +00:00
Antoine Pitrou
2b40efdfe8
Fix typo
2010-10-29 19:36:37 +00:00
Antoine Pitrou
c14efc4e80
Make a GC run before trying to clean up files left over by
...
the latest test run.
2010-10-29 19:34:45 +00:00
Antoine Pitrou
aa8796598a
Actually restore the original asyncore socket map by making a copy of the dict
2010-10-29 11:54:38 +00:00
Skip Montanaro
97019ff665
test_gdb should be skipped on darwin (not up to v7 yet)
2010-10-25 01:35:48 +00:00
Antoine Pitrou
ba8071241b
Revert debug printout
2010-10-15 13:52:53 +00:00
Antoine Pitrou
fe9791365d
Enable debug output at the start of the regression suite instead.
...
Sorry for the ephemeral inconvenience.
2010-10-15 13:47:00 +00:00
Antoine Pitrou
2731494720
Merged revisions 85482 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r85482 | antoine.pitrou | 2010-10-14 17:34:31 +0200 (jeu., 14 oct. 2010) | 4 lines
Replace the "compiler" resource with the more generic "cpu", so
as to mark CPU-heavy tests.
........
2010-10-14 15:41:23 +00:00
Antoine Pitrou
5bc4fa7a49
Replace the "compiler" resource with the more generic "cpu", so
...
as to mark CPU-heavy tests.
2010-10-14 15:34:31 +00:00
Antoine Pitrou
1b03f2ca83
Inherit interpreter flags in parallel testing
2010-10-14 11:12:00 +00:00
R. David Murray
11cabcf73d
#7110 : have regrtest print test failures and tracebacks to stderr not stdout.
...
Patch by Sandro Tosi.
2010-09-29 01:08:05 +00:00
Florent Xicluna
dc69e7217a
Make test.regrtest.__file__ absolute, this was not always the case when running profile or trace, for example. (issue #9323 )
2010-09-13 16:35:02 +00:00
Antoine Pitrou
36e778ef02
Issue #9433 : The "-j" option to regrtest now works under Windows too.
...
It is not sure it will be beneficial, though, since process launching is
more expensive under Windows than it is under Linux.
2010-08-18 20:44:14 +00:00
Antoine Pitrou
b14ac8c2b0
Save and restore the global asyncore.socket_map, and warn if a test modified it
2010-08-16 00:28:05 +00:00
Florent Xicluna
ec882214fe
Merged manually from 2.7 branch to 3.x trunk.
...
------------------------------------------------------------------------
r80411 | florent.xicluna | 2010-04-23 19:59:10 +0200 (ven. 23 avril 2010) | 2 lignes
Remove ImportWarnings filters. They become obsolete after r79310, issue #8205 .
------------------------------------------------------------------------
r80412 | florent.xicluna | 2010-04-23 20:10:12 +0200 (ven. 23 avril 2010) | 2 lignes
Fix the "regrtest -s" switch.
------------------------------------------------------------------------
r81140 | florent.xicluna | 2010-05-13 19:05:29 +0200 (jeu. 13 mai 2010) | 3 lignes
Add sensible information about the OS X platform to diagnose issue #8423 :
test_pep277 fails on "x86 Tiger" buildbot but not on "PPC Tiger".
------------------------------------------------------------------------
r81141 | florent.xicluna | 2010-05-13 20:16:06 +0200 (jeu. 13 mai 2010) | 2 lignes
Revert the additional OS X information (r81140). Keep the endianness information.
------------------------------------------------------------------------
2010-08-09 16:56:43 +00:00
Georg Brandl
e8e02e3b5b
Fix regrtest -F.
2010-08-03 07:56:50 +00:00
Georg Brandl
dee7b8503d
#8560 : add progress indicator to regrtest.
2010-08-02 18:59:52 +00:00
Brett Cannon
4507190a1e
Switch the __import__ state check from using __builtins__ to builtins to be
...
nicer to other VMs.
Thanks to Philip Jenvey for the pointer.
2010-06-14 22:22:54 +00:00
Brett Cannon
5976d975f8
When dealing with __import__ for detecting a global state change made by a
...
test, make sure to check if __builtins__ is a dict or not.
Discovered when running importlib.test.regrtest.
2010-06-12 00:38:29 +00:00
Victor Stinner
db19fb6bb1
Merged revisions 81359-81361 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r81359 | victor.stinner | 2010-05-19 19:00:07 +0200 (mer., 19 mai 2010) | 4 lines
Issue #8663 : distutils.log emulates backslashreplace error handler. Fix
compilation in a non-ASCII directory if stdout encoding is ASCII (eg. if stdout
is not a TTY).
........
r81360 | victor.stinner | 2010-05-19 19:11:19 +0200 (mer., 19 mai 2010) | 5 lines
regrtest.py: call replace_stdout() before the first call to print()
print("== ", os.getcwd()) fails if the current working directory is not ASCII
whereas sys.stdout encoding is ASCII.
........
r81361 | victor.stinner | 2010-05-19 19:15:50 +0200 (mer., 19 mai 2010) | 2 lines
Oops, add the new test_log.py for distutils test suite (missing part of r81359)
........
2010-05-19 20:30:19 +00:00
Victor Stinner
1802d3f388
regrtest.py: call replace_stdout() before the first call to print()
...
print("== ", os.getcwd()) fails if the current working directory is not ASCII
whereas sys.stdout encoding is ASCII.
2010-05-19 17:11:19 +00:00
Victor Stinner
37d2635212
Merged revisions 80905 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r80905 | victor.stinner | 2010-05-07 02:57:12 +0200 (ven., 07 mai 2010) | 4 lines
regrtest.py: disable replace_stdout() on Windows until it is fixed
See issue #8533 (problem with newlines on Windows).
........
2010-05-07 00:58:26 +00:00
Victor Stinner
a3032807f9
regrtest.py: disable replace_stdout() on Windows until it is fixed
...
See issue #8533 (problem with newlines on Windows).
2010-05-07 00:57:12 +00:00
Ronald Oussoren
94f25283c9
Remove traces of MacOS9 support.
...
Fix for issue #7908
2010-05-05 19:11:21 +00:00