Victor Stinner
3d0056842c
bpo-30263: regrtest: log system load ( #1452 )
...
* bpo-30263: regrtest: log system load
* regrtest: log the number of CPUs
Log the number of CPUs in the header. --verbose now imply --header.
2017-05-04 15:21:12 +02:00
Victor Stinner
ec4b17239d
regrtest: always show before/after of modified env ( #1192 )
...
Buildbots don't run tests with -vv and so only log "xxx was modified
by test_xxx" which is not enough to debug such random issue. In many
cases, I'm unable to reproduce the warning and so unable to fix it.
Always logging the value before and value after should help to debug
such warning on buildbots.
2017-04-20 00:57:30 +02:00
Ivan Levkivskyi
7acffa23c9
bpo-29638: Fix spurious refleaks after typing is imported ( #469 )
2017-03-05 20:15:20 +02:00
Victor Stinner
17a63e2169
Fix regrtest -j0 -R output
...
Write also dots into stderr, instead of stdout.
2017-02-08 13:06:08 +01:00
Victor Stinner
5bad70def6
regrtest: don't fail immediately if a child does crash
...
Issue #29362 : Catch a crash of a worker process as a normal failure and
continue to run next tests. It allows to get the usual test summary: single
line result (OK/FAIL), total duration, etc.
2017-02-06 12:42:00 +01:00
Victor Stinner
e8cfec5abc
Issue #29035 : Simplify a regex in libregrtest
...
regrtest: simplify the regex used to match test names for the --fromfile
command line option.
2017-01-03 01:38:58 +01:00
Xiang Zhang
f76df27806
Issue #28950 : Merge 3.6.
2016-12-19 22:05:46 +08:00
Xiang Zhang
772bf2ed83
Issue #28950 : Disallow -j0 combined with -T/-l in regrtest.
2016-12-19 22:00:22 +08:00
Victor Stinner
c24217e144
regrtest --fromfile now accepts a list of filenames
2016-12-09 16:05:51 +01:00
Serhiy Storchaka
684cadaef9
Issue #23839 : Various caches now are cleared before running every test file.
2016-11-11 11:48:22 +02:00
Serhiy Storchaka
839102603c
Issue #23839 : Various caches now are cleared before running every test file.
2016-11-11 11:46:44 +02:00
Serhiy Storchaka
1f9449589e
Issue #28649 : Clear the typing module caches when search for reference leaks.
2016-11-09 23:52:40 +02:00
Serhiy Storchaka
04c954d275
Issue #28649 : Clear the typing module caches when search for reference leaks.
2016-11-09 23:51:54 +02:00
Victor Stinner
8f5dd35d8e
Merge 3.7: Issue #28409 : regrtest: fix the parser of command line arguments.
2016-10-17 18:15:07 +02:00
Victor Stinner
a506a93b0b
Merge 3.6: Issue #28409 : regrtest: fix the parser of command line arguments.
2016-10-17 18:13:46 +02:00
Victor Stinner
e7d3b0cf14
Merge 3.6 (issue #27829 )
2016-09-23 11:16:32 +02:00
Victor Stinner
21c8c92422
Merge 3.5 (issue #27829 )
2016-09-23 11:15:50 +02:00
Victor Stinner
3e56c23e7d
regrtest: add -u for unbuffered stdout/stderr
2016-09-21 17:12:50 +02:00
Victor Stinner
eddc4b7272
Merge 3.5 (regrtest)
2016-09-10 04:27:56 -04:00
Eric V. Smith
451d0e38fc
Issue 27948: Allow backslashes in the literal string portion of f-strings, but not in the expressions. Also, require expressions to begin and end with literal curly braces.
2016-09-09 21:56:20 -04:00
Victor Stinner
b96ef55d49
regrtest: log FS and locale encodings
2016-09-08 21:46:56 -07:00
Steve Dower
22d0698d3b
Adds test.support.PGO and skips tests that are not useful for PGO.
2016-09-06 19:38:15 -07:00
Eric V. Smith
6a4efce7a5
Closes issue 27921: Disallow backslashes anywhere in f-strings. This is a temporary restriction. In 3.6 beta 2, the plan is to again allow backslashes in the string parts of f-strings, but disallow them in the expression parts.
2016-09-03 09:18:34 -04:00
Victor Stinner
ad7b6c3720
Issue #27829 : libregrtest.save_env: flush stderr
...
Use flush=True to try to get a warning which is missing in buildbots.
Use also f-string to make the code shorter.
2016-08-22 14:29:54 +02:00
Victor Stinner
ab98367747
Cleanup libregrtest
...
* main.py: remove unused import
* runtest: simplify runtest_inner() parameters, reuse ns parameter
2016-08-22 14:28:52 +02:00
Martin Panter
051b2201a7
Issue #27787 : Merge regrtest fixup from 3.5
2016-08-20 07:38:21 +00:00
Victor Stinner
f2abf5c11a
regrtest: replace "Result:" with "Tests result:"
2016-08-19 17:54:25 +02:00
Victor Stinner
636860354e
regrtest: add a summary of the summary, "Result: xxx"
...
It's sometimes hard to check quickly if tests succeeded, failed or something
bad happened. I added a final "Result: xxx" line which summarizes all outputs
into a single line, written at the end (it should always be the last line of
the output).
2016-08-17 16:12:16 +02:00
Victor Stinner
c5a01f8551
regrtest: set interrupted to True if re-run is interrupted
2016-08-17 16:00:12 +02:00
Victor Stinner
8f00319294
regrtest: add newlines in output for readability
2016-08-17 15:42:21 +02:00
Victor Stinner
435eaf4422
regrtest: nicer output for durations
...
Use milliseconds and minutes units, not only seconds.
2016-08-17 12:22:52 +02:00
Victor Stinner
6c44619ece
regrtest: rename --slow option to --slowest
...
Thanks to optparse, --slow syntax still works ;-)
2016-08-17 11:25:43 +02:00
Alexander Belopolsky
5d0c598382
Closes issue #24773 : Implement PEP 495 (Local Time Disambiguation).
2016-07-22 18:47:04 -04:00
Victor Stinner
1b8b42344e
regrtest: display test result (passed, failed, ...)
...
* in multiprocessing mode: always display the result
* sequential mode: only display the result if the test did not pass
2016-05-20 13:37:40 +02:00
Victor Stinner
6d81a2136d
regrtest doesn't ignore -j1 anymore
...
* regrtest now uses subprocesses when the -j1 command line option
is used: each test file runs in a fresh child process. Before, the -j1 option
was ignored.
* Tools/buildbot/test.bat script now uses -j1 by default to run
each test file in fresh child process.
2016-05-20 13:15:55 +02:00
Victor Stinner
9759dd3343
Issue #26295 : When using "python3 -m test --testdir=TESTDIR", regrtest doesn't
...
add "test." prefix to test module names.
regrtest also prepends testdir to sys.path.
2016-03-30 02:32:52 +02:00
Victor Stinner
8a96389d47
Merge 3.5 (regrtest)
2016-03-29 13:34:06 +02:00
Victor Stinner
80ec58c497
fix typo in comment
...
Thanks Arfrever for the report :)
2016-03-29 09:50:18 +02:00
Victor Stinner
622583e9bf
regrtest: round final timing towards +inf
2016-03-27 18:28:15 +02:00
Victor Stinner
d7ac00e620
Backed out changeset 245a16f33c4b
...
Serhiy asked me to review it.
2016-03-25 19:13:06 +01:00
Victor Stinner
ba8cf10873
Rework libregrtest.save_env
...
* Replace get/restore methods with a Resource class and Resource subclasses
* Create ModuleAttr, ModuleAttrList and ModuleAttrDict helper classes
* Use __subclasses__() to get resource classes instead of using an hardcoded
list (2 shutil resources were missinged in the list!)
* Don't define MultiprocessingProcessDangling resource if the multiprocessing
module is missing
* Nicer diff for dictionaries. Useful for the big os.environ dict
* Reorder code to group resources
2016-03-25 17:36:33 +01:00
Victor Stinner
3aac0adfe0
Cleanup regrtest "main()" function
...
* Rename libregrtest.main_in_temp_cwd() to libregrtest.main()
* Add regrtest.main_in_temp_cwd() alias to libregrtest.main()
* Move old main_in_temp_cwd() code into libregrtest.Regrtest.main()
* Update multiple scripts to call libregrtest.main()
2016-03-24 17:53:20 +01:00
Victor Stinner
56db16cd44
regrtest: when parallel tests are interrupted, display progress
2016-03-24 12:04:15 +01:00
Victor Stinner
2b60b7237e
regrtest: mention in tests run sequentially or in parallel
2016-03-24 11:55:29 +01:00
Victor Stinner
5de16e80c1
regrtest: fix --fromfile feature
...
* Update code for the name regrtest output format.
* Enhance also test_regrtest test on --fromfile
2016-03-24 09:43:00 +01:00
Victor Stinner
69649f21f0
regrtest: display test duration in sequential mode
...
Only display duration if a test takes more than 30 seconds.
2016-03-23 12:14:10 +01:00
Victor Stinner
6d7f4f6675
regrtest: add timeout to main process when using -jN
...
libregrtest: add a watchdog to run_tests_multiprocess() using
faulthandler.dump_traceback_later().
2016-03-23 02:04:32 +01:00
Victor Stinner
24f949e10c
regrtest: add time to output
...
Timestamps should help to debug slow buildbots, and timeout and hang on
buildbots.
2016-03-22 15:14:09 +01:00
Victor Stinner
82f04e2dfd
regrtest: Fix module.__path__
...
Issue #26538 : libregrtest: Fix setup_tests() to keep module.__path__ type
(_NamespacePath), don't convert to a list.
Add _NamespacePath.__setitem__() method to importlib._bootstrap_external.
2016-03-15 23:08:44 +01:00
Victor Stinner
45550178ef
regrtest: display progress every 30 seconds (instead of 60 seconds) when
...
running tests in multiprocessing mode (-jN).
2015-11-04 09:03:53 +01:00