Victor Stinner
a0ccc54e6d
Synchronize libregrtest from master to 3.6 ( #2244 )
...
* bpo-30523: regrtest: Add --list-cases option (#2238 )
* bpo-30284: Fix regrtest for out of tree build (#1481 )
* bpo-30540: regrtest: add --matchfile option (#1909 )
* bpo-30258: regrtest: Fix run_tests_multiprocess() (#1479 )
* bpo-30263: regrtest: log system load (#1452 )
2017-06-16 14:39:09 +02:00
Victor Stinner
2773add19a
bpo-27103: regrtest disables -W if -R is used ( #1651 ) ( #1656 )
...
Workaround for a regrtest bug.
(cherry picked from commit fcdd9b6b7e
)
2017-05-18 13:36:51 -07:00
Victor Stinner
564e89f43b
regrtest: always show before/after of modified env ( #1192 ) ( #1406 )
...
Buildbots don't run tests with -vv and so only log "xxx was modified
by test_xxx" which is not enough to debug such random issue. In many
cases, I'm unable to reproduce the warning and so unable to fix it.
Always logging the value before and value after should help to debug
such warning on buildbots.
(cherry picked from commit ec4b17239d
)
2017-05-03 02:12:22 +02:00
Ivan Levkivskyi
b414e349eb
bpo-29638: Fix spurious refleaks after typing is imported ( #469 ) ( #483 )
2017-03-05 21:18:43 +02:00
Xiang Zhang
772bf2ed83
Issue #28950 : Disallow -j0 combined with -T/-l in regrtest.
2016-12-19 22:00:22 +08:00
Serhiy Storchaka
839102603c
Issue #23839 : Various caches now are cleared before running every test file.
2016-11-11 11:46:44 +02:00
Serhiy Storchaka
04c954d275
Issue #28649 : Clear the typing module caches when search for reference leaks.
2016-11-09 23:51:54 +02:00
Victor Stinner
a506a93b0b
Merge 3.6: Issue #28409 : regrtest: fix the parser of command line arguments.
2016-10-17 18:13:46 +02:00
Victor Stinner
21c8c92422
Merge 3.5 (issue #27829 )
2016-09-23 11:15:50 +02:00
Victor Stinner
eddc4b7272
Merge 3.5 (regrtest)
2016-09-10 04:27:56 -04:00
Eric V. Smith
451d0e38fc
Issue 27948: Allow backslashes in the literal string portion of f-strings, but not in the expressions. Also, require expressions to begin and end with literal curly braces.
2016-09-09 21:56:20 -04:00
Victor Stinner
b96ef55d49
regrtest: log FS and locale encodings
2016-09-08 21:46:56 -07:00
Steve Dower
22d0698d3b
Adds test.support.PGO and skips tests that are not useful for PGO.
2016-09-06 19:38:15 -07:00
Eric V. Smith
6a4efce7a5
Closes issue 27921: Disallow backslashes anywhere in f-strings. This is a temporary restriction. In 3.6 beta 2, the plan is to again allow backslashes in the string parts of f-strings, but disallow them in the expression parts.
2016-09-03 09:18:34 -04:00
Victor Stinner
ad7b6c3720
Issue #27829 : libregrtest.save_env: flush stderr
...
Use flush=True to try to get a warning which is missing in buildbots.
Use also f-string to make the code shorter.
2016-08-22 14:29:54 +02:00
Victor Stinner
ab98367747
Cleanup libregrtest
...
* main.py: remove unused import
* runtest: simplify runtest_inner() parameters, reuse ns parameter
2016-08-22 14:28:52 +02:00
Martin Panter
051b2201a7
Issue #27787 : Merge regrtest fixup from 3.5
2016-08-20 07:38:21 +00:00
Victor Stinner
f2abf5c11a
regrtest: replace "Result:" with "Tests result:"
2016-08-19 17:54:25 +02:00
Victor Stinner
636860354e
regrtest: add a summary of the summary, "Result: xxx"
...
It's sometimes hard to check quickly if tests succeeded, failed or something
bad happened. I added a final "Result: xxx" line which summarizes all outputs
into a single line, written at the end (it should always be the last line of
the output).
2016-08-17 16:12:16 +02:00
Victor Stinner
c5a01f8551
regrtest: set interrupted to True if re-run is interrupted
2016-08-17 16:00:12 +02:00
Victor Stinner
8f00319294
regrtest: add newlines in output for readability
2016-08-17 15:42:21 +02:00
Victor Stinner
435eaf4422
regrtest: nicer output for durations
...
Use milliseconds and minutes units, not only seconds.
2016-08-17 12:22:52 +02:00
Victor Stinner
6c44619ece
regrtest: rename --slow option to --slowest
...
Thanks to optparse, --slow syntax still works ;-)
2016-08-17 11:25:43 +02:00
Alexander Belopolsky
5d0c598382
Closes issue #24773 : Implement PEP 495 (Local Time Disambiguation).
2016-07-22 18:47:04 -04:00
Victor Stinner
1b8b42344e
regrtest: display test result (passed, failed, ...)
...
* in multiprocessing mode: always display the result
* sequential mode: only display the result if the test did not pass
2016-05-20 13:37:40 +02:00
Victor Stinner
6d81a2136d
regrtest doesn't ignore -j1 anymore
...
* regrtest now uses subprocesses when the -j1 command line option
is used: each test file runs in a fresh child process. Before, the -j1 option
was ignored.
* Tools/buildbot/test.bat script now uses -j1 by default to run
each test file in fresh child process.
2016-05-20 13:15:55 +02:00
Victor Stinner
9759dd3343
Issue #26295 : When using "python3 -m test --testdir=TESTDIR", regrtest doesn't
...
add "test." prefix to test module names.
regrtest also prepends testdir to sys.path.
2016-03-30 02:32:52 +02:00
Victor Stinner
8a96389d47
Merge 3.5 (regrtest)
2016-03-29 13:34:06 +02:00
Victor Stinner
80ec58c497
fix typo in comment
...
Thanks Arfrever for the report :)
2016-03-29 09:50:18 +02:00
Victor Stinner
622583e9bf
regrtest: round final timing towards +inf
2016-03-27 18:28:15 +02:00
Victor Stinner
d7ac00e620
Backed out changeset 245a16f33c4b
...
Serhiy asked me to review it.
2016-03-25 19:13:06 +01:00
Victor Stinner
ba8cf10873
Rework libregrtest.save_env
...
* Replace get/restore methods with a Resource class and Resource subclasses
* Create ModuleAttr, ModuleAttrList and ModuleAttrDict helper classes
* Use __subclasses__() to get resource classes instead of using an hardcoded
list (2 shutil resources were missinged in the list!)
* Don't define MultiprocessingProcessDangling resource if the multiprocessing
module is missing
* Nicer diff for dictionaries. Useful for the big os.environ dict
* Reorder code to group resources
2016-03-25 17:36:33 +01:00
Victor Stinner
3aac0adfe0
Cleanup regrtest "main()" function
...
* Rename libregrtest.main_in_temp_cwd() to libregrtest.main()
* Add regrtest.main_in_temp_cwd() alias to libregrtest.main()
* Move old main_in_temp_cwd() code into libregrtest.Regrtest.main()
* Update multiple scripts to call libregrtest.main()
2016-03-24 17:53:20 +01:00
Victor Stinner
56db16cd44
regrtest: when parallel tests are interrupted, display progress
2016-03-24 12:04:15 +01:00
Victor Stinner
2b60b7237e
regrtest: mention in tests run sequentially or in parallel
2016-03-24 11:55:29 +01:00
Victor Stinner
5de16e80c1
regrtest: fix --fromfile feature
...
* Update code for the name regrtest output format.
* Enhance also test_regrtest test on --fromfile
2016-03-24 09:43:00 +01:00
Victor Stinner
69649f21f0
regrtest: display test duration in sequential mode
...
Only display duration if a test takes more than 30 seconds.
2016-03-23 12:14:10 +01:00
Victor Stinner
6d7f4f6675
regrtest: add timeout to main process when using -jN
...
libregrtest: add a watchdog to run_tests_multiprocess() using
faulthandler.dump_traceback_later().
2016-03-23 02:04:32 +01:00
Victor Stinner
24f949e10c
regrtest: add time to output
...
Timestamps should help to debug slow buildbots, and timeout and hang on
buildbots.
2016-03-22 15:14:09 +01:00
Victor Stinner
82f04e2dfd
regrtest: Fix module.__path__
...
Issue #26538 : libregrtest: Fix setup_tests() to keep module.__path__ type
(_NamespacePath), don't convert to a list.
Add _NamespacePath.__setitem__() method to importlib._bootstrap_external.
2016-03-15 23:08:44 +01:00
Victor Stinner
45550178ef
regrtest: display progress every 30 seconds (instead of 60 seconds) when
...
running tests in multiprocessing mode (-jN).
2015-11-04 09:03:53 +01:00
Serhiy Storchaka
4a7c03aab4
Issue #25523 : Merge a-to-an corrections from 3.5.
2015-11-02 14:44:29 +02:00
Victor Stinner
3909e58994
Close #25373 : Fix regrtest --slow with interrupted test
...
* Fix accumulate_result(): don't use time on interrupted and failed test
* Add unit test for interrupted test
* Add unit test on --slow with interrupted test, with and without
multiprocessing
2015-10-11 10:37:25 +02:00
Steve Dower
08ec6d9611
Fix missing import in libregrtest.
2015-10-08 11:34:07 -07:00
Steve Dower
12c2945ccf
Issue #23919 : Prevents assert dialogs appearing in the test suite.
2015-10-08 09:05:36 -07:00
Brett Cannon
11faa21843
Merge from 3.5 for issue #25188 .
2015-10-02 16:20:49 -07:00
Victor Stinner
5f9d3acc5e
Issue #22806 : Add ``python -m test --list-tests`` command to list tests.
2015-10-03 00:21:12 +02:00
Victor Stinner
076fc872bc
Issue #18174 : "python -m test --huntrleaks ..." now also checks for leak of
...
file descriptors. Patch written by Richard Oudkerk.
2015-10-03 00:20:56 +02:00
Victor Stinner
a53a818c3c
Fix regrtest --coverage on Windows
...
Issue #25260 : Fix ``python -m test --coverage`` on Windows. Remove the list of
ignored directories.
2015-10-01 00:53:09 +02:00
Victor Stinner
9a14214aee
Issue #25220 : Fix "-m test --forever"
...
* Fix "-m test --forever": replace _test_forever() with self._test_forever()
* Add unit test for --forever
* Add unit test for a failing test
* Fix also some pyflakes warnings in libregrtest
2015-09-30 13:51:17 +02:00