Victor Stinner
eddc4b7272
Merge 3.5 (regrtest)
2016-09-10 04:27:56 -04:00
Eric V. Smith
451d0e38fc
Issue 27948: Allow backslashes in the literal string portion of f-strings, but not in the expressions. Also, require expressions to begin and end with literal curly braces.
2016-09-09 21:56:20 -04:00
Victor Stinner
b96ef55d49
regrtest: log FS and locale encodings
2016-09-08 21:46:56 -07:00
Steve Dower
22d0698d3b
Adds test.support.PGO and skips tests that are not useful for PGO.
2016-09-06 19:38:15 -07:00
Eric V. Smith
6a4efce7a5
Closes issue 27921: Disallow backslashes anywhere in f-strings. This is a temporary restriction. In 3.6 beta 2, the plan is to again allow backslashes in the string parts of f-strings, but disallow them in the expression parts.
2016-09-03 09:18:34 -04:00
Victor Stinner
ad7b6c3720
Issue #27829 : libregrtest.save_env: flush stderr
...
Use flush=True to try to get a warning which is missing in buildbots.
Use also f-string to make the code shorter.
2016-08-22 14:29:54 +02:00
Victor Stinner
ab98367747
Cleanup libregrtest
...
* main.py: remove unused import
* runtest: simplify runtest_inner() parameters, reuse ns parameter
2016-08-22 14:28:52 +02:00
Martin Panter
051b2201a7
Issue #27787 : Merge regrtest fixup from 3.5
2016-08-20 07:38:21 +00:00
Victor Stinner
f2abf5c11a
regrtest: replace "Result:" with "Tests result:"
2016-08-19 17:54:25 +02:00
Victor Stinner
636860354e
regrtest: add a summary of the summary, "Result: xxx"
...
It's sometimes hard to check quickly if tests succeeded, failed or something
bad happened. I added a final "Result: xxx" line which summarizes all outputs
into a single line, written at the end (it should always be the last line of
the output).
2016-08-17 16:12:16 +02:00
Victor Stinner
c5a01f8551
regrtest: set interrupted to True if re-run is interrupted
2016-08-17 16:00:12 +02:00
Victor Stinner
8f00319294
regrtest: add newlines in output for readability
2016-08-17 15:42:21 +02:00
Victor Stinner
435eaf4422
regrtest: nicer output for durations
...
Use milliseconds and minutes units, not only seconds.
2016-08-17 12:22:52 +02:00
Victor Stinner
6c44619ece
regrtest: rename --slow option to --slowest
...
Thanks to optparse, --slow syntax still works ;-)
2016-08-17 11:25:43 +02:00
Alexander Belopolsky
5d0c598382
Closes issue #24773 : Implement PEP 495 (Local Time Disambiguation).
2016-07-22 18:47:04 -04:00
Victor Stinner
1b8b42344e
regrtest: display test result (passed, failed, ...)
...
* in multiprocessing mode: always display the result
* sequential mode: only display the result if the test did not pass
2016-05-20 13:37:40 +02:00
Victor Stinner
6d81a2136d
regrtest doesn't ignore -j1 anymore
...
* regrtest now uses subprocesses when the -j1 command line option
is used: each test file runs in a fresh child process. Before, the -j1 option
was ignored.
* Tools/buildbot/test.bat script now uses -j1 by default to run
each test file in fresh child process.
2016-05-20 13:15:55 +02:00
Victor Stinner
9759dd3343
Issue #26295 : When using "python3 -m test --testdir=TESTDIR", regrtest doesn't
...
add "test." prefix to test module names.
regrtest also prepends testdir to sys.path.
2016-03-30 02:32:52 +02:00
Victor Stinner
8a96389d47
Merge 3.5 (regrtest)
2016-03-29 13:34:06 +02:00
Victor Stinner
80ec58c497
fix typo in comment
...
Thanks Arfrever for the report :)
2016-03-29 09:50:18 +02:00
Victor Stinner
622583e9bf
regrtest: round final timing towards +inf
2016-03-27 18:28:15 +02:00
Victor Stinner
d7ac00e620
Backed out changeset 245a16f33c4b
...
Serhiy asked me to review it.
2016-03-25 19:13:06 +01:00
Victor Stinner
ba8cf10873
Rework libregrtest.save_env
...
* Replace get/restore methods with a Resource class and Resource subclasses
* Create ModuleAttr, ModuleAttrList and ModuleAttrDict helper classes
* Use __subclasses__() to get resource classes instead of using an hardcoded
list (2 shutil resources were missinged in the list!)
* Don't define MultiprocessingProcessDangling resource if the multiprocessing
module is missing
* Nicer diff for dictionaries. Useful for the big os.environ dict
* Reorder code to group resources
2016-03-25 17:36:33 +01:00
Victor Stinner
3aac0adfe0
Cleanup regrtest "main()" function
...
* Rename libregrtest.main_in_temp_cwd() to libregrtest.main()
* Add regrtest.main_in_temp_cwd() alias to libregrtest.main()
* Move old main_in_temp_cwd() code into libregrtest.Regrtest.main()
* Update multiple scripts to call libregrtest.main()
2016-03-24 17:53:20 +01:00
Victor Stinner
56db16cd44
regrtest: when parallel tests are interrupted, display progress
2016-03-24 12:04:15 +01:00
Victor Stinner
2b60b7237e
regrtest: mention in tests run sequentially or in parallel
2016-03-24 11:55:29 +01:00
Victor Stinner
5de16e80c1
regrtest: fix --fromfile feature
...
* Update code for the name regrtest output format.
* Enhance also test_regrtest test on --fromfile
2016-03-24 09:43:00 +01:00
Victor Stinner
69649f21f0
regrtest: display test duration in sequential mode
...
Only display duration if a test takes more than 30 seconds.
2016-03-23 12:14:10 +01:00
Victor Stinner
6d7f4f6675
regrtest: add timeout to main process when using -jN
...
libregrtest: add a watchdog to run_tests_multiprocess() using
faulthandler.dump_traceback_later().
2016-03-23 02:04:32 +01:00
Victor Stinner
24f949e10c
regrtest: add time to output
...
Timestamps should help to debug slow buildbots, and timeout and hang on
buildbots.
2016-03-22 15:14:09 +01:00
Victor Stinner
82f04e2dfd
regrtest: Fix module.__path__
...
Issue #26538 : libregrtest: Fix setup_tests() to keep module.__path__ type
(_NamespacePath), don't convert to a list.
Add _NamespacePath.__setitem__() method to importlib._bootstrap_external.
2016-03-15 23:08:44 +01:00
Victor Stinner
45550178ef
regrtest: display progress every 30 seconds (instead of 60 seconds) when
...
running tests in multiprocessing mode (-jN).
2015-11-04 09:03:53 +01:00
Serhiy Storchaka
4a7c03aab4
Issue #25523 : Merge a-to-an corrections from 3.5.
2015-11-02 14:44:29 +02:00
Victor Stinner
3909e58994
Close #25373 : Fix regrtest --slow with interrupted test
...
* Fix accumulate_result(): don't use time on interrupted and failed test
* Add unit test for interrupted test
* Add unit test on --slow with interrupted test, with and without
multiprocessing
2015-10-11 10:37:25 +02:00
Steve Dower
08ec6d9611
Fix missing import in libregrtest.
2015-10-08 11:34:07 -07:00
Steve Dower
12c2945ccf
Issue #23919 : Prevents assert dialogs appearing in the test suite.
2015-10-08 09:05:36 -07:00
Brett Cannon
11faa21843
Merge from 3.5 for issue #25188 .
2015-10-02 16:20:49 -07:00
Victor Stinner
5f9d3acc5e
Issue #22806 : Add ``python -m test --list-tests`` command to list tests.
2015-10-03 00:21:12 +02:00
Victor Stinner
076fc872bc
Issue #18174 : "python -m test --huntrleaks ..." now also checks for leak of
...
file descriptors. Patch written by Richard Oudkerk.
2015-10-03 00:20:56 +02:00
Victor Stinner
a53a818c3c
Fix regrtest --coverage on Windows
...
Issue #25260 : Fix ``python -m test --coverage`` on Windows. Remove the list of
ignored directories.
2015-10-01 00:53:09 +02:00
Victor Stinner
9a14214aee
Issue #25220 : Fix "-m test --forever"
...
* Fix "-m test --forever": replace _test_forever() with self._test_forever()
* Add unit test for --forever
* Add unit test for a failing test
* Fix also some pyflakes warnings in libregrtest
2015-09-30 13:51:17 +02:00
Victor Stinner
17f9716676
Issue #25220 , libregrtest: more verbose output for -jN
...
When the -jN command line option is used, display tests running since at least
30 seconds every minute.
2015-09-30 03:05:43 +02:00
Victor Stinner
b40843546b
Issue #25220 , libregrtest: Cleanup
...
No need to support.verbose in Regrtest.run_tests(), it's always set in
runtest().
2015-09-30 02:39:22 +02:00
Victor Stinner
6f20a2e01f
Issue #25220 , libregrtest: Pass directly ns to runtest()
...
* Remove runtest_ns(): pass directly ns to runtest().
* Create also Regrtest.rerun_failed_tests() method.
* Inline again Regrtest.run_test(): it's no more justified to have a method
2015-09-30 02:32:11 +02:00
Victor Stinner
a204502dbf
Issue #25220 , libregrtest: Set support.use_resources in setup_tests()
...
* Rename setup_python() to setup_tests()
* Remove use_resources parameter of runtest()
2015-09-30 02:17:28 +02:00
Victor Stinner
ecef622fec
Issue #25220 , libregrtest: Call setup_python(ns) in the slaves
...
Slaves (child processes running tests for regrtest -jN) now inherit
--memlimit/-M, --threshold/-t and --nowindows/-n options.
* -M, -t and -n are now supported with -jN
* Factorize code to run tests.
* run_test_in_subprocess() now pass the whole "ns" namespace to the child
process.
2015-09-30 01:39:28 +02:00
Victor Stinner
8bb19f094b
Issue #25220 , libregrtest: Add runtest_ns() function
...
* Factorize code to run tests.
* run_test_in_subprocess() now pass the whole "ns" namespace to the child
process.
2015-09-30 01:32:39 +02:00
Victor Stinner
234cbef39f
Issue #25220 , libregrtest: Move setup_python() to a new submodule
2015-09-30 01:13:53 +02:00
Victor Stinner
c7eab0528c
Issue #25220 , libregrtest: Cleanup setup code
2015-09-30 00:59:35 +02:00
Victor Stinner
f33536c430
Issue #25220 : Use print(flush=True) in libregrtest
2015-09-30 00:48:27 +02:00