3c6b0d967e
[3.7] Revert "bpo-34172: multiprocessing.Pool leaks resources after being deleted (GH-8450) (GH-9676)" ( #10968 )
...
This reverts commit 97f998a4df
2018-12-06 01:49:05 +01:00
97f998a4df
bpo-34172: multiprocessing.Pool leaks resources after being deleted (GH-8450) (GH-9676)
...
Fix a reference issue inside multiprocessing.Pool that caused the pool to remain alive if it was deleted without being closed or terminated explicitly.
(cherry picked from commit 97bfe8d3eb
2018-10-02 23:17:04 +02:00
ab74504346
bpo-32576: use queue.SimpleQueue in critical places ( #5216 )
...
Where a queue may be invoked from a weakref callback, we need
to use the reentrant SimpleQueue.
2018-01-18 10:38:03 +01:00
e91c2a5086
[Trivial] Remove now redundant assert ( #3245 )
2017-08-30 16:57:12 +02:00
bd73e72b4a
bpo-5001: More-informative multiprocessing error messages ( #3079 )
...
* Make error message more informative
Replace assertions in error-reporting code with more-informative version that doesn't cause confusion over where and what the error is.
* Additional clarification + get travis to check
* Change from SystemError to TypeError
As suggested in PR comment by @pitrou, changing from SystemError; TypeError appears appropriate.
* NEWS file installation; ACKS addition (will do my best to justify it by additional work)
* Making current AssertionErrors in multiprocessing more informative
* Blurb added re multiprocessing managers.py, queues.py cleanup
* Further multiprocessing cleanup - went through pool.py
* Fix two asserts in multiprocessing/util.py
* Most asserts in multiprocessing more informative
* Didn't save right version
* Further work on multiprocessing error messages
* Correct typo
* Correct typo v2
* Blasted colon... serves me right for trying to work on two things at once
* Simplify NEWS entry
* Update 2017-08-18-17-16-38.bpo-5001.gwnthq.rst
* Update 2017-08-18-17-16-38.bpo-5001.gwnthq.rst
OK, never mind.
* Corrected (thanks to pitrou) error messages for notify
* Remove extraneous backslash in docstring.
2017-08-30 00:52:18 +02:00
5affd23e6f
bpo-29762: More use "raise from None". ( #569 )
...
This hides unwanted implementation details from tracebacks.
2017-04-05 09:37:24 +03:00
794623bdb2
bpo-28699: fix abnormal behaviour of pools in multiprocessing.pool (GH-693)
...
an exception raised at the very first of an iterable would cause pools behave abnormally
(swallow the exception or hang)
2017-03-29 11:58:54 +08:00
8988945cdc
bpo-29861: release references to multiprocessing Pool tasks ( #743 )
...
* bpo-29861: release references to multiprocessing Pool tasks
Release references to tasks, their arguments and their results as soon
as they are finished, instead of keeping them alive until another task
arrives.
* Comments in test
2017-03-24 13:52:11 +01:00
78f55ffc63
Issue #23992 : multiprocessing: make MapResult not fail-fast upon exception.
2016-02-10 22:58:18 +00:00
63623ac252
Issue #23051 : multiprocessing.Pool methods imap() and imap_unordered() now
...
handle exceptions raised by an iterator. Patch by Alon Diamant and Davin
Potts.
2015-03-13 08:30:33 +02:00
79fbeee237
Issue #23051 : multiprocessing.Pool methods imap() and imap_unordered() now
...
handle exceptions raised by an iterator. Patch by Alon Diamant and Davin
Potts.
2015-03-13 08:25:26 +02:00
465e60e654
Issue #22033 : Reprs of most Python implemened classes now contain actual
...
class name instead of hardcoded one.
2014-07-25 23:36:00 +03:00
a924fc7abc
Issue #21565 : multiprocessing: use contex-manager protocol for synchronization
...
primitives.
2014-05-25 14:12:12 +01:00
80a5be1d84
Issue #20980 : Stop wrapping exception when using ThreadPool.
2014-03-23 12:30:54 +00:00
7fa767e517
Issue #20976 : pyflakes: Remove unused imports
2014-03-20 09:16:38 +01:00
33aaa73cad
Merge.
2013-10-28 23:23:04 +00:00
e90cedb711
Issue #19425 -- a pickling error should not cause pool to hang.
2013-10-28 23:11:58 +00:00
b1694cf588
Issue #18999 : Make multiprocessing use context objects.
...
This allows different parts of a program to use different methods for
starting processes without interfering with each other.
2013-10-16 16:41:56 +01:00
84ed9a68bd
Issue #8713 : Support alternative start methods in multiprocessing on Unix.
...
See http://hg.python.org/sandbox/sbt#spawn
2013-08-14 15:35:41 +01:00
37cfb0a920
Issue #17914 : Use os.cpu_count() instead of multiprocessing.cpu_count() where
...
applicable.
2013-06-28 19:25:45 +02:00
f3a0da24f3
Merge
2013-05-06 12:13:50 +01:00
def51ca8ea
Issue #17805 : Add AsyncResult alias for ApplyResult
2013-05-06 12:10:04 +01:00
8575783a00
Issue #13813 : Embed stringification of remote traceback in local
...
traceback raised when pool task raises an exception.
2013-05-06 11:38:25 +01:00
f7a17b48d7
Replace IOError with OSError ( #16715 )
2012-12-25 16:47:37 +02:00
254af2644a
#16307 : Fix multiprocessing.Pool.map_async not calling its callbacks
...
Patch by Janne Karila.
2012-10-27 12:53:02 +02:00
3095f4724e
raise a ValueError instead of an AssertionError when pool is an invalid state
2012-09-25 12:45:42 -04:00
d69cfe88ea
Issue #15064 : Implement context manager protocol for multiprocessing types
2012-06-18 17:47:52 +01:00
0f884273b0
Issue #15101 : Make pool finalizer avoid joining current thread.
2012-06-18 16:02:49 +01:00
f29ec4b0c8
Issue #15101 : Make pool finalizer avoid joining current thread.
2012-06-18 15:54:57 +01:00
58ba47f97b
Merge fixes for #13854 and #12157 .
2012-06-07 20:38:11 +01:00
e41682b994
Issue #12157 : pool.map() does not handle empty iterable correctly
...
Initial patch by mouad
2012-06-06 19:04:57 +01:00
692130a231
Issue #12091 : simplify ApplyResult and MapResult with threading.Event
...
Patch by Charles-François Natali
2012-05-25 13:26:53 +01:00
3e268aac3b
Mark multiprocessing files with "Licensed to PSF under a Contributor Agreement"
...
instead of BSD licence.
2012-04-30 12:13:55 +01:00
de911b2915
Issue #12708 : Add starmap() and starmap_async() methods (similar to itertools.starmap()) to multiprocessing.Pool.
...
Patch by Hynek Schlawack.
2011-12-21 11:03:24 +01:00
5d1155c08e
Closes #13258 : Use callable() built-in in the standard library.
2011-10-28 14:45:05 +02:00
f8859e1808
Issue #10332 : multiprocessing: fix a race condition when a Pool is closed
...
before all tasks have completed.
2011-10-24 18:45:29 +02:00
2fae27b735
Issue #12285 : multiprocessing.Pool() raises a ValueError if the number of
...
processes if negative or null.
2011-06-20 17:53:35 +02:00
bed9a5b6b3
Issue #11814 : Fix likely typo in multiprocessing.Pool._terminate().
2011-04-11 00:20:23 +02:00
81dee6b4d4
Issue #8428 : Fix a race condition in multiprocessing.Pool when terminating
...
worker processes: new processes would be spawned while the pool is being
shut down. Patch by Charles-François Natali.
2011-04-11 00:18:59 +02:00
3fc969a4a2
9162: fix license in multiprocessing files
2010-12-14 01:38:16 +00:00
2afcbf2249
Issue #9244 : multiprocessing.pool: Worker crashes if result can't be encoded
2010-11-09 20:55:52 +00:00
7c3e577395
Issue #7316 : the acquire() method of lock objects in the :mod:`threading`
...
module now takes an optional timeout argument in seconds. Timeout support
relies on the system threading library, so as to avoid a semi-busy wait
loop.
2010-04-14 15:44:10 +00:00
998171f0d7
Merged revisions 78777,78787,78790 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r78777 | florent.xicluna | 2010-03-08 00:49:03 +0100 (lun, 08 mar 2010) | 4 lines
Backport the Popen.poll() protection from subprocess to multiprocessing. See #1731717 .
It should fix transient failures on test_multiprocessing.
........
r78787 | florent.xicluna | 2010-03-08 08:21:16 +0100 (lun, 08 mar 2010) | 2 lines
Don't fail on a debug() statement, if the worker PID is (still) None.
........
r78790 | florent.xicluna | 2010-03-08 12:01:39 +0100 (lun, 08 mar 2010) | 2 lines
On finalize, don't try to join not started process.
........
2010-03-08 13:32:17 +00:00
1f0b658638
Merged revisions 77794 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r77794 | jesse.noller | 2010-01-26 22:05:57 -0500 (Tue, 26 Jan 2010) | 1 line
Issue #6963 : Added maxtasksperchild argument to multiprocessing.Pool
........
2010-01-27 03:36:01 +00:00
e52e3786c6
Merged revisions 73995,74002,74005,74007-74008,74011,74019-74023 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r73995 | vinay.sajip | 2009-07-13 07:21:05 -0400 (Mon, 13 Jul 2009) | 1 line
Issue #6314 : logging: Extra checks on the "level" argument in more places.
........
r74002 | marc-andre.lemburg | 2009-07-13 16:23:49 -0400 (Mon, 13 Jul 2009) | 6 lines
Use a new global DEV_NULL instead of hard-coding /dev/null into the system
command helper functions.
See #6479 for some motivation.
........
r74005 | marc-andre.lemburg | 2009-07-13 17:28:33 -0400 (Mon, 13 Jul 2009) | 6 lines
Use a different VER command output parser to address the localization
issues mentioned in #3410 .
Prepare for Windows 7 (still commented out).
........
r74007 | michael.foord | 2009-07-14 13:58:12 -0400 (Tue, 14 Jul 2009) | 1 line
Move TestRunner initialisation into unittest.TestProgram.runTests. Fixes issue 6418.
........
r74008 | benjamin.peterson | 2009-07-14 20:46:42 -0400 (Tue, 14 Jul 2009) | 1 line
update year
........
r74011 | ezio.melotti | 2009-07-15 13:07:04 -0400 (Wed, 15 Jul 2009) | 1 line
methods' names pep8ification
........
r74019 | amaury.forgeotdarc | 2009-07-15 17:29:27 -0400 (Wed, 15 Jul 2009) | 2 lines
#6076 Add a title to the IDLE Preferences window.
........
r74020 | georg.brandl | 2009-07-16 03:18:07 -0400 (Thu, 16 Jul 2009) | 1 line
#5910 : fix kqueue for calls with more than one event.
........
r74021 | georg.brandl | 2009-07-16 03:33:04 -0400 (Thu, 16 Jul 2009) | 1 line
#6486 : start with built in functions rather than "built in objects".
........
r74022 | georg.brandl | 2009-07-16 03:38:35 -0400 (Thu, 16 Jul 2009) | 1 line
#6481 : fix typo in os.system() replacement.
........
r74023 | jesse.noller | 2009-07-16 10:23:04 -0400 (Thu, 16 Jul 2009) | 1 line
Issue 6433: multiprocessing.pool.map hangs on empty list
........
2009-07-17 09:18:18 +00:00
f47ed4a014
Merged revisions 70912,70944,70968,71033,71041,71208,71263,71286,71395-71396,71405-71406,71485,71492,71494 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r70912 | georg.brandl | 2009-03-31 17:35:46 -0500 (Tue, 31 Mar 2009) | 1 line
#5617 : add a handy function to print a unicode string to gdbinit.
........
r70944 | georg.brandl | 2009-03-31 23:32:39 -0500 (Tue, 31 Mar 2009) | 1 line
#5631 : add upload to list of possible commands, which is presented in --help-commands.
........
r70968 | michael.foord | 2009-04-01 13:25:38 -0500 (Wed, 01 Apr 2009) | 1 line
Adding Wing project file
........
r71033 | brett.cannon | 2009-04-01 22:34:53 -0500 (Wed, 01 Apr 2009) | 3 lines
Fix two issues introduced by issue #71031 by changing the signature of
PyImport_AppendInittab() to take a const char *.
........
r71041 | jesse.noller | 2009-04-02 00:17:26 -0500 (Thu, 02 Apr 2009) | 1 line
Add custom initializer argument to multiprocess.Manager*, courtesy of lekma
........
r71208 | michael.foord | 2009-04-04 20:15:01 -0500 (Sat, 04 Apr 2009) | 4 lines
Change the way unittest.TestSuite use their tests to always access them through iteration. Non behavior changing, this allows you to create custom subclasses that override __iter__.
Issue #5693
........
r71263 | michael.foord | 2009-04-05 14:19:28 -0500 (Sun, 05 Apr 2009) | 4 lines
Adding assertIs and assertIsNot methods to unittest.TestCase
Issue #2578
........
r71286 | tarek.ziade | 2009-04-05 17:04:38 -0500 (Sun, 05 Apr 2009) | 1 line
added a simplest test to distutils.spawn._nt_quote_args
........
r71395 | benjamin.peterson | 2009-04-08 08:27:29 -0500 (Wed, 08 Apr 2009) | 1 line
these must be installed to correctly run tests
........
r71396 | benjamin.peterson | 2009-04-08 08:29:41 -0500 (Wed, 08 Apr 2009) | 1 line
fix syntax
........
r71405 | andrew.kuchling | 2009-04-09 06:22:47 -0500 (Thu, 09 Apr 2009) | 1 line
Add items
........
r71406 | andrew.kuchling | 2009-04-09 06:23:36 -0500 (Thu, 09 Apr 2009) | 1 line
Typo fixes
........
r71485 | andrew.kuchling | 2009-04-11 11:12:23 -0500 (Sat, 11 Apr 2009) | 1 line
Add various items
........
r71492 | georg.brandl | 2009-04-11 13:19:27 -0500 (Sat, 11 Apr 2009) | 1 line
Take credit for a patch of mine.
........
r71494 | benjamin.peterson | 2009-04-11 14:31:00 -0500 (Sat, 11 Apr 2009) | 1 line
ignore py3_test_grammar when compiling the library
........
2009-04-11 20:45:40 +00:00
9290503b2a
#4206 : fix 2.xisms in multiprocessing docs and docstrings.
2008-11-22 08:51:39 +00:00
58ea9fedc8
Merged revisions 65864 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r65864 | jesse.noller | 2008-08-19 14:06:19 -0500 (Tue, 19 Aug 2008) | 2 lines
issue3352: clean up the multiprocessing API to remove many get_/set_ methods and convert them to properties. Update the docs and the examples included.
........
2008-08-19 19:17:39 +00:00
fae4c62b1a
Merged revisions 65828 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r65828 | benjamin.peterson | 2008-08-18 13:31:58 -0500 (Mon, 18 Aug 2008) | 1 line
patch up multiprocessing until it's API can be changed too
........
2008-08-18 18:40:08 +00:00
672b8031a8
Merged revisions 64125 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/trunk
........
r64125 | benjamin.peterson | 2008-06-11 12:27:50 -0500 (Wed, 11 Jun 2008) | 2 lines
give the threading API PEP 8 names
........
2008-06-11 19:14:14 +00:00
Victor Stinner
Miss Islington (bot)
Antoine Pitrou
Allen W. Smith, Ph.D
Serhiy Storchaka
Xiang Zhang
Charles-François Natali
Richard Oudkerk
Victor Stinner
Andrew Svetlov
Hynek Schlawack
Benjamin Peterson
Antoine Pitrou
Florent Xicluna
Charles-François Natali
Victor Stinner
R. David Murray
Ask Solem
Jesse Noller
Alexandre Vassalotti
Georg Brandl