8988945cdc
bpo-29861: release references to multiprocessing Pool tasks ( #743 )
...
* bpo-29861: release references to multiprocessing Pool tasks
Release references to tasks, their arguments and their results as soon
as they are finished, instead of keeping them alive until another task
arrives.
* Comments in test
2017-03-24 13:52:11 +01:00
bdf6b910f9
bpo-29776: Use decorator syntax for properties. ( #585 )
2017-03-19 08:40:32 +02:00
ebb39bcc04
Issue #28779 : multiprocessing.set_forkserver_preload() would crash the forkserver process if a preloaded module instantiated some multiprocessing objects such as locks.
2016-12-10 17:16:17 +01:00
cd2a201e5b
Issue #28779 : multiprocessing.set_forkserver_preload() would crash the forkserver process if a preloaded module instantiated some multiprocessing objects such as locks.
2016-12-10 17:13:16 +01:00
5458647bb8
Issue #28053 : Applying refactorings, docs and other cleanup to follow.
2016-09-09 18:03:10 -05:00
37156a70b9
Issue #21201 : Improves readability of multiprocessing error message from server to client for certain exceptions
2016-09-08 14:40:36 -05:00
70897ec54c
Issue #21201 : Improves readability of multiprocessing error message from server to client for certain exceptions
2016-09-08 14:47:23 -05:00
86a7668426
Fixes issue #6766 : Updated multiprocessing Proxy Objects to support nesting
2016-09-07 18:48:01 -05:00
b6a9c9761c
Issue #26778 : Fixed "a/an/and" typos in code comment, documentation and error
...
messages.
2016-04-17 09:39:28 +03:00
6a7b3a77b4
Issue #26778 : Fixed "a/an/and" typos in code comment and documentation.
2016-04-17 08:32:47 +03:00
a6d865c128
Issue #25654 :
...
* multiprocessing: open file with closefd=False to avoid ResourceWarning
* _test_multiprocessing: open file with O_EXCL to detect bugs in tests (if a
previous test forgot to remove TESTFN)
* test_sys_exit(): remove TESTFN after each loop iteration
Initial patch written by Serhiy Storchaka.
2016-03-25 09:29:50 +01:00
78f55ffc63
Issue #23992 : multiprocessing: make MapResult not fail-fast upon exception.
2016-02-10 22:58:18 +00:00
16fb674882
Fix typo in docstring of multiprocessing.spawn.spawn_main()
2016-01-07 19:02:55 +02:00
225821c653
Issue #25899 : Converted non-ASCII characters in docstrings and manpage
...
to ASCII replacements. Original patch by Chris Angelico.
2015-12-18 13:05:04 +02:00
d5aec7ba48
Issue #21116 : Avoid blowing memory when allocating a multiprocessing shared
...
array that's larger than 50% of the available RAM.
Patch by Médéric Boquien.
2015-04-13 20:53:43 +02:00
2116b12da5
Issue #23865 : close() methods in multiple modules now are idempotent and more
...
robust at shutdown. If needs to release multiple resources, they are released
even if errors are occured.
2015-04-10 13:29:28 +03:00
7e7a3dba5f
Issue #23865 : close() methods in multiple modules now are idempotent and more
...
robust at shutdown. If needs to release multiple resources, they are released
even if errors are occured.
2015-04-10 13:24:41 +03:00
291d7b0284
Issue #23400 : Raise same exception on both Python 2 and 3 if sem_open is not available.
...
Patch by Davin Potts.
2015-04-08 17:57:44 +03:00
7ecfc82edb
Issue #23400 : Raise same exception on both Python 2 and 3 if sem_open is not available.
...
Patch by Davin Potts.
2015-04-08 17:56:30 +03:00
79fbeee237
Issue #23051 : multiprocessing.Pool methods imap() and imap_unordered() now
...
handle exceptions raised by an iterator. Patch by Alon Diamant and Davin
Potts.
2015-03-13 08:25:26 +02:00
63623ac252
Issue #23051 : multiprocessing.Pool methods imap() and imap_unordered() now
...
handle exceptions raised by an iterator. Patch by Alon Diamant and Davin
Potts.
2015-03-13 08:30:33 +02:00
4e02f8f4ae
Issue #18382 : Zero-length messages are consumed by ReadFile on Windows 8 and later
2015-03-02 08:06:30 -08:00
3f9e381030
Issue #18382 : Zero-length messages are consumed by ReadFile on Windows 8 and later
2015-03-02 08:05:27 -08:00
6e6c59b508
Issue #23285 : PEP 475 -- Retry system calls failing with EINTR.
2015-02-07 13:27:50 +00:00
438f4abb50
Issue #23060 : Suppresses a multiprocessing assert that fails incorrectly
...
This is to keep buildbots running while we figure out the best long-term fix.
2014-12-17 06:35:49 -08:00
b757c83ec6
Issue #22581 : Use more "bytes-like object" throughout the docs and comments.
2014-12-05 22:25:22 +02:00
92bf919ed0
Issue #22581 : Use more "bytes-like object" throughout the docs and comments.
2014-12-05 22:26:10 +02:00
0b87831de9
Simplify code in multiprocessing.Connection.send_bytes().
...
Followup to issue #20540 ; patch by Serhiy.
2014-07-31 18:41:57 -04:00
465e60e654
Issue #22033 : Reprs of most Python implemened classes now contain actual
...
class name instead of hardcoded one.
2014-07-25 23:36:00 +03:00
6e20460dc6
Issue #21566 : Make use of socket.listen() default backlog.
2014-07-23 19:28:13 +01:00
fbc877b794
Fixed bugs in reprs of CookieJar and multiprocessing.dummy.Value.
2014-07-22 11:10:37 +03:00
1392df96ef
Fixed bugs in reprs of CookieJar and multiprocessing.dummy.Value.
2014-07-22 11:09:36 +03:00
a924fc7abc
Issue #21565 : multiprocessing: use contex-manager protocol for synchronization
...
primitives.
2014-05-25 14:12:12 +01:00
40470e00b5
do not generate pipe names in the temporary dir
2014-04-14 12:24:37 -04:00
99d8dd2489
Issue #20990 : Correction for 619331c67638.
2014-03-23 18:44:11 +00:00
c346060440
Merge 3.3.
2014-03-23 12:52:16 +00:00
3e952d56ea
Issue #20633 : Replace relative import by absolute import.
2014-03-23 12:42:28 +00:00
80a5be1d84
Issue #20980 : Stop wrapping exception when using ThreadPool.
2014-03-23 12:30:54 +00:00
a40675a1a2
Issue #20990 : Fix issues found by pyflakes for multiprocessing.
2014-03-23 11:54:15 +00:00
7fa767e517
Issue #20976 : pyflakes: Remove unused imports
2014-03-20 09:16:38 +01:00
69b1e261fc
Issue #20978 : pyflakes: fix undefined names
2014-03-20 08:50:52 +01:00
b7d6d2ac6e
Issue #20540 : Fix a performance regression (vs. Python 3.2) when layering a multiprocessing Connection over a TCP socket.
...
For small payloads, Nagle's algorithm would introduce idle delays before the entire transmission of a message.
2014-02-08 23:03:56 +01:00
0c1e31ab1e
Issue #20540 : Fix a performance regression (vs. Python 3.2) when layering a multiprocessing Connection over a TCP socket.
...
For small payloads, Nagle's algorithm would introduce idle delays before the entire transmission of a message.
2014-02-08 23:05:52 +01:00
9a76735b1d
Close #19946 : use runpy as needed in multiprocessing
...
- handles main files without a suffix
- handles main submodules properly
- adds test cases for the various kinds of __main__
2013-12-17 22:17:26 +10:00
ca7ab7c7f1
Issue #19946 : Raise ImportError when the main module cannot be found
...
by multiprocessing.spawn (before it was raising an AttributeError).
2013-12-13 11:43:10 -05:00
b523f8433a
Implement PEP 451 (ModuleSpec).
2013-11-22 09:05:39 -07:00
634919a9fa
Issue #17276 : MD5 as default digestmod for HMAC is deprecated. The HMAC
...
module supports digestmod names, e.g. hmac.HMAC('sha1').
2013-11-20 17:23:06 +01:00
69cce482cb
Merge.
2013-11-17 17:30:54 +00:00
8731d7b3c6
Fix handling of SystemExit and exit code. Patch by Brodie Rao.
2013-11-17 17:24:11 +00:00
e943697750
Issue #19478 : Make choice of semaphore prefix more flexible.
2013-11-02 17:05:07 +00:00
e90cedb711
Issue #19425 -- a pickling error should not cause pool to hang.
2013-10-28 23:11:58 +00:00
33aaa73cad
Merge.
2013-10-28 23:23:04 +00:00
b1694cf588
Issue #18999 : Make multiprocessing use context objects.
...
This allows different parts of a program to use different methods for
starting processes without interfering with each other.
2013-10-16 16:41:56 +01:00
45e255167e
Issue #18934 : Use poll/select-based selectors for multiprocessing.Connection,
...
to avoid one extra FD per Connection.
2013-09-08 11:30:53 +02:00
e241ac9283
Issue #18934 : multiprocessing: use selectors module.
2013-09-05 20:46:49 +02:00
67973c0279
Issue #18865 : remove unused import from multiprocessing.util.spawnv_passfds()
2013-08-28 12:21:47 +02:00
0d097b6299
Issue #18865 : PEP 446 makes multiprocessing.util.pipe() unnecessary.
2013-08-28 11:25:34 +01:00
daf455554b
Issue #18571 : Implementation of the PEP 446: file descriptors and file handles
...
are now created non-inheritable; add functions os.get/set_inheritable(),
os.get/set_handle_inheritable() and socket.socket.get/set_inheritable().
2013-08-28 00:53:59 +02:00
7d2d43c0b1
Stop making fork server have copy of semaphore_tracker_fd.
2013-08-22 11:38:57 +01:00
0718f70131
Issue #18762 : Fix EBADF error when using forkserver.
2013-08-22 11:38:55 +01:00
a01fb39877
Issue #18762 : Print debug info on failure to create new forkserver process.
...
Also modify test code to hopefully avoid deadlock on failure.
2013-08-21 19:45:19 +01:00
30b9d5d3af
#18705 : fix a number of typos. Patch by Févry Thibault.
2013-08-17 15:50:46 +03:00
84ed9a68bd
Issue #8713 : Support alternative start methods in multiprocessing on Unix.
...
See http://hg.python.org/sandbox/sbt#spawn
2013-08-14 15:35:41 +01:00
580373c469
Issue #18593 : fix typo in comment
2013-07-30 06:13:01 -07:00
25f043b152
Issue #18593 : fix typo in comment
2013-07-30 06:12:49 -07:00
cd171c8e92
Issue #18200 : Back out usage of ModuleNotFoundError (8d28d44f3a9a)
2013-07-04 17:43:24 -04:00
1b6348e084
Issue #17261 : Ensure multiprocessing's proxies use proper address.
2013-07-02 13:38:58 +01:00
e3e8bcf3e7
Issue #17261 : Ensure multiprocessing's proxies use proper address.
2013-07-02 13:37:43 +01:00
626032ac54
Issue #17097 : Merge.
2013-07-01 19:10:39 +01:00
cca8c53d6a
Issue #17097 : Make multiprocessing ignore EINTR.
2013-07-01 18:59:26 +01:00
37cfb0a920
Issue #17914 : Use os.cpu_count() instead of multiprocessing.cpu_count() where
...
applicable.
2013-06-28 19:25:45 +02:00
4f4088eb6f
Issue #17177 : Stop using imp in multiprocessing
2013-06-15 13:23:01 -04:00
0a140668fa
Issue #18200 : Update the stdlib (except tests) to use
...
ModuleNotFoundError.
2013-06-13 20:57:26 -04:00
a33e11e436
Issue #17314 : Stop using imp in multiprocessing.forking and move over
...
to importlib.
2013-06-07 11:45:41 -04:00
44feda3cd0
Issue #17914 : Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an
...
initial patch by Trent Nelson.
2013-05-20 14:40:46 +02:00
94fd53ba4e
- Fix typos in the multiprocessing module.
2013-05-15 18:08:03 +02:00
9df891ca41
- Fix typos in the multiprocessing module.
2013-05-15 18:06:56 +02:00
f3a0da24f3
Merge
2013-05-06 12:13:50 +01:00
def51ca8ea
Issue #17805 : Add AsyncResult alias for ApplyResult
2013-05-06 12:10:04 +01:00
8575783a00
Issue #13813 : Embed stringification of remote traceback in local
...
traceback raised when pool task raises an exception.
2013-05-06 11:38:25 +01:00
b147f60a38
Issue #17555 : Fix ForkAwareThreadLock so that size of after fork
...
registry does not grow exponentially with generation of process.
2013-04-17 21:09:38 +01:00
409c31390f
Issue #17555 : Fix ForkAwareThreadLock so that size of after fork
...
registry does not grow exponentially with generation of process.
2013-04-17 20:58:00 +01:00
308307190f
Fix issue #17707 : multiprocessing.Queue's get() method does not block for short timeouts.
2013-04-17 13:12:27 +02:00
b38897fc91
Fix issue #17707 : multiprocessing.Queue's get() method does not block for short timeouts.
2013-04-17 13:08:59 +02:00
84e4316489
Issue #17025 : multiprocessing: Reduce Queue and SimpleQueue contention.
2013-03-25 18:20:40 +01:00
a655075d16
Issue #17025 : Add dumps() and loads() to ForkingPickler.
2013-03-24 15:21:49 +01:00
0320025f17
Merge
2013-02-26 13:11:11 +00:00
5b8a3242c4
Merge
2013-02-26 13:00:15 +00:00
7aaa1ef858
Issue #17018 : Make Process.join() retry if os.waitpid() fails with EINTR.
2013-02-26 12:39:57 +00:00
67da89446a
fix for previous commit related to issue 10527 which didn't have the intended effect as per http://bugs.python.org/issue10527#msg179895
2013-01-14 02:24:25 +01:00
0c8ad61c95
fix for previous commit related to issue 10527 which didn't have the intended effect as per http://bugs.python.org/issue10527#msg179895
2013-01-14 02:24:05 +01:00
0ee84e04da
Issue #16955 : Fix the poll() method for multiprocessing's socket
...
connections on Windows.
2013-01-13 22:52:13 +00:00
ed9e06cb21
Issue #16955 : Fix the poll() method for multiprocessing's socket
...
connections on Windows.
2013-01-13 22:46:48 +00:00
ef45380b6b
Fix overlooked licence text.
2013-01-01 14:25:59 +00:00
b4f39e85f2
Fix issue 10527: make multiprocessing use poll() instead of select() if available.
2012-12-31 17:38:46 +01:00
5051ca887c
Fix issue 10527: make multiprocessing use poll() instead of select() if available.
2012-12-31 17:38:17 +01:00
5e844c8052
Fix issue 10527: make multiprocessing use poll() instead of select() if available.
2012-12-31 17:23:09 +01:00
f7a17b48d7
Replace IOError with OSError ( #16715 )
2012-12-25 16:47:37 +02:00
2606a6f197
Issue #16719 : Get rid of WindowsError. Use OSError instead
...
Patch by Serhiy Storchaka.
2012-12-19 14:33:35 +02:00
ad28c7f9da
Issue #16706 : get rid of os.error
2012-12-18 22:02:39 +02:00
a191959849
Issue #16714 : use 'raise' exceptions, don't 'throw'.
...
Patch by Serhiy Storchaka.
2012-12-18 21:27:16 +02:00
5b89840d9c
Issue #16714 : use 'raise' exceptions, don't 'throw'.
...
Patch by Serhiy Storchaka.
2012-12-18 21:26:36 +02:00
737fb89dd1
Issue #16714 : use 'raise' exceptions, don't 'throw'.
...
Patch by Serhiy Storchaka.
2012-12-18 21:14:22 +02:00
8f7c4b8a85
Issue #16481 : Merge
2012-11-15 18:22:23 +00:00
021f4c2ecc
Issue #16481 : multiprocessing no longer leaks process handles on Windows.
2012-11-15 18:16:35 +00:00
6b973747f3
Issue #16284 : Prevent keeping unnecessary references to worker functions in concurrent.futures ThreadPoolExecutor.
2012-11-03 15:36:01 +02:00
969684f2ad
Merge 3.3
2012-10-27 12:56:30 +02:00
254af2644a
#16307 : Fix multiprocessing.Pool.map_async not calling its callbacks
...
Patch by Janne Karila.
2012-10-27 12:53:02 +02:00
5046e9741c
Make __mp_main__ an alias for __main__ in all processes to simplify
...
pickling of classes defined in main module.
2012-10-08 13:07:00 +01:00
3095f4724e
raise a ValueError instead of an AssertionError when pool is an invalid state
2012-09-25 12:45:42 -04:00
e8cd6bb127
Issue #15881 : Clarify comment in exit function
2012-09-13 17:27:15 +01:00
5bedef3e64
Issue #15881 : Fixed 3.2 backport.
2012-09-09 13:31:08 -04:00
7f704c11db
Fixed whitespace
2012-09-09 13:25:06 -04:00
36351564a2
Fixed whitespace
2012-09-09 13:22:45 -04:00
f36c49d124
Issue #15881 : Fixed atexit hook in multiprocessing.
2012-09-09 13:20:58 -04:00
59fb38b582
Issue #15881 : Fixed atexit hook in multiprocessing.
2012-09-09 13:16:15 -04:00
04ec8ce1bb
Issue #14669 : Fix pickling of connections and sockets on MacOSX
...
by sending/receiving an acknowledgment after file descriptor transfer.
TestPicklingConnection has been reenabled for MacOSX.
2012-08-16 16:48:55 +01:00
3165a75e45
Merge 3.2
2012-08-14 12:51:14 +01:00
e88a2445bc
Issue #15646 : Prevent equivalent of a fork bomb when using multiprocessing
...
on Windows without the "if __name__ == '__main__'" idiom.
2012-08-14 11:41:32 +01:00
b303580c7c
Issue #15525 : Increase timeout when TerminateProcess() fails
2012-08-01 17:44:18 +01:00
b15e622bb8
Issue #6056 : Make multiprocessing use setblocking(True) on the sockets it uses.
...
Original patch by J Derek Wilson.
2012-07-27 14:19:00 +01:00
4887b1c0e7
Issue #6056 : Make multiprocessing use setblocking(True) on the sockets it uses.
...
Original patch by J Derek Wilson.
2012-07-27 14:06:11 +01:00
8838061119
Issue #10527 : Remove dead code
2013-01-15 13:19:24 +00:00
549d465fe2
issue 10527: fix missing import
2013-01-03 02:54:27 +01:00
ac38571f00
Issue #15064 : Make BaseManager.__enter__() start server if necessary.
2012-06-18 21:29:30 +01:00
d69cfe88ea
Issue #15064 : Implement context manager protocol for multiprocessing types
2012-06-18 17:47:52 +01:00
0f884273b0
Issue #15101 : Make pool finalizer avoid joining current thread.
2012-06-18 16:02:49 +01:00
f29ec4b0c8
Issue #15101 : Make pool finalizer avoid joining current thread.
2012-06-18 15:54:57 +01:00
3049f1243e
Increase timeout used when waiting for manager to shutdown cleanly
...
before resorting to terminate()
2012-06-15 20:08:29 +01:00
3730a17a58
Issue #14059 : Implement multiprocessing.Barrier
2012-06-15 18:26:07 +01:00
73d9a292ae
Issue #13841 : Make child processes exit using sys.exit() on Windows
2012-06-14 15:30:10 +01:00
f0604fddc3
Issue #3518 : Remove references to non-existent BaseManager.from_address()
...
method
2012-06-11 17:56:08 +01:00
58ba47f97b
Merge fixes for #13854 and #12157 .
2012-06-07 20:38:11 +01:00
29471de459
Issue #13854 : Properly handle non-integer, non-string arg to SystemExit
...
Previously multiprocessing only expected int or str. It also wrongly
used an exit code of 1 when the argument was a string instead of zero.
2012-06-06 19:04:57 +01:00
e41682b994
Issue #12157 : pool.map() does not handle empty iterable correctly
...
Initial patch by mouad
2012-06-06 19:04:57 +01:00
bd7b5dd816
Prevent handle leak if CreateProcess() fails in multiprocessing
2012-06-04 18:59:10 +01:00
86eb7e97ae
Fix potential NameError in multiprocessing.Condition.wait()
2012-06-04 18:59:07 +01:00
ad06444d6c
Make Finalize reserve a reference to os.getpid in case called at shutdown
2012-06-04 18:58:59 +01:00
87ea780e8e
Use Python 3.x-style keyword only arg in Array()
...
Previously a Python 2.x compatible hack was used for
multiprocessing.sharedctypes.Array(). Also the documented
signature was wrong.
2012-05-29 12:01:47 +01:00
1074a9294b
Remove __getslice__, __setslice__, __delslice__ methods from proxies
...
Proxy classes in multiprocessing do not need these methods in Python 3.x.
2012-05-29 12:01:45 +01:00
26cdf1fe5b
Make multiprocessing's shared memory use memoryview instead of raw pointer
2012-05-26 22:09:59 +01:00
739ae5692e
Issue #14548 : Make multiprocessing finalizers check pid before running
...
This protects from possibilty of gc running just after fork.
2012-05-25 13:54:53 +01:00
692130a231
Issue #12091 : simplify ApplyResult and MapResult with threading.Event
...
Patch by Charles-François Natali
2012-05-25 13:26:53 +01:00
be39cfc9dc
Merge
2012-05-25 13:04:20 +01:00
54454e7dc2
Issue #14881 : Allow normal non-main thread to spawn a dummy process
...
Fix suggested by Itay Brandes
2012-05-25 12:57:58 +01:00
fa67aa0d72
Fix whitespace
2012-05-18 18:33:32 +02:00
ebdcd859e5
Move private function _args_from_interpreter_flags() to subprocess.py, so
...
that it can be imported when threads are disabled.
(followup to issue #12098 )
2012-05-18 18:33:07 +02:00
77c84f2def
#12098 : Make multiprocessing's child processes inherit sys.flags on Windows
...
Initial patch by Sergey Mezentsev.
2012-05-18 14:28:02 +01:00
59d5404bc7
Issue #14753 : Make multiprocessing treat negative timeouts as it did in 3.2
...
In Python 3.2 and earlier, Process.join() and Connection.poll()
treated negative timeouts as zero timeouts. Earlier versions from
the 3.3 line of development treat them as infinite timeouts.
The patch reverts to the old behaviour.
2012-05-10 16:11:12 +01:00
41eb85b194
Make AcquirerProxy.acquire() support timeout argument
2012-05-06 16:45:02 +01:00
Antoine Pitrou
Serhiy Storchaka
Antoine Pitrou
Davin Potts
Victor Stinner
Charles-François Natali
Berker Peksag
Steve Dower
Benjamin Peterson
Richard Oudkerk
Nick Coghlan
Brett Cannon
Eric Snow
Christian Heimes
Victor Stinner
Ezio Melotti
Eli Bendersky
doko@ubuntu.com
Giampaolo Rodola'
Andrew Svetlov
Hynek Schlawack
Alexander Belopolsky