80a5be1d84
Issue #20980 : Stop wrapping exception when using ThreadPool.
2014-03-23 12:30:54 +00:00
a40675a1a2
Issue #20990 : Fix issues found by pyflakes for multiprocessing.
2014-03-23 11:54:15 +00:00
7fa767e517
Issue #20976 : pyflakes: Remove unused imports
2014-03-20 09:16:38 +01:00
69b1e261fc
Issue #20978 : pyflakes: fix undefined names
2014-03-20 08:50:52 +01:00
b7d6d2ac6e
Issue #20540 : Fix a performance regression (vs. Python 3.2) when layering a multiprocessing Connection over a TCP socket.
...
For small payloads, Nagle's algorithm would introduce idle delays before the entire transmission of a message.
2014-02-08 23:03:56 +01:00
0c1e31ab1e
Issue #20540 : Fix a performance regression (vs. Python 3.2) when layering a multiprocessing Connection over a TCP socket.
...
For small payloads, Nagle's algorithm would introduce idle delays before the entire transmission of a message.
2014-02-08 23:05:52 +01:00
9a76735b1d
Close #19946 : use runpy as needed in multiprocessing
...
- handles main files without a suffix
- handles main submodules properly
- adds test cases for the various kinds of __main__
2013-12-17 22:17:26 +10:00
ca7ab7c7f1
Issue #19946 : Raise ImportError when the main module cannot be found
...
by multiprocessing.spawn (before it was raising an AttributeError).
2013-12-13 11:43:10 -05:00
b523f8433a
Implement PEP 451 (ModuleSpec).
2013-11-22 09:05:39 -07:00
634919a9fa
Issue #17276 : MD5 as default digestmod for HMAC is deprecated. The HMAC
...
module supports digestmod names, e.g. hmac.HMAC('sha1').
2013-11-20 17:23:06 +01:00
69cce482cb
Merge.
2013-11-17 17:30:54 +00:00
8731d7b3c6
Fix handling of SystemExit and exit code. Patch by Brodie Rao.
2013-11-17 17:24:11 +00:00
e943697750
Issue #19478 : Make choice of semaphore prefix more flexible.
2013-11-02 17:05:07 +00:00
e90cedb711
Issue #19425 -- a pickling error should not cause pool to hang.
2013-10-28 23:11:58 +00:00
33aaa73cad
Merge.
2013-10-28 23:23:04 +00:00
b1694cf588
Issue #18999 : Make multiprocessing use context objects.
...
This allows different parts of a program to use different methods for
starting processes without interfering with each other.
2013-10-16 16:41:56 +01:00
45e255167e
Issue #18934 : Use poll/select-based selectors for multiprocessing.Connection,
...
to avoid one extra FD per Connection.
2013-09-08 11:30:53 +02:00
e241ac9283
Issue #18934 : multiprocessing: use selectors module.
2013-09-05 20:46:49 +02:00
67973c0279
Issue #18865 : remove unused import from multiprocessing.util.spawnv_passfds()
2013-08-28 12:21:47 +02:00
0d097b6299
Issue #18865 : PEP 446 makes multiprocessing.util.pipe() unnecessary.
2013-08-28 11:25:34 +01:00
daf455554b
Issue #18571 : Implementation of the PEP 446: file descriptors and file handles
...
are now created non-inheritable; add functions os.get/set_inheritable(),
os.get/set_handle_inheritable() and socket.socket.get/set_inheritable().
2013-08-28 00:53:59 +02:00
7d2d43c0b1
Stop making fork server have copy of semaphore_tracker_fd.
2013-08-22 11:38:57 +01:00
0718f70131
Issue #18762 : Fix EBADF error when using forkserver.
2013-08-22 11:38:55 +01:00
a01fb39877
Issue #18762 : Print debug info on failure to create new forkserver process.
...
Also modify test code to hopefully avoid deadlock on failure.
2013-08-21 19:45:19 +01:00
30b9d5d3af
#18705 : fix a number of typos. Patch by Févry Thibault.
2013-08-17 15:50:46 +03:00
84ed9a68bd
Issue #8713 : Support alternative start methods in multiprocessing on Unix.
...
See http://hg.python.org/sandbox/sbt#spawn
2013-08-14 15:35:41 +01:00
580373c469
Issue #18593 : fix typo in comment
2013-07-30 06:13:01 -07:00
25f043b152
Issue #18593 : fix typo in comment
2013-07-30 06:12:49 -07:00
cd171c8e92
Issue #18200 : Back out usage of ModuleNotFoundError (8d28d44f3a9a)
2013-07-04 17:43:24 -04:00
1b6348e084
Issue #17261 : Ensure multiprocessing's proxies use proper address.
2013-07-02 13:38:58 +01:00
e3e8bcf3e7
Issue #17261 : Ensure multiprocessing's proxies use proper address.
2013-07-02 13:37:43 +01:00
626032ac54
Issue #17097 : Merge.
2013-07-01 19:10:39 +01:00
cca8c53d6a
Issue #17097 : Make multiprocessing ignore EINTR.
2013-07-01 18:59:26 +01:00
37cfb0a920
Issue #17914 : Use os.cpu_count() instead of multiprocessing.cpu_count() where
...
applicable.
2013-06-28 19:25:45 +02:00
4f4088eb6f
Issue #17177 : Stop using imp in multiprocessing
2013-06-15 13:23:01 -04:00
0a140668fa
Issue #18200 : Update the stdlib (except tests) to use
...
ModuleNotFoundError.
2013-06-13 20:57:26 -04:00
a33e11e436
Issue #17314 : Stop using imp in multiprocessing.forking and move over
...
to importlib.
2013-06-07 11:45:41 -04:00
44feda3cd0
Issue #17914 : Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an
...
initial patch by Trent Nelson.
2013-05-20 14:40:46 +02:00
94fd53ba4e
- Fix typos in the multiprocessing module.
2013-05-15 18:08:03 +02:00
9df891ca41
- Fix typos in the multiprocessing module.
2013-05-15 18:06:56 +02:00
f3a0da24f3
Merge
2013-05-06 12:13:50 +01:00
def51ca8ea
Issue #17805 : Add AsyncResult alias for ApplyResult
2013-05-06 12:10:04 +01:00
8575783a00
Issue #13813 : Embed stringification of remote traceback in local
...
traceback raised when pool task raises an exception.
2013-05-06 11:38:25 +01:00
b147f60a38
Issue #17555 : Fix ForkAwareThreadLock so that size of after fork
...
registry does not grow exponentially with generation of process.
2013-04-17 21:09:38 +01:00
409c31390f
Issue #17555 : Fix ForkAwareThreadLock so that size of after fork
...
registry does not grow exponentially with generation of process.
2013-04-17 20:58:00 +01:00
308307190f
Fix issue #17707 : multiprocessing.Queue's get() method does not block for short timeouts.
2013-04-17 13:12:27 +02:00
b38897fc91
Fix issue #17707 : multiprocessing.Queue's get() method does not block for short timeouts.
2013-04-17 13:08:59 +02:00
84e4316489
Issue #17025 : multiprocessing: Reduce Queue and SimpleQueue contention.
2013-03-25 18:20:40 +01:00
a655075d16
Issue #17025 : Add dumps() and loads() to ForkingPickler.
2013-03-24 15:21:49 +01:00
0320025f17
Merge
2013-02-26 13:11:11 +00:00
5b8a3242c4
Merge
2013-02-26 13:00:15 +00:00
7aaa1ef858
Issue #17018 : Make Process.join() retry if os.waitpid() fails with EINTR.
2013-02-26 12:39:57 +00:00
67da89446a
fix for previous commit related to issue 10527 which didn't have the intended effect as per http://bugs.python.org/issue10527#msg179895
2013-01-14 02:24:25 +01:00
0c8ad61c95
fix for previous commit related to issue 10527 which didn't have the intended effect as per http://bugs.python.org/issue10527#msg179895
2013-01-14 02:24:05 +01:00
0ee84e04da
Issue #16955 : Fix the poll() method for multiprocessing's socket
...
connections on Windows.
2013-01-13 22:52:13 +00:00
ed9e06cb21
Issue #16955 : Fix the poll() method for multiprocessing's socket
...
connections on Windows.
2013-01-13 22:46:48 +00:00
ef45380b6b
Fix overlooked licence text.
2013-01-01 14:25:59 +00:00
b4f39e85f2
Fix issue 10527: make multiprocessing use poll() instead of select() if available.
2012-12-31 17:38:46 +01:00
5051ca887c
Fix issue 10527: make multiprocessing use poll() instead of select() if available.
2012-12-31 17:38:17 +01:00
5e844c8052
Fix issue 10527: make multiprocessing use poll() instead of select() if available.
2012-12-31 17:23:09 +01:00
f7a17b48d7
Replace IOError with OSError ( #16715 )
2012-12-25 16:47:37 +02:00
2606a6f197
Issue #16719 : Get rid of WindowsError. Use OSError instead
...
Patch by Serhiy Storchaka.
2012-12-19 14:33:35 +02:00
ad28c7f9da
Issue #16706 : get rid of os.error
2012-12-18 22:02:39 +02:00
a191959849
Issue #16714 : use 'raise' exceptions, don't 'throw'.
...
Patch by Serhiy Storchaka.
2012-12-18 21:27:16 +02:00
5b89840d9c
Issue #16714 : use 'raise' exceptions, don't 'throw'.
...
Patch by Serhiy Storchaka.
2012-12-18 21:26:36 +02:00
737fb89dd1
Issue #16714 : use 'raise' exceptions, don't 'throw'.
...
Patch by Serhiy Storchaka.
2012-12-18 21:14:22 +02:00
8f7c4b8a85
Issue #16481 : Merge
2012-11-15 18:22:23 +00:00
021f4c2ecc
Issue #16481 : multiprocessing no longer leaks process handles on Windows.
2012-11-15 18:16:35 +00:00
6b973747f3
Issue #16284 : Prevent keeping unnecessary references to worker functions in concurrent.futures ThreadPoolExecutor.
2012-11-03 15:36:01 +02:00
969684f2ad
Merge 3.3
2012-10-27 12:56:30 +02:00
254af2644a
#16307 : Fix multiprocessing.Pool.map_async not calling its callbacks
...
Patch by Janne Karila.
2012-10-27 12:53:02 +02:00
5046e9741c
Make __mp_main__ an alias for __main__ in all processes to simplify
...
pickling of classes defined in main module.
2012-10-08 13:07:00 +01:00
3095f4724e
raise a ValueError instead of an AssertionError when pool is an invalid state
2012-09-25 12:45:42 -04:00
e8cd6bb127
Issue #15881 : Clarify comment in exit function
2012-09-13 17:27:15 +01:00
5bedef3e64
Issue #15881 : Fixed 3.2 backport.
2012-09-09 13:31:08 -04:00
7f704c11db
Fixed whitespace
2012-09-09 13:25:06 -04:00
36351564a2
Fixed whitespace
2012-09-09 13:22:45 -04:00
f36c49d124
Issue #15881 : Fixed atexit hook in multiprocessing.
2012-09-09 13:20:58 -04:00
59fb38b582
Issue #15881 : Fixed atexit hook in multiprocessing.
2012-09-09 13:16:15 -04:00
04ec8ce1bb
Issue #14669 : Fix pickling of connections and sockets on MacOSX
...
by sending/receiving an acknowledgment after file descriptor transfer.
TestPicklingConnection has been reenabled for MacOSX.
2012-08-16 16:48:55 +01:00
3165a75e45
Merge 3.2
2012-08-14 12:51:14 +01:00
e88a2445bc
Issue #15646 : Prevent equivalent of a fork bomb when using multiprocessing
...
on Windows without the "if __name__ == '__main__'" idiom.
2012-08-14 11:41:32 +01:00
b303580c7c
Issue #15525 : Increase timeout when TerminateProcess() fails
2012-08-01 17:44:18 +01:00
b15e622bb8
Issue #6056 : Make multiprocessing use setblocking(True) on the sockets it uses.
...
Original patch by J Derek Wilson.
2012-07-27 14:19:00 +01:00
4887b1c0e7
Issue #6056 : Make multiprocessing use setblocking(True) on the sockets it uses.
...
Original patch by J Derek Wilson.
2012-07-27 14:06:11 +01:00
8838061119
Issue #10527 : Remove dead code
2013-01-15 13:19:24 +00:00
549d465fe2
issue 10527: fix missing import
2013-01-03 02:54:27 +01:00
ac38571f00
Issue #15064 : Make BaseManager.__enter__() start server if necessary.
2012-06-18 21:29:30 +01:00
d69cfe88ea
Issue #15064 : Implement context manager protocol for multiprocessing types
2012-06-18 17:47:52 +01:00
0f884273b0
Issue #15101 : Make pool finalizer avoid joining current thread.
2012-06-18 16:02:49 +01:00
f29ec4b0c8
Issue #15101 : Make pool finalizer avoid joining current thread.
2012-06-18 15:54:57 +01:00
3049f1243e
Increase timeout used when waiting for manager to shutdown cleanly
...
before resorting to terminate()
2012-06-15 20:08:29 +01:00
3730a17a58
Issue #14059 : Implement multiprocessing.Barrier
2012-06-15 18:26:07 +01:00
73d9a292ae
Issue #13841 : Make child processes exit using sys.exit() on Windows
2012-06-14 15:30:10 +01:00
f0604fddc3
Issue #3518 : Remove references to non-existent BaseManager.from_address()
...
method
2012-06-11 17:56:08 +01:00
58ba47f97b
Merge fixes for #13854 and #12157 .
2012-06-07 20:38:11 +01:00
29471de459
Issue #13854 : Properly handle non-integer, non-string arg to SystemExit
...
Previously multiprocessing only expected int or str. It also wrongly
used an exit code of 1 when the argument was a string instead of zero.
2012-06-06 19:04:57 +01:00
e41682b994
Issue #12157 : pool.map() does not handle empty iterable correctly
...
Initial patch by mouad
2012-06-06 19:04:57 +01:00
bd7b5dd816
Prevent handle leak if CreateProcess() fails in multiprocessing
2012-06-04 18:59:10 +01:00
86eb7e97ae
Fix potential NameError in multiprocessing.Condition.wait()
2012-06-04 18:59:07 +01:00
ad06444d6c
Make Finalize reserve a reference to os.getpid in case called at shutdown
2012-06-04 18:58:59 +01:00
87ea780e8e
Use Python 3.x-style keyword only arg in Array()
...
Previously a Python 2.x compatible hack was used for
multiprocessing.sharedctypes.Array(). Also the documented
signature was wrong.
2012-05-29 12:01:47 +01:00
1074a9294b
Remove __getslice__, __setslice__, __delslice__ methods from proxies
...
Proxy classes in multiprocessing do not need these methods in Python 3.x.
2012-05-29 12:01:45 +01:00
26cdf1fe5b
Make multiprocessing's shared memory use memoryview instead of raw pointer
2012-05-26 22:09:59 +01:00
739ae5692e
Issue #14548 : Make multiprocessing finalizers check pid before running
...
This protects from possibilty of gc running just after fork.
2012-05-25 13:54:53 +01:00
692130a231
Issue #12091 : simplify ApplyResult and MapResult with threading.Event
...
Patch by Charles-François Natali
2012-05-25 13:26:53 +01:00
be39cfc9dc
Merge
2012-05-25 13:04:20 +01:00
54454e7dc2
Issue #14881 : Allow normal non-main thread to spawn a dummy process
...
Fix suggested by Itay Brandes
2012-05-25 12:57:58 +01:00
fa67aa0d72
Fix whitespace
2012-05-18 18:33:32 +02:00
ebdcd859e5
Move private function _args_from_interpreter_flags() to subprocess.py, so
...
that it can be imported when threads are disabled.
(followup to issue #12098 )
2012-05-18 18:33:07 +02:00
77c84f2def
#12098 : Make multiprocessing's child processes inherit sys.flags on Windows
...
Initial patch by Sergey Mezentsev.
2012-05-18 14:28:02 +01:00
59d5404bc7
Issue #14753 : Make multiprocessing treat negative timeouts as it did in 3.2
...
In Python 3.2 and earlier, Process.join() and Connection.poll()
treated negative timeouts as zero timeouts. Earlier versions from
the 3.3 line of development treat them as infinite timeouts.
The patch reverts to the old behaviour.
2012-05-10 16:11:12 +01:00
41eb85b194
Make AcquirerProxy.acquire() support timeout argument
2012-05-06 16:45:02 +01:00
7ef909cdd7
Fix for issue 14725 for 3.2 branch
2012-05-05 20:41:23 +01:00
fdb8dcf675
Fix for Issue 14725 for 3.3 branch.
2012-05-05 19:45:37 +01:00
a6becaa9cb
Fix dangling warning for test_multiprocessing
2012-05-03 18:29:02 +01:00
3e268aac3b
Mark multiprocessing files with "Licensed to PSF under a Contributor Agreement"
...
instead of BSD licence.
2012-04-30 12:13:55 +01:00
92ff4e196b
Issue #14666 : stop multiprocessing's resource-sharing thread after the tests are done.
...
Also, block delivery of signals to that thread. Patch by Richard Oudkerk.
This will hopefully fix sporadic freezes on the FreeBSD 9.0 buildbot.
2012-04-27 23:51:03 +02:00
5438ed1572
Issue #4892 : multiprocessing Connections can now be transferred over multiprocessing Connections.
...
Patch by Richard Oudkerk (sbt).
2012-04-24 22:56:57 +02:00
23bba4ca39
Issue #11750 : The Windows API functions scattered in the _subprocess and
...
_multiprocessing.win32 modules now live in a single module "_winapi".
Patch by sbt.
2012-04-18 20:51:15 +02:00
c8ce715a82
Issue #14087 : multiprocessing: add Condition.wait_for(). Patch by sbt.
2012-04-17 18:45:57 +02:00
df97cbe7a1
Issue #14522 : Avoid duplicating socket handles in multiprocessing.connection.
...
Patch by sbt.
2012-04-07 22:38:52 +02:00
5c73e8eaf4
Issue #14482 : Raise a ValueError, not a NameError, when trying to create
...
a multiprocessing Client or Listener with an AF_UNIX type address under
Windows. Patch by Popa Claudiu.
2012-04-03 20:13:45 +02:00
6d20cba8d6
Issue #14482 : Raise a ValueError, not a NameError, when trying to create
...
a multiprocessing Client or Listener with an AF_UNIX type address under
Windows. Patch by Popa Claudiu.
2012-04-03 20:12:23 +02:00
93bba8fb8a
Issue #14151 : Raise a ValueError, not a NameError, when trying to create
...
a multiprocessing Client or Listener with an AF_PIPE type address under
non-Windows platforms. Patch by Popa Claudiu.
2012-04-01 17:25:49 +02:00
709176f10c
Issue #14151 : Raise a ValueError, not a NameError, when trying to create
...
a multiprocessing Client or Listener with an AF_PIPE type address under
non-Windows platforms. Patch by Popa Claudiu.
2012-04-01 17:19:09 +02:00
846fd302a0
Issue #14335 : multiprocessing's custom Pickler subclass now inherits from the C-accelerated implementation.
...
Patch by sbt.
2012-03-17 00:23:04 +01:00
bdb1cf1ca5
Issue #12328 : Fix multiprocessing's use of overlapped I/O on Windows.
...
Also, add a multiprocessing.connection.wait(rlist, timeout=None) function
for polling multiple objects at once. Patch by sbt.
Complete changelist from sbt's patch:
* Adds a wait(rlist, timeout=None) function for polling multiple
objects at once. On Unix this is just a wrapper for
select(rlist, [], [], timeout=None).
* Removes use of the SentinelReady exception and the sentinels argument
to certain methods. concurrent.futures.process has been changed to
use wait() instead of SentinelReady.
* Fixes bugs concerning PipeConnection.poll() and messages of zero
length.
* Fixes PipeListener.accept() to call ConnectNamedPipe() with
overlapped=True.
* Fixes Queue.empty() and SimpleQueue.empty() so that they are
threadsafe on Windows.
* Now PipeConnection.poll() and wait() will not modify the pipe except
possibly by consuming a zero length message. (Previously poll()
could consume a partial message.)
* All of multiprocesing's pipe related blocking functions/methods are
now interruptible by SIGINT on Windows.
2012-03-05 19:28:37 +01:00
cd77815e4c
Issue #11836 : document and expose multiprocessing.SimpleQueue
2012-02-15 23:27:00 +01:00
ed4a8fc095
Issue #8184 : multiprocessing: On Windows, don't set SO_REUSEADDR on Connection
...
sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to make sure two
listeners can't bind to the same socket/pipe (or any existing socket/pipe).
2012-02-08 21:15:58 +01:00
edc67feaa4
Issue #8184 : Fix a potential file descriptor leak when a
...
multiprocessing.Connection socket can't be bound.
2012-02-04 15:12:08 +01:00
992ca5278e
Issue #8184 : Fix a potential file descriptor leak when a
...
multiprocessing.Connection socket can't be bound.
2012-02-04 14:55:53 +01:00
2d843d2520
Issue #13812 : When a multiprocessing Process child raises an exception, flush stderr after printing the exception traceback.
2012-01-27 10:53:35 +01:00
84a0fbf6b0
Issue #13812 : When a multiprocessing Process child raises an exception, flush stderr after printing the exception traceback.
2012-01-27 10:52:37 +01:00
fe8039b3e5
Issue #13565 : Increase multiprocessing's server socket backlog, to avoid
...
dropped connections in case of simultaneous connection requests.
2011-12-23 19:06:48 +01:00
78c1b42fde
Issue #13565 : Increase multiprocessing's server socket backlog, to avoid
...
dropped connections in case of simultaneous connection requests.
2011-12-23 19:07:58 +01:00
de911b2915
Issue #12708 : Add starmap() and starmap_async() methods (similar to itertools.starmap()) to multiprocessing.Pool.
...
Patch by Hynek Schlawack.
2011-12-21 11:03:24 +01:00
8a20851010
Issue #25654 :
...
* multiprocessing: open file with closefd=False to avoid ResourceWarning
* _test_multiprocessing: open file with O_EXCL to detect bugs in tests (if a
previous test forgot to remove TESTFN)
* test_sys_exit(): remove TESTFN after each loop iteration
Initial patch written by Serhiy Storchaka.
2016-03-25 09:29:50 +01:00
e6eabd4345
Issue #13215 : multiprocessing.Connection: don't hammer the remote end with
...
retries in case of ECONNREFUSED.
2011-11-19 09:59:43 +01:00
04842a84c3
Remove unused or redundant imports in concurrent.futures and multiprocessing.
2011-11-11 20:05:50 +01:00
021572431b
Issue #13373 : multiprocessing.Queue.get() could sometimes block indefinitely
...
when called with a timeout. Patch by Arnaud Ysmal.
2011-11-10 00:38:25 +01:00
a365113679
Issue #13373 : multiprocessing.Queue.get() could sometimes block indefinitely
...
when called with a timeout. Patch by Arnaud Ysmal.
2011-11-10 00:37:09 +01:00
5d1155c08e
Closes #13258 : Use callable() built-in in the standard library.
2011-10-28 14:45:05 +02:00
f8859e1808
Issue #10332 : multiprocessing: fix a race condition when a Pool is closed
...
before all tasks have completed.
2011-10-24 18:45:29 +02:00
e130a52d8a
Remove duplication.
2011-10-19 10:58:56 +03:00
aabbda5354
Merge 3.2
2011-10-28 14:52:29 +02:00
feeb3a366c
Issue #10332 : multiprocessing: fix a race condition when a Pool is closed
...
before all tasks have completed.
2011-10-24 18:47:43 +02:00
24d659daaf
Use InterruptedError instead of checking for EINTR
2011-10-23 23:49:42 +02:00
f10644983e
Merge with 3.2.
2011-10-19 11:06:26 +03:00
6b4883dec0
PEP 3151 / issue #12555 : reworking the OS and IO exception hierarchy.
2011-10-12 02:54:14 +02:00
Richard Oudkerk
Victor Stinner
Antoine Pitrou
Nick Coghlan
Brett Cannon
Eric Snow
Christian Heimes
Charles-François Natali
Victor Stinner
Ezio Melotti
Eli Bendersky
doko@ubuntu.com
Giampaolo Rodola'
Andrew Svetlov
Hynek Schlawack
Benjamin Peterson
Alexander Belopolsky
Charles-François Natali
Sandro Tosi
Florent Xicluna