2014-01-23 06:05:01 -04:00
|
|
|
.. currentmodule:: asyncio
|
|
|
|
|
2014-02-02 10:03:02 -04:00
|
|
|
.. _asyncio-streams:
|
2014-01-24 12:33:20 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
=======
|
|
|
|
Streams
|
|
|
|
=======
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
Streams are high-level async/await-ready primitives to work with
|
2018-09-11 21:10:37 -03:00
|
|
|
network connections. Streams allow sending and receiving data without
|
2018-09-11 13:54:40 -03:00
|
|
|
using callbacks or low-level protocols and transports.
|
2017-07-25 20:03:51 -03:00
|
|
|
|
2018-09-14 19:11:24 -03:00
|
|
|
.. _asyncio_example_stream:
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Here is an example of a TCP echo client written using asyncio
|
2018-09-11 13:54:40 -03:00
|
|
|
streams::
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
import asyncio
|
|
|
|
|
|
|
|
async def tcp_echo_client(message):
|
2019-06-24 15:16:58 -03:00
|
|
|
async with asyncio.connect('127.0.0.1', 8888) as stream:
|
|
|
|
print(f'Send: {message!r}')
|
|
|
|
await stream.write(message.encode())
|
2018-09-11 13:54:40 -03:00
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
data = await stream.read(100)
|
|
|
|
print(f'Received: {data.decode()!r}')
|
2015-10-19 17:18:04 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
asyncio.run(tcp_echo_client('Hello World!'))
|
2015-10-19 17:18:04 -03:00
|
|
|
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
See also the `Examples`_ section below.
|
|
|
|
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
.. rubric:: Stream Functions
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
The following top-level asyncio functions can be used to create
|
|
|
|
and work with streams:
|
2014-01-23 06:05:01 -04:00
|
|
|
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
.. coroutinefunction:: connect(host=None, port=None, \*, \
|
|
|
|
limit=2**16, ssl=None, family=0, \
|
|
|
|
proto=0, flags=0, sock=None, local_addr=None, \
|
|
|
|
server_hostname=None, ssl_handshake_timeout=None, \
|
|
|
|
happy_eyeballs_delay=None, interleave=None)
|
|
|
|
|
|
|
|
Connect to TCP socket on *host* : *port* address and return a :class:`Stream`
|
|
|
|
object of mode :attr:`StreamMode.READWRITE`.
|
|
|
|
|
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the returned :class:`Stream`
|
|
|
|
instance. By default the *limit* is set to 64 KiB.
|
|
|
|
|
|
|
|
The rest of the arguments are passed directly to :meth:`loop.create_connection`.
|
|
|
|
|
|
|
|
The function can be used with ``await`` to get a connected stream::
|
|
|
|
|
|
|
|
stream = await asyncio.connect('127.0.0.1', 8888)
|
|
|
|
|
|
|
|
The function can also be used as an async context manager::
|
|
|
|
|
|
|
|
async with asyncio.connect('127.0.0.1', 8888) as stream:
|
|
|
|
...
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
.. coroutinefunction:: open_connection(host=None, port=None, \*, \
|
|
|
|
loop=None, limit=None, ssl=None, family=0, \
|
|
|
|
proto=0, flags=0, sock=None, local_addr=None, \
|
|
|
|
server_hostname=None, ssl_handshake_timeout=None)
|
|
|
|
|
|
|
|
Establish a network connection and return a pair of
|
2018-09-11 21:10:37 -03:00
|
|
|
``(reader, writer)`` objects.
|
2018-09-11 13:54:40 -03:00
|
|
|
|
|
|
|
The returned *reader* and *writer* objects are instances of
|
|
|
|
:class:`StreamReader` and :class:`StreamWriter` classes.
|
|
|
|
|
|
|
|
The *loop* argument is optional and can always be determined
|
2018-09-17 20:16:44 -03:00
|
|
|
automatically when this function is awaited from a coroutine.
|
2018-09-11 13:54:40 -03:00
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the
|
2018-09-11 21:10:37 -03:00
|
|
|
returned :class:`StreamReader` instance. By default the *limit*
|
|
|
|
is set to 64 KiB.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-06-08 12:36:00 -03:00
|
|
|
The rest of the arguments are passed directly to
|
2018-09-11 13:54:40 -03:00
|
|
|
:meth:`loop.create_connection`.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-06-08 12:36:00 -03:00
|
|
|
.. versionadded:: 3.7
|
|
|
|
|
|
|
|
The *ssl_handshake_timeout* parameter.
|
|
|
|
|
2019-05-31 17:48:57 -03:00
|
|
|
.. deprecated-removed:: 3.8 3.10
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
`open_connection()` is deprecated in favor of :func:`connect`.
|
2019-05-31 17:48:57 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
.. coroutinefunction:: start_server(client_connected_cb, host=None, \
|
2019-06-24 15:16:58 -03:00
|
|
|
port=None, \*, loop=None, limit=2**16, \
|
2018-09-11 13:54:40 -03:00
|
|
|
family=socket.AF_UNSPEC, \
|
|
|
|
flags=socket.AI_PASSIVE, sock=None, \
|
|
|
|
backlog=100, ssl=None, reuse_address=None, \
|
|
|
|
reuse_port=None, ssl_handshake_timeout=None, \
|
|
|
|
start_serving=True)
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
Start a socket server.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-06-08 12:36:00 -03:00
|
|
|
The *client_connected_cb* callback is called whenever a new client
|
2018-09-11 13:54:40 -03:00
|
|
|
connection is established. It receives a ``(reader, writer)`` pair
|
|
|
|
as two arguments, instances of the :class:`StreamReader` and
|
|
|
|
:class:`StreamWriter` classes.
|
2018-06-08 12:36:00 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
*client_connected_cb* can be a plain callable or a
|
2018-06-08 12:36:00 -03:00
|
|
|
:ref:`coroutine function <coroutine>`; if it is a coroutine function,
|
2018-09-17 20:16:44 -03:00
|
|
|
it will be automatically scheduled as a :class:`Task`.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
The *loop* argument is optional and can always be determined
|
|
|
|
automatically when this method is awaited from a coroutine.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
*limit* determines the buffer size limit used by the
|
2018-09-11 21:10:37 -03:00
|
|
|
returned :class:`StreamReader` instance. By default the *limit*
|
|
|
|
is set to 64 KiB.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
The rest of the arguments are passed directly to
|
|
|
|
:meth:`loop.create_server`.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-06-08 12:36:00 -03:00
|
|
|
.. versionadded:: 3.7
|
|
|
|
|
|
|
|
The *ssl_handshake_timeout* and *start_serving* parameters.
|
|
|
|
|
2019-05-31 17:48:57 -03:00
|
|
|
.. deprecated-removed:: 3.8 3.10
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
`start_server()` is deprecated if favor of :class:`StreamServer`
|
|
|
|
|
|
|
|
.. coroutinefunction:: connect_read_pipe(pipe, *, limit=2**16)
|
|
|
|
|
|
|
|
Takes a :term:`file-like object <file object>` *pipe* to return a
|
|
|
|
:class:`Stream` object of the mode :attr:`StreamMode.READ` that has
|
|
|
|
similar API of :class:`StreamReader`. It can also be used as an async context manager.
|
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the returned :class:`Stream`
|
|
|
|
instance. By default the limit is set to 64 KiB.
|
2019-05-31 17:48:57 -03:00
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
|
|
|
.. coroutinefunction:: connect_write_pipe(pipe, *, limit=2**16)
|
|
|
|
|
|
|
|
Takes a :term:`file-like object <file object>` *pipe* to return a
|
|
|
|
:class:`Stream` object of the mode :attr:`StreamMode.WRITE` that has
|
|
|
|
similar API of :class:`StreamWriter`. It can also be used as an async context manager.
|
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the returned :class:`Stream`
|
|
|
|
instance. By default the limit is set to 64 KiB.
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
2018-09-11 21:10:37 -03:00
|
|
|
|
|
|
|
.. rubric:: Unix Sockets
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
.. function:: connect_unix(path=None, *, limit=2**16, ssl=None, \
|
|
|
|
sock=None, server_hostname=None, \
|
|
|
|
ssl_handshake_timeout=None)
|
|
|
|
|
|
|
|
Establish a Unix socket connection to socket with *path* address and
|
|
|
|
return an awaitable :class:`Stream` object of the mode :attr:`StreamMode.READWRITE`
|
|
|
|
that can be used as a reader and a writer.
|
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the returned :class:`Stream`
|
|
|
|
instance. By default the *limit* is set to 64 KiB.
|
|
|
|
|
|
|
|
The rest of the arguments are passed directly to :meth:`loop.create_unix_connection`.
|
|
|
|
|
|
|
|
The function can be used with ``await`` to get a connected stream::
|
|
|
|
|
|
|
|
stream = await asyncio.connect_unix('/tmp/example.sock')
|
|
|
|
|
|
|
|
The function can also be used as an async context manager::
|
|
|
|
|
|
|
|
async with asyncio.connect_unix('/tmp/example.sock') as stream:
|
|
|
|
...
|
|
|
|
|
|
|
|
.. availability:: Unix.
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
.. coroutinefunction:: open_unix_connection(path=None, \*, loop=None, \
|
|
|
|
limit=None, ssl=None, sock=None, \
|
|
|
|
server_hostname=None, ssl_handshake_timeout=None)
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
Establish a Unix socket connection and return a pair of
|
2018-09-11 13:54:40 -03:00
|
|
|
``(reader, writer)``.
|
2018-06-08 12:36:00 -03:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
Similar to :func:`open_connection` but operates on Unix sockets.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
See also the documentation of :meth:`loop.create_unix_connection`.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-10-12 11:55:20 -03:00
|
|
|
.. availability:: Unix.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-06-08 12:36:00 -03:00
|
|
|
.. versionadded:: 3.7
|
|
|
|
|
|
|
|
The *ssl_handshake_timeout* parameter.
|
|
|
|
|
|
|
|
.. versionchanged:: 3.7
|
|
|
|
|
|
|
|
The *path* parameter can now be a :term:`path-like object`
|
|
|
|
|
2019-05-31 17:48:57 -03:00
|
|
|
.. deprecated-removed:: 3.8 3.10
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
``open_unix_connection()`` is deprecated if favor of :func:`connect_unix`.
|
2019-05-31 17:48:57 -03:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
.. coroutinefunction:: start_unix_server(client_connected_cb, path=None, \
|
|
|
|
\*, loop=None, limit=None, sock=None, \
|
|
|
|
backlog=100, ssl=None, ssl_handshake_timeout=None, \
|
|
|
|
start_serving=True)
|
2018-06-08 12:36:00 -03:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
Start a Unix socket server.
|
2018-06-08 12:36:00 -03:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
Similar to :func:`start_server` but works with Unix sockets.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
See also the documentation of :meth:`loop.create_unix_server`.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-10-12 11:55:20 -03:00
|
|
|
.. availability:: Unix.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-06-08 12:36:00 -03:00
|
|
|
.. versionadded:: 3.7
|
|
|
|
|
|
|
|
The *ssl_handshake_timeout* and *start_serving* parameters.
|
|
|
|
|
|
|
|
.. versionchanged:: 3.7
|
|
|
|
|
|
|
|
The *path* parameter can now be a :term:`path-like object`.
|
|
|
|
|
2019-05-31 17:48:57 -03:00
|
|
|
.. deprecated-removed:: 3.8 3.10
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
``start_unix_server()`` is deprecated in favor of :class:`UnixStreamServer`.
|
2019-05-31 17:48:57 -03:00
|
|
|
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
---------
|
2018-09-11 13:54:40 -03:00
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
StreamServer
|
|
|
|
============
|
|
|
|
|
|
|
|
.. class:: StreamServer(client_connected_cb, /, host=None, port=None, *, \
|
|
|
|
limit=2**16, family=socket.AF_UNSPEC, \
|
|
|
|
flags=socket.AI_PASSIVE, sock=None, backlog=100, \
|
|
|
|
ssl=None, reuse_address=None, reuse_port=None, \
|
|
|
|
ssl_handshake_timeout=None, shutdown_timeout=60)
|
|
|
|
|
|
|
|
The *client_connected_cb* callback is called whenever a new client
|
|
|
|
connection is established. It receives a :class:`Stream` object of the
|
|
|
|
mode :attr:`StreamMode.READWRITE`.
|
|
|
|
|
|
|
|
*client_connected_cb* can be a plain callable or a
|
|
|
|
:ref:`coroutine function <coroutine>`; if it is a coroutine function,
|
|
|
|
it will be automatically scheduled as a :class:`Task`.
|
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the
|
|
|
|
returned :class:`Stream` instance. By default the *limit*
|
|
|
|
is set to 64 KiB.
|
|
|
|
|
|
|
|
The rest of the arguments are passed directly to
|
|
|
|
:meth:`loop.create_server`.
|
|
|
|
|
|
|
|
.. coroutinemethod:: start_serving()
|
|
|
|
|
|
|
|
Binds to the given host and port to start the server.
|
|
|
|
|
|
|
|
.. coroutinemethod:: serve_forever()
|
|
|
|
|
|
|
|
Start accepting connections until the coroutine is cancelled.
|
|
|
|
Cancellation of ``serve_forever`` task causes the server
|
|
|
|
to be closed.
|
|
|
|
|
|
|
|
This method can be called if the server is already accepting
|
|
|
|
connections. Only one ``serve_forever`` task can exist per
|
|
|
|
one *Server* object.
|
|
|
|
|
|
|
|
.. method:: is_serving()
|
|
|
|
|
|
|
|
Returns ``True`` if the server is bound and currently serving.
|
|
|
|
|
|
|
|
.. method:: bind()
|
|
|
|
|
|
|
|
Bind the server to the given *host* and *port*. This method is
|
|
|
|
automatically called during ``__aenter__`` when :class:`StreamServer` is
|
|
|
|
used as an async context manager.
|
|
|
|
|
|
|
|
.. method:: is_bound()
|
|
|
|
|
|
|
|
Return ``True`` if the server is bound.
|
|
|
|
|
|
|
|
.. coroutinemethod:: abort()
|
|
|
|
|
|
|
|
Closes the connection and cancels all pending tasks.
|
|
|
|
|
|
|
|
.. coroutinemethod:: close()
|
|
|
|
|
|
|
|
Closes the connection. This method is automatically called during
|
|
|
|
``__aexit__`` when :class:`StreamServer` is used as an async context
|
|
|
|
manager.
|
|
|
|
|
|
|
|
.. attribute:: sockets
|
|
|
|
|
|
|
|
Returns a tuple of socket objects the server is bound to.
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
|
|
|
|
|
|
|
UnixStreamServer
|
|
|
|
================
|
|
|
|
|
|
|
|
.. class:: UnixStreamServer(client_connected_cb, /, path=None, *, \
|
|
|
|
limit=2**16, sock=None, backlog=100, \
|
|
|
|
ssl=None, ssl_handshake_timeout=None, shutdown_timeout=60)
|
|
|
|
|
|
|
|
The *client_connected_cb* callback is called whenever a new client
|
|
|
|
connection is established. It receives a :class:`Stream` object of the
|
|
|
|
mode :attr:`StreamMode.READWRITE`.
|
|
|
|
|
|
|
|
*client_connected_cb* can be a plain callable or a
|
|
|
|
:ref:`coroutine function <coroutine>`; if it is a coroutine function,
|
|
|
|
it will be automatically scheduled as a :class:`Task`.
|
|
|
|
|
|
|
|
*limit* determines the buffer size limit used by the
|
|
|
|
returned :class:`Stream` instance. By default the *limit*
|
|
|
|
is set to 64 KiB.
|
|
|
|
|
|
|
|
The rest of the arguments are passed directly to
|
|
|
|
:meth:`loop.create_unix_server`.
|
|
|
|
|
|
|
|
.. coroutinemethod:: start_serving()
|
|
|
|
|
|
|
|
Binds to the given host and port to start the server.
|
|
|
|
|
|
|
|
.. method:: is_serving()
|
|
|
|
|
|
|
|
Returns ``True`` if the server is bound and currently serving.
|
|
|
|
|
|
|
|
.. method:: bind()
|
|
|
|
|
|
|
|
Bind the server to the given *host* and *port*. This method is
|
|
|
|
automatically called during ``__aenter__`` when :class:`UnixStreamServer` is
|
|
|
|
used as an async context manager.
|
|
|
|
|
|
|
|
.. method:: is_bound()
|
|
|
|
|
|
|
|
Return ``True`` if the server is bound.
|
|
|
|
|
|
|
|
.. coroutinemethod:: abort()
|
|
|
|
|
|
|
|
Closes the connection and cancels all pending tasks.
|
|
|
|
|
|
|
|
.. coroutinemethod:: close()
|
|
|
|
|
|
|
|
Closes the connection. This method is automatically called during
|
|
|
|
``__aexit__`` when :class:`UnixStreamServer` is used as an async context
|
|
|
|
manager.
|
|
|
|
|
|
|
|
.. attribute:: sockets
|
|
|
|
|
|
|
|
Returns a tuple of socket objects the server is bound to.
|
|
|
|
|
|
|
|
.. availability:: Unix.
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
|
|
|
Stream
|
|
|
|
======
|
|
|
|
|
|
|
|
.. class:: Stream
|
|
|
|
|
|
|
|
Represents a Stream object that provides APIs to read and write data
|
|
|
|
to the IO stream . It includes the API provided by :class:`StreamReader`
|
|
|
|
and :class:`StreamWriter`.
|
|
|
|
|
|
|
|
Do not instantiate *Stream* objects directly; use API like :func:`connect`
|
|
|
|
and :class:`StreamServer` instead.
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
|
|
|
|
|
|
|
StreamMode
|
|
|
|
==========
|
|
|
|
|
|
|
|
.. class:: StreamMode
|
|
|
|
|
|
|
|
A subclass of :class:`enum.Flag` that defines a set of values that can be
|
|
|
|
used to determine the ``mode`` of :class:`Stream` objects.
|
|
|
|
|
|
|
|
.. data:: READ
|
|
|
|
|
|
|
|
The stream object is readable and provides the API of :class:`StreamReader`.
|
|
|
|
|
|
|
|
.. data:: WRITE
|
|
|
|
|
|
|
|
The stream object is writeable and provides the API of :class:`StreamWriter`.
|
|
|
|
|
|
|
|
.. data:: READWRITE
|
|
|
|
|
|
|
|
The stream object is readable and writeable and provides the API of both
|
|
|
|
:class:`StreamReader` and :class:`StreamWriter`.
|
|
|
|
|
|
|
|
.. versionadded:: 3.8
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
|
2014-01-23 06:05:01 -04:00
|
|
|
StreamReader
|
|
|
|
============
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
.. class:: StreamReader
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Represents a reader object that provides APIs to read data
|
|
|
|
from the IO stream.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
It is not recommended to instantiate *StreamReader* objects
|
|
|
|
directly; use :func:`open_connection` and :func:`start_server`
|
|
|
|
instead.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2015-02-12 17:49:18 -04:00
|
|
|
.. coroutinemethod:: read(n=-1)
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2014-02-20 15:10:02 -04:00
|
|
|
Read up to *n* bytes. If *n* is not provided, or set to ``-1``,
|
|
|
|
read until EOF and return all read bytes.
|
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
If EOF was received and the internal buffer is empty,
|
2014-02-20 15:10:02 -04:00
|
|
|
return an empty ``bytes`` object.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2015-02-12 17:49:18 -04:00
|
|
|
.. coroutinemethod:: readline()
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Read one line, where "line" is a sequence of bytes
|
|
|
|
ending with ``\n``.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
If EOF is received and ``\n`` was not found, the method
|
2018-09-11 21:10:37 -03:00
|
|
|
returns partially read data.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
If EOF is received and the internal buffer is empty,
|
2014-02-20 15:10:02 -04:00
|
|
|
return an empty ``bytes`` object.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2015-02-12 17:49:18 -04:00
|
|
|
.. coroutinemethod:: readexactly(n)
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Read exactly *n* bytes.
|
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
Raise an :exc:`IncompleteReadError` if EOF is reached before *n*
|
2018-09-11 21:10:37 -03:00
|
|
|
can be read. Use the :attr:`IncompleteReadError.partial`
|
|
|
|
attribute to get the partially read data.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2016-10-17 18:34:46 -03:00
|
|
|
.. coroutinemethod:: readuntil(separator=b'\\n')
|
2016-05-16 17:23:00 -03:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
Read data from the stream until *separator* is found.
|
2016-05-16 17:23:00 -03:00
|
|
|
|
|
|
|
On success, the data and separator will be removed from the
|
|
|
|
internal buffer (consumed). Returned data will include the
|
|
|
|
separator at the end.
|
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
If the amount of data read exceeds the configured stream limit, a
|
|
|
|
:exc:`LimitOverrunError` exception is raised, and the data
|
|
|
|
is left in the internal buffer and can be read again.
|
2016-05-16 17:23:00 -03:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
If EOF is reached before the complete separator is found,
|
|
|
|
an :exc:`IncompleteReadError` exception is raised, and the internal
|
|
|
|
buffer is reset. The :attr:`IncompleteReadError.partial` attribute
|
|
|
|
may contain a portion of the separator.
|
2016-05-16 17:23:00 -03:00
|
|
|
|
|
|
|
.. versionadded:: 3.5.2
|
|
|
|
|
2014-02-20 15:10:02 -04:00
|
|
|
.. method:: at_eof()
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
Return ``True`` if the buffer is empty and :meth:`feed_eof`
|
|
|
|
was called.
|
2014-02-20 15:10:02 -04:00
|
|
|
|
2014-01-23 06:05:01 -04:00
|
|
|
|
|
|
|
StreamWriter
|
|
|
|
============
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
.. class:: StreamWriter
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Represents a writer object that provides APIs to write data
|
|
|
|
to the IO stream.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
It is not recommended to instantiate *StreamWriter* objects
|
|
|
|
directly; use :func:`open_connection` and :func:`start_server`
|
|
|
|
instead.
|
2014-01-23 06:05:01 -04:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
.. method:: write(data)
|
|
|
|
|
|
|
|
The method attempts to write the *data* to the underlying socket immediately.
|
|
|
|
If that fails, the data is queued in an internal write buffer until it can be
|
|
|
|
sent.
|
|
|
|
|
|
|
|
Starting with Python 3.8, it is possible to directly await on the `write()`
|
|
|
|
method::
|
|
|
|
|
|
|
|
await stream.write(data)
|
|
|
|
|
|
|
|
The ``await`` pauses the current coroutine until the data is written to the
|
|
|
|
socket.
|
|
|
|
|
|
|
|
Below is an equivalent code that works with Python <= 3.7::
|
|
|
|
|
|
|
|
stream.write(data)
|
|
|
|
await stream.drain()
|
|
|
|
|
|
|
|
.. versionchanged:: 3.8
|
|
|
|
Support ``await stream.write(...)`` syntax.
|
|
|
|
|
|
|
|
.. method:: writelines(data)
|
|
|
|
|
|
|
|
The method writes a list (or any iterable) of bytes to the underlying socket
|
|
|
|
immediately.
|
|
|
|
If that fails, the data is queued in an internal write buffer until it can be
|
|
|
|
sent.
|
|
|
|
|
|
|
|
Starting with Python 3.8, it is possible to directly await on the `write()`
|
|
|
|
method::
|
|
|
|
|
|
|
|
await stream.writelines(lines)
|
|
|
|
|
|
|
|
The ``await`` pauses the current coroutine until the data is written to the
|
|
|
|
socket.
|
|
|
|
|
|
|
|
Below is an equivalent code that works with Python <= 3.7::
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
stream.writelines(lines)
|
|
|
|
await stream.drain()
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
.. versionchanged:: 3.8
|
|
|
|
Support ``await stream.writelines()`` syntax.
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
.. method:: close()
|
|
|
|
|
|
|
|
The method closes the stream and the underlying socket.
|
|
|
|
|
|
|
|
Starting with Python 3.8, it is possible to directly await on the `close()`
|
|
|
|
method::
|
|
|
|
|
|
|
|
await stream.close()
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
The ``await`` pauses the current coroutine until the stream and the underlying
|
|
|
|
socket are closed (and SSL shutdown is performed for a secure connection).
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
Below is an equivalent code that works with Python <= 3.7::
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
stream.close()
|
|
|
|
await stream.wait_closed()
|
2018-09-13 20:53:49 -03:00
|
|
|
|
2019-05-09 16:14:58 -03:00
|
|
|
.. versionchanged:: 3.8
|
|
|
|
Support ``await stream.close()`` syntax.
|
2018-09-13 20:53:49 -03:00
|
|
|
|
|
|
|
.. method:: can_write_eof()
|
|
|
|
|
|
|
|
Return *True* if the underlying transport supports
|
|
|
|
the :meth:`write_eof` method, *False* otherwise.
|
|
|
|
|
|
|
|
.. method:: write_eof()
|
|
|
|
|
|
|
|
Close the write end of the stream after the buffered write
|
|
|
|
data is flushed.
|
|
|
|
|
|
|
|
.. attribute:: transport
|
|
|
|
|
|
|
|
Return the underlying asyncio transport.
|
|
|
|
|
|
|
|
.. method:: get_extra_info(name, default=None)
|
|
|
|
|
|
|
|
Access optional transport information; see
|
|
|
|
:meth:`BaseTransport.get_extra_info` for details.
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
.. coroutinemethod:: drain()
|
|
|
|
|
|
|
|
Wait until it is appropriate to resume writing to the stream.
|
2018-09-17 20:16:44 -03:00
|
|
|
Example::
|
2018-09-11 21:10:37 -03:00
|
|
|
|
|
|
|
writer.write(data)
|
|
|
|
await writer.drain()
|
2014-02-08 17:50:07 -04:00
|
|
|
|
2018-09-17 20:16:44 -03:00
|
|
|
This is a flow control method that interacts with the underlying
|
2018-09-11 21:10:37 -03:00
|
|
|
IO write buffer. When the size of the buffer reaches
|
2018-09-17 20:16:44 -03:00
|
|
|
the high watermark, *drain()* blocks until the size of the
|
|
|
|
buffer is drained down to the low watermark and writing can
|
2018-09-11 21:10:37 -03:00
|
|
|
be resumed. When there is nothing to wait for, the :meth:`drain`
|
|
|
|
returns immediately.
|
2014-02-08 17:50:07 -04:00
|
|
|
|
2018-01-24 18:30:30 -04:00
|
|
|
.. method:: is_closing()
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Return ``True`` if the stream is closed or in the process of
|
|
|
|
being closed.
|
2018-01-24 18:30:30 -04:00
|
|
|
|
|
|
|
.. versionadded:: 3.7
|
|
|
|
|
|
|
|
.. coroutinemethod:: wait_closed()
|
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Wait until the stream is closed.
|
2018-01-24 18:30:30 -04:00
|
|
|
|
2018-09-11 21:10:37 -03:00
|
|
|
Should be called after :meth:`close` to wait until the underlying
|
|
|
|
connection is closed.
|
2018-01-24 18:30:30 -04:00
|
|
|
|
|
|
|
.. versionadded:: 3.7
|
|
|
|
|
2014-01-23 06:25:48 -04:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
Examples
|
|
|
|
========
|
2014-10-11 10:52:14 -03:00
|
|
|
|
2014-10-12 15:18:16 -03:00
|
|
|
.. _asyncio-tcp-echo-client-streams:
|
|
|
|
|
|
|
|
TCP echo client using streams
|
|
|
|
-----------------------------
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
TCP echo client using the :func:`asyncio.connect` function::
|
2014-10-12 15:18:16 -03:00
|
|
|
|
|
|
|
import asyncio
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
async def tcp_echo_client(message):
|
2019-06-24 15:16:58 -03:00
|
|
|
async with asyncio.connect('127.0.0.1', 8888) as stream:
|
|
|
|
print(f'Send: {message!r}')
|
|
|
|
await stream.write(message.encode())
|
2014-10-12 15:18:16 -03:00
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
data = await stream.read(100)
|
|
|
|
print(f'Received: {data.decode()!r}')
|
2014-10-12 15:18:16 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
asyncio.run(tcp_echo_client('Hello World!'))
|
|
|
|
|
2014-10-12 15:18:16 -03:00
|
|
|
|
|
|
|
.. seealso::
|
|
|
|
|
2018-09-17 16:35:24 -03:00
|
|
|
The :ref:`TCP echo client protocol <asyncio_example_tcp_echo_client_protocol>`
|
2018-09-11 13:54:40 -03:00
|
|
|
example uses the low-level :meth:`loop.create_connection` method.
|
2014-10-12 15:18:16 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. _asyncio-tcp-echo-server-streams:
|
|
|
|
|
|
|
|
TCP echo server using streams
|
|
|
|
-----------------------------
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
TCP echo server using the :class:`asyncio.StreamServer` class::
|
2014-10-12 15:18:16 -03:00
|
|
|
|
|
|
|
import asyncio
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
async def handle_echo(stream):
|
|
|
|
data = await stream.read(100)
|
2014-10-12 15:18:16 -03:00
|
|
|
message = data.decode()
|
2019-06-24 15:16:58 -03:00
|
|
|
addr = stream.get_extra_info('peername')
|
2014-10-12 15:18:16 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
print(f"Received {message!r} from {addr!r}")
|
|
|
|
|
|
|
|
print(f"Send: {message!r}")
|
2019-06-24 15:16:58 -03:00
|
|
|
await stream.write(data)
|
2014-10-12 15:18:16 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
print("Close the connection")
|
2019-06-24 15:16:58 -03:00
|
|
|
await stream.close()
|
2014-10-12 15:18:16 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
async def main():
|
2019-06-24 15:16:58 -03:00
|
|
|
async with asyncio.StreamServer(
|
|
|
|
handle_echo, '127.0.0.1', 8888) as server:
|
|
|
|
addr = server.sockets[0].getsockname()
|
|
|
|
print(f'Serving on {addr}')
|
2018-09-11 13:54:40 -03:00
|
|
|
await server.serve_forever()
|
|
|
|
|
|
|
|
asyncio.run(main())
|
2014-10-12 15:18:16 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. seealso::
|
|
|
|
|
2018-09-17 16:35:24 -03:00
|
|
|
The :ref:`TCP echo server protocol <asyncio_example_tcp_echo_server_protocol>`
|
2018-09-11 13:54:40 -03:00
|
|
|
example uses the :meth:`loop.create_server` method.
|
2014-10-12 15:18:16 -03:00
|
|
|
|
|
|
|
|
2014-10-11 10:52:14 -03:00
|
|
|
Get HTTP headers
|
|
|
|
----------------
|
2014-01-23 06:25:48 -04:00
|
|
|
|
|
|
|
Simple example querying HTTP headers of the URL passed on the command line::
|
|
|
|
|
|
|
|
import asyncio
|
|
|
|
import urllib.parse
|
|
|
|
import sys
|
|
|
|
|
2018-08-07 17:29:06 -03:00
|
|
|
async def print_http_headers(url):
|
2014-01-23 06:25:48 -04:00
|
|
|
url = urllib.parse.urlsplit(url)
|
2014-10-11 10:52:14 -03:00
|
|
|
if url.scheme == 'https':
|
2019-06-24 15:16:58 -03:00
|
|
|
stream = await asyncio.connect(url.hostname, 443, ssl=True)
|
2014-10-11 10:52:14 -03:00
|
|
|
else:
|
2019-06-24 15:16:58 -03:00
|
|
|
stream = await asyncio.connect(url.hostname, 80)
|
2018-09-11 13:54:40 -03:00
|
|
|
|
|
|
|
query = (
|
|
|
|
f"HEAD {url.path or '/'} HTTP/1.0\r\n"
|
|
|
|
f"Host: {url.hostname}\r\n"
|
|
|
|
f"\r\n"
|
|
|
|
)
|
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
stream.write(query.encode('latin-1'))
|
|
|
|
while (line := await stream.readline()):
|
2014-01-23 06:25:48 -04:00
|
|
|
line = line.decode('latin1').rstrip()
|
|
|
|
if line:
|
2018-09-11 13:54:40 -03:00
|
|
|
print(f'HTTP header> {line}')
|
2014-01-23 06:25:48 -04:00
|
|
|
|
2014-10-11 10:52:14 -03:00
|
|
|
# Ignore the body, close the socket
|
2019-06-24 15:16:58 -03:00
|
|
|
await stream.close()
|
2014-10-11 10:52:14 -03:00
|
|
|
|
2014-01-23 06:25:48 -04:00
|
|
|
url = sys.argv[1]
|
2018-09-11 13:54:40 -03:00
|
|
|
asyncio.run(print_http_headers(url))
|
|
|
|
|
2014-01-23 06:25:48 -04:00
|
|
|
|
|
|
|
Usage::
|
|
|
|
|
|
|
|
python example.py http://example.com/path/page.html
|
|
|
|
|
2014-10-11 11:16:27 -03:00
|
|
|
or with HTTPS::
|
|
|
|
|
|
|
|
python example.py https://example.com/path/page.html
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
|
2018-09-17 16:35:24 -03:00
|
|
|
.. _asyncio_example_create_connection-streams:
|
2014-10-11 11:16:27 -03:00
|
|
|
|
|
|
|
Register an open socket to wait for data using streams
|
|
|
|
------------------------------------------------------
|
|
|
|
|
|
|
|
Coroutine waiting until a socket receives data using the
|
2019-06-24 15:16:58 -03:00
|
|
|
:func:`asyncio.connect` function::
|
2014-10-11 11:16:27 -03:00
|
|
|
|
|
|
|
import asyncio
|
2018-09-11 13:54:40 -03:00
|
|
|
import socket
|
|
|
|
|
|
|
|
async def wait_for_data():
|
|
|
|
# Get a reference to the current event loop because
|
|
|
|
# we want to access low-level APIs.
|
|
|
|
loop = asyncio.get_running_loop()
|
2014-10-11 11:16:27 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
# Create a pair of connected sockets.
|
|
|
|
rsock, wsock = socket.socketpair()
|
2014-10-11 11:16:27 -03:00
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
# Register the open socket to wait for data.
|
2019-06-24 15:16:58 -03:00
|
|
|
async with asyncio.connect(sock=rsock) as stream:
|
|
|
|
# Simulate the reception of data from the network
|
|
|
|
loop.call_soon(wsock.send, 'abc'.encode())
|
2014-10-11 11:16:27 -03:00
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
# Wait for data
|
|
|
|
data = await stream.read(100)
|
2014-10-11 11:16:27 -03:00
|
|
|
|
2019-06-24 15:16:58 -03:00
|
|
|
# Got data, we are done: close the socket
|
|
|
|
print("Received:", data.decode())
|
2014-10-11 11:16:27 -03:00
|
|
|
|
|
|
|
# Close the second socket
|
|
|
|
wsock.close()
|
|
|
|
|
2018-09-11 13:54:40 -03:00
|
|
|
asyncio.run(wait_for_data())
|
2014-10-11 11:16:27 -03:00
|
|
|
|
|
|
|
.. seealso::
|
|
|
|
|
|
|
|
The :ref:`register an open socket to wait for data using a protocol
|
2018-09-17 16:35:24 -03:00
|
|
|
<asyncio_example_create_connection>` example uses a low-level protocol and
|
2018-09-11 13:54:40 -03:00
|
|
|
the :meth:`loop.create_connection` method.
|
2014-10-11 11:16:27 -03:00
|
|
|
|
|
|
|
The :ref:`watch a file descriptor for read events
|
2018-09-17 16:35:24 -03:00
|
|
|
<asyncio_example_watch_fd>` example uses the low-level
|
2018-09-11 13:54:40 -03:00
|
|
|
:meth:`loop.add_reader` method to watch a file descriptor.
|