Restructure urllib doc structure.
This commit is contained in:
parent
dfe5dc8455
commit
62647653eb
|
@ -1,4 +1,3 @@
|
||||||
|
|
||||||
:mod:`urllib` --- Open arbitrary resources by URL
|
:mod:`urllib` --- Open arbitrary resources by URL
|
||||||
=================================================
|
=================================================
|
||||||
|
|
||||||
|
@ -17,8 +16,8 @@ built-in function :func:`open`, but accepts Universal Resource Locators (URLs)
|
||||||
instead of filenames. Some restrictions apply --- it can only open URLs for
|
instead of filenames. Some restrictions apply --- it can only open URLs for
|
||||||
reading, and no seek operations are available.
|
reading, and no seek operations are available.
|
||||||
|
|
||||||
It defines the following public functions:
|
High-level interface
|
||||||
|
--------------------
|
||||||
|
|
||||||
.. function:: urlopen(url[, data[, proxies]])
|
.. function:: urlopen(url[, data[, proxies]])
|
||||||
|
|
||||||
|
@ -178,6 +177,9 @@ It defines the following public functions:
|
||||||
:func:`urlretrieve`.
|
:func:`urlretrieve`.
|
||||||
|
|
||||||
|
|
||||||
|
Utility functions
|
||||||
|
-----------------
|
||||||
|
|
||||||
.. function:: quote(string[, safe])
|
.. function:: quote(string[, safe])
|
||||||
|
|
||||||
Replace special characters in *string* using the ``%xx`` escape. Letters,
|
Replace special characters in *string* using the ``%xx`` escape. Letters,
|
||||||
|
@ -239,6 +241,9 @@ It defines the following public functions:
|
||||||
to decode *path*.
|
to decode *path*.
|
||||||
|
|
||||||
|
|
||||||
|
URL Opener objects
|
||||||
|
------------------
|
||||||
|
|
||||||
.. class:: URLopener([proxies[, **x509]])
|
.. class:: URLopener([proxies[, **x509]])
|
||||||
|
|
||||||
Base class for opening and reading URLs. Unless you need to support opening
|
Base class for opening and reading URLs. Unless you need to support opening
|
||||||
|
@ -264,6 +269,48 @@ It defines the following public functions:
|
||||||
:class:`URLopener` objects will raise an :exc:`IOError` exception if the server
|
:class:`URLopener` objects will raise an :exc:`IOError` exception if the server
|
||||||
returns an error code.
|
returns an error code.
|
||||||
|
|
||||||
|
.. method:: open(fullurl[, data])
|
||||||
|
|
||||||
|
Open *fullurl* using the appropriate protocol. This method sets up cache and
|
||||||
|
proxy information, then calls the appropriate open method with its input
|
||||||
|
arguments. If the scheme is not recognized, :meth:`open_unknown` is called.
|
||||||
|
The *data* argument has the same meaning as the *data* argument of
|
||||||
|
:func:`urlopen`.
|
||||||
|
|
||||||
|
|
||||||
|
.. method:: open_unknown(fullurl[, data])
|
||||||
|
|
||||||
|
Overridable interface to open unknown URL types.
|
||||||
|
|
||||||
|
|
||||||
|
.. method:: retrieve(url[, filename[, reporthook[, data]]])
|
||||||
|
|
||||||
|
Retrieves the contents of *url* and places it in *filename*. The return value
|
||||||
|
is a tuple consisting of a local filename and either a
|
||||||
|
:class:`mimetools.Message` object containing the response headers (for remote
|
||||||
|
URLs) or ``None`` (for local URLs). The caller must then open and read the
|
||||||
|
contents of *filename*. If *filename* is not given and the URL refers to a
|
||||||
|
local file, the input filename is returned. If the URL is non-local and
|
||||||
|
*filename* is not given, the filename is the output of :func:`tempfile.mktemp`
|
||||||
|
with a suffix that matches the suffix of the last path component of the input
|
||||||
|
URL. If *reporthook* is given, it must be a function accepting three numeric
|
||||||
|
parameters. It will be called after each chunk of data is read from the
|
||||||
|
network. *reporthook* is ignored for local URLs.
|
||||||
|
|
||||||
|
If the *url* uses the :file:`http:` scheme identifier, the optional *data*
|
||||||
|
argument may be given to specify a ``POST`` request (normally the request type
|
||||||
|
is ``GET``). The *data* argument must in standard
|
||||||
|
:mimetype:`application/x-www-form-urlencoded` format; see the :func:`urlencode`
|
||||||
|
function below.
|
||||||
|
|
||||||
|
|
||||||
|
.. attribute:: version
|
||||||
|
|
||||||
|
Variable that specifies the user agent of the opener object. To get
|
||||||
|
:mod:`urllib` to tell servers that it is a particular user agent, set this in a
|
||||||
|
subclass as a class variable or in the constructor before calling the base
|
||||||
|
constructor.
|
||||||
|
|
||||||
|
|
||||||
.. class:: FancyURLopener(...)
|
.. class:: FancyURLopener(...)
|
||||||
|
|
||||||
|
@ -293,6 +340,18 @@ It defines the following public functions:
|
||||||
users for the required information on the controlling terminal. A subclass may
|
users for the required information on the controlling terminal. A subclass may
|
||||||
override this method to support more appropriate behavior if needed.
|
override this method to support more appropriate behavior if needed.
|
||||||
|
|
||||||
|
The :class:`FancyURLopener` class offers one additional method that should be
|
||||||
|
overloaded to provide the appropriate behavior:
|
||||||
|
|
||||||
|
.. method:: prompt_user_passwd(host, realm)
|
||||||
|
|
||||||
|
Return information needed to authenticate the user at the given host in the
|
||||||
|
specified security realm. The return value should be a tuple, ``(user,
|
||||||
|
password)``, which can be used for basic authentication.
|
||||||
|
|
||||||
|
The implementation prompts for this information on the terminal; an application
|
||||||
|
should override this method to use an appropriate interaction model in the local
|
||||||
|
environment.
|
||||||
|
|
||||||
.. exception:: ContentTooShortError(msg[, content])
|
.. exception:: ContentTooShortError(msg[, content])
|
||||||
|
|
||||||
|
@ -303,7 +362,9 @@ It defines the following public functions:
|
||||||
|
|
||||||
.. versionadded:: 2.5
|
.. versionadded:: 2.5
|
||||||
|
|
||||||
Restrictions:
|
|
||||||
|
:mod:`urllib` Restrictions
|
||||||
|
--------------------------
|
||||||
|
|
||||||
.. index::
|
.. index::
|
||||||
pair: HTTP; protocol
|
pair: HTTP; protocol
|
||||||
|
@ -364,75 +425,6 @@ Restrictions:
|
||||||
module :mod:`urlparse`.
|
module :mod:`urlparse`.
|
||||||
|
|
||||||
|
|
||||||
.. _urlopener-objs:
|
|
||||||
|
|
||||||
URLopener Objects
|
|
||||||
-----------------
|
|
||||||
|
|
||||||
.. sectionauthor:: Skip Montanaro <skip@pobox.com>
|
|
||||||
|
|
||||||
|
|
||||||
:class:`URLopener` and :class:`FancyURLopener` objects have the following
|
|
||||||
attributes.
|
|
||||||
|
|
||||||
|
|
||||||
.. method:: URLopener.open(fullurl[, data])
|
|
||||||
|
|
||||||
Open *fullurl* using the appropriate protocol. This method sets up cache and
|
|
||||||
proxy information, then calls the appropriate open method with its input
|
|
||||||
arguments. If the scheme is not recognized, :meth:`open_unknown` is called.
|
|
||||||
The *data* argument has the same meaning as the *data* argument of
|
|
||||||
:func:`urlopen`.
|
|
||||||
|
|
||||||
|
|
||||||
.. method:: URLopener.open_unknown(fullurl[, data])
|
|
||||||
|
|
||||||
Overridable interface to open unknown URL types.
|
|
||||||
|
|
||||||
|
|
||||||
.. method:: URLopener.retrieve(url[, filename[, reporthook[, data]]])
|
|
||||||
|
|
||||||
Retrieves the contents of *url* and places it in *filename*. The return value
|
|
||||||
is a tuple consisting of a local filename and either a
|
|
||||||
:class:`mimetools.Message` object containing the response headers (for remote
|
|
||||||
URLs) or ``None`` (for local URLs). The caller must then open and read the
|
|
||||||
contents of *filename*. If *filename* is not given and the URL refers to a
|
|
||||||
local file, the input filename is returned. If the URL is non-local and
|
|
||||||
*filename* is not given, the filename is the output of :func:`tempfile.mktemp`
|
|
||||||
with a suffix that matches the suffix of the last path component of the input
|
|
||||||
URL. If *reporthook* is given, it must be a function accepting three numeric
|
|
||||||
parameters. It will be called after each chunk of data is read from the
|
|
||||||
network. *reporthook* is ignored for local URLs.
|
|
||||||
|
|
||||||
If the *url* uses the :file:`http:` scheme identifier, the optional *data*
|
|
||||||
argument may be given to specify a ``POST`` request (normally the request type
|
|
||||||
is ``GET``). The *data* argument must in standard
|
|
||||||
:mimetype:`application/x-www-form-urlencoded` format; see the :func:`urlencode`
|
|
||||||
function below.
|
|
||||||
|
|
||||||
|
|
||||||
.. attribute:: URLopener.version
|
|
||||||
|
|
||||||
Variable that specifies the user agent of the opener object. To get
|
|
||||||
:mod:`urllib` to tell servers that it is a particular user agent, set this in a
|
|
||||||
subclass as a class variable or in the constructor before calling the base
|
|
||||||
constructor.
|
|
||||||
|
|
||||||
The :class:`FancyURLopener` class offers one additional method that should be
|
|
||||||
overloaded to provide the appropriate behavior:
|
|
||||||
|
|
||||||
|
|
||||||
.. method:: FancyURLopener.prompt_user_passwd(host, realm)
|
|
||||||
|
|
||||||
Return information needed to authenticate the user at the given host in the
|
|
||||||
specified security realm. The return value should be a tuple, ``(user,
|
|
||||||
password)``, which can be used for basic authentication.
|
|
||||||
|
|
||||||
The implementation prompts for this information on the terminal; an application
|
|
||||||
should override this method to use an appropriate interaction model in the local
|
|
||||||
environment.
|
|
||||||
|
|
||||||
|
|
||||||
.. _urllib-examples:
|
.. _urllib-examples:
|
||||||
|
|
||||||
Examples
|
Examples
|
||||||
|
|
Loading…
Reference in New Issue