2008-06-23 01:41:59 -03:00
|
|
|
:mod:`urllib.request` --- extensible library for opening URLs
|
|
|
|
=============================================================
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. module:: urllib.request
|
2007-08-15 11:28:22 -03:00
|
|
|
:synopsis: Next generation URL opening library.
|
2009-03-31 11:38:13 -03:00
|
|
|
.. moduleauthor:: Jeremy Hylton <jeremy@alum.mit.edu>
|
2007-08-15 11:28:22 -03:00
|
|
|
.. sectionauthor:: Moshe Zadka <moshez@users.sourceforge.net>
|
|
|
|
|
|
|
|
|
2008-06-23 08:23:31 -03:00
|
|
|
The :mod:`urllib.request` module defines functions and classes which help in
|
|
|
|
opening URLs (mostly HTTP) in a complex world --- basic and digest
|
|
|
|
authentication, redirections, cookies and more.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
The :mod:`urllib.request` module defines the following functions:
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. function:: urlopen(url[, data][, timeout])
|
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
Open the URL *url*, which can be either a string or a
|
|
|
|
:class:`Request` object.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
*data* may be a string specifying additional data to send to the
|
|
|
|
server, or ``None`` if no such data is needed. Currently HTTP
|
|
|
|
requests are the only ones that use *data*; the HTTP request will
|
|
|
|
be a POST instead of a GET when the *data* parameter is provided.
|
|
|
|
*data* should be a buffer in the standard
|
2007-08-15 11:28:22 -03:00
|
|
|
:mimetype:`application/x-www-form-urlencoded` format. The
|
2008-12-05 03:32:56 -04:00
|
|
|
:func:`urllib.parse.urlencode` function takes a mapping or sequence
|
|
|
|
of 2-tuples and returns a string in this format.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
The optional *timeout* parameter specifies a timeout in seconds for
|
|
|
|
blocking operations like the connection attempt (if not specified,
|
|
|
|
the global default timeout setting will be used). This actually
|
|
|
|
only works for HTTP, HTTPS, FTP and FTPS connections.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
This function returns a file-like object with two additional methods from
|
|
|
|
the :mod:`urllib.response` module
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
* :meth:`geturl` --- return the URL of the resource retrieved,
|
|
|
|
commonly used to determine if a redirect was followed
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-02-27 12:46:46 -04:00
|
|
|
* :meth:`info` --- return the meta-information of the page, such as headers,
|
Merged revisions 70712,70714,70764-70765,70769-70771,70773,70776-70777,70788-70789,70824,70828,70832,70836,70842,70851,70855,70857,70866-70872,70883,70885,70893-70894,70896-70897,70903,70905-70907,70915,70927,70933,70951,70960,70962-70964,70998,71001,71006,71008,71010-71011,71019,71037,71056,71094,71101-71103,71106,71119,71123,71149-71150,71203,71212,71214-71217,71221,71240 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r70712 | benjamin.peterson | 2009-03-30 10:15:38 -0500 (Mon, 30 Mar 2009) | 1 line
don't rely on the order dict repr #5605
........
r70714 | brett.cannon | 2009-03-30 10:20:53 -0500 (Mon, 30 Mar 2009) | 1 line
Add an entry to developers.txt.
........
r70764 | martin.v.loewis | 2009-03-30 17:06:33 -0500 (Mon, 30 Mar 2009) | 2 lines
Add several VM developers.
........
r70765 | georg.brandl | 2009-03-30 17:09:34 -0500 (Mon, 30 Mar 2009) | 1 line
#5199: make warning about vars() assignment more visible.
........
r70769 | andrew.kuchling | 2009-03-30 17:29:53 -0500 (Mon, 30 Mar 2009) | 1 line
Remove comment
........
r70770 | andrew.kuchling | 2009-03-30 17:30:20 -0500 (Mon, 30 Mar 2009) | 1 line
Add several items and placeholders
........
r70771 | andrew.kuchling | 2009-03-30 17:31:11 -0500 (Mon, 30 Mar 2009) | 1 line
Many edits
........
r70773 | georg.brandl | 2009-03-30 17:43:00 -0500 (Mon, 30 Mar 2009) | 1 line
#5039: make it clear that the impl. note refers to CPython.
........
r70776 | andrew.kuchling | 2009-03-30 18:08:24 -0500 (Mon, 30 Mar 2009) | 1 line
typo fix
........
r70777 | andrew.kuchling | 2009-03-30 18:09:46 -0500 (Mon, 30 Mar 2009) | 1 line
Add more items
........
r70788 | andrew.kuchling | 2009-03-30 20:21:01 -0500 (Mon, 30 Mar 2009) | 1 line
Add various items
........
r70789 | georg.brandl | 2009-03-30 20:25:15 -0500 (Mon, 30 Mar 2009) | 1 line
Fix a wrong struct field assignment (docstring as closure).
........
r70824 | georg.brandl | 2009-03-31 10:43:20 -0500 (Tue, 31 Mar 2009) | 1 line
#5519: remove reference to Kodos, which seems dead.
........
r70828 | georg.brandl | 2009-03-31 10:50:16 -0500 (Tue, 31 Mar 2009) | 1 line
#5581: fget argument of abstractproperty is optional as well.
........
r70832 | georg.brandl | 2009-03-31 11:31:11 -0500 (Tue, 31 Mar 2009) | 1 line
#1386675: specify WindowsError as the exception, because it has a winerror attribute that EnvironmentError doesnt have.
........
r70836 | georg.brandl | 2009-03-31 11:50:25 -0500 (Tue, 31 Mar 2009) | 1 line
#5417: replace references to undocumented functions by ones to documented functions.
........
r70842 | georg.brandl | 2009-03-31 12:13:06 -0500 (Tue, 31 Mar 2009) | 1 line
#970783: document PyObject_Generic[GS]etAttr.
........
r70851 | georg.brandl | 2009-03-31 13:26:55 -0500 (Tue, 31 Mar 2009) | 1 line
#837577: note cryptic return value of spawn*e on invalid env dicts.
........
r70855 | georg.brandl | 2009-03-31 13:30:37 -0500 (Tue, 31 Mar 2009) | 1 line
#5245: note that PyRun_SimpleString doesnt return on SystemExit.
........
r70857 | georg.brandl | 2009-03-31 13:33:10 -0500 (Tue, 31 Mar 2009) | 1 line
#5227: note that Py_Main doesnt return on SystemExit.
........
r70866 | georg.brandl | 2009-03-31 14:06:57 -0500 (Tue, 31 Mar 2009) | 1 line
#4882: document named group behavior a bit better.
........
r70867 | georg.brandl | 2009-03-31 14:10:35 -0500 (Tue, 31 Mar 2009) | 1 line
#1096310: document usage of sys.__std*__ a bit better.
........
r70868 | georg.brandl | 2009-03-31 14:12:17 -0500 (Tue, 31 Mar 2009) | 1 line
#5190: export make_option in __all__.
........
r70869 | georg.brandl | 2009-03-31 14:14:42 -0500 (Tue, 31 Mar 2009) | 1 line
Fix-up unwanted change.
........
r70870 | georg.brandl | 2009-03-31 14:26:24 -0500 (Tue, 31 Mar 2009) | 1 line
#4411: document mro() and __mro__. (I hope I got it right.)
........
r70871 | georg.brandl | 2009-03-31 14:30:56 -0500 (Tue, 31 Mar 2009) | 1 line
#5618: fix typo.
........
r70872 | r.david.murray | 2009-03-31 14:31:17 -0500 (Tue, 31 Mar 2009) | 3 lines
Delete out-of-date and little-known README from the test
directory by consensus of devs at pycon sprint.
........
r70883 | georg.brandl | 2009-03-31 15:41:08 -0500 (Tue, 31 Mar 2009) | 1 line
#1674032: return value of flag from Event.wait(). OKed by Guido.
........
r70885 | tarek.ziade | 2009-03-31 15:48:31 -0500 (Tue, 31 Mar 2009) | 1 line
using log.warn for sys.stderr
........
r70893 | georg.brandl | 2009-03-31 15:56:32 -0500 (Tue, 31 Mar 2009) | 1 line
#1530012: move TQS section before raw strings.
........
r70894 | benjamin.peterson | 2009-03-31 16:06:30 -0500 (Tue, 31 Mar 2009) | 1 line
take the usual lock precautions around _active_limbo_lock
........
r70896 | georg.brandl | 2009-03-31 16:15:33 -0500 (Tue, 31 Mar 2009) | 1 line
#5598: document DocFileSuite *args argument.
........
r70897 | benjamin.peterson | 2009-03-31 16:34:42 -0500 (Tue, 31 Mar 2009) | 1 line
fix Thread.ident when it is the main thread or a dummy thread #5632
........
r70903 | georg.brandl | 2009-03-31 16:45:18 -0500 (Tue, 31 Mar 2009) | 1 line
#1676135: remove trailing slashes from --prefix argument.
........
r70905 | georg.brandl | 2009-03-31 17:03:40 -0500 (Tue, 31 Mar 2009) | 1 line
#5563: more documentation for bdist_msi.
........
r70906 | georg.brandl | 2009-03-31 17:11:53 -0500 (Tue, 31 Mar 2009) | 1 line
#1651995: fix _convert_ref for non-ASCII characters.
........
r70907 | georg.brandl | 2009-03-31 17:18:19 -0500 (Tue, 31 Mar 2009) | 1 line
#3427: document correct return type for urlopen().info().
........
r70915 | georg.brandl | 2009-03-31 17:40:16 -0500 (Tue, 31 Mar 2009) | 1 line
#5018: remove confusing paragraph.
........
r70927 | georg.brandl | 2009-03-31 18:01:27 -0500 (Tue, 31 Mar 2009) | 1 line
Dont shout to users.
........
r70933 | georg.brandl | 2009-03-31 19:04:33 -0500 (Tue, 31 Mar 2009) | 2 lines
Issue #5635: Fix running test_sys with tracing enabled.
........
r70951 | georg.brandl | 2009-04-01 09:02:27 -0500 (Wed, 01 Apr 2009) | 1 line
Add Maksim, who worked on several issues at the sprint.
........
r70960 | jesse.noller | 2009-04-01 11:42:19 -0500 (Wed, 01 Apr 2009) | 1 line
Issue 3270: document Listener address restrictions on windows
........
r70962 | brett.cannon | 2009-04-01 12:07:16 -0500 (Wed, 01 Apr 2009) | 2 lines
Ron DuPlain was given commit privileges at PyCon 2009 to work on 3to2.
........
r70963 | georg.brandl | 2009-04-01 12:46:01 -0500 (Wed, 01 Apr 2009) | 1 line
#5655: fix docstring oversight.
........
r70964 | brett.cannon | 2009-04-01 12:52:13 -0500 (Wed, 01 Apr 2009) | 2 lines
Paul Kippes was given commit privileges to work on 3to2.
........
r70998 | georg.brandl | 2009-04-01 16:54:21 -0500 (Wed, 01 Apr 2009) | 1 line
In Pdb, stop assigning values to __builtin__._ which interferes with the one commonly installed by gettext.
........
r71001 | brett.cannon | 2009-04-01 18:01:12 -0500 (Wed, 01 Apr 2009) | 3 lines
Add my initials to Misc/developers.txt. Names are now sorted by number of
characters in the person's name.
........
r71006 | georg.brandl | 2009-04-01 18:32:17 -0500 (Wed, 01 Apr 2009) | 1 line
Cache the f_locals dict of the current frame, since every access to frame.f_locals overrides its contents with the real locals which undoes modifications made by the debugging user.
........
r71008 | andrew.kuchling | 2009-04-01 19:02:14 -0500 (Wed, 01 Apr 2009) | 1 line
Typo fix
........
r71010 | benjamin.peterson | 2009-04-01 19:11:52 -0500 (Wed, 01 Apr 2009) | 1 line
fix markup
........
r71011 | benjamin.peterson | 2009-04-01 19:12:47 -0500 (Wed, 01 Apr 2009) | 1 line
this should be :noindex:
........
r71019 | georg.brandl | 2009-04-01 21:00:01 -0500 (Wed, 01 Apr 2009) | 1 line
Fix test_doctest, missed two assignments to curframe.
........
r71037 | r.david.murray | 2009-04-01 23:34:04 -0500 (Wed, 01 Apr 2009) | 6 lines
Clarify that datetime strftime does not produce leap seconds and datetime
strptime does not accept it in the strftime behavior section of the
datetime docs.
Closes issue 2568.
........
r71056 | georg.brandl | 2009-04-02 12:43:07 -0500 (Thu, 02 Apr 2009) | 2 lines
Actually the displayhook should print the repr.
........
r71094 | vinay.sajip | 2009-04-03 05:23:18 -0500 (Fri, 03 Apr 2009) | 1 line
Added warning about logging use from asynchronous signal handlers.
........
r71101 | andrew.kuchling | 2009-04-03 16:43:00 -0500 (Fri, 03 Apr 2009) | 1 line
Add some items
........
r71102 | andrew.kuchling | 2009-04-03 16:44:49 -0500 (Fri, 03 Apr 2009) | 1 line
Fix 'the the'; grammar fix
........
r71103 | andrew.kuchling | 2009-04-03 16:45:29 -0500 (Fri, 03 Apr 2009) | 1 line
Fix 'the the' duplication
........
r71106 | vinay.sajip | 2009-04-03 16:58:16 -0500 (Fri, 03 Apr 2009) | 1 line
Clarified warning about logging use from asynchronous signal handlers.
........
r71119 | raymond.hettinger | 2009-04-04 00:37:47 -0500 (Sat, 04 Apr 2009) | 1 line
Add helpful link.
........
r71123 | r.david.murray | 2009-04-04 01:39:56 -0500 (Sat, 04 Apr 2009) | 2 lines
Fix error in description of 'oct' (issue 5678).
........
r71149 | georg.brandl | 2009-04-04 08:42:39 -0500 (Sat, 04 Apr 2009) | 1 line
#5642: clarify map() compatibility to the builtin.
........
r71150 | georg.brandl | 2009-04-04 08:45:49 -0500 (Sat, 04 Apr 2009) | 1 line
#5601: clarify that webbrowser is not meant for file names.
........
r71203 | benjamin.peterson | 2009-04-04 18:46:34 -0500 (Sat, 04 Apr 2009) | 1 line
note how using iter* are unsafe while mutating and document iter(dict)
........
r71212 | georg.brandl | 2009-04-05 05:24:20 -0500 (Sun, 05 Apr 2009) | 1 line
#1742837: expand HTTP server docs, and fix SocketServer ones to document methods as methods, not functions.
........
r71214 | georg.brandl | 2009-04-05 05:29:57 -0500 (Sun, 05 Apr 2009) | 1 line
Normalize spelling of Mac OS X.
........
r71215 | georg.brandl | 2009-04-05 05:32:26 -0500 (Sun, 05 Apr 2009) | 1 line
Avoid sure signs of a diseased mind.
........
r71216 | georg.brandl | 2009-04-05 05:41:02 -0500 (Sun, 05 Apr 2009) | 1 line
#1718017: document the relation of os.path and the posixpath, ntpath etc. modules better.
........
r71217 | georg.brandl | 2009-04-05 05:48:47 -0500 (Sun, 05 Apr 2009) | 1 line
#1726172: dont raise an unexpected IndexError if a voidresp() call has an empty response.
........
r71221 | vinay.sajip | 2009-04-05 06:06:24 -0500 (Sun, 05 Apr 2009) | 1 line
Issue #5695: Moved logging.captureWarnings() call inside with statement in WarningsTest.test_warnings.
........
r71240 | georg.brandl | 2009-04-05 09:40:06 -0500 (Sun, 05 Apr 2009) | 1 line
#5370: doc update about unpickling objects with custom __getattr__ etc. methods.
........
2009-04-05 16:13:16 -03:00
|
|
|
in the form of an :class:`http.client.HTTPMessage` instance (see `Quick
|
2009-02-27 12:46:46 -04:00
|
|
|
Reference to HTTP Headers <http://www.cs.tut.fi/~jkorpela/http.html>`_)
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
Raises :exc:`URLError` on errors.
|
|
|
|
|
2009-02-27 12:46:46 -04:00
|
|
|
Note that ``None`` may be returned if no handler handles the request (though
|
|
|
|
the default installed global :class:`OpenerDirector` uses
|
|
|
|
:class:`UnknownHandler` to ensure this never happens).
|
|
|
|
|
|
|
|
The legacy ``urllib.urlopen`` function from Python 2.6 and earlier has been
|
|
|
|
discontinued; :func:`urlopen` corresponds to the old ``urllib2.urlopen``.
|
|
|
|
Proxy handling, which was done by passing a dictionary parameter to
|
|
|
|
``urllib.urlopen``, can be obtained by using :class:`ProxyHandler` objects.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
.. function:: install_opener(opener)
|
|
|
|
|
|
|
|
Install an :class:`OpenerDirector` instance as the default global opener.
|
|
|
|
Installing an opener is only necessary if you want urlopen to use that opener;
|
|
|
|
otherwise, simply call :meth:`OpenerDirector.open` instead of :func:`urlopen`.
|
|
|
|
The code does not check for a real :class:`OpenerDirector`, and any class with
|
|
|
|
the appropriate interface will work.
|
|
|
|
|
|
|
|
|
|
|
|
.. function:: build_opener([handler, ...])
|
|
|
|
|
|
|
|
Return an :class:`OpenerDirector` instance, which chains the handlers in the
|
|
|
|
order given. *handler*\s can be either instances of :class:`BaseHandler`, or
|
|
|
|
subclasses of :class:`BaseHandler` (in which case it must be possible to call
|
|
|
|
the constructor without any parameters). Instances of the following classes
|
|
|
|
will be in front of the *handler*\s, unless the *handler*\s contain them,
|
|
|
|
instances of them or subclasses of them: :class:`ProxyHandler`,
|
|
|
|
:class:`UnknownHandler`, :class:`HTTPHandler`, :class:`HTTPDefaultErrorHandler`,
|
|
|
|
:class:`HTTPRedirectHandler`, :class:`FTPHandler`, :class:`FileHandler`,
|
|
|
|
:class:`HTTPErrorProcessor`.
|
|
|
|
|
Merge the trunk changes in. Breaks socket.ssl for now.
Merged revisions 57392-57619 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r57395 | georg.brandl | 2007-08-24 19:23:23 +0200 (Fri, 24 Aug 2007) | 2 lines
Bug #1011: fix rfc822.Message.getheader docs.
........
r57397 | georg.brandl | 2007-08-24 19:38:49 +0200 (Fri, 24 Aug 2007) | 2 lines
Patch #1006: port test_winreg to unittest.
........
r57398 | georg.brandl | 2007-08-24 19:46:54 +0200 (Fri, 24 Aug 2007) | 2 lines
Fix #1012: wrong URL to :mod:`site` in install/index.rst.
........
r57399 | georg.brandl | 2007-08-24 20:07:52 +0200 (Fri, 24 Aug 2007) | 2 lines
Patch #1008: port test_signal to unittest.
........
r57400 | georg.brandl | 2007-08-24 20:22:54 +0200 (Fri, 24 Aug 2007) | 2 lines
Port test_frozen to unittest.
........
r57401 | georg.brandl | 2007-08-24 20:27:43 +0200 (Fri, 24 Aug 2007) | 2 lines
Document new utility functions in test_support.
........
r57402 | georg.brandl | 2007-08-24 20:30:06 +0200 (Fri, 24 Aug 2007) | 2 lines
Remove test_rgbimg output file, there is no test_rgbimg.py.
........
r57403 | georg.brandl | 2007-08-24 20:35:27 +0200 (Fri, 24 Aug 2007) | 2 lines
Remove output file for test_ossaudiodev, also properly close the dsp object.
........
r57404 | georg.brandl | 2007-08-24 20:46:27 +0200 (Fri, 24 Aug 2007) | 2 lines
Convert test_linuxaudiodev to unittest. Fix a wrong finally clause in test_ossaudiodev.
........
r57406 | collin.winter | 2007-08-24 21:13:58 +0200 (Fri, 24 Aug 2007) | 1 line
Convert test_pkg to use unittest.
........
r57408 | georg.brandl | 2007-08-24 21:22:34 +0200 (Fri, 24 Aug 2007) | 2 lines
Catch the correct errors.
........
r57409 | georg.brandl | 2007-08-24 21:33:53 +0200 (Fri, 24 Aug 2007) | 2 lines
Port test_class to unittest. Patch #1671298.
........
r57415 | collin.winter | 2007-08-24 23:09:42 +0200 (Fri, 24 Aug 2007) | 1 line
Make test_structmembers pass when run with regrtests's -R flag.
........
r57455 | nick.coghlan | 2007-08-25 06:32:07 +0200 (Sat, 25 Aug 2007) | 1 line
Revert misguided attempt at fixing incompatibility between -m and -i switches (better fix coming soon)
........
r57456 | nick.coghlan | 2007-08-25 06:35:54 +0200 (Sat, 25 Aug 2007) | 1 line
Revert compile.c changes that shouldn't have been included in previous checkin
........
r57461 | nick.coghlan | 2007-08-25 12:50:41 +0200 (Sat, 25 Aug 2007) | 1 line
Fix bug 1764407 - the -i switch now does the right thing when using the -m switch
........
r57464 | guido.van.rossum | 2007-08-25 17:08:43 +0200 (Sat, 25 Aug 2007) | 4 lines
Server-side SSL and certificate validation, by Bill Janssen.
While cleaning up Bill's C style, I may have cleaned up some code
he didn't touch as well (in _ssl.c).
........
r57465 | neal.norwitz | 2007-08-25 18:41:36 +0200 (Sat, 25 Aug 2007) | 3 lines
Try to get this to build with Visual Studio by moving all the variable
declarations to the beginning of a scope.
........
r57466 | neal.norwitz | 2007-08-25 18:54:38 +0200 (Sat, 25 Aug 2007) | 1 line
Fix test so it is skipped properly if there is no SSL support.
........
r57467 | neal.norwitz | 2007-08-25 18:58:09 +0200 (Sat, 25 Aug 2007) | 2 lines
Fix a few more variables to try to get this to compile with Visual Studio.
........
r57473 | neal.norwitz | 2007-08-25 19:25:17 +0200 (Sat, 25 Aug 2007) | 1 line
Try to get this test to pass for systems that do not have SO_REUSEPORT
........
r57482 | gregory.p.smith | 2007-08-26 02:26:00 +0200 (Sun, 26 Aug 2007) | 7 lines
keep setup.py from listing unneeded hash modules (_md5, _sha*) as
missing when they were not built because _hashlib with openssl provided
their functionality instead.
don't build bsddb185 if bsddb was built.
........
r57483 | neal.norwitz | 2007-08-26 03:08:16 +0200 (Sun, 26 Aug 2007) | 1 line
Fix typo in docstring (missing c in reacquire)
........
r57484 | neal.norwitz | 2007-08-26 03:42:03 +0200 (Sun, 26 Aug 2007) | 2 lines
Spell check (also americanify behaviour, it's almost 3 times as common)
........
r57503 | neal.norwitz | 2007-08-26 08:29:57 +0200 (Sun, 26 Aug 2007) | 4 lines
Reap children before the test starts so hopefully SocketServer
won't find any old children left around which causes an exception
in collect_children() and the test to fail.
........
r57510 | neal.norwitz | 2007-08-26 20:50:39 +0200 (Sun, 26 Aug 2007) | 1 line
Fail gracefully if the cert files cannot be created
........
r57513 | guido.van.rossum | 2007-08-26 21:35:09 +0200 (Sun, 26 Aug 2007) | 4 lines
Bill Janssen wrote:
Here's a patch which makes test_ssl a better player in the buildbots
environment. I deep-ended on "try-except-else" clauses.
........
r57518 | neal.norwitz | 2007-08-26 23:40:16 +0200 (Sun, 26 Aug 2007) | 1 line
Get the test passing by commenting out some writes (should they be removed?)
........
r57522 | neal.norwitz | 2007-08-27 00:16:23 +0200 (Mon, 27 Aug 2007) | 3 lines
Catch IOError for when the device file doesn't exist or the user doesn't have
permission to write to the device.
........
r57524 | neal.norwitz | 2007-08-27 00:20:03 +0200 (Mon, 27 Aug 2007) | 5 lines
Another patch from Bill Janssen that:
1) Fixes the bug that two class names are initial-lower-case.
2) Replaces the poll waiting for the server to become ready with
a threading.Event signal.
........
r57536 | neal.norwitz | 2007-08-27 02:58:33 +0200 (Mon, 27 Aug 2007) | 1 line
Stop using string.join (from the module) to ease upgrade to py3k
........
r57537 | neal.norwitz | 2007-08-27 03:03:18 +0200 (Mon, 27 Aug 2007) | 1 line
Make a utility function for handling (printing) an error
........
r57538 | neal.norwitz | 2007-08-27 03:15:33 +0200 (Mon, 27 Aug 2007) | 4 lines
If we can't create a certificate, print a warning, but don't fail the test.
Modified patch from what Bill Janssen sent on python-3000.
........
r57539 | facundo.batista | 2007-08-27 03:15:34 +0200 (Mon, 27 Aug 2007) | 7 lines
Ignore test failures caused by 'resource temporarily unavailable'
exceptions raised in the test server thread, since SimpleXMLRPCServer
does not gracefully handle them. Changed number of requests handled
by tests server thread to one (was 2) because no tests require more
than one request. [GSoC - Alan McIntyre]
........
r57561 | guido.van.rossum | 2007-08-27 19:19:42 +0200 (Mon, 27 Aug 2007) | 8 lines
> Regardless, building a fixed test certificate and checking it in sounds like
> the better option. Then the openssl command in the test code can be turned
> into a comment describing how the test data was pregenerated.
Here's a patch that does that.
Bill
........
r57568 | guido.van.rossum | 2007-08-27 20:42:23 +0200 (Mon, 27 Aug 2007) | 26 lines
> Some of the code sets the error string in this directly before
> returning NULL, and other pieces of the code call PySSL_SetError,
> which creates the error string. I think some of the places which set
> the string directly probably shouldn't; instead, they should call
> PySSL_SetError to cons up the error name directly from the err code.
> However, PySSL_SetError only works after the construction of an ssl
> object, which means it can't be used there... I'll take a longer look
> at it and see if there's a reasonable fix.
Here's a patch which addresses this. It also fixes the indentation in
PySSL_SetError, bringing it into line with PEP 7, fixes a compile warning
about one of the OpenSSL macros, and makes the namespace a bit more
consistent. I've tested it on FC 7 and OS X 10.4.
% ./python ./Lib/test/regrtest.py -R :1: -u all test_ssl
test_ssl
beginning 6 repetitions
123456
......
1 test OK.
[29244 refs]
%
[GvR: slightly edited to enforce 79-char line length, even if it required
violating the style guide.]
........
r57570 | guido.van.rossum | 2007-08-27 21:11:11 +0200 (Mon, 27 Aug 2007) | 2 lines
Patch 10124 by Bill Janssen, docs for the new ssl code.
........
r57574 | guido.van.rossum | 2007-08-27 22:51:00 +0200 (Mon, 27 Aug 2007) | 3 lines
Patch # 1739906 by Christian Heimes -- add reduce to functools (importing
it from __builtin__).
........
r57575 | guido.van.rossum | 2007-08-27 22:52:10 +0200 (Mon, 27 Aug 2007) | 2 lines
News about functools.reduce.
........
r57611 | georg.brandl | 2007-08-28 10:29:08 +0200 (Tue, 28 Aug 2007) | 2 lines
Document rev. 57574.
........
r57612 | sean.reifschneider | 2007-08-28 11:07:54 +0200 (Tue, 28 Aug 2007) | 2 lines
Adding basic imputil documentation.
........
r57614 | georg.brandl | 2007-08-28 12:48:18 +0200 (Tue, 28 Aug 2007) | 2 lines
Fix some glitches.
........
r57616 | lars.gustaebel | 2007-08-28 14:31:09 +0200 (Tue, 28 Aug 2007) | 5 lines
TarFile.__init__() no longer fails if no name argument is passed and
the fileobj argument has no usable name attribute (e.g. StringIO).
(will backport to 2.5)
........
r57619 | thomas.wouters | 2007-08-28 17:28:19 +0200 (Tue, 28 Aug 2007) | 22 lines
Improve extended slicing support in builtin types and classes. Specifically:
- Specialcase extended slices that amount to a shallow copy the same way as
is done for simple slices, in the tuple, string and unicode case.
- Specialcase step-1 extended slices to optimize the common case for all
involved types.
- For lists, allow extended slice assignment of differing lengths as long
as the step is 1. (Previously, 'l[:2:1] = []' failed even though
'l[:2] = []' and 'l[:2:None] = []' do not.)
- Implement extended slicing for buffer, array, structseq, mmap and
UserString.UserString.
- Implement slice-object support (but not non-step-1 slice assignment) for
UserString.MutableString.
- Add tests for all new functionality.
........
2007-08-28 18:37:11 -03:00
|
|
|
If the Python installation has SSL support (i.e., if the :mod:`ssl` module can be imported),
|
2007-08-15 11:28:22 -03:00
|
|
|
:class:`HTTPSHandler` will also be added.
|
|
|
|
|
2008-05-12 15:05:20 -03:00
|
|
|
A :class:`BaseHandler` subclass may also change its :attr:`handler_order`
|
|
|
|
member variable to modify its position in the handlers list.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. function:: urlretrieve(url[, filename[, reporthook[, data]]])
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
Copy a network object denoted by a URL to a local file, if necessary. If the URL
|
|
|
|
points to a local file, or a valid cached copy of the object exists, the object
|
|
|
|
is not copied. Return a tuple ``(filename, headers)`` where *filename* is the
|
|
|
|
local file name under which the object can be found, and *headers* is whatever
|
|
|
|
the :meth:`info` method of the object returned by :func:`urlopen` returned (for
|
|
|
|
a remote object, possibly cached). Exceptions are the same as for
|
|
|
|
:func:`urlopen`.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
The second argument, if present, specifies the file location to copy to (if
|
|
|
|
absent, the location will be a tempfile with a generated name). The third
|
|
|
|
argument, if present, is a hook function that will be called once on
|
|
|
|
establishment of the network connection and once after each block read
|
|
|
|
thereafter. The hook will be passed three arguments; a count of blocks
|
|
|
|
transferred so far, a block size in bytes, and the total size of the file. The
|
|
|
|
third argument may be ``-1`` on older FTP servers which do not return a file
|
|
|
|
size in response to a retrieval request.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
If the *url* uses the :file:`http:` scheme identifier, the optional *data*
|
|
|
|
argument may be given to specify a ``POST`` request (normally the request type
|
|
|
|
is ``GET``). The *data* argument must in standard
|
|
|
|
:mimetype:`application/x-www-form-urlencoded` format; see the :func:`urlencode`
|
|
|
|
function below.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
:func:`urlretrieve` will raise :exc:`ContentTooShortError` when it detects that
|
|
|
|
the amount of data available was less than the expected amount (which is the
|
|
|
|
size reported by a *Content-Length* header). This can occur, for example, when
|
|
|
|
the download is interrupted.
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
The *Content-Length* is treated as a lower bound: if there's more data to read,
|
|
|
|
urlretrieve reads more data, but if less data is available, it raises the
|
|
|
|
exception.
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
You can still retrieve the downloaded data in this case, it is stored in the
|
|
|
|
:attr:`content` attribute of the exception instance.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
If no *Content-Length* header was supplied, urlretrieve can not check the size
|
|
|
|
of the data it has downloaded, and just returns it. In this case you just have
|
|
|
|
to assume that the download was successful.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. data:: _urlopener
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
The public functions :func:`urlopen` and :func:`urlretrieve` create an instance
|
|
|
|
of the :class:`FancyURLopener` class and use it to perform their requested
|
|
|
|
actions. To override this functionality, programmers can create a subclass of
|
|
|
|
:class:`URLopener` or :class:`FancyURLopener`, then assign an instance of that
|
|
|
|
class to the ``urllib._urlopener`` variable before calling the desired function.
|
|
|
|
For example, applications may want to specify a different
|
|
|
|
:mailheader:`User-Agent` header than :class:`URLopener` defines. This can be
|
|
|
|
accomplished with the following code::
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
import urllib.request
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
class AppURLopener(urllib.request.FancyURLopener):
|
|
|
|
version = "App/1.7"
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
urllib._urlopener = AppURLopener()
|
|
|
|
|
|
|
|
|
|
|
|
.. function:: urlcleanup()
|
|
|
|
|
|
|
|
Clear the cache that may have been built up by previous calls to
|
|
|
|
:func:`urlretrieve`.
|
|
|
|
|
|
|
|
.. function:: pathname2url(path)
|
|
|
|
|
|
|
|
Convert the pathname *path* from the local syntax for a path to the form used in
|
|
|
|
the path component of a URL. This does not produce a complete URL. The return
|
|
|
|
value will already be quoted using the :func:`quote` function.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. function:: url2pathname(path)
|
|
|
|
|
|
|
|
Convert the path component *path* from an encoded URL to the local syntax for a
|
|
|
|
path. This does not accept a complete URL. This function uses :func:`unquote`
|
|
|
|
to decode *path*.
|
|
|
|
|
|
|
|
The following classes are provided:
|
|
|
|
|
Merged revisions 60481,60485,60489-60520,60523-60527,60530-60533,60535-60538,60540-60551 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
NOTE: I blocked the following revisions:
svnmerge.py block -r 60521,60522,60528,60529,60534,60539
The new tests must be merged with lots of manual work.
........
r60493 | georg.brandl | 2008-02-01 12:59:08 +0100 (Fri, 01 Feb 2008) | 2 lines
Update IPv6 RFC number.
........
r60497 | georg.brandl | 2008-02-01 16:50:15 +0100 (Fri, 01 Feb 2008) | 2 lines
Add link checker builder, written for GHOP by Thomas Lamb.
........
r60500 | georg.brandl | 2008-02-01 19:08:09 +0100 (Fri, 01 Feb 2008) | 2 lines
Rename batch file.
........
r60504 | christian.heimes | 2008-02-01 19:49:26 +0100 (Fri, 01 Feb 2008) | 1 line
More int -> pid_t.
........
r60507 | georg.brandl | 2008-02-01 20:24:01 +0100 (Fri, 01 Feb 2008) | 2 lines
Wording nit.
........
r60510 | georg.brandl | 2008-02-01 21:45:33 +0100 (Fri, 01 Feb 2008) | 2 lines
Update for latest sphinx latex writer.
........
r60511 | raymond.hettinger | 2008-02-01 22:30:23 +0100 (Fri, 01 Feb 2008) | 1 line
Issue #1996: float.as_integer_ratio() should return fraction in lowest terms.
........
r60512 | raymond.hettinger | 2008-02-01 23:15:52 +0100 (Fri, 01 Feb 2008) | 1 line
Integer ratio should return ints instead of longs whereever possible.
........
r60513 | raymond.hettinger | 2008-02-01 23:22:50 +0100 (Fri, 01 Feb 2008) | 1 line
labs() takes a long for an input.
........
r60514 | raymond.hettinger | 2008-02-01 23:42:59 +0100 (Fri, 01 Feb 2008) | 1 line
Test round-trip on float.as_integer_ratio() and float.__truediv__().
........
r60515 | marc-andre.lemburg | 2008-02-01 23:58:17 +0100 (Fri, 01 Feb 2008) | 3 lines
Bump distutils version number to match Python version.
........
r60516 | raymond.hettinger | 2008-02-02 00:12:19 +0100 (Sat, 02 Feb 2008) | 1 line
Fix int/long typecase. Add check for non-binary floating point.
........
r60517 | raymond.hettinger | 2008-02-02 00:45:44 +0100 (Sat, 02 Feb 2008) | 1 line
Add protection from weirdness while scaling the mantissa to an integer.
........
r60518 | raymond.hettinger | 2008-02-02 06:11:40 +0100 (Sat, 02 Feb 2008) | 1 line
Simpler solution to handling non-IEEE 754 environments.
........
r60519 | raymond.hettinger | 2008-02-02 06:24:44 +0100 (Sat, 02 Feb 2008) | 1 line
Neaten-up a bit.
........
r60520 | georg.brandl | 2008-02-02 10:56:20 +0100 (Sat, 02 Feb 2008) | 2 lines
Amendments to the urllib2 docs, written for GHOP by Thomas Lamb.
........
r60525 | georg.brandl | 2008-02-02 11:49:58 +0100 (Sat, 02 Feb 2008) | 3 lines
Add email example how to send a multipart message.
Written for GHOP by Martin Matejek.
........
r60526 | georg.brandl | 2008-02-02 12:05:00 +0100 (Sat, 02 Feb 2008) | 2 lines
Rewrite test_socketserver as unittest, written for GHOP by Benjamin Petersen.
........
r60527 | georg.brandl | 2008-02-02 12:05:34 +0100 (Sat, 02 Feb 2008) | 2 lines
Add GHOP contributor.
........
r60530 | mark.dickinson | 2008-02-02 18:16:13 +0100 (Sat, 02 Feb 2008) | 2 lines
Make the Rational constructor accept '3.' and '.2' as well as '3.2'.
........
r60531 | neal.norwitz | 2008-02-02 19:52:51 +0100 (Sat, 02 Feb 2008) | 1 line
Update the leaky tests (ie, ignore these tests if they report leaks). This version has been running for a while.
........
r60533 | skip.montanaro | 2008-02-02 20:11:57 +0100 (Sat, 02 Feb 2008) | 7 lines
Split the refleak mail body into two parts, the first being those failing
tests which are deemed more important issues, the second those which are
known to have difficult to solve problems and are generally expected to
leak. Hopefully this doesn't break the script...
........
r60535 | georg.brandl | 2008-02-03 01:04:50 +0100 (Sun, 03 Feb 2008) | 3 lines
Wait for a delay before reaping children -- this should fix the
test_socketserver failures on several platforms.
........
r60536 | brett.cannon | 2008-02-03 03:07:55 +0100 (Sun, 03 Feb 2008) | 2 lines
Fix a minor typo.
........
r60537 | brett.cannon | 2008-02-03 03:08:45 +0100 (Sun, 03 Feb 2008) | 3 lines
Directories from CPPFLAGS and LDFLAGS were being added in the reverse order for
searches as to how they were listed in the environment variable.
........
r60538 | brett.cannon | 2008-02-03 03:34:14 +0100 (Sun, 03 Feb 2008) | 2 lines
Remove extra tick marks and add a missing closing parenthesis.
........
r60540 | andrew.macintyre | 2008-02-03 07:58:06 +0100 (Sun, 03 Feb 2008) | 2 lines
Update OS/2 EMX build bits for 2.6.
........
r60541 | andrew.macintyre | 2008-02-03 08:01:11 +0100 (Sun, 03 Feb 2008) | 2 lines
Rename module definition file to reflect v2.6.
........
r60542 | andrew.macintyre | 2008-02-03 08:07:31 +0100 (Sun, 03 Feb 2008) | 6 lines
The wrapper function is supposed to be for spawnvpe() so that's
what we should call [this wrapper only available on OS/2].
Backport candidate to 2.5.
........
r60544 | gregory.p.smith | 2008-02-03 08:20:53 +0100 (Sun, 03 Feb 2008) | 6 lines
Merge this fix from the pybsddb tree:
r293 | jcea | 2008-01-31 01:08:19 -0800 (Thu, 31 Jan 2008) | 4 lines
Solved memory leak when using cursors with
databases without environment.
........
r60546 | gregory.p.smith | 2008-02-03 09:01:46 +0100 (Sun, 03 Feb 2008) | 2 lines
remove a repeated occurance of a hardcoded berkeleydb library version number
........
r60549 | brett.cannon | 2008-02-03 10:59:21 +0100 (Sun, 03 Feb 2008) | 2 lines
Add an entry for r60537.
........
r60550 | georg.brandl | 2008-02-03 13:29:00 +0100 (Sun, 03 Feb 2008) | 2 lines
#2003: fix sentence.
........
r60551 | christian.heimes | 2008-02-03 15:34:18 +0100 (Sun, 03 Feb 2008) | 2 lines
Fixed paths to Windows build directories in build_ext.py
Use vsbuild instead of devenv in build.bat and _bsddb.vcproj
........
2008-02-03 12:51:08 -04:00
|
|
|
.. class:: Request(url[, data][, headers][, origin_req_host][, unverifiable])
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
This class is an abstraction of a URL request.
|
|
|
|
|
|
|
|
*url* should be a string containing a valid URL.
|
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
*data* may be a string specifying additional data to send to the
|
|
|
|
server, or ``None`` if no such data is needed. Currently HTTP
|
|
|
|
requests are the only ones that use *data*; the HTTP request will
|
|
|
|
be a POST instead of a GET when the *data* parameter is provided.
|
|
|
|
*data* should be a buffer in the standard
|
2007-08-15 11:28:22 -03:00
|
|
|
:mimetype:`application/x-www-form-urlencoded` format. The
|
2008-12-05 03:32:56 -04:00
|
|
|
:func:`urllib.parse.urlencode` function takes a mapping or sequence
|
|
|
|
of 2-tuples and returns a string in this format.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
*headers* should be a dictionary, and will be treated as if
|
|
|
|
:meth:`add_header` was called with each key and value as arguments.
|
|
|
|
This is often used to "spoof" the ``User-Agent`` header, which is
|
|
|
|
used by a browser to identify itself -- some HTTP servers only
|
|
|
|
allow requests coming from common browsers as opposed to scripts.
|
|
|
|
For example, Mozilla Firefox may identify itself as ``"Mozilla/5.0
|
|
|
|
(X11; U; Linux i686) Gecko/20071127 Firefox/2.0.0.11"``, while
|
|
|
|
:mod:`urllib`'s default user agent string is
|
|
|
|
``"Python-urllib/2.6"`` (on Python 2.6).
|
|
|
|
|
|
|
|
The final two arguments are only of interest for correct handling
|
|
|
|
of third-party HTTP cookies:
|
|
|
|
|
|
|
|
*origin_req_host* should be the request-host of the origin
|
|
|
|
transaction, as defined by :rfc:`2965`. It defaults to
|
|
|
|
``http.cookiejar.request_host(self)``. This is the host name or IP
|
|
|
|
address of the original request that was initiated by the user.
|
|
|
|
For example, if the request is for an image in an HTML document,
|
|
|
|
this should be the request-host of the request for the page
|
2008-05-26 13:32:26 -03:00
|
|
|
containing the image.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
*unverifiable* should indicate whether the request is unverifiable,
|
|
|
|
as defined by RFC 2965. It defaults to False. An unverifiable
|
|
|
|
request is one whose URL the user did not have the option to
|
|
|
|
approve. For example, if the request is for an image in an HTML
|
|
|
|
document, and the user had no option to approve the automatic
|
|
|
|
fetching of the image, this should be true.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. class:: URLopener([proxies[, **x509]])
|
|
|
|
|
|
|
|
Base class for opening and reading URLs. Unless you need to support opening
|
|
|
|
objects using schemes other than :file:`http:`, :file:`ftp:`, or :file:`file:`,
|
|
|
|
you probably want to use :class:`FancyURLopener`.
|
|
|
|
|
|
|
|
By default, the :class:`URLopener` class sends a :mailheader:`User-Agent` header
|
|
|
|
of ``urllib/VVV``, where *VVV* is the :mod:`urllib` version number.
|
|
|
|
Applications can define their own :mailheader:`User-Agent` header by subclassing
|
|
|
|
:class:`URLopener` or :class:`FancyURLopener` and setting the class attribute
|
|
|
|
:attr:`version` to an appropriate string value in the subclass definition.
|
|
|
|
|
|
|
|
The optional *proxies* parameter should be a dictionary mapping scheme names to
|
|
|
|
proxy URLs, where an empty dictionary turns proxies off completely. Its default
|
|
|
|
value is ``None``, in which case environmental proxy settings will be used if
|
|
|
|
present, as discussed in the definition of :func:`urlopen`, above.
|
|
|
|
|
|
|
|
Additional keyword parameters, collected in *x509*, may be used for
|
|
|
|
authentication of the client when using the :file:`https:` scheme. The keywords
|
|
|
|
*key_file* and *cert_file* are supported to provide an SSL key and certificate;
|
|
|
|
both are needed to support client authentication.
|
|
|
|
|
|
|
|
:class:`URLopener` objects will raise an :exc:`IOError` exception if the server
|
|
|
|
returns an error code.
|
|
|
|
|
|
|
|
.. method:: open(fullurl[, data])
|
|
|
|
|
|
|
|
Open *fullurl* using the appropriate protocol. This method sets up cache and
|
|
|
|
proxy information, then calls the appropriate open method with its input
|
|
|
|
arguments. If the scheme is not recognized, :meth:`open_unknown` is called.
|
|
|
|
The *data* argument has the same meaning as the *data* argument of
|
|
|
|
:func:`urlopen`.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: open_unknown(fullurl[, data])
|
|
|
|
|
|
|
|
Overridable interface to open unknown URL types.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: retrieve(url[, filename[, reporthook[, data]]])
|
|
|
|
|
|
|
|
Retrieves the contents of *url* and places it in *filename*. The return value
|
|
|
|
is a tuple consisting of a local filename and either a
|
|
|
|
:class:`email.message.Message` object containing the response headers (for remote
|
|
|
|
URLs) or ``None`` (for local URLs). The caller must then open and read the
|
|
|
|
contents of *filename*. If *filename* is not given and the URL refers to a
|
|
|
|
local file, the input filename is returned. If the URL is non-local and
|
|
|
|
*filename* is not given, the filename is the output of :func:`tempfile.mktemp`
|
|
|
|
with a suffix that matches the suffix of the last path component of the input
|
|
|
|
URL. If *reporthook* is given, it must be a function accepting three numeric
|
|
|
|
parameters. It will be called after each chunk of data is read from the
|
|
|
|
network. *reporthook* is ignored for local URLs.
|
|
|
|
|
|
|
|
If the *url* uses the :file:`http:` scheme identifier, the optional *data*
|
|
|
|
argument may be given to specify a ``POST`` request (normally the request type
|
|
|
|
is ``GET``). The *data* argument must in standard
|
|
|
|
:mimetype:`application/x-www-form-urlencoded` format; see the :func:`urlencode`
|
|
|
|
function below.
|
|
|
|
|
|
|
|
|
|
|
|
.. attribute:: version
|
|
|
|
|
|
|
|
Variable that specifies the user agent of the opener object. To get
|
|
|
|
:mod:`urllib` to tell servers that it is a particular user agent, set this in a
|
|
|
|
subclass as a class variable or in the constructor before calling the base
|
|
|
|
constructor.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: FancyURLopener(...)
|
|
|
|
|
|
|
|
:class:`FancyURLopener` subclasses :class:`URLopener` providing default handling
|
|
|
|
for the following HTTP response codes: 301, 302, 303, 307 and 401. For the 30x
|
|
|
|
response codes listed above, the :mailheader:`Location` header is used to fetch
|
|
|
|
the actual URL. For 401 response codes (authentication required), basic HTTP
|
|
|
|
authentication is performed. For the 30x response codes, recursion is bounded
|
|
|
|
by the value of the *maxtries* attribute, which defaults to 10.
|
|
|
|
|
|
|
|
For all other response codes, the method :meth:`http_error_default` is called
|
|
|
|
which you can override in subclasses to handle the error appropriately.
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
According to the letter of :rfc:`2616`, 301 and 302 responses to POST requests
|
|
|
|
must not be automatically redirected without confirmation by the user. In
|
|
|
|
reality, browsers do allow automatic redirection of these responses, changing
|
|
|
|
the POST to a GET, and :mod:`urllib` reproduces this behaviour.
|
|
|
|
|
|
|
|
The parameters to the constructor are the same as those for :class:`URLopener`.
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
When performing basic authentication, a :class:`FancyURLopener` instance calls
|
|
|
|
its :meth:`prompt_user_passwd` method. The default implementation asks the
|
|
|
|
users for the required information on the controlling terminal. A subclass may
|
|
|
|
override this method to support more appropriate behavior if needed.
|
|
|
|
|
|
|
|
The :class:`FancyURLopener` class offers one additional method that should be
|
|
|
|
overloaded to provide the appropriate behavior:
|
|
|
|
|
|
|
|
.. method:: prompt_user_passwd(host, realm)
|
|
|
|
|
|
|
|
Return information needed to authenticate the user at the given host in the
|
|
|
|
specified security realm. The return value should be a tuple, ``(user,
|
|
|
|
password)``, which can be used for basic authentication.
|
|
|
|
|
|
|
|
The implementation prompts for this information on the terminal; an application
|
|
|
|
should override this method to use an appropriate interaction model in the local
|
|
|
|
environment.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
.. class:: OpenerDirector()
|
|
|
|
|
|
|
|
The :class:`OpenerDirector` class opens URLs via :class:`BaseHandler`\ s chained
|
|
|
|
together. It manages the chaining of handlers, and recovery from errors.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: BaseHandler()
|
|
|
|
|
|
|
|
This is the base class for all registered handlers --- and handles only the
|
|
|
|
simple mechanics of registration.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPDefaultErrorHandler()
|
|
|
|
|
|
|
|
A class which defines a default handler for HTTP error responses; all responses
|
|
|
|
are turned into :exc:`HTTPError` exceptions.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPRedirectHandler()
|
|
|
|
|
|
|
|
A class to handle redirections.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPCookieProcessor([cookiejar])
|
|
|
|
|
|
|
|
A class to handle HTTP Cookies.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: ProxyHandler([proxies])
|
|
|
|
|
|
|
|
Cause requests to go through a proxy. If *proxies* is given, it must be a
|
|
|
|
dictionary mapping protocol names to URLs of proxies. The default is to read the
|
|
|
|
list of proxies from the environment variables :envvar:`<protocol>_proxy`.
|
Merged revisions 61644,61646-61647,61649-61652,61656-61658,61663,61665,61667 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r61644 | trent.nelson | 2008-03-19 22:51:16 +0100 (Mi, 19 Mär 2008) | 1 line
Force a clean of the tcltk/tcltk64 directories now that we've completely changed the tcl/tk build environment.
........
r61646 | gregory.p.smith | 2008-03-19 23:23:51 +0100 (Mi, 19 Mär 2008) | 2 lines
Improve the error message when the CRCs don't match.
........
r61647 | trent.nelson | 2008-03-19 23:41:10 +0100 (Mi, 19 Mär 2008) | 1 line
Comment out tcltk/tcltk64 removal.
........
r61649 | raymond.hettinger | 2008-03-19 23:47:48 +0100 (Mi, 19 Mär 2008) | 1 line
Remove unnecessary traceback save/restore pair.
........
r61650 | trent.nelson | 2008-03-19 23:51:42 +0100 (Mi, 19 Mär 2008) | 1 line
Bump the SIGALM delay from 3 seconds to 20 seconds, mainly in an effort to see if it fixes the alarm failures in this test experienced by some of the buildbots.
........
r61651 | brett.cannon | 2008-03-20 00:01:17 +0100 (Do, 20 Mär 2008) | 5 lines
Make sure that the warnings filter is not reset or changed beyond the current
running test file.
Closes issue2407. Thanks Jerry Seutter.
........
r61652 | gregory.p.smith | 2008-03-20 00:03:25 +0100 (Do, 20 Mär 2008) | 10 lines
Prevent ioctl op codes from being sign extended from int to unsigned long
when used on platforms that actually define ioctl as taking an unsigned long.
(the BSDs and OS X / Darwin)
Adds a unittest for fcntl.ioctl that tests what happens with both positive and
negative numbers.
This was done because of issue1471 but I'm not able to reproduce -that- problem
in the first place on Linux 32bit or 64bit or OS X 10.4 & 10.5 32bit or 64 bit.
........
r61656 | sean.reifschneider | 2008-03-20 01:46:50 +0100 (Do, 20 Mär 2008) | 2 lines
Issue #2143: Fix embedded readline() hang on SSL socket EOF.
........
r61657 | sean.reifschneider | 2008-03-20 01:50:07 +0100 (Do, 20 Mär 2008) | 2 lines
Forgot to add NEWS item about smtplib SSL readline hang fix.
........
r61658 | trent.nelson | 2008-03-20 01:58:44 +0100 (Do, 20 Mär 2008) | 1 line
Revert r61650; the intent of this commit was to try and address alarm failures on some of the build slaves. As Neal points out, it's called after test_main(), so it's not going to factor into the test when run via regrtest.py (and removes the original functionality that Jeffrey wanted that would kill the test if it took longer than 3 seconds to run when executing it directly during development).
........
r61663 | sean.reifschneider | 2008-03-20 04:20:48 +0100 (Do, 20 Mär 2008) | 2 lines
Issue 2188: Documentation hint about disabling proxy detection.
........
r61665 | gregory.p.smith | 2008-03-20 06:41:53 +0100 (Do, 20 Mär 2008) | 7 lines
Attempt to fix the Solaris Sparc 10 buildbot. It was failing with an invalid
argument error on ioctl. This was caused by the added test_fcntl ioctl test
that hard coded 0 as the fd to use. Without a terminal, this fails on solaris.
(it passed from the command line on sol 10, both 32 and 64 bit)
Also, test_ioctl exists so I moved the test into there where it belongs.
........
r61667 | georg.brandl | 2008-03-20 08:25:55 +0100 (Do, 20 Mär 2008) | 2 lines
#2383: remove obsolete XXX comment in stat.py.
........
2008-03-20 07:49:03 -03:00
|
|
|
To disable autodetected proxy pass an empty dictionary.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPPasswordMgr()
|
|
|
|
|
|
|
|
Keep a database of ``(realm, uri) -> (user, password)`` mappings.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPPasswordMgrWithDefaultRealm()
|
|
|
|
|
|
|
|
Keep a database of ``(realm, uri) -> (user, password)`` mappings. A realm of
|
|
|
|
``None`` is considered a catch-all realm, which is searched if no other realm
|
|
|
|
fits.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: AbstractBasicAuthHandler([password_mgr])
|
|
|
|
|
|
|
|
This is a mixin class that helps with HTTP authentication, both to the remote
|
|
|
|
host and to a proxy. *password_mgr*, if given, should be something that is
|
|
|
|
compatible with :class:`HTTPPasswordMgr`; refer to section
|
|
|
|
:ref:`http-password-mgr` for information on the interface that must be
|
|
|
|
supported.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPBasicAuthHandler([password_mgr])
|
|
|
|
|
|
|
|
Handle authentication with the remote host. *password_mgr*, if given, should be
|
|
|
|
something that is compatible with :class:`HTTPPasswordMgr`; refer to section
|
|
|
|
:ref:`http-password-mgr` for information on the interface that must be
|
|
|
|
supported.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: ProxyBasicAuthHandler([password_mgr])
|
|
|
|
|
|
|
|
Handle authentication with the proxy. *password_mgr*, if given, should be
|
|
|
|
something that is compatible with :class:`HTTPPasswordMgr`; refer to section
|
|
|
|
:ref:`http-password-mgr` for information on the interface that must be
|
|
|
|
supported.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: AbstractDigestAuthHandler([password_mgr])
|
|
|
|
|
|
|
|
This is a mixin class that helps with HTTP authentication, both to the remote
|
|
|
|
host and to a proxy. *password_mgr*, if given, should be something that is
|
|
|
|
compatible with :class:`HTTPPasswordMgr`; refer to section
|
|
|
|
:ref:`http-password-mgr` for information on the interface that must be
|
|
|
|
supported.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPDigestAuthHandler([password_mgr])
|
|
|
|
|
|
|
|
Handle authentication with the remote host. *password_mgr*, if given, should be
|
|
|
|
something that is compatible with :class:`HTTPPasswordMgr`; refer to section
|
|
|
|
:ref:`http-password-mgr` for information on the interface that must be
|
|
|
|
supported.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: ProxyDigestAuthHandler([password_mgr])
|
|
|
|
|
|
|
|
Handle authentication with the proxy. *password_mgr*, if given, should be
|
|
|
|
something that is compatible with :class:`HTTPPasswordMgr`; refer to section
|
|
|
|
:ref:`http-password-mgr` for information on the interface that must be
|
|
|
|
supported.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPHandler()
|
|
|
|
|
|
|
|
A class to handle opening of HTTP URLs.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: HTTPSHandler()
|
|
|
|
|
|
|
|
A class to handle opening of HTTPS URLs.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: FileHandler()
|
|
|
|
|
|
|
|
Open local files.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: FTPHandler()
|
|
|
|
|
|
|
|
Open FTP URLs.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: CacheFTPHandler()
|
|
|
|
|
|
|
|
Open FTP URLs, keeping a cache of open FTP connections to minimize delays.
|
|
|
|
|
|
|
|
|
|
|
|
.. class:: UnknownHandler()
|
|
|
|
|
|
|
|
A catch-all class to handle unknown URLs.
|
|
|
|
|
|
|
|
|
|
|
|
.. _request-objects:
|
|
|
|
|
|
|
|
Request Objects
|
|
|
|
---------------
|
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
The following methods describe :class:`Request`'s public interface,
|
|
|
|
and so all may be overridden in subclasses. It also defines several
|
|
|
|
public attributes that can be used by clients to inspect the parsed
|
|
|
|
request.
|
|
|
|
|
|
|
|
.. attribute:: Request.full_url
|
|
|
|
|
|
|
|
The original URL passed to the constructor.
|
|
|
|
|
|
|
|
.. attribute:: Request.type
|
|
|
|
|
|
|
|
The URI scheme.
|
|
|
|
|
|
|
|
.. attribute:: Request.host
|
|
|
|
|
|
|
|
The URI authority, typically a host, but may also contain a port
|
|
|
|
separated by a colon.
|
|
|
|
|
|
|
|
.. attribute:: Request.origin_req_host
|
|
|
|
|
|
|
|
The original host for the request, without port.
|
|
|
|
|
|
|
|
.. attribute:: Request.selector
|
|
|
|
|
|
|
|
The URI path. If the :class:`Request` uses a proxy, then selector
|
|
|
|
will be the full url that is passed to the proxy.
|
|
|
|
|
|
|
|
.. attribute:: Request.data
|
|
|
|
|
|
|
|
The entity body for the request, or None if not specified.
|
|
|
|
|
|
|
|
.. attribute:: Request.unverifiable
|
2007-08-15 11:28:22 -03:00
|
|
|
|
2009-03-31 11:38:13 -03:00
|
|
|
boolean, indicates whether the request is unverifiable as defined
|
|
|
|
by RFC 2965.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
.. method:: Request.add_data(data)
|
|
|
|
|
|
|
|
Set the :class:`Request` data to *data*. This is ignored by all handlers except
|
|
|
|
HTTP handlers --- and there it should be a byte string, and will change the
|
|
|
|
request to be ``POST`` rather than ``GET``.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_method()
|
|
|
|
|
|
|
|
Return a string indicating the HTTP request method. This is only meaningful for
|
|
|
|
HTTP requests, and currently always returns ``'GET'`` or ``'POST'``.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.has_data()
|
|
|
|
|
|
|
|
Return whether the instance has a non-\ ``None`` data.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_data()
|
|
|
|
|
|
|
|
Return the instance's data.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.add_header(key, val)
|
|
|
|
|
|
|
|
Add another header to the request. Headers are currently ignored by all
|
|
|
|
handlers except HTTP handlers, where they are added to the list of headers sent
|
|
|
|
to the server. Note that there cannot be more than one header with the same
|
|
|
|
name, and later calls will overwrite previous calls in case the *key* collides.
|
|
|
|
Currently, this is no loss of HTTP functionality, since all headers which have
|
|
|
|
meaning when used more than once have a (header-specific) way of gaining the
|
|
|
|
same functionality using only one header.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.add_unredirected_header(key, header)
|
|
|
|
|
|
|
|
Add a header that will not be added to a redirected request.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.has_header(header)
|
|
|
|
|
|
|
|
Return whether the instance has the named header (checks both regular and
|
|
|
|
unredirected).
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_full_url()
|
|
|
|
|
|
|
|
Return the URL given in the constructor.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_type()
|
|
|
|
|
|
|
|
Return the type of the URL --- also known as the scheme.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_host()
|
|
|
|
|
|
|
|
Return the host to which a connection will be made.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_selector()
|
|
|
|
|
|
|
|
Return the selector --- the part of the URL that is sent to the server.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.set_proxy(host, type)
|
|
|
|
|
|
|
|
Prepare the request by connecting to a proxy server. The *host* and *type* will
|
|
|
|
replace those of the instance, and the instance's selector will be the original
|
|
|
|
URL given in the constructor.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.get_origin_req_host()
|
|
|
|
|
|
|
|
Return the request-host of the origin transaction, as defined by :rfc:`2965`.
|
|
|
|
See the documentation for the :class:`Request` constructor.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: Request.is_unverifiable()
|
|
|
|
|
|
|
|
Return whether the request is unverifiable, as defined by RFC 2965. See the
|
|
|
|
documentation for the :class:`Request` constructor.
|
|
|
|
|
|
|
|
|
|
|
|
.. _opener-director-objects:
|
|
|
|
|
|
|
|
OpenerDirector Objects
|
|
|
|
----------------------
|
|
|
|
|
|
|
|
:class:`OpenerDirector` instances have the following methods:
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: OpenerDirector.add_handler(handler)
|
|
|
|
|
|
|
|
*handler* should be an instance of :class:`BaseHandler`. The following methods
|
|
|
|
are searched, and added to the possible chains (note that HTTP errors are a
|
|
|
|
special case).
|
|
|
|
|
|
|
|
* :meth:`protocol_open` --- signal that the handler knows how to open *protocol*
|
|
|
|
URLs.
|
|
|
|
|
|
|
|
* :meth:`http_error_type` --- signal that the handler knows how to handle HTTP
|
|
|
|
errors with HTTP error code *type*.
|
|
|
|
|
|
|
|
* :meth:`protocol_error` --- signal that the handler knows how to handle errors
|
|
|
|
from (non-\ ``http``) *protocol*.
|
|
|
|
|
|
|
|
* :meth:`protocol_request` --- signal that the handler knows how to pre-process
|
|
|
|
*protocol* requests.
|
|
|
|
|
|
|
|
* :meth:`protocol_response` --- signal that the handler knows how to
|
|
|
|
post-process *protocol* responses.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: OpenerDirector.open(url[, data][, timeout])
|
|
|
|
|
|
|
|
Open the given *url* (which can be a request object or a string), optionally
|
Merged revisions 62998-63003,63005-63006,63009-63012,63014-63017,63019-63020,63022-63024,63026-63029,63031-63041,63043-63045,63047-63054,63056-63062 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r62998 | andrew.kuchling | 2008-05-10 15:51:55 -0400 (Sat, 10 May 2008) | 7 lines
#1858 from Tarek Ziade:
Allow multiple repositories in .pypirc; see http://wiki.python.org/moin/EnhancedPyPI
for discussion.
The patch is slightly revised from Tarek's last patch: I've simplified
the PyPIRCCommand.finalize_options() method to not look at sys.argv.
Tests still pass.
........
r63000 | alexandre.vassalotti | 2008-05-10 15:59:16 -0400 (Sat, 10 May 2008) | 5 lines
Cleaned up io._BytesIO.write().
I am amazed that the old code, for inserting null-bytes, actually
worked. Who wrote that thing? Oh, it is me... doh.
........
r63002 | brett.cannon | 2008-05-10 16:52:01 -0400 (Sat, 10 May 2008) | 2 lines
Revert r62998 as it broke the build (seems distutils.config is missing).
........
r63014 | andrew.kuchling | 2008-05-10 18:12:38 -0400 (Sat, 10 May 2008) | 1 line
#1858: add distutils.config module
........
r63027 | brett.cannon | 2008-05-10 21:09:32 -0400 (Sat, 10 May 2008) | 2 lines
Flesh out the 3.0 deprecation to suggest using the ctypes module.
........
r63028 | skip.montanaro | 2008-05-10 22:59:30 -0400 (Sat, 10 May 2008) | 4 lines
Copied two versions of the example from the interactive session. Delete
one.
........
r63037 | georg.brandl | 2008-05-11 03:02:17 -0400 (Sun, 11 May 2008) | 2 lines
reload() takes the module itself.
........
r63038 | alexandre.vassalotti | 2008-05-11 03:06:04 -0400 (Sun, 11 May 2008) | 4 lines
Added test framework for handling module renames.
Factored the import guard in test_py3kwarn.TestStdlibRemovals into
a context manager, namely test_support.CleanImport.
........
r63039 | georg.brandl | 2008-05-11 03:06:05 -0400 (Sun, 11 May 2008) | 2 lines
#2742: ``''`` is not converted to NULL in getaddrinfo.
........
r63040 | alexandre.vassalotti | 2008-05-11 03:08:12 -0400 (Sun, 11 May 2008) | 2 lines
Fixed typo in a comment of test_support.CleanImport.
........
r63041 | alexandre.vassalotti | 2008-05-11 03:10:25 -0400 (Sun, 11 May 2008) | 2 lines
Removed a dead line of code.
........
r63043 | georg.brandl | 2008-05-11 04:47:53 -0400 (Sun, 11 May 2008) | 2 lines
#2812: document property.getter/setter/deleter.
........
r63049 | georg.brandl | 2008-05-11 05:06:30 -0400 (Sun, 11 May 2008) | 2 lines
#1153769: document PEP 237 changes to string formatting.
........
r63050 | georg.brandl | 2008-05-11 05:11:40 -0400 (Sun, 11 May 2008) | 2 lines
#2809: elaborate str.split docstring a bit.
........
r63051 | georg.brandl | 2008-05-11 06:13:59 -0400 (Sun, 11 May 2008) | 2 lines
Fix typo.
........
r63052 | georg.brandl | 2008-05-11 06:33:27 -0400 (Sun, 11 May 2008) | 2 lines
#2709: clarification.
........
r63053 | georg.brandl | 2008-05-11 06:42:28 -0400 (Sun, 11 May 2008) | 2 lines
#2659: add ``break_on_hyphens`` to TextWrapper.
........
r63057 | georg.brandl | 2008-05-11 06:59:39 -0400 (Sun, 11 May 2008) | 2 lines
#2741: clarification of value range for address_family.
........
r63058 | georg.brandl | 2008-05-11 07:09:35 -0400 (Sun, 11 May 2008) | 2 lines
#2452: timeout is used for all blocking operations.
........
r63059 | andrew.kuchling | 2008-05-11 09:33:56 -0400 (Sun, 11 May 2008) | 2 lines
#1792: Improve performance of marshal.dumps() on large objects by increasing
the size of the buffer more quickly.
........
r63060 | andrew.kuchling | 2008-05-11 10:00:00 -0400 (Sun, 11 May 2008) | 1 line
#1858: re-apply patch for this, adding the missing files
........
r63061 | benjamin.peterson | 2008-05-11 10:13:25 -0400 (Sun, 11 May 2008) | 2 lines
Add the "until" command to pdb
........
r63062 | georg.brandl | 2008-05-11 10:17:13 -0400 (Sun, 11 May 2008) | 2 lines
Add some sentence endings.
........
2008-05-15 21:03:33 -03:00
|
|
|
passing the given *data*. Arguments, return values and exceptions raised are
|
|
|
|
the same as those of :func:`urlopen` (which simply calls the :meth:`open`
|
|
|
|
method on the currently installed global :class:`OpenerDirector`). The
|
|
|
|
optional *timeout* parameter specifies a timeout in seconds for blocking
|
Merged revisions 63562,63570,63728,63734,63784,63788,63802,63817,63827,63839,63887,63975,63998 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r63562 | martin.v.loewis | 2008-05-23 17:06:50 +0200 (Fri, 23 May 2008) | 2 lines
Patch #1722225: Support QNX 6.
........
r63570 | trent.nelson | 2008-05-23 22:33:14 +0200 (Fri, 23 May 2008) | 1 line
Introduce a user macro named $(externalsDir), which should point to the root directory of where all the external sources should live. Developers can change this value if their external sources live elsewhere. The default of '..\..' matches the current status quo.
........
r63728 | gregory.p.smith | 2008-05-26 23:16:34 +0200 (Mon, 26 May 2008) | 4 lines
Fix issue2589: there was a potential integer overflow leading to
memory corruption on esoteric platforms and incorrect behavior on
normal platforms.
........
r63734 | gregory.p.smith | 2008-05-27 00:07:28 +0200 (Tue, 27 May 2008) | 3 lines
Fix issue2588: Do not execute str[size-1] = '\0' when a 0 size is
passed in. (The assert won't prevent this in non-debug builds).
........
r63784 | raymond.hettinger | 2008-05-29 10:38:23 +0200 (Thu, 29 May 2008) | 1 line
Fix two typos.
........
r63788 | facundo.batista | 2008-05-29 18:39:26 +0200 (Thu, 29 May 2008) | 6 lines
Fixed the semantic of timeout for socket.create_connection and
all the upper level libraries that use it, including urllib2.
Added and fixed some tests, and changed docs correspondingly.
Thanks to John J Lee for the patch and the pusing, :)
........
r63802 | mark.dickinson | 2008-05-30 04:46:53 +0200 (Fri, 30 May 2008) | 2 lines
Fix typo in testSum
........
r63817 | raymond.hettinger | 2008-05-30 20:20:50 +0200 (Fri, 30 May 2008) | 8 lines
* Mark intermedidate computes values (hi, lo, yr) as volatile.
* Expand comments.
* Swap variable names in the sum_exact code so that x and y
are consistently chosen as the larger and smaller magnitude
values respectively.
........
r63827 | raymond.hettinger | 2008-05-31 05:24:31 +0200 (Sat, 31 May 2008) | 1 line
Implement heapq in terms of less-than (to match list.sort()).
........
r63839 | gerhard.haering | 2008-05-31 23:33:27 +0200 (Sat, 31 May 2008) | 2 lines
Fixed rowcount for SELECT statements. They're -1 now (again), for better DB-API 2.0 compliance.
........
r63887 | gregory.p.smith | 2008-06-02 06:05:52 +0200 (Mon, 02 Jun 2008) | 4 lines
Fix issue 2782: be less strict about the format string type in strftime.
Accept unicode and anything else ParseTuple "s#" can deal with. This
matches the time.strftime behavior.
........
r63975 | neal.norwitz | 2008-06-06 06:47:01 +0200 (Fri, 06 Jun 2008) | 3 lines
Aldo Cortesi confirmed this is still needed for OpenBSD 4.2 and 4.3.
(I didn't regen configure, since I don't have a working autoconf.)
........
r63998 | raymond.hettinger | 2008-06-06 23:47:51 +0200 (Fri, 06 Jun 2008) | 1 line
Issue 3501: Make heapq support both __le__ and __lt__.
........
2008-06-10 14:40:04 -03:00
|
|
|
operations like the connection attempt (if not specified, the global default
|
|
|
|
timeout setting will be usedi). The timeout feature actually works only for
|
|
|
|
HTTP, HTTPS, FTP and FTPS connections).
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. method:: OpenerDirector.error(proto[, arg[, ...]])
|
|
|
|
|
|
|
|
Handle an error of the given protocol. This will call the registered error
|
|
|
|
handlers for the given protocol with the given arguments (which are protocol
|
|
|
|
specific). The HTTP protocol is a special case which uses the HTTP response
|
|
|
|
code to determine the specific error handler; refer to the :meth:`http_error_\*`
|
|
|
|
methods of the handler classes.
|
|
|
|
|
|
|
|
Return values and exceptions raised are the same as those of :func:`urlopen`.
|
|
|
|
|
|
|
|
OpenerDirector objects open URLs in three stages:
|
|
|
|
|
|
|
|
The order in which these methods are called within each stage is determined by
|
|
|
|
sorting the handler instances.
|
|
|
|
|
|
|
|
#. Every handler with a method named like :meth:`protocol_request` has that
|
|
|
|
method called to pre-process the request.
|
|
|
|
|
|
|
|
#. Handlers with a method named like :meth:`protocol_open` are called to handle
|
|
|
|
the request. This stage ends when a handler either returns a non-\ :const:`None`
|
|
|
|
value (ie. a response), or raises an exception (usually :exc:`URLError`).
|
|
|
|
Exceptions are allowed to propagate.
|
|
|
|
|
|
|
|
In fact, the above algorithm is first tried for methods named
|
|
|
|
:meth:`default_open`. If all such methods return :const:`None`, the algorithm
|
|
|
|
is repeated for methods named like :meth:`protocol_open`. If all such methods
|
|
|
|
return :const:`None`, the algorithm is repeated for methods named
|
|
|
|
:meth:`unknown_open`.
|
|
|
|
|
|
|
|
Note that the implementation of these methods may involve calls of the parent
|
|
|
|
:class:`OpenerDirector` instance's :meth:`.open` and :meth:`.error` methods.
|
|
|
|
|
|
|
|
#. Every handler with a method named like :meth:`protocol_response` has that
|
|
|
|
method called to post-process the response.
|
|
|
|
|
|
|
|
|
|
|
|
.. _base-handler-objects:
|
|
|
|
|
|
|
|
BaseHandler Objects
|
|
|
|
-------------------
|
|
|
|
|
|
|
|
:class:`BaseHandler` objects provide a couple of methods that are directly
|
|
|
|
useful, and others that are meant to be used by derived classes. These are
|
|
|
|
intended for direct use:
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.add_parent(director)
|
|
|
|
|
|
|
|
Add a director as parent.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.close()
|
|
|
|
|
|
|
|
Remove any parents.
|
|
|
|
|
|
|
|
The following members and methods should only be used by classes derived from
|
|
|
|
:class:`BaseHandler`.
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
The convention has been adopted that subclasses defining
|
|
|
|
:meth:`protocol_request` or :meth:`protocol_response` methods are named
|
|
|
|
:class:`\*Processor`; all others are named :class:`\*Handler`.
|
|
|
|
|
|
|
|
|
|
|
|
.. attribute:: BaseHandler.parent
|
|
|
|
|
|
|
|
A valid :class:`OpenerDirector`, which can be used to open using a different
|
|
|
|
protocol, or handle errors.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.default_open(req)
|
|
|
|
|
|
|
|
This method is *not* defined in :class:`BaseHandler`, but subclasses should
|
|
|
|
define it if they want to catch all URLs.
|
|
|
|
|
|
|
|
This method, if implemented, will be called by the parent
|
|
|
|
:class:`OpenerDirector`. It should return a file-like object as described in
|
|
|
|
the return value of the :meth:`open` of :class:`OpenerDirector`, or ``None``.
|
|
|
|
It should raise :exc:`URLError`, unless a truly exceptional thing happens (for
|
|
|
|
example, :exc:`MemoryError` should not be mapped to :exc:`URLError`).
|
|
|
|
|
|
|
|
This method will be called before any protocol-specific open method.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.protocol_open(req)
|
|
|
|
:noindex:
|
|
|
|
|
|
|
|
This method is *not* defined in :class:`BaseHandler`, but subclasses should
|
|
|
|
define it if they want to handle URLs with the given protocol.
|
|
|
|
|
|
|
|
This method, if defined, will be called by the parent :class:`OpenerDirector`.
|
|
|
|
Return values should be the same as for :meth:`default_open`.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.unknown_open(req)
|
|
|
|
|
|
|
|
This method is *not* defined in :class:`BaseHandler`, but subclasses should
|
|
|
|
define it if they want to catch all URLs with no specific registered handler to
|
|
|
|
open it.
|
|
|
|
|
|
|
|
This method, if implemented, will be called by the :attr:`parent`
|
|
|
|
:class:`OpenerDirector`. Return values should be the same as for
|
|
|
|
:meth:`default_open`.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.http_error_default(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
This method is *not* defined in :class:`BaseHandler`, but subclasses should
|
|
|
|
override it if they intend to provide a catch-all for otherwise unhandled HTTP
|
|
|
|
errors. It will be called automatically by the :class:`OpenerDirector` getting
|
|
|
|
the error, and should not normally be called in other circumstances.
|
|
|
|
|
|
|
|
*req* will be a :class:`Request` object, *fp* will be a file-like object with
|
|
|
|
the HTTP error body, *code* will be the three-digit code of the error, *msg*
|
|
|
|
will be the user-visible explanation of the code and *hdrs* will be a mapping
|
|
|
|
object with the headers of the error.
|
|
|
|
|
|
|
|
Return values and exceptions raised should be the same as those of
|
|
|
|
:func:`urlopen`.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.http_error_nnn(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
*nnn* should be a three-digit HTTP error code. This method is also not defined
|
|
|
|
in :class:`BaseHandler`, but will be called, if it exists, on an instance of a
|
|
|
|
subclass, when an HTTP error with code *nnn* occurs.
|
|
|
|
|
|
|
|
Subclasses should override this method to handle specific HTTP errors.
|
|
|
|
|
|
|
|
Arguments, return values and exceptions raised should be the same as for
|
|
|
|
:meth:`http_error_default`.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.protocol_request(req)
|
|
|
|
:noindex:
|
|
|
|
|
|
|
|
This method is *not* defined in :class:`BaseHandler`, but subclasses should
|
|
|
|
define it if they want to pre-process requests of the given protocol.
|
|
|
|
|
|
|
|
This method, if defined, will be called by the parent :class:`OpenerDirector`.
|
|
|
|
*req* will be a :class:`Request` object. The return value should be a
|
|
|
|
:class:`Request` object.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: BaseHandler.protocol_response(req, response)
|
|
|
|
:noindex:
|
|
|
|
|
|
|
|
This method is *not* defined in :class:`BaseHandler`, but subclasses should
|
|
|
|
define it if they want to post-process responses of the given protocol.
|
|
|
|
|
|
|
|
This method, if defined, will be called by the parent :class:`OpenerDirector`.
|
|
|
|
*req* will be a :class:`Request` object. *response* will be an object
|
|
|
|
implementing the same interface as the return value of :func:`urlopen`. The
|
|
|
|
return value should implement the same interface as the return value of
|
|
|
|
:func:`urlopen`.
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-redirect-handler:
|
|
|
|
|
|
|
|
HTTPRedirectHandler Objects
|
|
|
|
---------------------------
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
Some HTTP redirections require action from this module's client code. If this
|
|
|
|
is the case, :exc:`HTTPError` is raised. See :rfc:`2616` for details of the
|
|
|
|
precise meanings of the various redirection codes.
|
|
|
|
|
|
|
|
|
2009-02-13 06:40:43 -04:00
|
|
|
.. method:: HTTPRedirectHandler.redirect_request(req, fp, code, msg, hdrs, newurl)
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
Return a :class:`Request` or ``None`` in response to a redirect. This is called
|
|
|
|
by the default implementations of the :meth:`http_error_30\*` methods when a
|
|
|
|
redirection is received from the server. If a redirection should take place,
|
|
|
|
return a new :class:`Request` to allow :meth:`http_error_30\*` to perform the
|
2009-02-13 06:40:43 -04:00
|
|
|
redirect to *newurl*. Otherwise, raise :exc:`HTTPError` if no other handler
|
|
|
|
should try to handle this URL, or return ``None`` if you can't but another
|
|
|
|
handler might.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
.. note::
|
|
|
|
|
|
|
|
The default implementation of this method does not strictly follow :rfc:`2616`,
|
|
|
|
which says that 301 and 302 responses to ``POST`` requests must not be
|
|
|
|
automatically redirected without confirmation by the user. In reality, browsers
|
|
|
|
do allow automatic redirection of these responses, changing the POST to a
|
|
|
|
``GET``, and the default implementation reproduces this behavior.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPRedirectHandler.http_error_301(req, fp, code, msg, hdrs)
|
|
|
|
|
2009-02-13 06:40:43 -04:00
|
|
|
Redirect to the ``Location:`` or ``URI:`` URL. This method is called by the
|
|
|
|
parent :class:`OpenerDirector` when getting an HTTP 'moved permanently' response.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPRedirectHandler.http_error_302(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
The same as :meth:`http_error_301`, but called for the 'found' response.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPRedirectHandler.http_error_303(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
The same as :meth:`http_error_301`, but called for the 'see other' response.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPRedirectHandler.http_error_307(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
The same as :meth:`http_error_301`, but called for the 'temporary redirect'
|
|
|
|
response.
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-cookie-processor:
|
|
|
|
|
|
|
|
HTTPCookieProcessor Objects
|
|
|
|
---------------------------
|
|
|
|
|
|
|
|
:class:`HTTPCookieProcessor` instances have one attribute:
|
|
|
|
|
|
|
|
.. attribute:: HTTPCookieProcessor.cookiejar
|
|
|
|
|
2008-05-26 13:32:26 -03:00
|
|
|
The :class:`http.cookiejar.CookieJar` in which cookies are stored.
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
|
|
|
|
.. _proxy-handler:
|
|
|
|
|
|
|
|
ProxyHandler Objects
|
|
|
|
--------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: ProxyHandler.protocol_open(request)
|
|
|
|
:noindex:
|
|
|
|
|
|
|
|
The :class:`ProxyHandler` will have a method :meth:`protocol_open` for every
|
|
|
|
*protocol* which has a proxy in the *proxies* dictionary given in the
|
|
|
|
constructor. The method will modify requests to go through the proxy, by
|
|
|
|
calling ``request.set_proxy()``, and call the next handler in the chain to
|
|
|
|
actually execute the protocol.
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-password-mgr:
|
|
|
|
|
|
|
|
HTTPPasswordMgr Objects
|
|
|
|
-----------------------
|
|
|
|
|
|
|
|
These methods are available on :class:`HTTPPasswordMgr` and
|
|
|
|
:class:`HTTPPasswordMgrWithDefaultRealm` objects.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPPasswordMgr.add_password(realm, uri, user, passwd)
|
|
|
|
|
|
|
|
*uri* can be either a single URI, or a sequence of URIs. *realm*, *user* and
|
|
|
|
*passwd* must be strings. This causes ``(user, passwd)`` to be used as
|
|
|
|
authentication tokens when authentication for *realm* and a super-URI of any of
|
|
|
|
the given URIs is given.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPPasswordMgr.find_user_password(realm, authuri)
|
|
|
|
|
|
|
|
Get user/password for given realm and URI, if any. This method will return
|
|
|
|
``(None, None)`` if there is no matching user/password.
|
|
|
|
|
|
|
|
For :class:`HTTPPasswordMgrWithDefaultRealm` objects, the realm ``None`` will be
|
|
|
|
searched if the given *realm* has no matching user/password.
|
|
|
|
|
|
|
|
|
|
|
|
.. _abstract-basic-auth-handler:
|
|
|
|
|
|
|
|
AbstractBasicAuthHandler Objects
|
|
|
|
--------------------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: AbstractBasicAuthHandler.http_error_auth_reqed(authreq, host, req, headers)
|
|
|
|
|
|
|
|
Handle an authentication request by getting a user/password pair, and re-trying
|
|
|
|
the request. *authreq* should be the name of the header where the information
|
|
|
|
about the realm is included in the request, *host* specifies the URL and path to
|
|
|
|
authenticate for, *req* should be the (failed) :class:`Request` object, and
|
|
|
|
*headers* should be the error headers.
|
|
|
|
|
|
|
|
*host* is either an authority (e.g. ``"python.org"``) or a URL containing an
|
|
|
|
authority component (e.g. ``"http://python.org/"``). In either case, the
|
|
|
|
authority must not contain a userinfo component (so, ``"python.org"`` and
|
|
|
|
``"python.org:80"`` are fine, ``"joe:password@python.org"`` is not).
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-basic-auth-handler:
|
|
|
|
|
|
|
|
HTTPBasicAuthHandler Objects
|
|
|
|
----------------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPBasicAuthHandler.http_error_401(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
Retry the request with authentication information, if available.
|
|
|
|
|
|
|
|
|
|
|
|
.. _proxy-basic-auth-handler:
|
|
|
|
|
|
|
|
ProxyBasicAuthHandler Objects
|
|
|
|
-----------------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: ProxyBasicAuthHandler.http_error_407(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
Retry the request with authentication information, if available.
|
|
|
|
|
|
|
|
|
|
|
|
.. _abstract-digest-auth-handler:
|
|
|
|
|
|
|
|
AbstractDigestAuthHandler Objects
|
|
|
|
---------------------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: AbstractDigestAuthHandler.http_error_auth_reqed(authreq, host, req, headers)
|
|
|
|
|
|
|
|
*authreq* should be the name of the header where the information about the realm
|
|
|
|
is included in the request, *host* should be the host to authenticate to, *req*
|
|
|
|
should be the (failed) :class:`Request` object, and *headers* should be the
|
|
|
|
error headers.
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-digest-auth-handler:
|
|
|
|
|
|
|
|
HTTPDigestAuthHandler Objects
|
|
|
|
-----------------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPDigestAuthHandler.http_error_401(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
Retry the request with authentication information, if available.
|
|
|
|
|
|
|
|
|
|
|
|
.. _proxy-digest-auth-handler:
|
|
|
|
|
|
|
|
ProxyDigestAuthHandler Objects
|
|
|
|
------------------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: ProxyDigestAuthHandler.http_error_407(req, fp, code, msg, hdrs)
|
|
|
|
|
|
|
|
Retry the request with authentication information, if available.
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-handler-objects:
|
|
|
|
|
|
|
|
HTTPHandler Objects
|
|
|
|
-------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPHandler.http_open(req)
|
|
|
|
|
|
|
|
Send an HTTP request, which can be either GET or POST, depending on
|
|
|
|
``req.has_data()``.
|
|
|
|
|
|
|
|
|
|
|
|
.. _https-handler-objects:
|
|
|
|
|
|
|
|
HTTPSHandler Objects
|
|
|
|
--------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: HTTPSHandler.https_open(req)
|
|
|
|
|
|
|
|
Send an HTTPS request, which can be either GET or POST, depending on
|
|
|
|
``req.has_data()``.
|
|
|
|
|
|
|
|
|
|
|
|
.. _file-handler-objects:
|
|
|
|
|
|
|
|
FileHandler Objects
|
|
|
|
-------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: FileHandler.file_open(req)
|
|
|
|
|
|
|
|
Open the file locally, if there is no host name, or the host name is
|
|
|
|
``'localhost'``. Change the protocol to ``ftp`` otherwise, and retry opening it
|
|
|
|
using :attr:`parent`.
|
|
|
|
|
|
|
|
|
|
|
|
.. _ftp-handler-objects:
|
|
|
|
|
|
|
|
FTPHandler Objects
|
|
|
|
------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: FTPHandler.ftp_open(req)
|
|
|
|
|
|
|
|
Open the FTP file indicated by *req*. The login is always done with empty
|
|
|
|
username and password.
|
|
|
|
|
|
|
|
|
|
|
|
.. _cacheftp-handler-objects:
|
|
|
|
|
|
|
|
CacheFTPHandler Objects
|
|
|
|
-----------------------
|
|
|
|
|
|
|
|
:class:`CacheFTPHandler` objects are :class:`FTPHandler` objects with the
|
|
|
|
following additional methods:
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: CacheFTPHandler.setTimeout(t)
|
|
|
|
|
|
|
|
Set timeout of connections to *t* seconds.
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: CacheFTPHandler.setMaxConns(m)
|
|
|
|
|
|
|
|
Set maximum number of cached connections to *m*.
|
|
|
|
|
|
|
|
|
|
|
|
.. _unknown-handler-objects:
|
|
|
|
|
|
|
|
UnknownHandler Objects
|
|
|
|
----------------------
|
|
|
|
|
|
|
|
|
|
|
|
.. method:: UnknownHandler.unknown_open()
|
|
|
|
|
|
|
|
Raise a :exc:`URLError` exception.
|
|
|
|
|
|
|
|
|
|
|
|
.. _http-error-processor-objects:
|
|
|
|
|
|
|
|
HTTPErrorProcessor Objects
|
|
|
|
--------------------------
|
|
|
|
|
|
|
|
.. method:: HTTPErrorProcessor.unknown_open()
|
|
|
|
|
|
|
|
Process HTTP error responses.
|
|
|
|
|
|
|
|
For 200 error codes, the response object is returned immediately.
|
|
|
|
|
|
|
|
For non-200 error codes, this simply passes the job on to the
|
|
|
|
:meth:`protocol_error_code` handler methods, via :meth:`OpenerDirector.error`.
|
2008-06-23 08:23:31 -03:00
|
|
|
Eventually, :class:`HTTPDefaultErrorHandler` will raise an
|
2007-08-15 11:28:22 -03:00
|
|
|
:exc:`HTTPError` if no other handler handles the error.
|
|
|
|
|
2008-06-23 08:23:31 -03:00
|
|
|
|
|
|
|
.. _urllib-request-examples:
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
Examples
|
|
|
|
--------
|
|
|
|
|
|
|
|
This example gets the python.org main page and displays the first 100 bytes of
|
|
|
|
it::
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
>>> import urllib.request
|
|
|
|
>>> f = urllib.request.urlopen('http://www.python.org/')
|
2007-09-01 20:34:30 -03:00
|
|
|
>>> print(f.read(100))
|
2007-08-15 11:28:22 -03:00
|
|
|
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
|
|
|
|
<?xml-stylesheet href="./css/ht2html
|
|
|
|
|
|
|
|
Here we are sending a data-stream to the stdin of a CGI and reading the data it
|
|
|
|
returns to us. Note that this example will only work when the Python
|
|
|
|
installation supports SSL. ::
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
>>> import urllib.request
|
|
|
|
>>> req = urllib.request.Request(url='https://localhost/cgi-bin/test.cgi',
|
2007-08-15 11:28:22 -03:00
|
|
|
... data='This data is passed to stdin of the CGI')
|
2008-06-23 01:41:59 -03:00
|
|
|
>>> f = urllib.request.urlopen(req)
|
2007-09-01 20:34:30 -03:00
|
|
|
>>> print(f.read())
|
2007-08-15 11:28:22 -03:00
|
|
|
Got Data: "This data is passed to stdin of the CGI"
|
|
|
|
|
|
|
|
The code for the sample CGI used in the above example is::
|
|
|
|
|
|
|
|
#!/usr/bin/env python
|
|
|
|
import sys
|
|
|
|
data = sys.stdin.read()
|
2007-09-01 20:34:30 -03:00
|
|
|
print('Content-type: text-plain\n\nGot Data: "%s"' % data)
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
Use of Basic HTTP Authentication::
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
import urllib.request
|
2007-08-15 11:28:22 -03:00
|
|
|
# Create an OpenerDirector with support for Basic HTTP Authentication...
|
2008-06-23 01:41:59 -03:00
|
|
|
auth_handler = urllib.request.HTTPBasicAuthHandler()
|
2007-08-15 11:28:22 -03:00
|
|
|
auth_handler.add_password(realm='PDQ Application',
|
|
|
|
uri='https://mahler:8092/site-updates.py',
|
|
|
|
user='klem',
|
|
|
|
passwd='kadidd!ehopper')
|
2008-06-23 01:41:59 -03:00
|
|
|
opener = urllib.request.build_opener(auth_handler)
|
2007-08-15 11:28:22 -03:00
|
|
|
# ...and install it globally so it can be used with urlopen.
|
2008-06-23 01:41:59 -03:00
|
|
|
urllib.request.install_opener(opener)
|
|
|
|
urllib.request.urlopen('http://www.example.com/login.html')
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
:func:`build_opener` provides many handlers by default, including a
|
|
|
|
:class:`ProxyHandler`. By default, :class:`ProxyHandler` uses the environment
|
|
|
|
variables named ``<scheme>_proxy``, where ``<scheme>`` is the URL scheme
|
|
|
|
involved. For example, the :envvar:`http_proxy` environment variable is read to
|
|
|
|
obtain the HTTP proxy's URL.
|
|
|
|
|
|
|
|
This example replaces the default :class:`ProxyHandler` with one that uses
|
Merged revisions 64722,64729,64753,64845-64846,64849,64871,64880-64882,64885,64888,64897,64900-64901,64915,64926-64929,64938-64941,64944,64961,64966,64973 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r64722 | georg.brandl | 2008-07-05 12:13:36 +0200 (Sat, 05 Jul 2008) | 4 lines
#2663: support an *ignore* argument to shutil.copytree(). Patch by Tarek Ziade.
This is a new feature, but Barry authorized adding it in the beta period.
........
r64729 | mark.dickinson | 2008-07-05 13:33:52 +0200 (Sat, 05 Jul 2008) | 5 lines
Issue 3188: accept float('infinity') as well as float('inf'). This
makes the float constructor behave in the same way as specified
by various other language standards, including C99, IEEE 754r,
and the IBM Decimal standard.
........
r64753 | gregory.p.smith | 2008-07-06 05:35:58 +0200 (Sun, 06 Jul 2008) | 4 lines
- Issue #2862: Make int and float freelist management consistent with other
freelists. Changes their CompactFreeList apis into ClearFreeList apis and
calls them via gc.collect().
........
r64845 | raymond.hettinger | 2008-07-10 16:03:19 +0200 (Thu, 10 Jul 2008) | 1 line
Issue 3301: Bisect functions behaved badly when lo was negative.
........
r64846 | raymond.hettinger | 2008-07-10 16:34:57 +0200 (Thu, 10 Jul 2008) | 1 line
Issue 3285: Fractions from_float() and from_decimal() accept Integral arguments.
........
r64849 | andrew.kuchling | 2008-07-10 16:43:31 +0200 (Thu, 10 Jul 2008) | 1 line
Wording changes
........
r64871 | raymond.hettinger | 2008-07-11 14:00:21 +0200 (Fri, 11 Jul 2008) | 1 line
Add cautionary note on the use of PySequence_Fast_ITEMS.
........
r64880 | amaury.forgeotdarc | 2008-07-11 23:28:25 +0200 (Fri, 11 Jul 2008) | 5 lines
#3317 in zipfile module, restore the previous names of global variables:
some applications relied on them.
Also remove duplicated lines.
........
r64881 | amaury.forgeotdarc | 2008-07-11 23:45:06 +0200 (Fri, 11 Jul 2008) | 3 lines
#3342: In tracebacks, printed source lines were not indented since r62555.
#3343: Py_DisplaySourceLine should be a private function. Rename it to _Py_DisplaySourceLine.
........
r64882 | josiah.carlson | 2008-07-12 00:17:14 +0200 (Sat, 12 Jul 2008) | 2 lines
Fix for the AttributeError in test_asynchat.
........
r64885 | josiah.carlson | 2008-07-12 01:26:59 +0200 (Sat, 12 Jul 2008) | 2 lines
Fixed test for asyncore.
........
r64888 | matthias.klose | 2008-07-12 09:51:48 +0200 (Sat, 12 Jul 2008) | 2 lines
- Fix bashisms in Tools/faqwiz/move-faqwiz.sh
........
r64897 | benjamin.peterson | 2008-07-12 22:16:19 +0200 (Sat, 12 Jul 2008) | 1 line
fix various doc typos #3320
........
r64900 | alexandre.vassalotti | 2008-07-13 00:06:53 +0200 (Sun, 13 Jul 2008) | 2 lines
Fixed typo.
........
r64901 | benjamin.peterson | 2008-07-13 01:41:19 +0200 (Sun, 13 Jul 2008) | 1 line
#1778443 robotparser fixes from Aristotelis Mikropoulos
........
r64915 | nick.coghlan | 2008-07-13 16:52:36 +0200 (Sun, 13 Jul 2008) | 1 line
Fix issue 3221 by emitting a RuntimeWarning instead of raising SystemError when the parent module can't be found during an absolute import (likely due to non-PEP 361 aware code which sets a module level __package__ attribute)
........
r64926 | martin.v.loewis | 2008-07-13 22:31:49 +0200 (Sun, 13 Jul 2008) | 2 lines
Add turtle into the module index.
........
r64927 | alexandre.vassalotti | 2008-07-13 22:42:44 +0200 (Sun, 13 Jul 2008) | 3 lines
Issue #3274: Use a less common identifier for the temporary variable
in Py_CLEAR().
........
r64928 | andrew.kuchling | 2008-07-13 23:43:25 +0200 (Sun, 13 Jul 2008) | 1 line
Re-word
........
r64929 | andrew.kuchling | 2008-07-13 23:43:52 +0200 (Sun, 13 Jul 2008) | 1 line
Add various items; move ctypes items into a subsection of their own
........
r64938 | andrew.kuchling | 2008-07-14 02:35:32 +0200 (Mon, 14 Jul 2008) | 1 line
Typo fixes
........
r64939 | andrew.kuchling | 2008-07-14 02:40:55 +0200 (Mon, 14 Jul 2008) | 1 line
Typo fix
........
r64940 | andrew.kuchling | 2008-07-14 03:18:16 +0200 (Mon, 14 Jul 2008) | 1 line
Typo fix
........
r64941 | andrew.kuchling | 2008-07-14 03:18:31 +0200 (Mon, 14 Jul 2008) | 1 line
Expand the multiprocessing section
........
r64944 | gregory.p.smith | 2008-07-14 08:06:48 +0200 (Mon, 14 Jul 2008) | 7 lines
Fix posix.fork1() / os.fork1() to only call PyOS_AfterFork() in the child
process rather than both parent and child.
Does anyone actually use fork1()? It appears to be a Solaris thing
but if Python is built with pthreads on Solaris, fork1() and fork()
should be the same.
........
r64961 | jesse.noller | 2008-07-15 15:47:33 +0200 (Tue, 15 Jul 2008) | 1 line
multiprocessing/connection.py patch to remove fqdn oddness for issue 3270
........
r64966 | nick.coghlan | 2008-07-15 17:40:22 +0200 (Tue, 15 Jul 2008) | 1 line
Add missing NEWS entry for r64962
........
r64973 | jesse.noller | 2008-07-15 20:29:18 +0200 (Tue, 15 Jul 2008) | 1 line
Revert 3270 patch: self._address is in pretty widespread use, need to revisit
........
2008-07-16 09:55:28 -03:00
|
|
|
programmatically-supplied proxy URLs, and adds proxy authorization support with
|
2007-08-15 11:28:22 -03:00
|
|
|
:class:`ProxyBasicAuthHandler`. ::
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
proxy_handler = urllib.request.ProxyHandler({'http': 'http://www.example.com:3128/'})
|
|
|
|
proxy_auth_handler = urllib.request.HTTPBasicAuthHandler()
|
2007-08-15 11:28:22 -03:00
|
|
|
proxy_auth_handler.add_password('realm', 'host', 'username', 'password')
|
|
|
|
|
|
|
|
opener = build_opener(proxy_handler, proxy_auth_handler)
|
|
|
|
# This time, rather than install the OpenerDirector, we use it directly:
|
|
|
|
opener.open('http://www.example.com/login.html')
|
|
|
|
|
|
|
|
Adding HTTP headers:
|
|
|
|
|
|
|
|
Use the *headers* argument to the :class:`Request` constructor, or::
|
|
|
|
|
2008-06-23 08:44:14 -03:00
|
|
|
import urllib.request
|
2008-06-23 01:41:59 -03:00
|
|
|
req = urllib.request.Request('http://www.example.com/')
|
2007-08-15 11:28:22 -03:00
|
|
|
req.add_header('Referer', 'http://www.python.org/')
|
2008-06-23 01:41:59 -03:00
|
|
|
r = urllib.request.urlopen(req)
|
2007-08-15 11:28:22 -03:00
|
|
|
|
|
|
|
:class:`OpenerDirector` automatically adds a :mailheader:`User-Agent` header to
|
|
|
|
every :class:`Request`. To change this::
|
|
|
|
|
2008-06-23 08:44:14 -03:00
|
|
|
import urllib.request
|
2008-06-23 01:41:59 -03:00
|
|
|
opener = urllib.request.build_opener()
|
2007-08-15 11:28:22 -03:00
|
|
|
opener.addheaders = [('User-agent', 'Mozilla/5.0')]
|
|
|
|
opener.open('http://www.example.com/')
|
|
|
|
|
|
|
|
Also, remember that a few standard headers (:mailheader:`Content-Length`,
|
|
|
|
:mailheader:`Content-Type` and :mailheader:`Host`) are added when the
|
|
|
|
:class:`Request` is passed to :func:`urlopen` (or :meth:`OpenerDirector.open`).
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. _urllib-examples:
|
|
|
|
|
|
|
|
Here is an example session that uses the ``GET`` method to retrieve a URL
|
|
|
|
containing parameters::
|
|
|
|
|
|
|
|
>>> import urllib.request
|
|
|
|
>>> import urllib.parse
|
|
|
|
>>> params = urllib.parse.urlencode({'spam': 1, 'eggs': 2, 'bacon': 0})
|
|
|
|
>>> f = urllib.request.urlopen("http://www.musi-cal.com/cgi-bin/query?%s" % params)
|
|
|
|
>>> print(f.read())
|
|
|
|
|
|
|
|
The following example uses the ``POST`` method instead::
|
|
|
|
|
|
|
|
>>> import urllib.request
|
|
|
|
>>> import urllib.parse
|
|
|
|
>>> params = urllib.parse.urlencode({'spam': 1, 'eggs': 2, 'bacon': 0})
|
|
|
|
>>> f = urllib.request.urlopen("http://www.musi-cal.com/cgi-bin/query", params)
|
|
|
|
>>> print(f.read())
|
|
|
|
|
|
|
|
The following example uses an explicitly specified HTTP proxy, overriding
|
|
|
|
environment settings::
|
|
|
|
|
|
|
|
>>> import urllib.request
|
|
|
|
>>> proxies = {'http': 'http://proxy.example.com:8080/'}
|
|
|
|
>>> opener = urllib.request.FancyURLopener(proxies)
|
|
|
|
>>> f = opener.open("http://www.python.org")
|
|
|
|
>>> f.read()
|
|
|
|
|
|
|
|
The following example uses no proxies at all, overriding environment settings::
|
|
|
|
|
|
|
|
>>> import urllib.request
|
|
|
|
>>> opener = urllib.request.FancyURLopener({})
|
|
|
|
>>> f = opener.open("http://www.python.org/")
|
|
|
|
>>> f.read()
|
|
|
|
|
|
|
|
|
|
|
|
:mod:`urllib.request` Restrictions
|
|
|
|
----------------------------------
|
|
|
|
|
|
|
|
.. index::
|
|
|
|
pair: HTTP; protocol
|
|
|
|
pair: FTP; protocol
|
|
|
|
|
|
|
|
* Currently, only the following protocols are supported: HTTP, (versions 0.9 and
|
|
|
|
1.0), FTP, and local files.
|
|
|
|
|
|
|
|
* The caching feature of :func:`urlretrieve` has been disabled until I find the
|
|
|
|
time to hack proper processing of Expiration time headers.
|
|
|
|
|
|
|
|
* There should be a function to query whether a particular URL is in the cache.
|
|
|
|
|
|
|
|
* For backward compatibility, if a URL appears to point to a local file but the
|
|
|
|
file can't be opened, the URL is re-interpreted using the FTP protocol. This
|
|
|
|
can sometimes cause confusing error messages.
|
|
|
|
|
|
|
|
* The :func:`urlopen` and :func:`urlretrieve` functions can cause arbitrarily
|
|
|
|
long delays while waiting for a network connection to be set up. This means
|
|
|
|
that it is difficult to build an interactive Web client using these functions
|
|
|
|
without using threads.
|
|
|
|
|
|
|
|
.. index::
|
|
|
|
single: HTML
|
|
|
|
pair: HTTP; protocol
|
|
|
|
|
|
|
|
* The data returned by :func:`urlopen` or :func:`urlretrieve` is the raw data
|
|
|
|
returned by the server. This may be binary data (such as an image), plain text
|
|
|
|
or (for example) HTML. The HTTP protocol provides type information in the reply
|
|
|
|
header, which can be inspected by looking at the :mailheader:`Content-Type`
|
|
|
|
header. If the returned data is HTML, you can use the module
|
|
|
|
:mod:`html.parser` to parse it.
|
|
|
|
|
|
|
|
.. index:: single: FTP
|
|
|
|
|
|
|
|
* The code handling the FTP protocol cannot differentiate between a file and a
|
|
|
|
directory. This can lead to unexpected behavior when attempting to read a URL
|
|
|
|
that points to a file that is not accessible. If the URL ends in a ``/``, it is
|
|
|
|
assumed to refer to a directory and will be handled accordingly. But if an
|
|
|
|
attempt to read a file leads to a 550 error (meaning the URL cannot be found or
|
|
|
|
is not accessible, often for permission reasons), then the path is treated as a
|
|
|
|
directory in order to handle the case when a directory is specified by a URL but
|
|
|
|
the trailing ``/`` has been left off. This can cause misleading results when
|
|
|
|
you try to fetch a file whose read permissions make it inaccessible; the FTP
|
|
|
|
code will try to read it, fail with a 550 error, and then perform a directory
|
|
|
|
listing for the unreadable file. If fine-grained control is needed, consider
|
|
|
|
using the :mod:`ftplib` module, subclassing :class:`FancyURLOpener`, or changing
|
|
|
|
*_urlopener* to meet your needs.
|
|
|
|
|
2008-06-23 08:23:31 -03:00
|
|
|
|
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
:mod:`urllib.response` --- Response classes used by urllib.
|
|
|
|
===========================================================
|
2008-06-23 08:23:31 -03:00
|
|
|
|
2008-06-23 01:41:59 -03:00
|
|
|
.. module:: urllib.response
|
|
|
|
:synopsis: Response classes used by urllib.
|
|
|
|
|
|
|
|
The :mod:`urllib.response` module defines functions and classes which define a
|
2008-06-23 08:23:31 -03:00
|
|
|
minimal file like interface, including ``read()`` and ``readline()``. The
|
|
|
|
typical response object is an addinfourl instance, which defines and ``info()``
|
|
|
|
method and that returns headers and a ``geturl()`` method that returns the url.
|
2008-06-23 01:41:59 -03:00
|
|
|
Functions defined by this module are used internally by the
|
|
|
|
:mod:`urllib.request` module.
|
|
|
|
|