462502b084
Issue #24848 : Fixed yet one bug in UTF-7 decoder. Testing for BASE64 character
...
was locale depending.
2015-10-10 09:33:11 +03:00
0451fb942e
Make error report in test_codecs more informative.
2015-10-04 13:52:40 +03:00
e12f632186
Issue #24848 : Fixed bugs in UTF-7 decoding of misformed data:
...
1. Non-ASCII bytes were accepted after shift sequence.
2. A low surrogate could be emitted in case of error in high surrogate.
2015-10-02 13:14:53 +03:00
b2528c92f1
Issue #16473 : Fix byte transform codec documentation; test quotetabs=True
...
This changes the equivalent functions listed for the Base-64, hex and Quoted-
Printable codecs to reflect the functions actually used. Also mention and
test the "quotetabs" setting for Quoted-Printable encoding.
2015-09-12 00:34:28 +00:00
90bc71f5b1
Remove and enable misplaced codecs tests ported from Python 3
...
Most of these tests are about blacklisted non-text codecs, which are not
relevant in Python 2. The only one remaining is TransformCodecTest.test_uu_
invalid().
2015-09-12 02:20:06 +00:00
c7797dc748
Issue #19543 : Emit deprecation warning for known non-text encodings.
...
Backported issues #19619 : encode() and decode() methods and constructors
of str, unicode and bytearray classes now emit deprecation warning for known
non-text encodings when Python is ran with the -3 option.
Backported issues #20404 : io.TextIOWrapper (and hence io.open()) now uses the
internal codec marking system added to emit deprecation warning for known non-text
encodings at stream construction time when Python is ran with the -3 option.
2015-05-31 20:21:00 +03:00
74a651b4e6
Issue #23071 : Added missing names to codecs.__all__. Patch by Martin Panter.
2014-12-20 17:42:24 +02:00
b4f3d80d4f
Backported tests for issue #22406 .
2014-11-07 14:07:43 +02:00
76249ea4a7
Issue #20532 : Tests which use _testcapi now are marked as CPython only.
2014-02-07 10:06:05 +02:00
6a036793b6
Issue #20520 : Fixed readline test in test_codecs.
2014-02-06 09:26:32 +02:00
2403a787b9
Issue #8260 : The read(), readline() and readlines() methods of
...
codecs.StreamReader returned incomplete data when were called after
readline() or read(size). Based on patch by Amaury Forgeot d'Arc.
2014-01-26 19:20:24 +02:00
f105672332
Issue #19279 : UTF-7 decoder no more produces illegal unicode strings.
2013-10-19 20:37:49 +03:00
74e449fe6a
Add tests for raw-unicode-escape codec.
2013-01-29 11:39:44 +02:00
7277f9d099
Clean up escape-decode decoder tests.
2013-01-29 11:06:28 +02:00
c8e58126a2
Issue #16979 : Fix error handling bugs in the unicode-escape-decode decoder.
2013-01-29 10:20:34 +02:00
01b3a08f5e
Issue #16975 : Fix error handling bug in the escape-decode decoder.
2013-01-25 23:30:50 +02:00
9599745e2c
Issue #14850 : Now a chamap decoder treates U+FFFE as "undefined mapping"
...
in any mapping, not only in an unicode string.
2013-01-15 14:42:59 +02:00
c4b82c037e
Issue #11461 : Fix the incremental UTF-16 decoder. Original patch by
...
Amaury Forgeot d'Arc. Added tests for partial decoding of non-BMP
characters.
2013-01-08 23:12:00 +02:00
e3ae321222
Issue #15379 : Fix passing of non-BMP characters as integers for the charmap decoder (already working as unicode strings).
...
Patch by Serhiy Storchaka.
2012-11-17 21:14:58 +01:00
715a63b783
Issue #14579 : Fix error handling bug in the utf-16 decoder.
...
Patch by Serhiy Storchaka.
2012-07-21 00:52:06 +02:00
4cfae027b3
Issue #1813 : Fix codec lookup and setting/getting locales under Turkish locales.
2011-07-24 02:51:01 +02:00
6c603c4593
test_codecs now removes the temporay file (created by the test)
2011-05-23 16:19:31 +02:00
2623a37852
Merged revisions 86596 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r86596 | ezio.melotti | 2010-11-20 21:04:17 +0200 (Sat, 20 Nov 2010) | 1 line
#9424 : Replace deprecated assert* methods in the Python test suite.
........
2010-11-21 13:34:58 +00:00
cca3a3f396
Issue #8941 : decoding big endian UTF-32 data in UCS-2 builds could crash
...
the interpreter with characters outside the Basic Multilingual Plane
(higher than 0x10000).
2010-06-11 21:42:26 +00:00
f0757a2937
#8016 : add the CP858 codec (approved by Benjamin). (Also add CP720 to the tests, it was missing there.)
2010-05-24 21:29:07 +00:00
7df55dad3b
Issue #6268 : More bugfixes about BOM, UTF-16 and UTF-32
...
* Fix seek() method of codecs.open(), don't write the BOM twice after seek(0)
* Fix reset() method of codecs, UTF-16, UTF-32 and StreamWriter classes
* test_codecs: use "w+" mode instead of "wt+". "t" mode is not supported by
Solaris or Windows, but does it really exist? I found it the in the issue.
2010-05-22 13:37:56 +00:00
262be5e70b
Issue #6268 : Fix seek() method of codecs.open(), don't read the BOM twice
...
after seek(0)
2010-05-22 02:11:07 +00:00
034b0acdd3
fix escape_encode to return the correct consumed size
2010-04-05 02:51:51 +00:00
f4b6186d9c
#691291 : codecs.open() should not convert end of lines on reading and writing.
2010-02-26 10:40:58 +00:00
b0f5adc3f4
use assert[Not]IsInstance where appropriate
2010-01-24 16:58:36 +00:00
e9741f3ed8
Issue #6922 : Fix an infinite loop when trying to decode an invalid
...
UTF-32 stream with a non-raising error handler like "replace" or "ignore".
2009-09-17 11:28:09 +00:00
5c8da86f3a
convert usage of fail* to assert*
2009-06-30 22:57:08 +00:00
a7fb408a02
Issue 3739: The unicode-internal encoder now reports the number of *characters*
...
consumed like any other encoder (instead of the number of bytes).
2009-05-06 14:28:24 +00:00
5087980c1e
The incremental decoder for utf-7 must preserve its state between calls.
...
Solves issue1460.
Might not be a backport candidate: a new API function was added,
and some code may rely on details in utf-7.py.
2007-11-20 23:31:27 +00:00
183744d6b9
Fix for #1444 : utf_8_sig.StreamReader was (indirectly through decode())
...
calling codecs.utf_8_decode() with final==True, which falled with incomplete
byte sequences. Fix and test by James G. Sack.
2007-11-19 12:41:10 +00:00
fc7e72d1c6
Fix typo in comment.
2007-11-19 12:14:05 +00:00
6e39080649
Backport r57105 and r57145 from the py3k branch: UTF-32 codecs.
2007-08-17 16:41:28 +00:00
4234827e99
Fix utf-8-sig incremental decoder, which didn't recognise a BOM when the
...
first chunk fed to the decoder started with a BOM, but was longer than 3 bytes.
2007-04-12 10:35:00 +00:00
39b8b6afb5
Change decode() so that it works with a buffer (i.e. unicode(..., 'utf-8-sig'))
...
SF bug #1601501 .
2006-11-23 05:03:56 +00:00
abd8a336a3
Whitespace normalization.
2006-11-03 02:32:46 +00:00
1ead698494
I'm assuming this is correct, it fixes the tests so they pass again
2006-10-29 23:58:36 +00:00
98c70acf47
Add tests for incremental codecs with an errors
...
argument.
2006-10-29 23:02:27 +00:00
2c9838e30f
Bug #1586613 : fix zlib and bz2 codecs' incremental en/decoders.
2006-10-29 14:39:09 +00:00
5b4e1c2530
Fix the new EncodedFile test to work with big endian platforms.
2006-10-29 09:32:16 +00:00
8f99f81dfc
Fix codecs.EncodedFile which did not use file_encoding in 2.5.0, and
...
fix all codecs file wrappers to work correctly with the "with"
statement (bug #1586513 ).
2006-10-29 08:39:22 +00:00
6d3d339d21
Verify the crash due to EncodingMap not initialized does not return
2006-06-13 08:41:06 +00:00
78a0be6ab3
Add a BufferedIncrementalEncoder class that can be used for implementing
...
an incremental encoder that must retain part of the data between calls
to the encode() method.
Fix the incremental encoder and decoder for the IDNA encoding.
This closes SF patch #1453235 .
2006-04-14 18:25:39 +00:00
15be5ec100
Call encode()/decode() with final==True as the last call in the
...
incremental codec tests.
2006-04-14 14:03:55 +00:00
9ae019bf5b
Add tests for the C APIs PyCodec_IncrementalEncoder() and
...
PyCodec_IncrementalDecoder().
2006-03-18 14:22:26 +00:00
abb02e5994
Patch #1436130 : codecs.lookup() now returns a CodecInfo object (a subclass
...
of tuple) that provides incremental decoders and encoders (a way to use
stateful codecs without the stream API). Functions
codecs.getincrementaldecoder() and codecs.getincrementalencoder() have
been added.
2006-03-15 11:35:15 +00:00
Serhiy Storchaka
Martin Panter
Antoine Pitrou
Victor Stinner
Ezio Melotti
Georg Brandl
Philip Jenvey
Florent Xicluna
Benjamin Peterson
Walter Dörwald
Amaury Forgeot d'Arc
Tim Peters
Neal Norwitz