94ee389308
Issue #19619 : Blacklist non-text codecs in method API
...
str.encode, bytes.decode and bytearray.decode now use an
internal API to throw LookupError for known non-text encodings,
rather than attempting the encoding or decoding operation and
then throwing a TypeError for an unexpected output type.
The latter mechanism remains in place for third party non-text
encodings.
Backported changeset d68df99d7a57.
2014-02-24 14:43:03 +02:00
1be39e5154
Issue #20571 : skip test_readline() of test_codecs for Windows code page 65001.
...
The decoder does not support partial decoding yet for this code page.
2014-02-09 13:11:53 +01:00
016a3f33a5
Issue #20538 : UTF-7 incremental decoder produced inconsistant string when
...
input was truncated in BASE64 section.
2014-02-08 14:01:29 +02:00
5cfc79deae
Issue #20532 : Tests which use _testcapi now are marked as CPython only.
2014-02-07 10:06:39 +02:00
5b4fab1ad7
Issue #20520 : Fixed readline test in test_codecs.
2014-02-06 09:26:56 +02:00
8003850e22
Issue #8260 : The read(), readline() and readlines() methods of
...
codecs.StreamReader returned incomplete data when were called after
readline() or read(size). Based on patch by Amaury Forgeot d'Arc.
2014-01-26 19:21:00 +02:00
0e071c967c
Fixed tests for issue #19279 .
2013-10-19 21:14:57 +03:00
35804e4c63
Issue #19279 : UTF-7 decoder no more produces illegal strings.
2013-10-19 20:38:19 +03:00
799fd9c877
Add tests for raw-unicode-escape codec.
2013-01-29 11:41:01 +02:00
c9c4338e2b
Add tests for raw-unicode-escape codec.
2013-01-29 11:40:00 +02:00
db6add7d71
Clean up escape-decode decoder tests.
2013-01-29 11:07:27 +02:00
077cb347a9
Clean up escape-decode decoder tests.
2013-01-29 11:06:53 +02:00
24193debd4
Issue #16979 : Fix error handling bugs in the unicode-escape-decode decoder.
2013-01-29 10:28:07 +02:00
d679377be7
Issue #16979 : Fix error handling bugs in the unicode-escape-decode decoder.
2013-01-29 10:20:44 +02:00
e58785b200
Issue #16975 : Fix error handling bug in the escape-decode bytes decoder.
2013-01-25 23:32:41 +02:00
ace3ad3bf7
Issue #16975 : Fix error handling bug in the escape-decode bytes decoder.
2013-01-25 23:31:43 +02:00
45d16d9924
Issue #14850 : Now a chamap decoder treates U+FFFE as "undefined mapping"
...
in any mapping, not only in an unicode string.
2013-01-15 15:01:20 +02:00
4fb8caee87
Issue #14850 : Now a chamap decoder treates U+FFFE as "undefined mapping"
...
in any mapping, not only in an unicode string.
2013-01-15 14:43:21 +02:00
5d3dba0d27
#16918 : test_codecs now works with unittest test discovery. Patch by Zachary Ware.
2013-01-11 06:02:07 +02:00
e0b87edd7f
Merge fix for broken/disabled test.
2013-01-11 05:57:58 +02:00
26ed234052
Enable a broken test and fix it.
2013-01-11 05:54:57 +02:00
ae3b32ad6b
Issue #11461 : Fix the incremental UTF-16 decoder. Original patch by
...
Amaury Forgeot d'Arc. Added tests for partial decoding of non-BMP
characters.
2013-01-08 23:40:52 +02:00
48e188e573
Issue #11461 : Fix the incremental UTF-16 decoder. Original patch by
...
Amaury Forgeot d'Arc. Added tests for partial decoding of non-BMP
characters.
2013-01-08 23:14:24 +02:00
a0b5c46fa2
#16336 : merge with 3.2.
2012-11-03 23:04:41 +02:00
540da76115
#16336 : fix input checking in the surrogatepass error handler. Patch by Serhiy Storchaka.
2012-11-03 23:03:39 +02:00
5f9459fbed
merge with 3.2
2012-10-26 17:05:09 -07:00
45c41494bf
bounds check for bad data (thanks amaury)
2012-10-26 17:01:53 -07:00
a1f7655fa7
Issue #15379 : Fix passing of non-BMP characters as integers for the charmap decoder (already working as unicode strings).
...
Patch by Serhiy Storchaka.
2012-09-23 20:00:04 +02:00
6f80f5d444
Issue #15379 : Fix passing of non-BMP characters as integers for the charmap decoder (already working as unicode strings).
...
Patch by Serhiy Storchaka.
2012-09-23 19:55:21 +02:00
5e36edbaba
Port additional tests from #14579 (the issue is already fixed).
2012-07-21 00:47:48 +02:00
b4bbee25b1
Issue #14579 : Fix CVE-2012-2135: vulnerability in the utf-16 decoder after error handling.
...
Patch by Serhiy Storchaka.
2012-07-21 00:45:14 +02:00
e3b47152a4
Write tests for invalid characters (U+00110000)
...
Test the following functions:
* codecs.raw_unicode_escape_decode()
* PyUnicode_FromWideChar()
* PyUnicode_FromUnicode()
* "unicode_internal" and "unicode_escape" decoders
2011-12-09 20:49:49 +01:00
adc417ce36
#13406 : fix more deprecation warnings and move the deprecation of unicode-internal earlier in the code.
2011-11-17 12:23:34 +02:00
345379a7f8
#13406 : correct the error message in check_warnings too.
2011-11-16 09:54:19 +02:00
11060a4a48
#13406 : silence deprecation warnings in test_codecs.
2011-11-16 09:39:10 +02:00
040e16e3e8
"unicode_internal" codec has been deprecated: fix related tests
2011-11-15 22:44:05 +01:00
76a31a6bff
Cleanup decode_code_page_stateful() and encode_code_page()
...
* Fix decode_code_page_errors() result
* Inline decode_code_page() and encode_code_page_chunk()
* Replace the PyUnicodeObject type by PyObject
2011-11-04 00:05:13 +01:00
2f3ca9f20e
Close #13247 : Add cp65001 codec, the Windows UTF-8 (CP_UTF8)
2011-10-27 01:38:56 +02:00
9e92188f53
Issue #12281 : Fix test_codecs.test_cp932() on Windows XP
...
Cool! Decoding b'\x81\x00abc' from cp932 with replace error handler is now
giving the same result on all Windows versions.
2011-10-18 21:55:25 +02:00
62be4fb21f
Issue #12281 : Skip code page tests on non-Windows platforms
2011-10-18 21:46:37 +02:00
3a50e7056e
Issue #12281 : Rewrite the MBCS codec to handle correctly replace and ignore
...
error handlers on all Windows versions. The MBCS codec is now supporting all
error handlers, instead of only replace to encode and ignore to decode.
2011-10-18 21:21:00 +02:00
00b2c86d09
Fix text failures when ctypes is not available
...
(followup to Victor's 85d11cf67aa8 and 7a50e549bd11)
2011-10-05 13:01:41 +02:00
182d90d9ee
Fix test_codecs for Windows: check size of wchar_t, not sys.maxunicode
2011-09-29 19:53:55 +02:00
d63a3b8beb
Implement PEP 393.
2011-09-28 07:41:54 +02:00
2a20f9be70
Backport 0398f07d4827 (fix for weird buildbot failures)
2011-07-27 01:06:07 +02:00
d05066d1ee
Try to fix weird buildbot failures
2011-07-26 23:55:33 +02:00
5a24d82941
Add a test for issue #1813 : getlocale() failing under a Turkish locale
...
(not a problem under 3.x)
2011-07-24 02:41:54 +02:00
cf9d3c08c8
Issue #1813 : Fix codec lookup under Turkish locales.
2011-07-24 02:27:04 +02:00
0501070669
Revert my commit 3555cf6f9c98: "Issue #8796 : codecs.open() calls the builtin
...
open() function instead of using StreamReaderWriter. Deprecate StreamReader,
StreamWriter, StreamReaderWriter, StreamRecoder and EncodedFile() of the codec
module. Use the builtin open() function or io.TextIOWrapper instead."
"It has not been approved !" wrote Marc-Andre Lemburg.
2011-05-27 16:50:40 +02:00
98fe1a0c3b
Issue #8796 : codecs.open() calls the builtin open() function instead of using
...
StreamReaderWriter. Deprecate StreamReader, StreamWriter, StreamReaderWriter,
StreamRecoder and EncodedFile() of the codec module. Use the builtin open()
function or io.TextIOWrapper instead.
2011-05-27 01:51:18 +02:00
Serhiy Storchaka
Victor Stinner
Ezio Melotti
Philip Jenvey
Antoine Pitrou
Victor Stinner
Martin v. Löwis