Serhiy Storchaka
799fd9c877
Add tests for raw-unicode-escape codec.
2013-01-29 11:41:01 +02:00
Serhiy Storchaka
c9c4338e2b
Add tests for raw-unicode-escape codec.
2013-01-29 11:40:00 +02:00
Serhiy Storchaka
db6add7d71
Clean up escape-decode decoder tests.
2013-01-29 11:07:27 +02:00
Serhiy Storchaka
077cb347a9
Clean up escape-decode decoder tests.
2013-01-29 11:06:53 +02:00
Serhiy Storchaka
24193debd4
Issue #16979 : Fix error handling bugs in the unicode-escape-decode decoder.
2013-01-29 10:28:07 +02:00
Serhiy Storchaka
d679377be7
Issue #16979 : Fix error handling bugs in the unicode-escape-decode decoder.
2013-01-29 10:20:44 +02:00
Serhiy Storchaka
e58785b200
Issue #16975 : Fix error handling bug in the escape-decode bytes decoder.
2013-01-25 23:32:41 +02:00
Serhiy Storchaka
ace3ad3bf7
Issue #16975 : Fix error handling bug in the escape-decode bytes decoder.
2013-01-25 23:31:43 +02:00
Serhiy Storchaka
45d16d9924
Issue #14850 : Now a chamap decoder treates U+FFFE as "undefined mapping"
...
in any mapping, not only in an unicode string.
2013-01-15 15:01:20 +02:00
Serhiy Storchaka
4fb8caee87
Issue #14850 : Now a chamap decoder treates U+FFFE as "undefined mapping"
...
in any mapping, not only in an unicode string.
2013-01-15 14:43:21 +02:00
Ezio Melotti
5d3dba0d27
#16918 : test_codecs now works with unittest test discovery. Patch by Zachary Ware.
2013-01-11 06:02:07 +02:00
Ezio Melotti
e0b87edd7f
Merge fix for broken/disabled test.
2013-01-11 05:57:58 +02:00
Ezio Melotti
26ed234052
Enable a broken test and fix it.
2013-01-11 05:54:57 +02:00
Serhiy Storchaka
ae3b32ad6b
Issue #11461 : Fix the incremental UTF-16 decoder. Original patch by
...
Amaury Forgeot d'Arc. Added tests for partial decoding of non-BMP
characters.
2013-01-08 23:40:52 +02:00
Serhiy Storchaka
48e188e573
Issue #11461 : Fix the incremental UTF-16 decoder. Original patch by
...
Amaury Forgeot d'Arc. Added tests for partial decoding of non-BMP
characters.
2013-01-08 23:14:24 +02:00
Ezio Melotti
a0b5c46fa2
#16336 : merge with 3.2.
2012-11-03 23:04:41 +02:00
Ezio Melotti
540da76115
#16336 : fix input checking in the surrogatepass error handler. Patch by Serhiy Storchaka.
2012-11-03 23:03:39 +02:00
Philip Jenvey
5f9459fbed
merge with 3.2
2012-10-26 17:05:09 -07:00
Philip Jenvey
45c41494bf
bounds check for bad data (thanks amaury)
2012-10-26 17:01:53 -07:00
Antoine Pitrou
a1f7655fa7
Issue #15379 : Fix passing of non-BMP characters as integers for the charmap decoder (already working as unicode strings).
...
Patch by Serhiy Storchaka.
2012-09-23 20:00:04 +02:00
Antoine Pitrou
6f80f5d444
Issue #15379 : Fix passing of non-BMP characters as integers for the charmap decoder (already working as unicode strings).
...
Patch by Serhiy Storchaka.
2012-09-23 19:55:21 +02:00
Antoine Pitrou
5e36edbaba
Port additional tests from #14579 (the issue is already fixed).
2012-07-21 00:47:48 +02:00
Antoine Pitrou
b4bbee25b1
Issue #14579 : Fix CVE-2012-2135: vulnerability in the utf-16 decoder after error handling.
...
Patch by Serhiy Storchaka.
2012-07-21 00:45:14 +02:00
Victor Stinner
e3b47152a4
Write tests for invalid characters (U+00110000)
...
Test the following functions:
* codecs.raw_unicode_escape_decode()
* PyUnicode_FromWideChar()
* PyUnicode_FromUnicode()
* "unicode_internal" and "unicode_escape" decoders
2011-12-09 20:49:49 +01:00
Ezio Melotti
adc417ce36
#13406 : fix more deprecation warnings and move the deprecation of unicode-internal earlier in the code.
2011-11-17 12:23:34 +02:00
Ezio Melotti
345379a7f8
#13406 : correct the error message in check_warnings too.
2011-11-16 09:54:19 +02:00
Ezio Melotti
11060a4a48
#13406 : silence deprecation warnings in test_codecs.
2011-11-16 09:39:10 +02:00
Victor Stinner
040e16e3e8
"unicode_internal" codec has been deprecated: fix related tests
2011-11-15 22:44:05 +01:00
Victor Stinner
76a31a6bff
Cleanup decode_code_page_stateful() and encode_code_page()
...
* Fix decode_code_page_errors() result
* Inline decode_code_page() and encode_code_page_chunk()
* Replace the PyUnicodeObject type by PyObject
2011-11-04 00:05:13 +01:00
Victor Stinner
2f3ca9f20e
Close #13247 : Add cp65001 codec, the Windows UTF-8 (CP_UTF8)
2011-10-27 01:38:56 +02:00
Victor Stinner
9e92188f53
Issue #12281 : Fix test_codecs.test_cp932() on Windows XP
...
Cool! Decoding b'\x81\x00abc' from cp932 with replace error handler is now
giving the same result on all Windows versions.
2011-10-18 21:55:25 +02:00
Victor Stinner
62be4fb21f
Issue #12281 : Skip code page tests on non-Windows platforms
2011-10-18 21:46:37 +02:00
Victor Stinner
3a50e7056e
Issue #12281 : Rewrite the MBCS codec to handle correctly replace and ignore
...
error handlers on all Windows versions. The MBCS codec is now supporting all
error handlers, instead of only replace to encode and ignore to decode.
2011-10-18 21:21:00 +02:00
Antoine Pitrou
00b2c86d09
Fix text failures when ctypes is not available
...
(followup to Victor's 85d11cf67aa8 and 7a50e549bd11)
2011-10-05 13:01:41 +02:00
Victor Stinner
182d90d9ee
Fix test_codecs for Windows: check size of wchar_t, not sys.maxunicode
2011-09-29 19:53:55 +02:00
Martin v. Löwis
d63a3b8beb
Implement PEP 393.
2011-09-28 07:41:54 +02:00
Antoine Pitrou
2a20f9be70
Backport 0398f07d4827 (fix for weird buildbot failures)
2011-07-27 01:06:07 +02:00
Antoine Pitrou
d05066d1ee
Try to fix weird buildbot failures
2011-07-26 23:55:33 +02:00
Antoine Pitrou
5a24d82941
Add a test for issue #1813 : getlocale() failing under a Turkish locale
...
(not a problem under 3.x)
2011-07-24 02:41:54 +02:00
Antoine Pitrou
cf9d3c08c8
Issue #1813 : Fix codec lookup under Turkish locales.
2011-07-24 02:27:04 +02:00
Victor Stinner
0501070669
Revert my commit 3555cf6f9c98: "Issue #8796 : codecs.open() calls the builtin
...
open() function instead of using StreamReaderWriter. Deprecate StreamReader,
StreamWriter, StreamReaderWriter, StreamRecoder and EncodedFile() of the codec
module. Use the builtin open() function or io.TextIOWrapper instead."
"It has not been approved !" wrote Marc-Andre Lemburg.
2011-05-27 16:50:40 +02:00
Victor Stinner
98fe1a0c3b
Issue #8796 : codecs.open() calls the builtin open() function instead of using
...
StreamReaderWriter. Deprecate StreamReader, StreamWriter, StreamReaderWriter,
StreamRecoder and EncodedFile() of the codec module. Use the builtin open()
function or io.TextIOWrapper instead.
2011-05-27 01:51:18 +02:00
Victor Stinner
d6881701fb
Merge 3.2
2011-05-23 14:58:07 +02:00
Victor Stinner
b43dd4b8ca
Merge 3.1
2011-05-23 14:57:05 +02:00
Victor Stinner
2cca057284
test_codecs now removes the temporay file (created by the test)
2011-05-23 14:51:42 +02:00
Marc-André Lemburg
8f36af7a4c
Normalize the encoding names for Latin-1 and UTF-8 to
...
'latin-1' and 'utf-8'.
These are optimized in the Python Unicode implementation
to result in more direct processing, bypassing the codec
registry.
Also see issue11303.
2011-02-25 15:42:01 +00:00
Benjamin Peterson
28a4dce6a8
remove (un)transform methods
2010-12-12 01:33:04 +00:00
Victor Stinner
53a9dd776e
Issue #10546 : UTF-16-LE and UTF-16-BE *do* support non-BMP characters
...
Fix the doc and add tests.
2010-12-08 22:25:45 +00:00
Georg Brandl
02524629f3
#7475 : add (un)transform method to bytes/bytearray and str, add back codecs that can be used with them from Python 2.
2010-12-02 18:06:51 +00:00
Ezio Melotti
19f2aeba67
Merged revisions 86596 via svnmerge from
...
svn+ssh://pythondev@svn.python.org/python/branches/py3k
........
r86596 | ezio.melotti | 2010-11-20 21:04:17 +0200 (Sat, 20 Nov 2010) | 1 line
#9424 : Replace deprecated assert* methods in the Python test suite.
........
2010-11-21 01:30:29 +00:00