113feb3ec2
bpo-40328: Add tool for generating cjk mapping headers (GH-19602)
2020-04-30 02:34:24 +09:00
51796e5d26
Update some www.unicode.org URLs to use HTTPS. (GH-18912)
2020-03-10 21:10:59 -07:00
051b9d08d1
closes bpo-39926: Update Unicode to 13.0.0. (GH-18910)
2020-03-10 20:41:34 -07:00
a65678c5c9
bpo-37760: Convert from length-18 lists to a dataclass, in makeunicodedata. (GH-15265)
...
Now the fields have names! Much easier to keep straight as a
reader than the elements of an 18-tuple.
Runs about 10-15% slower: from 10.8s to 12.3s, on my laptop.
Fortunately that's perfectly fine for this maintenance script.
2019-09-12 10:23:43 +01:00
3cbc23aa22
bpo-37758: Cut always-constant conditionals on sys.maxunicode. (GH-15302)
...
Since PEP 393 in Python 3.3, this value is always 0x10ffff, the
maximum codepoint in Unicode; there's no longer such a thing as a
UCS-2 build of Python, which couldn't properly represent some
characters.
There are a couple of spots left where we still condition on the value
of this constant. Take them out.
2019-09-09 08:20:40 -07:00
3e4498d35c
bpo-37760: Avoid cluttering work tree with downloaded Unicode files. (GH-15128)
2019-08-14 18:18:53 -07:00
c03e698c34
bpo-37760: Factor out standard range-expanding logic in makeunicodedata. (GH-15248)
...
Much like the lower-level logic in commit ef2af1ad4
2019-08-13 19:28:38 -07:00
99d208efed
bpo-37760: Constant-fold some old options in makeunicodedata. (GH-15129)
...
The `expand` option was introduced in 2000 in commit fad27aee1
2019-08-12 22:59:30 -07:00
ef2af1ad44
bpo-37760: Factor out the basic UCD parsing logic of makeunicodedata. (GH-15130)
...
There were 10 copies of this, and almost as many distinct versions of
exactly how it was written. They're all implementing the same
standard. Pull them out to the top, so the more interesting logic
that remains becomes easier to read.
2019-08-12 22:20:56 -07:00
faa2948654
Clean up and reduce visual clutter in the makeunicode.py script. (GH-7558)
2019-06-01 21:49:03 +02:00
3aca40d3cb
closes bpo-36861: Update Unicode database to 12.1.0. (GH-13214)
...
Adds ㋿.
2019-05-08 20:59:35 -07:00
6fec905de5
bpo-36642: make unicodedata const (GH-12855)
2019-04-17 08:40:34 +09:00
172bb39452
bpo-22831: Use "with" to avoid possible fd leaks in tools (part 2). (GH-10927)
2019-03-30 08:33:02 +02:00
738c19f4c5
closes bpo-33376: Update to Unicode 12.0.0. (GH-12256)
2019-03-09 16:25:55 -08:00
7c69c1c0fb
update to Unicode 11.0.0 (closes bpo-33778) (GH-7439)
...
Also, standardize indentation of generated tables.
2018-06-06 20:14:28 -07:00
279a96206f
bpo-30736: upgrade to Unicode 10.0 ( #2344 )
...
Straightforward. While we're at it, though, strip trailing whitespace from generated tables.
2017-06-22 22:31:08 -07:00
6b6e687766
bpo-27425: Be more explicit in .gitattributes (GH-840)
...
Updates checked-in line endings on several files.
2017-06-10 14:58:42 -05:00
3972628de3
bpo-30296 Remove unnecessary tuples, lists, sets, and dicts ( #1489 )
...
* Replaced list(<generator expression>) with list comprehension
* Replaced dict(<generator expression>) with dict comprehension
* Replaced set(<list literal>) with set literal
* Replaced builtin func(<list comprehension>) with func(<generator
expression>) when supported (e.g. any(), all(), tuple(), min(), &
max())
2017-05-18 07:35:54 -07:00
6775231597
Unicode 9.0.0
...
Not completely mechanical since support for East Asian Width changes—emoji
codepoints became Wide—had to be added to unicodedata.
2016-09-14 23:53:47 -07:00
44b548dda8
#27364 : fix "incorrect" uses of escape character in the stdlib.
...
And most of the tools.
Patch by Emanual Barry, reviewed by me, Serhiy Storchaka, and
Martin Panter.
2016-09-08 13:59:53 -04:00
4801383c29
upgrade to Unicode 8.0.0
2015-06-27 15:45:56 -05:00
ba9ac5b5c4
Issue #16261 : Converted some bare except statements to except statements
...
with specified exception type. Original patch by Ramchandra Apte.
2015-05-20 10:33:40 +03:00
774ac377da
Closes #17202 : Merge with 3.4
2015-04-13 12:11:40 -05:00
4c9c848159
Issue #17202 : Add .bat to .hgeol to force them to CRLF.
...
Using LF can a script to fail if it tries to use a label that is
split across 512 byte blocks. Who knows why.
2015-04-13 11:59:54 -05:00
82e07b92b3
Issue #23181 : More "codepoint" -> "code point".
2015-01-18 11:33:31 +02:00
d3faf43f9b
Issue #23181 : More "codepoint" -> "code point".
2015-01-18 11:28:37 +02:00
2623a5db6f
Merge: #18176 : Change generic UCD PropList link to version specific link.
2014-10-09 20:47:31 -04:00
5f16f90d1b
#18176 : Change generic UCD PropList link to version specific link.
2014-10-09 20:45:59 -04:00
532783bd5e
Merge: #18176 : fix another reference and add it to the makeunicodedata comment.
2014-10-09 17:41:55 -04:00
5bd62420f4
#18176 : fix another reference and add it to the makeunicodedata comment.
2014-10-09 17:39:48 -04:00
5ac125cde3
Merge: #18176 : updated stdtypes UCD link, added reminder to makeunicodedata.
2014-10-09 17:33:15 -04:00
7445a383a6
#18176 : updated stdtypes UCD link, added reminder to makeunicodedata.
...
Patch by Alexander Belopolsky.
2014-10-09 17:30:33 -04:00
3032ed7cb1
upgrade to unicode 7.0.0
2014-07-06 13:04:20 -07:00
8f8ec92de8
Issue #19936 : Added executable bits or shebang lines to Python scripts which
...
requires them. Disable executable bits and shebang lines in test and
benchmark files in order to prevent using a random system python, and in
source files of modules which don't provide command line interface. Fixed
shebang lines in the unittestgui and checkpip scripts.
2014-01-16 17:33:23 +02:00
b992a0e102
Issue #19936 : Added executable bits or shebang lines to Python scripts which
...
requires them. Disable executable bits and shebang lines in test and
benchmark files in order to prevent using a random system python, and in
source files of modules which don't provide command line interface. Fixed
shebang line to use python3 executable in the unittestgui script.
2014-01-16 17:15:49 +02:00
9d5c071060
#1097797 : add the original mapping file
2013-11-10 21:46:02 -05:00
695f07b27b
Fix some PEP8-formatting problems in the generated code
2013-11-10 21:45:24 -05:00
94d08d908b
upgrade unicode db to 6.3.0 ( closes #19221 )
2013-10-10 17:24:45 -04:00
d640fe2af5
#18803 : merge with 3.3.
2013-08-26 01:33:30 +03:00
7c4a7e6f3c
#18803 : fix more typos. Patch by Févry Thibault.
2013-08-26 01:32:56 +03:00
9ed5f27266
Issue #18722 : Remove uses of the "register" keyword in C code.
2013-08-13 20:18:52 +02:00
302b8c31ec
Issue #15239 : Make mkstringprep.py work again on Python 3.
2013-06-09 17:11:48 +03:00
e7275ffa4c
Issue #15239 : Make mkstringprep.py work again on Python 3.
2013-06-09 17:08:00 +03:00
e9631e5d3a
Issue #15378 : Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.
2012-10-17 16:14:40 +02:00
31605ace0d
Issue #15378 : Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.
2012-10-17 16:13:55 +02:00
1eff0fc3cd
Issue #15378 : Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.
2012-10-17 16:12:30 +02:00
b8350f1c7d
upgrade to UCD 6.2
2012-09-29 13:47:39 -04:00
c20740109d
Some cleanup in the Tools directory.
2012-07-07 17:03:54 +02:00
aaefac76dd
Issue #14874 : Restore charmap decoding speed to pre-PEP 393 levels.
...
Patch by Serhiy Storchaka.
2012-06-16 22:48:21 +02:00
71f660e00f
update to Unicode 6.1
2012-02-20 22:24:29 -05:00
Dong-hee Na
Benjamin Peterson
Greg Price
Stefan Behnel
Inada Naoki
Serhiy Storchaka
Zachary Ware
Jon Dufresne
R David Murray
Andrew Kuchling
Ezio Melotti
Antoine Pitrou
Florent Xicluna