7c924ec925
Issue #1054943 : Fix unicodedata.normalize('NFC', text) for the Public Review
...
Issue #29 .
PR #29 was released in february 2004!
2010-03-04 12:09:33 +00:00
d0052d17b1
#1571184 : makeunicodedata.py now generates the functions _PyUnicode_ToNumeric,
...
_PyUnicode_IsLinebreak and _PyUnicode_IsWhitespace.
It now also parses the Unihan.txt for numeric values.
2009-10-06 19:56:32 +00:00
e988e286b2
Issue #1734234 : Massively speedup `unicodedata.normalize()` when the
...
string is already in normalized form, by performing a quick check beforehand.
Original patch by Rauli Ruohonen.
2009-04-27 21:53:26 +00:00
24329ba176
Issue #3811 : The Unicode database was updated to 5.1.
...
Reviewed by Fredrik Lundh and Marc-Andre Lemburg.
2008-09-10 13:38:12 +00:00
dd96db63f6
This reverts r63675 based on the discussion in this thread:
...
http://mail.python.org/pipermail/python-dev/2008-June/079988.html
Python 2.6 should stick with PyString_* in its codebase. The PyBytes_* names
in the spirit of 3.0 are available via a #define only. See the email thread.
2008-06-09 04:58:54 +00:00
a2a89a8712
Change all functions that expect one unicode character to accept a pair of
...
surrogates in narrow builds. Fixes issue #1706460 .
2008-06-02 20:36:03 +00:00
593daf545b
Renamed PyString to PyBytes
2008-05-26 12:51:38 +00:00
e93237dfcc
#1629 : Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT. Macros for b/w compatibility are available.
2007-12-19 02:37:44 +00:00
f1e0b3f630
Bug #1704793 : Return UTF-16 pair if unicodedata.lookup cannot
...
represent the result in a single character.
2007-07-28 07:03:05 +00:00
6819210b9e
PEP 3123: Provide forward compatibility with Python 3.0, while keeping
...
backwards compatibility. Add Py_Refcnt, Py_Type, Py_Size, and
PyVarObject_HEAD_INIT.
2007-07-21 06:55:02 +00:00
6fc2382883
Replace C++ comment with C comment (fixes SF bug #1593525 ).
2006-11-09 16:23:26 +00:00
b45f351832
I'm not sure why this code allocates this string for the error message.
...
I think it would be better to always use snprintf and have the format
limit the size of the name appropriately (like %.200s).
Klocwork #340
2006-08-12 01:57:47 +00:00
789c09d2cd
Update dangling references to the 3.2 database to
...
mention that this is UCD 4.1 now.
2006-08-10 19:04:00 +00:00
37f694f21b
No functional change. Add comment and assert to describe why there cannot be overflow which was reported by Klocwork. Discussed on python-dev
2006-07-27 04:04:50 +00:00
d004fc810a
Patch 1494554: Update numeric properties to Unicode 4.1.
2006-05-27 08:36:52 +00:00
88c97845c6
No reason to export get_decomp_record, make static
2006-04-17 00:36:29 +00:00
3c6e4188ed
Support NFD of very long strings.
2006-04-13 06:36:31 +00:00
65c05b20e9
Get rid of warnings about using chars as subscripts
...
on Alpha (and possibly other platforms) by using Py_CHARMASK().
2006-04-10 02:17:47 +00:00
c350912990
Adjust CJK Ideograph range to Unicode 4.1.
2006-03-11 12:16:23 +00:00
0e2f9b2dfb
Fix refcounting bug.
2006-03-10 11:29:32 +00:00
5bd7c02298
Avoid forward-declaring the methods array.
...
Rename unicodedata.db* to unicodedata.ucd*
2006-03-10 11:20:04 +00:00
480f1bb67b
Update Unicode database to Unicode 4.1.
2006-03-09 23:38:20 +00:00
1e365b265a
Remove gcc (4.0.x) warning about uninitialized value by explicitly setting
...
the sentinel value in the main function, rather than the helper. This
function could possibly do with an early-out if any of the helper calls ends
up with a len of 0, but I doubt it really matters (how common are malformed
hangul syllables, really?)
2006-03-01 21:58:30 +00:00
8b291e2d66
Patch #1213831 : Fix typo in unicodedata._getcode.
...
Will backport to Python 2.4.
2005-09-18 08:17:56 +00:00
4c560ea05b
Correct URL to the official UnicodeData 3.2.0 resource. (Reported
...
by Darek Suchojad)
2005-06-04 07:31:48 +00:00
cf18a5d67b
Fill docstrings for module and functions, extracted from the tex
...
documentation. (Patch #1173245 , Contributed by Jeremy Yallop)
2005-04-04 16:32:07 +00:00
e9ddfbb412
SF #989185 : Drop unicode.iswide() and unicode.width() and add
...
unicodedata.east_asian_width(). You can still implement your own
simple width() function using it like this:
def width(u):
w = 0
for c in unicodedata.normalize('NFC', u):
cwidth = unicodedata.east_asian_width(c)
if cwidth in ('W', 'F'): w += 2
else: w += 1
return w
2004-08-04 07:38:35 +00:00
69dc1c8f6a
Fix typo.
2004-07-15 04:30:25 +00:00
61e40bd897
Special case normalization of empty strings. Fixes #924361 .
...
Backported to 2.3.
2004-04-17 19:36:48 +00:00
d2171d2ba4
Overallocate target buffer for normalization more early. Fixes #834676 .
...
Backported to 2.3.
2003-11-06 20:47:57 +00:00
e9c571f968
Fix SF bug #694816 , remove comparison of unsigned value < 0
2003-02-28 03:14:37 +00:00
2fb661fb80
Remove C++ comment.
2002-12-07 14:56:36 +00:00
b5c980b802
Add unidata_version. Bump generator version number.
2002-11-25 09:13:37 +00:00
8d93ca1383
Verify that the code in CJK UNIFIED IDEOGRAPH- actually denotes an ideograph.
2002-11-23 22:10:29 +00:00
677bde2dd1
Patch #626485 : Support Unicode normalization.
2002-11-23 22:08:15 +00:00
ef7fe2e813
Implement names for CJK unified ideographs. Add name to KeyError output.
...
Verify that the lookup for an existing name succeeds.
2002-11-23 18:01:32 +00:00
2f4be4e38a
Fix off-by-one error.
2002-11-23 17:11:06 +00:00
7d41e29c58
Patch #626548 : Support Hangul syllable names.
2002-11-23 12:22:32 +00:00
9def6a3a77
Update to Unicode 3.2 database.
2002-10-18 16:11:54 +00:00
62b1ab1b31
Replace DL_IMPORT with PyMODINIT_FUNC and remove "/export:init..." link
...
command line for Windows builds. This should allow MSVC to import and
build the Python MSVC6 project files without error.
2002-07-23 06:31:15 +00:00
14f8b4cfcb
Patch #568124 : Add doc string macros.
2002-06-13 20:33:02 +00:00
74a3bec592
_Py prefix is verboten for static entry points
2002-06-13 11:55:14 +00:00
a2bd8d3816
Remove direct manipulation of the module dict.
2002-04-03 21:39:26 +00:00
7bf6833e17
OS/2 EMX port changes (Modules part of patch #450267 ):
...
Modules/
_hotshot.c
dbmmodule.c
fcntlmodule.c
main.c
pwdmodule.c
readline.c
selectmodule.c
signalmodule.c
termios.c
timemodule.c
unicodedata.c
2002-03-03 02:59:16 +00:00
69b83b113f
unicodedata_decomposition(): sprintf -> PyOS_snprintf.
2001-11-30 07:23:05 +00:00
6a16ea07b8
Kill a warning on the SGI compiler.
...
This is part of SF patch #434992 .
2001-07-19 21:11:13 +00:00
f585bef504
Be a bit more strict in setting up the export of the C API for this
...
module; do not attempt to insert the API object into the module dict
if there was an error creating it.
2001-03-03 19:41:55 +00:00
b95896b2d2
renamed internal functions to avoid name clashes under OpenVMS
...
(fixes bug #132815 )
2001-02-18 22:06:17 +00:00
ae7636753e
stupid typo (for some reason, this only caused problems on OpenVMS).
2001-02-18 11:41:49 +00:00
06d126803c
Move uchhash functionality into unicodedata (after the recent
...
crop of changes, the files are small enough to do this). Also
adds "name" and "lookup" functions to unicodedata.
2001-01-24 07:59:11 +00:00
Victor Stinner
Amaury Forgeot d'Arc
Antoine Pitrou
Martin v. Löwis
Gregory P. Smith
Walter Dörwald
Christian Heimes
Neal Norwitz
Thomas Wouters
Hye-Shik Chang
Mark Hammond
Andrew MacIntyre
Fred Drake
Tim Peters
Fredrik Lundh