Mirror
/
cpython
mirror of https://github.com/python/cpython
4
1
Fork 0
Code Issues Releases Wiki Activity
43,451 Commits 6 Branches 592 Tags 2.4 GiB
Commit Graph

57 Commits

Author SHA1 Message Date
Amaury Forgeot d'Arc d0052d17b1 #1571184: makeunicodedata.py now generates the functions _PyUnicode_ToNumeric, 
_PyUnicode_IsLinebreak and _PyUnicode_IsWhitespace.

It now also parses the Unihan.txt for numeric values.
 2009-10-06 19:56:32 +00:00
Antoine Pitrou e988e286b2 Issue #1734234: Massively speedup `unicodedata.normalize()` when the 
string is already in normalized form, by performing a quick check beforehand.
Original patch by Rauli Ruohonen.
 2009-04-27 21:53:26 +00:00
Martin v. Löwis 24329ba176 Issue #3811: The Unicode database was updated to 5.1. 
Reviewed by Fredrik Lundh and Marc-Andre Lemburg.
 2008-09-10 13:38:12 +00:00
Gregory P. Smith dd96db63f6 This reverts r63675 based on the discussion in this thread: 
http://mail.python.org/pipermail/python-dev/2008-June/079988.html

Python 2.6 should stick with PyString_* in its codebase.  The PyBytes_* names
in the spirit of 3.0 are available via a #define only.  See the email thread.
 2008-06-09 04:58:54 +00:00
Walter Dörwald a2a89a8712 Change all functions that expect one unicode character to accept a pair of 
surrogates in narrow builds. Fixes issue #1706460.
 2008-06-02 20:36:03 +00:00
Christian Heimes 593daf545b Renamed PyString to PyBytes 2008-05-26 12:51:38 +00:00
Christian Heimes e93237dfcc #1629: Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT. Macros for b/w compatibility are available. 2007-12-19 02:37:44 +00:00
Martin v. Löwis f1e0b3f630 Bug #1704793: Return UTF-16 pair if unicodedata.lookup cannot 
represent the result in a single character.
 2007-07-28 07:03:05 +00:00
Martin v. Löwis 6819210b9e PEP 3123: Provide forward compatibility with Python 3.0, while keeping 
backwards compatibility. Add Py_Refcnt, Py_Type, Py_Size, and
PyVarObject_HEAD_INIT.
 2007-07-21 06:55:02 +00:00
Walter Dörwald 6fc2382883 Replace C++ comment with C comment (fixes SF bug #1593525). 2006-11-09 16:23:26 +00:00
Neal Norwitz b45f351832 I'm not sure why this code allocates this string for the error message. 
I think it would be better to always use snprintf and have the format
limit the size of the name appropriately (like %.200s).

Klocwork #340
 2006-08-12 01:57:47 +00:00
Martin v. Löwis 789c09d2cd Update dangling references to the 3.2 database to 
mention that this is UCD 4.1 now.
 2006-08-10 19:04:00 +00:00
Neal Norwitz 37f694f21b No functional change. Add comment and assert to describe why there cannot be overflow which was reported by Klocwork. Discussed on python-dev 2006-07-27 04:04:50 +00:00
Martin v. Löwis d004fc810a Patch 1494554: Update numeric properties to Unicode 4.1. 2006-05-27 08:36:52 +00:00
Neal Norwitz 88c97845c6 No reason to export get_decomp_record, make static 2006-04-17 00:36:29 +00:00
Martin v. Löwis 3c6e4188ed Support NFD of very long strings. 2006-04-13 06:36:31 +00:00
Neal Norwitz 65c05b20e9 Get rid of warnings about using chars as subscripts 
on Alpha (and possibly other platforms) by using Py_CHARMASK().
 2006-04-10 02:17:47 +00:00
Martin v. Löwis c350912990 Adjust CJK Ideograph range to Unicode 4.1. 2006-03-11 12:16:23 +00:00
Martin v. Löwis 0e2f9b2dfb Fix refcounting bug. 2006-03-10 11:29:32 +00:00
Martin v. Löwis 5bd7c02298 Avoid forward-declaring the methods array. 
Rename unicodedata.db* to unicodedata.ucd*
 2006-03-10 11:20:04 +00:00
Martin v. Löwis 480f1bb67b Update Unicode database to Unicode 4.1. 2006-03-09 23:38:20 +00:00
Thomas Wouters 1e365b265a Remove gcc (4.0.x) warning about uninitialized value by explicitly setting 
the sentinel value in the main function, rather than the helper. This
function could possibly do with an early-out if any of the helper calls ends
up with a len of 0, but I doubt it really matters (how common are malformed
hangul syllables, really?)
 2006-03-01 21:58:30 +00:00
Martin v. Löwis 8b291e2d66 Patch #1213831: Fix typo in unicodedata._getcode. 
Will backport to Python 2.4.
 2005-09-18 08:17:56 +00:00
Hye-Shik Chang 4c560ea05b Correct URL to the official UnicodeData 3.2.0 resource. (Reported 
by Darek Suchojad)
 2005-06-04 07:31:48 +00:00
Hye-Shik Chang cf18a5d67b Fill docstrings for module and functions, extracted from the tex 
documentation.  (Patch #1173245, Contributed by Jeremy Yallop)
 2005-04-04 16:32:07 +00:00
Hye-Shik Chang e9ddfbb412 SF #989185: Drop unicode.iswide() and unicode.width() and add 
unicodedata.east_asian_width().  You can still implement your own
simple width() function using it like this:
    def width(u):
        w = 0
        for c in unicodedata.normalize('NFC', u):
            cwidth = unicodedata.east_asian_width(c)
            if cwidth in ('W', 'F'): w += 2
            else: w += 1
        return w
 2004-08-04 07:38:35 +00:00
Hye-Shik Chang 69dc1c8f6a Fix typo. 2004-07-15 04:30:25 +00:00
Martin v. Löwis 61e40bd897 Special case normalization of empty strings. Fixes #924361. 
Backported to 2.3.
 2004-04-17 19:36:48 +00:00
Martin v. Löwis d2171d2ba4 Overallocate target buffer for normalization more early. Fixes #834676. 
Backported to 2.3.
 2003-11-06 20:47:57 +00:00
Neal Norwitz e9c571f968 Fix SF bug #694816, remove comparison of unsigned value < 0 2003-02-28 03:14:37 +00:00
Martin v. Löwis 2fb661fb80 Remove C++ comment. 2002-12-07 14:56:36 +00:00
Martin v. Löwis b5c980b802 Add unidata_version. Bump generator version number. 2002-11-25 09:13:37 +00:00
Martin v. Löwis 8d93ca1383 Verify that the code in CJK UNIFIED IDEOGRAPH- actually denotes an ideograph. 2002-11-23 22:10:29 +00:00
Martin v. Löwis 677bde2dd1 Patch #626485: Support Unicode normalization. 2002-11-23 22:08:15 +00:00
Martin v. Löwis ef7fe2e813 Implement names for CJK unified ideographs. Add name to KeyError output. 
Verify that the lookup for an existing name succeeds.
 2002-11-23 18:01:32 +00:00
Martin v. Löwis 2f4be4e38a Fix off-by-one error. 2002-11-23 17:11:06 +00:00
Martin v. Löwis 7d41e29c58 Patch #626548: Support Hangul syllable names. 2002-11-23 12:22:32 +00:00
Martin v. Löwis 9def6a3a77 Update to Unicode 3.2 database. 2002-10-18 16:11:54 +00:00
Mark Hammond 62b1ab1b31 Replace DL_IMPORT with PyMODINIT_FUNC and remove "/export:init..." link 
command line for Windows builds.  This should allow MSVC to import and
build the Python MSVC6 project files without error.
 2002-07-23 06:31:15 +00:00
Martin v. Löwis 14f8b4cfcb Patch #568124: Add doc string macros. 2002-06-13 20:33:02 +00:00
Andrew MacIntyre 74a3bec592 _Py prefix is verboten for static entry points 2002-06-13 11:55:14 +00:00
Fred Drake a2bd8d3816 Remove direct manipulation of the module dict. 2002-04-03 21:39:26 +00:00
Andrew MacIntyre 7bf6833e17 OS/2 EMX port changes (Modules part of patch #450267): 
Modules/
    _hotshot.c
    dbmmodule.c
    fcntlmodule.c
    main.c
    pwdmodule.c
    readline.c
    selectmodule.c
    signalmodule.c
    termios.c
    timemodule.c
    unicodedata.c
 2002-03-03 02:59:16 +00:00
Tim Peters 69b83b113f unicodedata_decomposition(): sprintf -> PyOS_snprintf. 2001-11-30 07:23:05 +00:00
Fred Drake 6a16ea07b8 Kill a warning on the SGI compiler. 
This is part of SF patch #434992.
 2001-07-19 21:11:13 +00:00
Fred Drake f585bef504 Be a bit more strict in setting up the export of the C API for this 
module; do not attempt to insert the API object into the module dict
if there was an error creating it.
 2001-03-03 19:41:55 +00:00
Fredrik Lundh b95896b2d2 renamed internal functions to avoid name clashes under OpenVMS 
(fixes bug #132815)
 2001-02-18 22:06:17 +00:00
Fredrik Lundh ae7636753e stupid typo (for some reason, this only caused problems on OpenVMS). 2001-02-18 11:41:49 +00:00
Fredrik Lundh 06d126803c Move uchhash functionality into unicodedata (after the recent 
crop of changes, the files are small enough to do this).  Also
adds "name" and "lookup" functions to unicodedata.
 2001-01-24 07:59:11 +00:00
Fredrik Lundh b2dfd73bdc Unicode nits: Don't include unicodedatabase.h no more. And make sure 
to build *all* tables in makeunicodedata.py.
 2001-01-21 23:31:52 +00:00