5e3d338a74
Issue #19655 : Replace the ASDL parser carried with CPython
...
The new parser does not rely on Spark (which is now removed from our repo),
uses modern 3.x idioms and is significantly smaller and simpler.
It generates exactly the same AST files (.h and .c), so in practice no builds
should be affected.
2014-05-09 17:58:22 -07:00
d51374ed78
PEP 465: a dedicated infix operator for matrix multiplication ( closes #21176 )
2014-04-09 23:55:56 -04:00
78f1e4c865
Merge with 3.3
2014-02-28 15:43:36 +01:00
815b41b1cd
Issue #20731 : Properly position in source code files even if they
...
are opened in text mode. Patch by Serhiy Storchaka.
2014-02-28 15:27:29 +01:00
42ec031fe7
merge 3.3 ( #20588 )
2014-02-10 22:41:40 -05:00
c2f665e721
don't put runtime values in array initializer for C89 compliance ( closes #20588 )
2014-02-10 22:19:02 -05:00
5940b92909
Do not reset the line number because we already set file position to correct
...
value.
(fixes error in patch for issue #18960 )
2014-01-09 20:13:52 +02:00
1064a13bb0
Do not reset the line number because we already set file position to correct
...
value.
(fixes error in patch for issue #18960 )
2014-01-09 20:12:49 +02:00
7282ff6d5b
Issue #18960 : Fix bugs with Python source code encoding in the second line.
...
* The first line of Python script could be executed twice when the source
encoding (not equal to 'utf-8') was specified on the second line.
* Now the source encoding declaration on the second line isn't effective if
the first line contains anything except a comment.
* As a consequence, 'python -x' works now again with files with the source
encoding declarations specified on the second file, and can be used again
to make Python batch files on Windows.
* The tokenize module now ignore the source encoding declaration on the second
line if the first line contains anything except a comment.
* IDLE now ignores the source encoding declaration on the second line if the
first line contains anything except a comment.
* 2to3 and the findnocoding.py script now ignore the source encoding
declaration on the second line if the first line contains anything except
a comment.
2014-01-09 18:41:59 +02:00
768c16ce02
Issue #18960 : Fix bugs with Python source code encoding in the second line.
...
* The first line of Python script could be executed twice when the source
encoding (not equal to 'utf-8') was specified on the second line.
* Now the source encoding declaration on the second line isn't effective if
the first line contains anything except a comment.
* As a consequence, 'python -x' works now again with files with the source
encoding declarations specified on the second file, and can be used again
to make Python batch files on Windows.
* The tokenize module now ignore the source encoding declaration on the second
line if the first line contains anything except a comment.
* IDLE now ignores the source encoding declaration on the second line if the
first line contains anything except a comment.
* 2to3 and the findnocoding.py script now ignore the source encoding
declaration on the second line if the first line contains anything except
a comment.
2014-01-09 18:36:09 +02:00
af01f66817
Issue #16136 : Remove VMS support and VMS-related code
2013-12-21 16:19:10 +01:00
724b828e79
upcast int to size_t to silence two autological-constant-out-of-range-compare warnings with clang.
2013-12-04 08:42:46 +01:00
cad876d542
Fix a compiler warning on Windows 64-bit in parsetok.c
...
Python parser doesn't support lines longer than INT_MAX bytes yet
2013-11-18 01:09:51 +01:00
3a8a333942
Fix compiler warnings on Windows 64-bit in grammar.c
...
INT_MAX states and labels should be enough for everyone
2013-11-18 01:07:38 +01:00
c679227e31
Issue #1772673 : The type of `char*` arguments now changed to `const char*`.
2013-10-19 21:03:34 +03:00
c548660af5
Issue #16742 : My fix on PyOS_StdioReadline() was incomplete, PyMem_FREE() was
...
not patched
2013-10-19 02:40:16 +02:00
d01d396e7f
Issue #4555 : All exported C symbols are now prefixed with either "Py" or "_Py".
...
("make smelly" now clean)
2013-10-12 22:52:43 +02:00
2fe9bac4dc
Close #16742 : Fix misuse of memory allocations in PyOS_Readline()
...
The GIL must be held to call PyMem_Malloc(), whereas PyOS_Readline() releases
the GIL to read input.
The result of the C callback PyOS_ReadlineFunctionPointer must now be a string
allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL if an error
occurred), instead of a string allocated by PyMem_Malloc() or PyMem_Realloc().
Fixing this issue was required to setup a hook on PyMem_Malloc(), for example
using the tracemalloc module.
PyOS_Readline() copies the result of PyOS_ReadlineFunctionPointer() into a new
buffer allocated by PyMem_Malloc(). So the public API of PyOS_Readline() does
not change.
2013-10-10 16:18:20 +02:00
1891cff587
Move open outside try/finally
2013-09-26 09:35:39 -07:00
99081238e9
Don't use fancy new Python features like 'with' - some bots don't have them
...
and can't bootstrap the parser.
2013-09-26 06:41:36 -07:00
58fe1b1307
Normalize whitespace
2013-09-26 06:32:22 -07:00
b788a385cd
Small fixes in Parser/asdl.py - no change in functionality.
...
1. Make it work when invoked directly from the command-line. It was failing
due to a couple of stale function/class usages in the __main__ section.
2. Close the parsed file in the parse() function after opening it.
2013-09-26 06:31:32 -07:00
daf455554b
Issue #18571 : Implementation of the PEP 446: file descriptors and file handles
...
are now created non-inheritable; add functions os.get/set_inheritable(),
os.get/set_handle_inheritable() and socket.socket.get/set_inheritable().
2013-08-28 00:53:59 +02:00
14e461d5b9
Close #11619 : The parser and the import machinery do not encode Unicode
...
filenames anymore on Windows.
2013-08-26 22:28:21 +02:00
d640fe2af5
#18803 : merge with 3.3.
2013-08-26 01:33:30 +03:00
7c4a7e6f3c
#18803 : fix more typos. Patch by Févry Thibault.
2013-08-26 01:32:56 +03:00
9ed5f27266
Issue #18722 : Remove uses of the "register" keyword in C code.
2013-08-13 20:18:52 +02:00
73207e03ad
Issue #18368 : PyOS_StdioReadline() no longer leaks memory when realloc() fails.
2013-08-06 16:03:33 +02:00
9ae513caa7
Issue #18368 : PyOS_StdioReadline() no longer leaks memory when realloc() fails.
2013-08-06 15:59:16 +02:00
1289565f4b
Silence warning about set but unused variable inside compile_atom() in non-debug builds
2013-07-31 23:48:04 +02:00
5e4d372524
Silence warning about set but unused variable inside compile_atom() in non-debug builds
2013-07-31 23:47:56 +02:00
b7f1b38dea
Issue #18552 : Check return value of PyArena_AddPyObject() in obj2ast_object().
2013-07-27 00:33:35 +02:00
70c94e7896
Issue #18552 : Check return value of PyArena_AddPyObject() in obj2ast_object().
2013-07-27 00:33:13 +02:00
b318990cac
(Merge 3.3) Parser/asdl_c.py: use Py_CLEAR()
2013-07-27 00:04:42 +02:00
1acc129d48
Parser/asdl_c.py: use Py_CLEAR()
2013-07-27 00:03:47 +02:00
ee4b59c0f8
(Merge 3.3) According to the PEP 7, C code must "use 4-space indents"
...
Replace 8 spaces with 4.
2013-07-27 00:01:35 +02:00
ce72e1ce6c
According to the PEP 7, C code must "use 4-space indents"
...
Replace 8 spaces with 4.
2013-07-27 00:00:36 +02:00
7b3902a20f
Some compilers complain about 'control reaches end of non-void function'
...
because they don't understand that Py_FatalError() terminates the program.
2013-07-22 16:34:28 +02:00
1eb0cb12ac
Some compilers complain about 'control reaches end of non-void function'
...
because they don't understand that Py_FatalError() terminates the program.
2013-07-22 16:34:13 +02:00
826b754e32
Add sanity check to PyGrammar_LabelRepr() in order to catch invalid tokens when debugging
...
a new grammar.
CID 715360
2013-07-22 10:30:45 +02:00
53d2dc4045
Add sanity check to PyGrammar_LabelRepr() in order to catch invalid tokens when debugging
...
a new grammar.
CID 715360
2013-07-22 10:30:14 +02:00
bdf630c4a7
Issue #18408 : Fix Python-ast.c: handle init_types() failure (ex: MemoryError)
2013-07-17 00:17:15 +02:00
cb2226cb69
merge 3.3
2013-07-15 20:50:25 -07:00
265fba40c8
move declaration to top of block
2013-07-15 20:50:22 -07:00
fd9c0203de
merge 3.3 ( closes #18470 )
2013-07-15 20:47:47 -07:00
2dbfd88245
check the return value of new_string() ( closes #18470 )
2013-07-15 19:15:34 -07:00
526daabf34
Issue #18408 : parsetok() must not write into stderr on memory allocation error
...
The caller gets an error code and can raise a classic Python exception.
2013-07-11 23:17:33 +02:00
3bf5f530d9
Issue #18408 : parsetok() must not write into stderr on memory allocation error
...
The caller gets an error code and can raise a classic Python exception.
2013-07-11 22:52:19 +02:00
22ed7fe906
Fix resource leak in parser, free node ptr
...
CID 1028068 (#1 of 1): Resource leak (RESOURCE_LEAK)
leaked_storage: Variable n going out of scope leaks the storage it points to.
2013-06-29 21:03:51 +02:00
9670543a00
Issue #18038 : SyntaxError raised during compilation sources with illegal
...
encoding now always contains an encoding name.
2013-06-09 16:53:55 +03:00
3af14aaba5
Issue #18038 : SyntaxError raised during compilation sources with illegal
...
encoding now always contains an encoding name.
2013-06-09 16:51:52 +03:00
796977360f
Issue #9566 : Fix compiler warning on Windows 64-bit
2013-06-05 00:44:00 +02:00
8d89c2aaba
change AST codegen to use PyModule_AddIntMacro
2013-05-20 10:28:48 -07:00
7654ab9ef0
placate msvc
2013-03-18 23:39:53 -07:00
b72406b8fa
refactor to fix refleaks
2013-03-18 23:24:41 -07:00
cda75be02a
unify some ast.argument's attrs; change Attribute column offset ( closes #16795 )
...
Patch from Sven Brauch.
2013-03-18 10:48:58 -07:00
b26a9b10ea
Replace WaitForSingleObject with WaitForSingleObjectEx,
...
for better WinRT compatibility.
2013-01-25 14:25:48 +01:00
442f20996d
create NameConstant AST class for None, True, and False literals ( closes #16619 )
2012-12-06 17:41:04 -05:00
073f067369
Issue #16546 : merge fix from 3.3
2012-11-25 14:37:43 +00:00
ded35aeb9d
Issue #16546 : make ast.YieldFrom argument mandatory.
2012-11-25 14:36:26 +00:00
742b2f8d7a
make PyGrammar_LabelRepr return a const char * ( closes #16369 )
2012-10-31 13:36:13 -04:00
d0845588b8
make _PyParser_TokenNames const
2012-10-24 08:21:52 -07:00
aee3c76acf
- Issue #16262 : fix out-of-src-tree builds, if mercurial is not installed.
2012-10-21 23:12:35 +02:00
8a9cc526fe
#15923 : merge with 3.2.
2012-09-30 22:47:47 +03:00
cb2916a714
#15923 : fix a mistake in asdl_c.py that resulted in a TypeError after 2801bf875a24 (see #15801 ).
2012-09-30 22:41:37 +03:00
ca8aa4acf6
Issue #15144 : Fix possible integer overflow when handling pointers as integer values, by using Py_uintptr_t instead of size_t.
...
Patch by Serhiy Storchaka.
2012-09-20 20:56:47 +02:00
cc98887e45
Remove unused variables in parsetok().
2012-08-11 11:16:18 +02:00
88ca04e6a8
MERGE: Closes #15512 : Correct __sizeof__ support for parser
2012-08-03 14:29:26 +02:00
e9c5318967
Closes #15512 : Correct __sizeof__ support for parser
2012-08-03 14:28:37 +02:00
481ae50ccd
construct fields in the right order ( closes #15517 )
...
Patch from Taihyun Hwang.
2012-07-31 21:41:56 -07:00
8107176f9b
add gc support to the AST base type ( closes #15293 )
2012-07-08 11:03:46 -07:00
507507473e
Issue #15291 : Fix a memory leak where AST nodes where not properly deallocated.
2012-07-08 12:43:32 +02:00
035997f1a3
Issue #1677 : Unused variable warning in Non-Windows
2012-07-03 13:15:03 +02:00
9175c3d804
Issue #1677 : Handle better a race condition between the interactive interpreter and
...
the Ctrl-C signal handler on Windows
2012-06-29 18:39:26 +01:00
b92b757eed
Issue #1677 : Handle better a race condition between the interactive interpreter and
...
the Ctrl-C signal handler on Windows
2012-06-29 18:27:08 +01:00
0b3847de6d
Issue #15096 : Drop support for the ur string prefix
2012-06-20 11:17:58 +02:00
77fa9379e2
use Py_ssize_t for ast sequence lengths
2012-05-15 10:10:27 -07:00
ce58ed3e7c
Merge with 3.2: issue #14433
2012-04-30 06:20:37 +02:00
e654c11f56
Issue #14433 : Prevent msvcrt crash in interactive prompt when stdin is closed.
2012-04-30 06:10:41 +02:00
1767e0274b
free AST's dict
2012-03-14 21:50:29 -05:00
45e50de1f5
Try to fix compilation of Python-ast.c on Visual Studio 2008
2012-03-13 01:17:31 +01:00
7e0dbfbbde
give the AST class a __dict__
2012-03-12 09:46:44 -07:00
6ecf77b3f8
Basic support for PEP 414 without docs or tests.
2012-03-04 12:04:06 +00:00
cff9237d57
check after comments, too ( #13832 )
2012-01-19 17:46:13 -05:00
188bee5873
don't leak node
2012-01-19 08:48:18 -05:00
79c1f96438
only check this when parsing python
2012-01-19 08:48:11 -05:00
fa21bf015d
Issue #12705 : Raise SyntaxError when compiling multiple statements as single interactive statement
2012-01-19 01:08:41 -06:00
8d5a62df10
murder tabs
2012-01-16 09:54:28 -05:00
527c622926
make YieldFrom its own distinct from Yield ( closes #13780 )
2012-01-14 08:58:23 -05:00
1f7ce62bd6
Implement PEP 380 - 'yield from' ( closes #11682 )
2012-01-13 21:43:40 +10:00
3a5d4cb940
Issue #13748 : Raw bytes literals can now be written with the `rb` prefix as well as `br`.
2012-01-12 22:46:19 +01:00
f51d36a743
evidently some buildbots don't have python 3 installed
2011-12-29 12:07:21 -06:00
3ab85886d6
run AST toolchain on python3
2011-12-29 12:03:55 -06:00
ab0e9f7089
Issue #10350 : Read and save errno before calling a function which might overwrite it.
...
Original patch by Hallvard B Furuseth.
2011-12-16 12:29:37 +01:00
c345ce1a69
Issue #10350 : Read and save errno before calling a function which might overwrite it.
...
Original patch by Hallvard B Furuseth.
2011-12-16 12:28:32 +01:00
942d5ba125
Merge branch 3.2
2011-11-22 22:02:01 +01:00
58e8761da6
Issue #13436 : Fix a bogus error message when an AST object was passed
...
an invalid integer value.
2011-11-22 21:51:55 +01:00
f364e7b598
Fix memory leak with FLUFL-related syntax errors (!)
2011-11-13 01:02:02 +01:00
9ec2593bda
Fix memory leak with FLUFL-related syntax errors (!)
2011-11-13 01:01:23 +01:00
70d86bdef1
Issue 13243: Rename _Py_identifier to _Py_IDENTIFIER in asdl_c.py
...
Parser/asdl_c.py was missed in commit 7109f31300fb when _Py_identifier
was replaced with _Py_IDENTIFIER. Thanks to Eric Snow for the patch.
2011-10-22 14:06:50 -05:00
1c67dd9b15
Port SetAttrString/HasAttrString to SetAttrId/GetAttrId.
2011-10-14 15:16:45 +02:00
bd928fef42
Rename _Py_identifier to _Py_IDENTIFIER.
2011-10-14 10:20:37 +02:00
1ee1b6fe0d
Use identifier API for PyObject_GetAttrString.
2011-10-10 18:11:30 +02:00
afe55bba33
Add API for static strings, primarily good for identifiers.
...
Thanks to Konrad Schöbel and Jasper Schulz for helping with the mass-editing.
2011-10-09 10:38:36 +02:00
d63a3b8beb
Implement PEP 393.
2011-09-28 07:41:54 +02:00
6f08f53e79
Merge 3.2
2011-09-02 17:32:30 +02:00
0224d4e699
accept bytes for the AST 'string' type
...
This is a temporary kludge and all is well in 3.3.
2011-08-31 22:13:03 -04:00
5a3f49bb7e
revert code which conditionally writes Python-ast.h ( closes #12727 )
2011-08-11 14:42:28 -05:00
257a1d0f28
2.x syntax
2011-08-09 18:48:02 -05:00
4ec450d3c7
make this work on 2.4
2011-08-09 18:38:57 -05:00
6f7500424c
make this work with py2.5
2011-08-09 16:49:52 -05:00
398256b230
don't rewrite the header file if it hasn't changed; this reduces development build time
2011-08-09 16:28:58 -05:00
4dc6499613
the bool asdl type died a while ago
2011-08-09 16:10:09 -05:00
e249841903
add a asdl bytes type, so Bytes.s be properly typechecked
2011-08-09 16:08:39 -05:00
8a4b42b7f4
merge 3.2
2011-07-22 11:10:43 -05:00
180e63507d
None is ok for identifiers but not strings
2011-07-22 11:09:07 -05:00
86f088e8e5
merge 3.2
2011-07-22 10:55:02 -05:00
2193d2b72b
type check AST strings and identifiers
...
This is related to a21829180423 as well as #12609 and #12610 .
2011-07-22 10:50:23 -05:00
efad2449fc
hardcode the old svn __version__
2011-07-22 10:39:12 -05:00
0bd152cd67
remove ast.__version__ ( closes #12273 )
2011-07-15 21:10:13 -05:00
620b2c8c98
comment which is not applicable anymore
2011-07-15 15:27:34 -05:00
0c1036270d
remove intrcheck.c, which hasn't been used for years
2011-06-20 19:22:34 -05:00
0c9f31b4c0
(Merge 3.2) Issue #12016 : my_fgets() now always clears errors before calling
...
fgets(). Fix the following case: sys.stdin.read() stopped with CTRL+d (end of
file), raw_input() interrupted by CTRL+c.
2011-05-30 23:47:01 +02:00
4f71101eed
Issue #12016 : my_fgets() now always clears errors before calling fgets(). Fix
...
the following case: sys.stdin.read() stopped with CTRL+d (end of file),
raw_input() interrupted by CTRL+c.
2011-05-30 23:46:00 +02:00
758888d437
don't restrict unexpected EOF errors to the first line ( closes #12216 )
2011-05-30 11:12:38 -05:00
43af12b0b4
unify TryExcept and TryFinally ( closes #12199 )
2011-05-29 11:43:10 -05:00
bf1bbc1452
reflect with statements with multiple items in the AST ( closes #12106 )
2011-05-27 13:58:08 -05:00
00c5925533
(Merge 3.2) Issue #1195 : Fix input() if it is interrupted by CTRL+d and then
...
CTRL+c, clear the end-of-file indicator after CTRL+d.
2011-05-10 00:21:26 +02:00
db932786af
Issue #1195 : Fix input() if it is interrupted by CTRL+d and then CTRL+c, clear
...
the end-of-file indicator after CTRL+d.
2011-05-10 00:20:35 +02:00
4755ab010f
Issue #1195 : Fix input() if it is interrupted by CTRL+d and then CTRL+c,
...
clear the end-of-file indicator after CTRL+d.
2011-05-10 00:19:53 +02:00
c1935d2abf
Revert bb62908896fe, but keep the test
2011-04-25 04:03:58 +02:00
88f7841be7
Correctly merging #9319 into 3.3?
2011-04-25 03:46:43 +02:00
c68b6aaec8
Issue #9319 : Fix a crash on parsing a Python source code without encoding
...
cookie and not valid in UTF-8: use "<file>" as the filename instead of
reading from NULL.
2011-04-23 00:41:19 +02:00
4ae3b447c8
(Merge 3.2) Issue #11650 : PyOS_StdioReadline() retries fgets() if it was
...
interrupted (EINTR), for example if the program is stopped with CTRL+z on Mac
OS X. Patch written by Charles-Francois Natali.
2011-04-09 16:01:55 +02:00
a870e35a7d
(Merge 3.1) Issue #11650 : PyOS_StdioReadline() retries fgets() if it was
...
interrupted (EINTR), for example if the program is stopped with CTRL+z on Mac
OS X. Patch written by Charles-Francois Natali.
2011-04-09 15:59:25 +02:00
52c950f229
Issue #11650 : PyOS_StdioReadline() retries fgets() if it was interrupted
...
(EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
written by Charles-Francois Natali.
2011-04-09 15:55:44 +02:00
fe7c5b5bdf
Issue #9319 : Include the filename in "Non-UTF8 code ..." syntax error.
2011-04-05 01:48:03 +02:00
7f2fee3640
Issue #10785 : Store the filename as Unicode in the Python parser.
2011-04-05 00:39:01 +02:00
4969f709cc
#11515 : Merge with 3.1.
2011-03-15 05:59:46 +02:00
42da663e6f
#11515 : fix several typos. Patch by Piotr Kasprzyk.
2011-03-15 05:18:48 +02:00
373089239b
#11515 : Merge with 3.2.
2011-03-15 06:03:08 +02:00
c9723d09eb
use only the hex version, since the revno is unreliable across repos
2011-03-13 16:36:08 -05:00
0d6245dd89
actually get file rev
2011-03-12 18:35:02 -06:00
6cb2b923e0
convert ast versioning to mercurial
2011-03-12 18:28:16 -06:00
b94767ff44
Issue #8914 : fix various warnings from the Clang static analyzer v254.
2011-02-22 20:15:44 +00:00
034c7537d8
Issue #10841 : don't translate newlines for pgen
2011-01-07 18:56:19 +00:00
89e3436606
Issue #10841 : set binary mode on files; the parser translates newlines
...
On Windows, set the binary mode on stdin, stdout, stderr and all
io.FileIO objects (to not translate newlines, \r\n <=> \n). The Python parser
translates newlines (\r\n => \n).
2011-01-07 18:47:22 +00:00
aaa4e9a438
Remove arbitrary string length limits
...
PyUnicode_FromFormat() and PyErr_Format() allocates a buffer of the needed
size, it is no more a fixed-buffer of 500 bytes.
2011-01-05 03:33:26 +00:00
60fe499941
Compile pgenmain.c and printgrammar.c with PGEN defined
2010-12-28 23:05:20 +00:00
83098a4095
Issue #10778 : decoding_fgets() decodes the filename from the filesystem
...
encoding instead of UTF-8.
2010-12-27 20:12:13 +00:00
Eli Bendersky
Benjamin Peterson
Martin v. Löwis
Serhiy Storchaka
Christian Heimes
Victor Stinner
Antoine Pitrou
Ezio Melotti
Mark Dickinson
Matthias Klose
Georg Brandl
Jesus Cea
Tim Golden
Christian Heimes
Armin Ronacher
Meador Inge
Nick Coghlan
Amaury Forgeot d'Arc
Éric Araujo
Victor Stinner
Brett Cannon