025eb98dc0
bpo-34683: Make SyntaxError column offsets consistently 1-indexed (gh-9338)
...
Also point to start of tokens in parsing errors.
Fixes bpo-34683
2018-09-24 14:12:49 -07:00
e502451781
closes bpo-34646: Remove PyAPI_* macros from declarations. (GH-9218)
2018-09-12 12:06:42 -07:00
5061a74a4c
Remove unneeded PyUnicode_READY() in tokenizer.c (GH-9114)
2018-09-10 09:27:31 +03:00
3e26e42c90
bpo-34400: Fix more undefined behavior in parsetok.c (GH-8833)
2018-08-20 20:11:40 -07:00
7c4ab2afb1
closes bpo-34400: Fix undefined behavior in parsetok(). (GH-4439)
...
Avoid undefined pointer arithmetic with NULL.
2018-08-14 23:27:26 -07:00
53b7d4e402
bpo-34170: Add _PyCoreConfig.bytes_warning (GH-8447)
...
Add more fields to _PyCoreConfig:
* _check_hash_pycs_mode
* bytes_warning
* debug
* inspect
* interactive
* legacy_windows_fs_encoding
* legacy_windows_stdio
* optimization_level
* quiet
* unbuffered_stdio
* user_site_directory
* verbose
* write_bytecode
Changes:
* Remove pymain_get_global_config() and pymain_set_global_config()
which became useless. These functions have been replaced by
_PyCoreConfig_GetGlobalConfig() and
_PyCoreConfig_SetGlobalConfig().
* sys.flags.dont_write_bytecode value is now restricted to 1 even if
-B option is specified multiple times on the command line.
* PyThreadState_Clear() now uses the config from the current
interpreter rather than using global Py_VerboseFlag
2018-07-25 01:37:05 +02:00
aba24ff360
bpo-34084: Fix setting an error message for the "Barry as BDFL" easter egg. (GH-8262)
2018-07-23 23:41:11 +03:00
c884616390
Fix Windows compiler warning in tokenize.c (GH-8359)
...
Fix the following warning on Windows:
parser\tokenizer.c(1297): warning C4244: 'function': conversion from
'__int64' to 'int', possible loss of data.
2018-07-21 03:36:06 +02:00
ce75df3031
bpo-30237: Output error when ReadConsole is canceled by CancelSynchronousIo. (GH-7911)
2018-07-19 15:34:03 -07:00
cf7303ed2a
bpo-33305: Improve SyntaxError for invalid numerical literals. (GH-6517)
2018-07-09 15:09:35 +03:00
9b9d58f0d8
bpo-31546: Fix input hook integration (GH-7978)
2018-06-28 09:29:44 -07:00
a5c42284e6
bpo-33677: Fix signatures of tp_clear handlers for AST and deque. (GH-7196)
2018-05-31 07:34:34 +03:00
73cbe7a01a
bpo-32911: Revert bpo-29463. (GH-7121) (GH-7197)
...
Remove the docstring attribute of AST types and restore docstring
expression as a first stmt in their body.
Co-authored-by: INADA Naoki <methane@users.noreply.github.com>
2018-05-29 12:04:55 +03:00
f320be77ff
bpo-32571: Avoid raising unneeded AttributeError and silencing it in C code (GH-5222)
...
Add two new private APIs: _PyObject_LookupAttr() and _PyObject_LookupAttrId()
2018-01-25 17:49:40 +09:00
0a37a30037
closes bpo-32460: ensure all non-static globals have initializers ( #5061 )
2017-12-31 10:04:13 -08:00
598ceae876
bpo-32150: Expand tabs to spaces in C files. ( #4583 )
2017-11-28 17:56:10 +02:00
9e87e7776f
bpo-32096: Remove obj and mem from _PyRuntime ( #4532 )
...
bpo-32096, bpo-30860: Partially revert the commit
2ebc5ce42a8a9e047e790aefbf9a94811569b2b6:
* Move structures back from Include/internal/mem.h to
Objects/obmalloc.c
* Remove _PyObject_Initialize() and _PyMem_Initialize()
* Remove Include/internal/pymalloc.h
* Add test_capi.test_pre_initialization_api():
Make sure that it's possible to call Py_DecodeLocale(), and then call
Py_SetProgramName() with the decoded string, before Py_Initialize().
PyMem_RawMalloc() and Py_DecodeLocale() can be called again before
_PyRuntimeState_Init().
Co-Authored-By: Eric Snow <ericsnowcurrently@gmail.com>
2017-11-24 12:09:24 +01:00
f2ddc6ac93
tokenizer: Remove unused tabs options ( #4422 )
...
Remove the following fields from tok_state structure which are now
used unused:
* altwarning: "Issue warning if alternate tabs don't match"
* alterror: "Issue error if alternate tabs don't match"
* alttabsize: "Alternate tab spacing"
Replace alttabsize variable with ALTTABSIZE define.
2017-11-17 01:25:47 -08:00
f7e5b56c37
bpo-32030: Split Py_Main() into subfunctions ( #4399 )
...
* Don't use "Python runtime" anymore to parse command line options or
to get environment variables: pymain_init() is now a strict
separation.
* Use an error message rather than "crashing" directly with
Py_FatalError(). Limit the number of calls to Py_FatalError(). It
prepares the code to handle errors more nicely later.
* Warnings options (-W, PYTHONWARNINGS) and "XOptions" (-X) are now
only added to the sys module once Python core is properly
initialized.
* _PyMain is now the well identified owner of some important strings
like: warnings options, XOptions, and the "program name". The
program name string is now properly freed at exit.
pymain_free() is now responsible to free the "command" string.
* Rename most methods in Modules/main.c to use a "pymain_" prefix to
avoid conflits and ease debug.
* Replace _Py_CommandLineDetails_INIT with memset(0)
* Reorder a lot of code to fix the initialization ordering. For
example, initializing standard streams now comes before parsing
PYTHONWARNINGS.
* Py_Main() now handles errors when adding warnings options and
XOptions.
* Add _PyMem_GetDefaultRawAllocator() private function.
* Cleanup _PyMem_Initialize(): remove useless global constants: move
them into _PyMem_Initialize().
* Call _PyRuntime_Initialize() as soon as possible:
_PyRuntime_Initialize() now returns an error message on failure.
* Add _PyInitError structure and following macros:
* _Py_INIT_OK()
* _Py_INIT_ERR(msg)
* _Py_INIT_USER_ERR(msg): "user" error, don't abort() in that case
* _Py_INIT_FAILED(err)
2017-11-15 15:48:08 -08:00
bba2239c17
bpo-31572: Get rid of _PyObject_HasAttrId() in the ASDL parser. ( #3725 )
...
Silence only expected AttributeError.
2017-11-11 16:41:32 +02:00
ac317700ce
bpo-30406: Make async and await proper keywords ( #1669 )
...
Per PEP 492, 'async' and 'await' should become proper keywords in 3.7.
2017-10-05 23:24:46 -04:00
b091bec824
bpo-31536: Avoid wholesale rebuild after `make regen-all` ( #3678 )
...
* bpo-31536: Avoid wholesale rebuild after `make regen-all`
* Add NEWS
2017-09-20 14:57:56 -07:00
5d84cb368c
bpo-31464: asdl_c.py no longer emits trailing spaces in Python-ast.h. ( #3568 )
2017-09-14 20:28:22 -07:00
b2e5794870
bpo-31338 ( #3374 )
...
* Add Py_UNREACHABLE() as an alias to abort().
* Use Py_UNREACHABLE() instead of assert(0)
* Convert more unreachable code to use Py_UNREACHABLE()
* Document Py_UNREACHABLE() and a few other macros.
2017-09-14 18:13:16 -07:00
2ebc5ce42a
bpo-30860: Consolidate stateful runtime globals. ( #3397 )
...
* group the (stateful) runtime globals into various topical structs
* consolidate the topical structs under a single top-level _PyRuntimeState struct
* add a check-c-globals.py script that helps identify runtime globals
Other globals are excluded (see globals.txt and check-c-globals.py).
2017-09-07 23:51:28 -06:00
a6a4dc816d
bpo-31370: Remove support for threads-less builds ( #3385 )
...
* Remove Setup.config
* Always define WITH_THREAD for compatibility.
2017-09-07 18:56:24 +02:00
05351c1bd8
Revert "bpo-30860: Consolidate stateful runtime globals." ( #3379 )
...
Windows buildbots started failing due to include-related errors.
2017-09-05 21:43:08 -07:00
76d5abc868
bpo-30860: Consolidate stateful runtime globals. ( #2594 )
...
* group the (stateful) runtime globals into various topical structs
* consolidate the topical structs under a single top-level _PyRuntimeState struct
* add a check-c-globals.py script that helps identify runtime globals
Other globals are excluded (see globals.txt and check-c-globals.py).
2017-09-05 18:26:16 -07:00
a6296d34a4
bpo-31095: fix potential crash during GC (GH-2974)
2017-08-24 14:55:17 +09:00
2af565baf4
Fix a shadow-compatible-local warning ( #2180 )
...
Change the shadowing naming, 'value' (Python-ast.c:4652), to 'val'
to prevent the variables from being misused.
2017-08-04 10:53:12 -07:00
c9ccacea3f
bpo-25324: add missing comma in Parser/tokenizer.c (GH-1910)
2017-06-01 13:51:27 -07:00
fc354f0785
bpo-25324: copy tok_name before changing it ( #1608 )
...
* add test to check if were modifying token
* copy list so import tokenize doesnt have side effects on token
* shorten line
* add tokenize tokens to token.h to get them to show up in token
* move ERRORTOKEN back to its previous location, and fix nitpick
* copy comments from token.h automatically
* fix whitespace and make more pythonic
* change to fix comments from @haypo
* update token.rst and Misc/NEWS
* change wording
* some more wording changes
2017-05-31 16:00:21 +02:00
cf1958af4c
Remove obsolete declaration in tokenizer.h ( #962 )
2017-04-03 19:18:32 +03:00
0b3ec19225
Use NULL rather than 0. ( #778 )
...
There was few cases of using literal 0 instead of NULL in the context of
pointers. While this was a legitimate C code, using NULL rather than 0 makes
the code clearer.
2017-03-23 17:53:47 +02:00
4c78c527d2
bpo-29622: Make AST constructor to accept less than enough number of positional arguments (GH-249)
...
bpo-29463 added optional "docstring" field to 4 AST types.
While it is optional, it breaks backward compatibility because AST constructor
requires number of positional argument is same to number of fields.
AST types accepts empty arguments, and incomplete keyword arguments.
But it's not big problem because field can be filled after creation, and checked when compiling.
So stop requiring complete set of fields for positional arguments too.
2017-02-24 02:48:17 +09:00
cb41b2766d
bpo-29463: Add docstring field to some AST nodes. ( #46 )
...
* bpo-29463: Add docstring field to some AST nodes.
ClassDef, ModuleDef, FunctionDef, and AsyncFunctionDef has docstring
field for now. It was first statement of there body.
* fix document. thanks travis!
* doc fixes
2017-02-22 16:31:59 +01:00
d2f4404bbb
Issue #28489 : Merge from 3.6
2017-02-05 04:33:11 +03:00
6f80562862
Issue #28489 : Fix comment in tokenizer.c
...
Patch by Ryan Gonzalez.
2017-02-05 04:32:39 +03:00
fc489082c8
Issue #29369 : Use Py_IDENTIFIER in Python-ast.c
2017-01-25 22:33:43 +09:00
a5ed5f000a
Use _PyObject_CallNoArg()
...
Replace:
PyObject_CallObject(callable, NULL)
with:
_PyObject_CallNoArg(callable)
2016-12-06 18:45:50 +01:00
06515833fe
Replaced outdated macros _PyUnicode_AsString and _PyUnicode_AsStringAndSize
...
with PyUnicode_AsUTF8 and PyUnicode_AsUTF8AndSize.
2016-11-20 09:13:07 +02:00
6c2b9d3479
Issue #28333 : Fixes off-by-one error that was adding an extra space.
2016-10-25 11:51:54 -07:00
59bd34fa8a
Issue #28333 : Remove unnecessary increment.
2016-10-08 12:20:45 -07:00
3cd187b9f5
Issue #28333 : Enables Unicode for ps1/ps2 and input() prompts. (Patch by Eryk Sun)
2016-10-08 12:18:16 -07:00
5e80855af3
Issue #24098 : Fixed possible crash when AST is changed in process of
...
compiling it.
2016-10-07 21:55:49 +03:00
cf3806026b
Issue #24098 : Fixed possible crash when AST is changed in process of
...
compiling it.
2016-10-07 21:51:28 +03:00
e2e792d98f
merge 3.5 ( #28184 )
2016-09-19 22:17:16 -07:00
f5e8e8fc2b
merge 3.5 ( #24022 )
2016-09-18 23:44:02 -07:00
57bda335e1
merge 3.4
2016-09-18 23:43:18 -07:00
26d998cfdd
properly handle the single null-byte file ( closes #24022 )
2016-09-18 23:41:11 -07:00
9ac11a752a
properly free memory in pgen
2016-09-18 18:00:25 -07:00
5a715cfc57
merge 3.5 ( #27981 )
2016-09-12 22:07:14 -07:00
35ee948fa5
restructure fp_setreadl so as to avoid refleaks ( closes #27981 )
2016-09-12 22:06:58 -07:00
a721abac29
Issue #26331 : Implement the parsing part of PEP 515.
...
Thanks to Georg Brandl for the patch.
2016-09-09 14:57:09 -07:00
52c4e7cc84
Issue #28008 : Implement PEP 530 -- asynchronous comprehensions.
2016-09-09 10:36:01 -07:00
f8cb8a16a3
Issue #27985 : Implement PEP 526 -- Syntax for Variable Annotations.
...
Patch by Ivan Levkivskyi.
2016-09-08 20:50:03 -07:00
c6cc23d0b9
Skip unused value in tokenizer code
...
In the case of an escape character, c is never read. tok_next() is
used to advance the pointer.
CID 1225097
2016-09-09 00:09:45 +02:00
3929499914
Issue #1602 : Windows console doesn't input or print Unicode (PEP 528)
...
Closes #17602 : Adds a readline implementation for the Windows console
2016-08-30 21:22:36 -07:00
940f33a50f
Issue #23524 : Finish removing _PyVerify_fd from sources
2016-09-08 11:21:54 -07:00
2f8bfef158
replace PY_SIZE_MAX with SIZE_MAX
2016-09-07 09:26:18 -07:00
ca47063998
replace Py_(u)intptr_t with the c99 standard types
2016-09-06 13:47:26 -07:00
4bb31e90f0
Fix a clang warning in grammar.c
...
Clang is smarter than GCC and emits a warning for dead code after a function
declared with __attribute__((__noreturn__)) (Py_FatalError).
2016-08-19 15:11:56 +02:00
531396c764
Issue #27336 : Fix compilation failures --without-threads
2016-06-17 13:25:01 +03:00
ec39756960
Issue #22570 : Renamed Py_SETREF to Py_XSETREF.
2016-04-06 09:50:03 +03:00
48842714b9
Issue #22570 : Renamed Py_SETREF to Py_XSETREF.
2016-04-06 09:45:48 +03:00
2a65ecb780
Issue #26130 : Remove redundant variable 's' from Parser/parser.c
...
Patch by Oren Milman.
2016-03-28 00:45:28 +03:00
7285d520e0
remove duplicated check for fractions and complex numbers ( closes #26076 )
...
Patch by Oren Milman.
2016-03-24 22:43:23 -07:00
a051bf3afb
Issue #26581 : Use the first coding cookie on a line, not the last one.
2016-03-20 23:47:48 +02:00
e431d3c9aa
Issue #26581 : Use the first coding cookie on a line, not the last one.
2016-03-20 23:36:29 +02:00
0611c26a58
On memory error, dump the memory block traceback
...
Issue #26564 : _PyObject_DebugDumpAddress() now dumps the traceback where a
memory block was allocated on memory block. Use the tracemalloc module to get
the traceback.
2016-03-15 22:22:13 +01:00
8a1be61849
Add more checks on the GIL
...
Issue #10915 , #15751 , #26558 :
* PyGILState_Check() now returns 1 (success) before the creation of the GIL and
after the destruction of the GIL. It allows to use the function early in
Python initialization and late in Python finalization.
* Add a flag to disable PyGILState_Check(). Disable PyGILState_Check() when
Py_NewInterpreter() is called
* Add assert(PyGILState_Check()) to: _Py_dup(), _Py_fstat(), _Py_read()
and _Py_write()
2016-03-14 22:07:55 +01:00
25219f596a
Issue #26146 : remove useless code
...
obj2ast_constant() code is baesd on obj2ast_object() which has a special case
for Py_None. But in practice, we don't need to have a special case for
constants.
Issue noticed by Joseph Jevnik on a review.
2016-01-27 00:37:59 +01:00
f2c1aa1661
Add ast.Constant
...
Issue #26146 : Add a new kind of AST node: ast.Constant. It can be used by
external AST optimizers, but the compiler does not emit directly such node.
An optimizer can replace the following AST nodes with ast.Constant:
* ast.NameConstant: None, False, True
* ast.Num: int, float, complex
* ast.Str: str
* ast.Bytes: bytes
* ast.Tuple if items are constants too: tuple
* frozenset
Update code to accept ast.Constant instead of ast.Num and/or ast.Str:
* compiler
* docstrings
* ast.literal_eval()
* Tools/parser/unparse.py
2016-01-26 00:40:57 +01:00
ef1585eb9a
Issue #25923 : Added more const qualifiers to signatures of static and private functions.
2015-12-25 20:01:53 +02:00
2d06e84455
Issue #25923 : Added the const qualifier to static constant arrays.
2015-12-25 19:53:18 +02:00
f006940351
Issue #20440 : Massive replacing unsafe attribute setting code with special
...
macro Py_SETREF.
2015-12-24 10:39:57 +02:00
5a57ade58e
Issue #20440 : Massive replacing unsafe attribute setting code with special
...
macro Py_SETREF.
2015-12-24 10:35:59 +02:00
0304729ec4
Issue #25388 : Fixed tokenizer crash when processing undecodable source code
...
with a null byte.
2015-11-14 15:12:04 +02:00
7e2b870b85
Issue #25388 : Fixed tokenizer crash when processing undecodable source code
...
with a null byte.
2015-11-14 15:11:17 +02:00
0d441119f5
Issue #25388 : Fixed tokenizer crash when processing undecodable source code
...
with a null byte.
2015-11-14 15:10:35 +02:00
f9827ea618
Issue #25555 : Fix parser and AST: fill lineno and col_offset of "arg" node when
...
compiling AST from Python objects.
2015-11-06 17:01:48 +01:00
c106c68aeb
Issue #25555 : Fix parser and AST: fill lineno and col_offset of "arg" node when
...
compiling AST from Python objects.
2015-11-06 17:01:48 +01:00
860c8a404a
merge 3.5 ( #25502 )
2015-10-28 23:15:22 -07:00
669ff66c32
remove duplicated imports ( closes #25502 )
2015-10-28 23:15:13 -07:00
fc632e3912
Merge with 3.5.
2015-10-06 18:52:52 +03:00
235a6f0984
Issue #24965 : Implement PEP 498 "Literal String Interpolation". Documentation is still needed, I'll open an issue for that.
2015-09-19 14:51:32 -04:00
6408dc82fa
Fixed indentation.
2015-09-12 18:53:36 -04:00
481d3af82e
Make asdl_c.py to generate Python-ast.c changed in issue #15989 .
2015-09-06 23:29:04 +03:00
96ec934e75
Issue #24619 : Simplify async/await tokenization.
...
This commit simplifies async/await tokenization in tokenizer.c,
tokenize.py & lib2to3/tokenize.py. Previous solution was to keep
a stack of async-def & def blocks, whereas the new approach is just
to remember position of the outermost async-def block.
This change won't bring any parsing performance improvements, but
it makes the code much easier to read and validate.
2015-07-23 15:01:58 +03:00
8fb307cd65
Issue #24619 : New approach for tokenizing async/await.
...
This commit fixes how one-line async-defs and defs are tracked
by tokenizer. It allows to correctly parse invalid code such
as:
>>> async def f():
... def g(): pass
... async = 10
and valid code such as:
>>> async def f():
... async def g(): pass
... await z
As a consequence, is is now possible to have one-line
'async def foo(): await ..' functions:
>>> async def foo(): return await bar()
2015-07-22 13:33:45 +03:00
8085b80c18
Issue 24226: Fix parsing of many sequential one-line 'def' statements.
2015-05-18 12:50:52 -04:00
7544508f02
PEP 0492 -- Coroutines with async and await syntax. Issue #24017 .
2015-05-11 22:57:16 -04:00
025e9ebd0a
PEP 448: additional unpacking generalizations ( closes #2292 )
...
Patch by Neil Girdhar.
2015-05-05 20:16:41 -04:00
273a720f87
merge 3.4 ( #24022 )
2015-04-21 12:07:06 -04:00
d73aca769f
do not call into python api if an exception is set ( #24022 )
2015-04-21 12:05:19 -04:00
45ec3288d0
Removed trailing whitespaces in miscalenous files.
2015-04-03 19:42:32 +03:00
a8cd4d482f
Got rid of warnings "suggest braces around empty body in an ‘else’ statement"
...
in Parser/pgen.c.
2015-04-03 15:24:33 +03:00
df1b699447
Issue #22823 : Use set literals instead of creating a set from a list
2014-11-09 15:56:33 -08:00
67c719b34b
Silenced some warnings about comparison between signed and unsigned integer
...
expressions.
2014-09-05 10:10:23 +03:00
416b516d46
Fix bootstrapping asdl -- it didn't work with Python 2.7.
2014-07-08 16:22:48 -07:00
3e439797ba
merge 3.4 ( #21642 )
2014-06-07 12:39:51 -07:00
c416162302
allow the keyword else immediately after (no space) an integer ( closes #21642 )
2014-06-07 12:36:39 -07:00
5e3d338a74
Issue #19655 : Replace the ASDL parser carried with CPython
...
The new parser does not rely on Spark (which is now removed from our repo),
uses modern 3.x idioms and is significantly smaller and simpler.
It generates exactly the same AST files (.h and .c), so in practice no builds
should be affected.
2014-05-09 17:58:22 -07:00
d51374ed78
PEP 465: a dedicated infix operator for matrix multiplication ( closes #21176 )
2014-04-09 23:55:56 -04:00
78f1e4c865
Merge with 3.3
2014-02-28 15:43:36 +01:00
815b41b1cd
Issue #20731 : Properly position in source code files even if they
...
are opened in text mode. Patch by Serhiy Storchaka.
2014-02-28 15:27:29 +01:00
42ec031fe7
merge 3.3 ( #20588 )
2014-02-10 22:41:40 -05:00
c2f665e721
don't put runtime values in array initializer for C89 compliance ( closes #20588 )
2014-02-10 22:19:02 -05:00
5940b92909
Do not reset the line number because we already set file position to correct
...
value.
(fixes error in patch for issue #18960 )
2014-01-09 20:13:52 +02:00
1064a13bb0
Do not reset the line number because we already set file position to correct
...
value.
(fixes error in patch for issue #18960 )
2014-01-09 20:12:49 +02:00
7282ff6d5b
Issue #18960 : Fix bugs with Python source code encoding in the second line.
...
* The first line of Python script could be executed twice when the source
encoding (not equal to 'utf-8') was specified on the second line.
* Now the source encoding declaration on the second line isn't effective if
the first line contains anything except a comment.
* As a consequence, 'python -x' works now again with files with the source
encoding declarations specified on the second file, and can be used again
to make Python batch files on Windows.
* The tokenize module now ignore the source encoding declaration on the second
line if the first line contains anything except a comment.
* IDLE now ignores the source encoding declaration on the second line if the
first line contains anything except a comment.
* 2to3 and the findnocoding.py script now ignore the source encoding
declaration on the second line if the first line contains anything except
a comment.
2014-01-09 18:41:59 +02:00
768c16ce02
Issue #18960 : Fix bugs with Python source code encoding in the second line.
...
* The first line of Python script could be executed twice when the source
encoding (not equal to 'utf-8') was specified on the second line.
* Now the source encoding declaration on the second line isn't effective if
the first line contains anything except a comment.
* As a consequence, 'python -x' works now again with files with the source
encoding declarations specified on the second file, and can be used again
to make Python batch files on Windows.
* The tokenize module now ignore the source encoding declaration on the second
line if the first line contains anything except a comment.
* IDLE now ignores the source encoding declaration on the second line if the
first line contains anything except a comment.
* 2to3 and the findnocoding.py script now ignore the source encoding
declaration on the second line if the first line contains anything except
a comment.
2014-01-09 18:36:09 +02:00
af01f66817
Issue #16136 : Remove VMS support and VMS-related code
2013-12-21 16:19:10 +01:00
724b828e79
upcast int to size_t to silence two autological-constant-out-of-range-compare warnings with clang.
2013-12-04 08:42:46 +01:00
cad876d542
Fix a compiler warning on Windows 64-bit in parsetok.c
...
Python parser doesn't support lines longer than INT_MAX bytes yet
2013-11-18 01:09:51 +01:00
3a8a333942
Fix compiler warnings on Windows 64-bit in grammar.c
...
INT_MAX states and labels should be enough for everyone
2013-11-18 01:07:38 +01:00
c679227e31
Issue #1772673 : The type of `char*` arguments now changed to `const char*`.
2013-10-19 21:03:34 +03:00
c548660af5
Issue #16742 : My fix on PyOS_StdioReadline() was incomplete, PyMem_FREE() was
...
not patched
2013-10-19 02:40:16 +02:00
d01d396e7f
Issue #4555 : All exported C symbols are now prefixed with either "Py" or "_Py".
...
("make smelly" now clean)
2013-10-12 22:52:43 +02:00
2fe9bac4dc
Close #16742 : Fix misuse of memory allocations in PyOS_Readline()
...
The GIL must be held to call PyMem_Malloc(), whereas PyOS_Readline() releases
the GIL to read input.
The result of the C callback PyOS_ReadlineFunctionPointer must now be a string
allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL if an error
occurred), instead of a string allocated by PyMem_Malloc() or PyMem_Realloc().
Fixing this issue was required to setup a hook on PyMem_Malloc(), for example
using the tracemalloc module.
PyOS_Readline() copies the result of PyOS_ReadlineFunctionPointer() into a new
buffer allocated by PyMem_Malloc(). So the public API of PyOS_Readline() does
not change.
2013-10-10 16:18:20 +02:00
1891cff587
Move open outside try/finally
2013-09-26 09:35:39 -07:00
99081238e9
Don't use fancy new Python features like 'with' - some bots don't have them
...
and can't bootstrap the parser.
2013-09-26 06:41:36 -07:00
58fe1b1307
Normalize whitespace
2013-09-26 06:32:22 -07:00
b788a385cd
Small fixes in Parser/asdl.py - no change in functionality.
...
1. Make it work when invoked directly from the command-line. It was failing
due to a couple of stale function/class usages in the __main__ section.
2. Close the parsed file in the parse() function after opening it.
2013-09-26 06:31:32 -07:00
daf455554b
Issue #18571 : Implementation of the PEP 446: file descriptors and file handles
...
are now created non-inheritable; add functions os.get/set_inheritable(),
os.get/set_handle_inheritable() and socket.socket.get/set_inheritable().
2013-08-28 00:53:59 +02:00
14e461d5b9
Close #11619 : The parser and the import machinery do not encode Unicode
...
filenames anymore on Windows.
2013-08-26 22:28:21 +02:00
d640fe2af5
#18803 : merge with 3.3.
2013-08-26 01:33:30 +03:00
7c4a7e6f3c
#18803 : fix more typos. Patch by Févry Thibault.
2013-08-26 01:32:56 +03:00
9ed5f27266
Issue #18722 : Remove uses of the "register" keyword in C code.
2013-08-13 20:18:52 +02:00
73207e03ad
Issue #18368 : PyOS_StdioReadline() no longer leaks memory when realloc() fails.
2013-08-06 16:03:33 +02:00
9ae513caa7
Issue #18368 : PyOS_StdioReadline() no longer leaks memory when realloc() fails.
2013-08-06 15:59:16 +02:00
1289565f4b
Silence warning about set but unused variable inside compile_atom() in non-debug builds
2013-07-31 23:48:04 +02:00
5e4d372524
Silence warning about set but unused variable inside compile_atom() in non-debug builds
2013-07-31 23:47:56 +02:00
b7f1b38dea
Issue #18552 : Check return value of PyArena_AddPyObject() in obj2ast_object().
2013-07-27 00:33:35 +02:00
70c94e7896
Issue #18552 : Check return value of PyArena_AddPyObject() in obj2ast_object().
2013-07-27 00:33:13 +02:00
b318990cac
(Merge 3.3) Parser/asdl_c.py: use Py_CLEAR()
2013-07-27 00:04:42 +02:00
1acc129d48
Parser/asdl_c.py: use Py_CLEAR()
2013-07-27 00:03:47 +02:00
ee4b59c0f8
(Merge 3.3) According to the PEP 7, C code must "use 4-space indents"
...
Replace 8 spaces with 4.
2013-07-27 00:01:35 +02:00
ce72e1ce6c
According to the PEP 7, C code must "use 4-space indents"
...
Replace 8 spaces with 4.
2013-07-27 00:00:36 +02:00
7b3902a20f
Some compilers complain about 'control reaches end of non-void function'
...
because they don't understand that Py_FatalError() terminates the program.
2013-07-22 16:34:28 +02:00
1eb0cb12ac
Some compilers complain about 'control reaches end of non-void function'
...
because they don't understand that Py_FatalError() terminates the program.
2013-07-22 16:34:13 +02:00
826b754e32
Add sanity check to PyGrammar_LabelRepr() in order to catch invalid tokens when debugging
...
a new grammar.
CID 715360
2013-07-22 10:30:45 +02:00
53d2dc4045
Add sanity check to PyGrammar_LabelRepr() in order to catch invalid tokens when debugging
...
a new grammar.
CID 715360
2013-07-22 10:30:14 +02:00
bdf630c4a7
Issue #18408 : Fix Python-ast.c: handle init_types() failure (ex: MemoryError)
2013-07-17 00:17:15 +02:00
cb2226cb69
merge 3.3
2013-07-15 20:50:25 -07:00
265fba40c8
move declaration to top of block
2013-07-15 20:50:22 -07:00
fd9c0203de
merge 3.3 ( closes #18470 )
2013-07-15 20:47:47 -07:00
2dbfd88245
check the return value of new_string() ( closes #18470 )
2013-07-15 19:15:34 -07:00
526daabf34
Issue #18408 : parsetok() must not write into stderr on memory allocation error
...
The caller gets an error code and can raise a classic Python exception.
2013-07-11 23:17:33 +02:00
3bf5f530d9
Issue #18408 : parsetok() must not write into stderr on memory allocation error
...
The caller gets an error code and can raise a classic Python exception.
2013-07-11 22:52:19 +02:00
22ed7fe906
Fix resource leak in parser, free node ptr
...
CID 1028068 (#1 of 1): Resource leak (RESOURCE_LEAK)
leaked_storage: Variable n going out of scope leaks the storage it points to.
2013-06-29 21:03:51 +02:00
9670543a00
Issue #18038 : SyntaxError raised during compilation sources with illegal
...
encoding now always contains an encoding name.
2013-06-09 16:53:55 +03:00
3af14aaba5
Issue #18038 : SyntaxError raised during compilation sources with illegal
...
encoding now always contains an encoding name.
2013-06-09 16:51:52 +03:00
796977360f
Issue #9566 : Fix compiler warning on Windows 64-bit
2013-06-05 00:44:00 +02:00
8d89c2aaba
change AST codegen to use PyModule_AddIntMacro
2013-05-20 10:28:48 -07:00
7654ab9ef0
placate msvc
2013-03-18 23:39:53 -07:00
b72406b8fa
refactor to fix refleaks
2013-03-18 23:24:41 -07:00
cda75be02a
unify some ast.argument's attrs; change Attribute column offset ( closes #16795 )
...
Patch from Sven Brauch.
2013-03-18 10:48:58 -07:00
b26a9b10ea
Replace WaitForSingleObject with WaitForSingleObjectEx,
...
for better WinRT compatibility.
2013-01-25 14:25:48 +01:00
442f20996d
create NameConstant AST class for None, True, and False literals ( closes #16619 )
2012-12-06 17:41:04 -05:00
073f067369
Issue #16546 : merge fix from 3.3
2012-11-25 14:37:43 +00:00
ded35aeb9d
Issue #16546 : make ast.YieldFrom argument mandatory.
2012-11-25 14:36:26 +00:00
742b2f8d7a
make PyGrammar_LabelRepr return a const char * ( closes #16369 )
2012-10-31 13:36:13 -04:00
d0845588b8
make _PyParser_TokenNames const
2012-10-24 08:21:52 -07:00
aee3c76acf
- Issue #16262 : fix out-of-src-tree builds, if mercurial is not installed.
2012-10-21 23:12:35 +02:00
8a9cc526fe
#15923 : merge with 3.2.
2012-09-30 22:47:47 +03:00
cb2916a714
#15923 : fix a mistake in asdl_c.py that resulted in a TypeError after 2801bf875a24 (see #15801 ).
2012-09-30 22:41:37 +03:00
ca8aa4acf6
Issue #15144 : Fix possible integer overflow when handling pointers as integer values, by using Py_uintptr_t instead of size_t.
...
Patch by Serhiy Storchaka.
2012-09-20 20:56:47 +02:00
cc98887e45
Remove unused variables in parsetok().
2012-08-11 11:16:18 +02:00
88ca04e6a8
MERGE: Closes #15512 : Correct __sizeof__ support for parser
2012-08-03 14:29:26 +02:00
e9c5318967
Closes #15512 : Correct __sizeof__ support for parser
2012-08-03 14:28:37 +02:00
481ae50ccd
construct fields in the right order ( closes #15517 )
...
Patch from Taihyun Hwang.
2012-07-31 21:41:56 -07:00
8107176f9b
add gc support to the AST base type ( closes #15293 )
2012-07-08 11:03:46 -07:00
507507473e
Issue #15291 : Fix a memory leak where AST nodes where not properly deallocated.
2012-07-08 12:43:32 +02:00
035997f1a3
Issue #1677 : Unused variable warning in Non-Windows
2012-07-03 13:15:03 +02:00
9175c3d804
Issue #1677 : Handle better a race condition between the interactive interpreter and
...
the Ctrl-C signal handler on Windows
2012-06-29 18:39:26 +01:00
b92b757eed
Issue #1677 : Handle better a race condition between the interactive interpreter and
...
the Ctrl-C signal handler on Windows
2012-06-29 18:27:08 +01:00
0b3847de6d
Issue #15096 : Drop support for the ur string prefix
2012-06-20 11:17:58 +02:00
77fa9379e2
use Py_ssize_t for ast sequence lengths
2012-05-15 10:10:27 -07:00
ce58ed3e7c
Merge with 3.2: issue #14433
2012-04-30 06:20:37 +02:00
e654c11f56
Issue #14433 : Prevent msvcrt crash in interactive prompt when stdin is closed.
2012-04-30 06:10:41 +02:00
1767e0274b
free AST's dict
2012-03-14 21:50:29 -05:00
45e50de1f5
Try to fix compilation of Python-ast.c on Visual Studio 2008
2012-03-13 01:17:31 +01:00
7e0dbfbbde
give the AST class a __dict__
2012-03-12 09:46:44 -07:00
6ecf77b3f8
Basic support for PEP 414 without docs or tests.
2012-03-04 12:04:06 +00:00
cff9237d57
check after comments, too ( #13832 )
2012-01-19 17:46:13 -05:00
188bee5873
don't leak node
2012-01-19 08:48:18 -05:00
79c1f96438
only check this when parsing python
2012-01-19 08:48:11 -05:00
fa21bf015d
Issue #12705 : Raise SyntaxError when compiling multiple statements as single interactive statement
2012-01-19 01:08:41 -06:00
8d5a62df10
murder tabs
2012-01-16 09:54:28 -05:00
527c622926
make YieldFrom its own distinct from Yield ( closes #13780 )
2012-01-14 08:58:23 -05:00
1f7ce62bd6
Implement PEP 380 - 'yield from' ( closes #11682 )
2012-01-13 21:43:40 +10:00
3a5d4cb940
Issue #13748 : Raw bytes literals can now be written with the `rb` prefix as well as `br`.
2012-01-12 22:46:19 +01:00
f51d36a743
evidently some buildbots don't have python 3 installed
2011-12-29 12:07:21 -06:00
3ab85886d6
run AST toolchain on python3
2011-12-29 12:03:55 -06:00
ab0e9f7089
Issue #10350 : Read and save errno before calling a function which might overwrite it.
...
Original patch by Hallvard B Furuseth.
2011-12-16 12:29:37 +01:00
c345ce1a69
Issue #10350 : Read and save errno before calling a function which might overwrite it.
...
Original patch by Hallvard B Furuseth.
2011-12-16 12:28:32 +01:00
942d5ba125
Merge branch 3.2
2011-11-22 22:02:01 +01:00
58e8761da6
Issue #13436 : Fix a bogus error message when an AST object was passed
...
an invalid integer value.
2011-11-22 21:51:55 +01:00
f364e7b598
Fix memory leak with FLUFL-related syntax errors (!)
2011-11-13 01:02:02 +01:00
9ec2593bda
Fix memory leak with FLUFL-related syntax errors (!)
2011-11-13 01:01:23 +01:00
70d86bdef1
Issue 13243: Rename _Py_identifier to _Py_IDENTIFIER in asdl_c.py
...
Parser/asdl_c.py was missed in commit 7109f31300fb when _Py_identifier
was replaced with _Py_IDENTIFIER. Thanks to Eric Snow for the patch.
2011-10-22 14:06:50 -05:00
1c67dd9b15
Port SetAttrString/HasAttrString to SetAttrId/GetAttrId.
2011-10-14 15:16:45 +02:00
bd928fef42
Rename _Py_identifier to _Py_IDENTIFIER.
2011-10-14 10:20:37 +02:00
1ee1b6fe0d
Use identifier API for PyObject_GetAttrString.
2011-10-10 18:11:30 +02:00
afe55bba33
Add API for static strings, primarily good for identifiers.
...
Thanks to Konrad Schöbel and Jasper Schulz for helping with the mass-editing.
2011-10-09 10:38:36 +02:00
d63a3b8beb
Implement PEP 393.
2011-09-28 07:41:54 +02:00
6f08f53e79
Merge 3.2
2011-09-02 17:32:30 +02:00
0224d4e699
accept bytes for the AST 'string' type
...
This is a temporary kludge and all is well in 3.3.
2011-08-31 22:13:03 -04:00
5a3f49bb7e
revert code which conditionally writes Python-ast.h ( closes #12727 )
2011-08-11 14:42:28 -05:00
257a1d0f28
2.x syntax
2011-08-09 18:48:02 -05:00
4ec450d3c7
make this work on 2.4
2011-08-09 18:38:57 -05:00
6f7500424c
make this work with py2.5
2011-08-09 16:49:52 -05:00
398256b230
don't rewrite the header file if it hasn't changed; this reduces development build time
2011-08-09 16:28:58 -05:00
4dc6499613
the bool asdl type died a while ago
2011-08-09 16:10:09 -05:00
e249841903
add a asdl bytes type, so Bytes.s be properly typechecked
2011-08-09 16:08:39 -05:00
8a4b42b7f4
merge 3.2
2011-07-22 11:10:43 -05:00
180e63507d
None is ok for identifiers but not strings
2011-07-22 11:09:07 -05:00
86f088e8e5
merge 3.2
2011-07-22 10:55:02 -05:00
2193d2b72b
type check AST strings and identifiers
...
This is related to a21829180423 as well as #12609 and #12610 .
2011-07-22 10:50:23 -05:00
efad2449fc
hardcode the old svn __version__
2011-07-22 10:39:12 -05:00
0bd152cd67
remove ast.__version__ ( closes #12273 )
2011-07-15 21:10:13 -05:00
620b2c8c98
comment which is not applicable anymore
2011-07-15 15:27:34 -05:00
0c1036270d
remove intrcheck.c, which hasn't been used for years
2011-06-20 19:22:34 -05:00
0c9f31b4c0
(Merge 3.2) Issue #12016 : my_fgets() now always clears errors before calling
...
fgets(). Fix the following case: sys.stdin.read() stopped with CTRL+d (end of
file), raw_input() interrupted by CTRL+c.
2011-05-30 23:47:01 +02:00
4f71101eed
Issue #12016 : my_fgets() now always clears errors before calling fgets(). Fix
...
the following case: sys.stdin.read() stopped with CTRL+d (end of file),
raw_input() interrupted by CTRL+c.
2011-05-30 23:46:00 +02:00
758888d437
don't restrict unexpected EOF errors to the first line ( closes #12216 )
2011-05-30 11:12:38 -05:00
43af12b0b4
unify TryExcept and TryFinally ( closes #12199 )
2011-05-29 11:43:10 -05:00
bf1bbc1452
reflect with statements with multiple items in the AST ( closes #12106 )
2011-05-27 13:58:08 -05:00
00c5925533
(Merge 3.2) Issue #1195 : Fix input() if it is interrupted by CTRL+d and then
...
CTRL+c, clear the end-of-file indicator after CTRL+d.
2011-05-10 00:21:26 +02:00
db932786af
Issue #1195 : Fix input() if it is interrupted by CTRL+d and then CTRL+c, clear
...
the end-of-file indicator after CTRL+d.
2011-05-10 00:20:35 +02:00
4755ab010f
Issue #1195 : Fix input() if it is interrupted by CTRL+d and then CTRL+c,
...
clear the end-of-file indicator after CTRL+d.
2011-05-10 00:19:53 +02:00
c1935d2abf
Revert bb62908896fe, but keep the test
2011-04-25 04:03:58 +02:00
88f7841be7
Correctly merging #9319 into 3.3?
2011-04-25 03:46:43 +02:00
c68b6aaec8
Issue #9319 : Fix a crash on parsing a Python source code without encoding
...
cookie and not valid in UTF-8: use "<file>" as the filename instead of
reading from NULL.
2011-04-23 00:41:19 +02:00
4ae3b447c8
(Merge 3.2) Issue #11650 : PyOS_StdioReadline() retries fgets() if it was
...
interrupted (EINTR), for example if the program is stopped with CTRL+z on Mac
OS X. Patch written by Charles-Francois Natali.
2011-04-09 16:01:55 +02:00
a870e35a7d
(Merge 3.1) Issue #11650 : PyOS_StdioReadline() retries fgets() if it was
...
interrupted (EINTR), for example if the program is stopped with CTRL+z on Mac
OS X. Patch written by Charles-Francois Natali.
2011-04-09 15:59:25 +02:00
52c950f229
Issue #11650 : PyOS_StdioReadline() retries fgets() if it was interrupted
...
(EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch
written by Charles-Francois Natali.
2011-04-09 15:55:44 +02:00
fe7c5b5bdf
Issue #9319 : Include the filename in "Non-UTF8 code ..." syntax error.
2011-04-05 01:48:03 +02:00
7f2fee3640
Issue #10785 : Store the filename as Unicode in the Python parser.
2011-04-05 00:39:01 +02:00
4969f709cc
#11515 : Merge with 3.1.
2011-03-15 05:59:46 +02:00
42da663e6f
#11515 : fix several typos. Patch by Piotr Kasprzyk.
2011-03-15 05:18:48 +02:00
373089239b
#11515 : Merge with 3.2.
2011-03-15 06:03:08 +02:00
c9723d09eb
use only the hex version, since the revno is unreliable across repos
2011-03-13 16:36:08 -05:00
0d6245dd89
actually get file rev
2011-03-12 18:35:02 -06:00
6cb2b923e0
convert ast versioning to mercurial
2011-03-12 18:28:16 -06:00
b94767ff44
Issue #8914 : fix various warnings from the Clang static analyzer v254.
2011-02-22 20:15:44 +00:00
034c7537d8
Issue #10841 : don't translate newlines for pgen
2011-01-07 18:56:19 +00:00
89e3436606
Issue #10841 : set binary mode on files; the parser translates newlines
...
On Windows, set the binary mode on stdin, stdout, stderr and all
io.FileIO objects (to not translate newlines, \r\n <=> \n). The Python parser
translates newlines (\r\n => \n).
2011-01-07 18:47:22 +00:00
aaa4e9a438
Remove arbitrary string length limits
...
PyUnicode_FromFormat() and PyErr_Format() allocates a buffer of the needed
size, it is no more a fixed-buffer of 500 bytes.
2011-01-05 03:33:26 +00:00
Ammar Askar
Benjamin Peterson
Zackery Spytz
Victor Stinner
Serhiy Storchaka
ValeriyaSinevich
Thomas A Caswell
Victor Stinner
Jelle Zijlstra
Antoine Pitrou
Barry Warsaw
Eric Snow
INADA Naoki
Yuan Chao Chou
Albert-Jan Nijburg
Jim Fasarakis-Hilliard
Berker Peksag
INADA Naoki
Steve Dower
Brett Cannon
Yury Selivanov
Christian Heimes
Eric V. Smith
Yury Selivanov
Raymond Hettinger
Guido van Rossum
Eli Bendersky
Martin v. Löwis
Christian Heimes
Antoine Pitrou
Ezio Melotti
Mark Dickinson
Matthias Klose
Georg Brandl
Jesus Cea
Tim Golden
Christian Heimes
Armin Ronacher
Meador Inge
Nick Coghlan
Amaury Forgeot d'Arc
Éric Araujo
Victor Stinner
Brett Cannon