4db245ee9d
bpo-40334: refactor and cleanup for the PEG generators (GH-19775)
2020-04-29 10:42:21 +01:00
6d65087655
bpo-40334: Disallow invalid single statements in the new parser (GH-19774)
...
After parsing is done in single statement mode, the tokenizer buffer has to be checked for additional lines and a `SyntaxError` must be raised, in case there are any.
Co-authored-by: Pablo Galindo <Pablogsal@gmail.com>
2020-04-29 02:42:27 +01:00
2208134918
bpo-40334: Explicitly cast to int in pegen.c to fix a compiler warning (GH-19779)
2020-04-29 02:04:06 +01:00
37af21b667
bpo-40334: Fix shifting of nested f-strings in the new parser (GH-19771)
...
`JoinedStr`s and `FormattedValue also needs to be shifted, in order to correctly compute the location information of nested f-strings.
2020-04-29 01:43:50 +01:00
d55133f49f
bpo-40334: Catch E_EOF error, when the tokenizer returns ERRORTOKEN (GH-19743)
...
An E_EOF error was only being caught after the parser exited before this commit. There are some cases though, where the tokenizer returns ERRORTOKEN *and* has set an E_EOF error (like when EOF directly follows a line continuation character) which weren't correctly handled before.
2020-04-28 01:23:35 +01:00
b94dbd7ac3
bpo-40334: Support PyPARSE_DONT_IMPLY_DEDENT in the new parser (GH-19736)
2020-04-27 18:35:58 +01:00
2b74c835a7
bpo-40334: Support CO_FUTURE_BARRY_AS_BDFL in the new parser (GH-19721)
...
This commit also allows to pass flags to the new parser in all interfaces and fixes a bug in the parser generator that was causing to inline rules with actions, making them disappear.
2020-04-27 18:02:07 +01:00
9f27dd3e16
Use Py_ssize_t instead of ssize_t (GH-19685)
2020-04-24 01:13:33 +01:00
ebebb6429c
bpo-40334: Improve various PEG-Parser related stuff (GH-19669)
...
The changes in this commit are all related to @vstinner's original review comments of the initial PEP 617 implementation PR.
2020-04-23 16:36:06 +01:00
1df5a9e88c
bpo-40334: Fix build errors and warnings in test_peg_generator (GH-19672)
2020-04-23 12:42:13 +01:00
ee40e4b856
bpo-40334: Don't downcast from Py_ssize_t to int (GH-19671)
2020-04-23 03:43:08 +01:00
0b7829e089
Compile extensions in test_peg_generator with C99 (GH-19668)
2020-04-23 03:24:25 +01:00
458004bf79
bpo-40334: Fix errors in parse_string.c with old compilers (GH-19666)
2020-04-23 00:13:47 +01:00
c5fc156852
bpo-40334: PEP 617 implementation: New PEG parser for CPython (GH-19503)
...
Co-authored-by: Guido van Rossum <guido@python.org>
Co-authored-by: Lysandros Nikolaou <lisandrosnik@gmail.com>
2020-04-22 23:29:27 +01:00
Pablo Galindo
Lysandros Nikolaou