96ec934e75
This commit simplifies async/await tokenization in tokenizer.c, tokenize.py & lib2to3/tokenize.py. Previous solution was to keep a stack of async-def & def blocks, whereas the new approach is just to remember position of the outermost async-def block. This change won't bring any parsing performance improvements, but it makes the code much easier to read and validate. |
||
|---|---|---|
| .. | ||
| fixes | ||
| pgen2 | ||
| tests | ||
| Grammar.txt | ||
| PatternGrammar.txt | ||
| __init__.py | ||
| __main__.py | ||
| btm_matcher.py | ||
| btm_utils.py | ||
| fixer_base.py | ||
| fixer_util.py | ||
| main.py | ||
| patcomp.py | ||
| pygram.py | ||
| pytree.py | ||
| refactor.py | ||