mirror of https://github.com/python/cpython
fc354f0785
* add test to check if were modifying token * copy list so import tokenize doesnt have side effects on token * shorten line * add tokenize tokens to token.h to get them to show up in token * move ERRORTOKEN back to its previous location, and fix nitpick * copy comments from token.h automatically * fix whitespace and make more pythonic * change to fix comments from @haypo * update token.rst and Misc/NEWS * change wording * some more wording changes |
||
|---|---|---|
| .. | ||
| Python.asdl | ||
| acceler.c | ||
| asdl.py | ||
| asdl_c.py | ||
| bitset.c | ||
| firstsets.c | ||
| grammar.c | ||
| grammar1.c | ||
| listnode.c | ||
| metagrammar.c | ||
| myreadline.c | ||
| node.c | ||
| parser.c | ||
| parser.h | ||
| parsetok.c | ||
| parsetok_pgen.c | ||
| pgen.c | ||
| pgenmain.c | ||
| printgrammar.c | ||
| tokenizer.c | ||
| tokenizer.h | ||
| tokenizer_pgen.c | ||