This causes them to be collapsed by default in diffs shown on GitHub.
https://bugs.python.org/issue37760
Automerge-Triggered-By: @benjaminp
(cherry picked from commit 4e3dfcc4b9)
Co-authored-by: Greg Price <gnprice@gmail.com>
"Include/token.h", "Lib/token.py" (containing now some data moved from
"Lib/tokenize.py") and new files "Parser/token.c" (containing the code
moved from "Parser/tokenizer.c") and "Doc/library/token-list.inc" (included
in "Doc/library/token.rst") are now generated from "Grammar/Tokens" by
"Tools/scripts/generate_token.py". The script overwrites files only if
needed and can be used on the read-only sources tree.
"Lib/symbol.py" is now generated by "Tools/scripts/generate_symbol_py.py"
instead of been executable itself.
Added new make targets "regen-token" and "regen-symbol" which are now
dependencies of "regen-all".
The documentation contains now strings for operators and punctuation tokens.
Github doesn't support it (ref. isaacs/github#487). So it can't ease
conflict on Github.
Additionally, it can make trouble when cherry-pick. (ref. GH-212)
Miss Islington (bot)
Serhiy Storchaka
Steve Dower
Victor Stinner
INADA Naoki
Victor Stinner
Zachary Ware
Benjamin Peterson