mirror of https://github.com/python/cpython
da5727a120
Remove the token.h header file. There was never any public tokenizer C API. The token.h header file was only designed to be used by Python internals. Move Include/token.h to Include/internal/pycore_token.h. Including this header file now requires that the Py_BUILD_CORE macro is defined. It no longer checks for the Py_LIMITED_API macro. Rename functions: * PyToken_OneChar() => _PyToken_OneChar() * PyToken_TwoChars() => _PyToken_TwoChars() * PyToken_ThreeChars() => _PyToken_ThreeChars() |
||
|---|---|---|
| .. | ||
| Python.asdl | ||
| action_helpers.c | ||
| asdl.py | ||
| asdl_c.py | ||
| myreadline.c | ||
| parser.c | ||
| peg_api.c | ||
| pegen.c | ||
| pegen.h | ||
| pegen_errors.c | ||
| string_parser.c | ||
| string_parser.h | ||
| token.c | ||
| tokenizer.c | ||
| tokenizer.h | ||