mirror of https://github.com/python/cpython
01481f2dc1
* The lexer, which include the actual lexeme producing logic, goes into the `lexer` directory. * The wrappers, one wrapper per input mode (file, string, utf-8, and readline), go into the `tokenizer` directory and include logic for creating a lexer instance and managing the buffer for different modes. --------- Co-authored-by: Pablo Galindo <pablogsal@gmail.com> Co-authored-by: blurb-it[bot] <43283697+blurb-it[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| lexer | ||
| tokenizer | ||
| Python.asdl | ||
| action_helpers.c | ||
| asdl.py | ||
| asdl_c.py | ||
| myreadline.c | ||
| parser.c | ||
| peg_api.c | ||
| pegen.c | ||
| pegen.h | ||
| pegen_errors.c | ||
| string_parser.c | ||
| string_parser.h | ||
| token.c | ||