bpo-39718: add TYPE_IGNORE, COLONEQUAL to py38 changes in token (GH-18598)

(cherry picked from commit c2f7eb254b)

Co-authored-by: Shantanu <hauntsaninja@users.noreply.github.com>
This commit is contained in:
Miss Islington (bot) 2020-02-28 15:31:20 -08:00 committed by GitHub
parent 445152e0d3
commit 7f53d87cb0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 2 additions and 1 deletions

View File

@ -87,7 +87,7 @@ the :mod:`tokenize` module.
now tokenized as :data:`NAME` tokens. now tokenized as :data:`NAME` tokens.
.. versionchanged:: 3.8 .. versionchanged:: 3.8
Added :data:`TYPE_COMMENT`. Added :data:`TYPE_COMMENT`, :data:`TYPE_IGNORE`, :data:`COLONEQUAL`.
Added :data:`AWAIT` and :data:`ASYNC` tokens back (they're needed Added :data:`AWAIT` and :data:`ASYNC` tokens back (they're needed
to support parsing older Python versions for :func:`ast.parse` with to support parsing older Python versions for :func:`ast.parse` with
``feature_version`` set to 6 or lower). ``feature_version`` set to 6 or lower).

View File

@ -0,0 +1 @@
Update :mod:`token` documentation to reflect additions in Python 3.8