traverseda
/
cpython
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

bpo-31394: Make tokenize.rst PEP 8-compliant (GH-3526) 

The last commit contained lines longer than 80 characters.
This commit is contained in:
Mariatta 2017-09-12 21:00:00 -07:00 committed by GitHub
parent 5f8fbf917e
commit ea0f7c26ce
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
Doc/library/tokenize.rst
View File

@ -16,8 +16,9 @@ implemented in Python. The scanner in this module returns comments as tokens
as well, making it useful for implementing "pretty-printers," including
colorizers for on-screen displays.
To simplify token stream handling, all :ref:`operator <operators>` and :ref:`delimiter <delimiters>`
tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact
To simplify token stream handling, all :ref:`operator <operators>` and
:ref:`delimiter <delimiters>` tokens and :data:`Ellipsis` are returned using
the generic :data:`~token.OP` token type. The exact
type can be determined by checking the ``exact_type`` property on the
:term:`named tuple` returned from :func:`tokenize.tokenize`.