Mirror
/
cpython
mirror of https://github.com/python/cpython
4
1
Fork 0
Code Issues Releases Wiki Activity

The StopIteration API applies to both tokenize() and generate_tokens()

This commit is contained in:
Raymond Hettinger 2012-07-01 20:00:09 -07:00
parent e970dc757c
commit 2aa8519f07
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
Doc/library/tokenize.rst
View File

@ -29,7 +29,8 @@ The primary entry point is a :term:`generator`:
which must be a callable object which provides the same interface as the
:meth:`readline` method of built-in file objects (see section
:ref:`bltin-file-objects`). Each call to the function should return one line
of input as a string.
of input as a string. Alternately, *readline* may be a callable object that
signals completion by raising :exc:`StopIteration`.
The generator produces 5-tuples with these members: the token type; the token
string; a 2-tuple ``(srow, scol)`` of ints specifying the row and column