Mirror
/
cpython
mirror of https://github.com/python/cpython
4
1
Fork 0
Code Issues Releases Wiki Activity

added description of NL token

This commit is contained in:
Skip Montanaro 2001-02-28 22:05:41 +00:00
parent 0bba7f83f2
commit 58177b9975
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
Doc/lib/libtokenize.tex
View File

@ -36,9 +36,12 @@ The scanner is exposed by a single function:
All constants from the \refmodule{token} module are also exported from
\module{tokenize}, as is one additional token type value that might be
\module{tokenize}, as are two additional token type values that might be
passed to the \var{tokeneater} function by \function{tokenize()}:
\begin{datadesc}{COMMENT}
Token value used to indicate a comment.
\end{datadesc}
\begin{datadesc}{NL}
Token value used to indicate a newline.
\end{datadesc}