Commit Graph

11 Commits

Author SHA1 Message Date
Benjamin Peterson 806f9d704f document TokenError and unclosed expression behavior (closes #12063)
Patch by Amandine Lee.
2014-06-07 17:47:41 -07:00
Terry Jan Reedy f7568e0a8a Closes #20956: 2.7 tokenize does not produce named tuples. Patch by Sam Kimbrel. 2014-04-14 16:17:09 -04:00
Raymond Hettinger 2aa8519f07 The StopIteration API applies to both tokenize() and generate_tokens() 2012-07-01 20:00:09 -07:00
Meador Inge da747c3d97 Issue #2134: Clarify token.OP handling rationale in tokenize documentation. 2012-01-19 00:17:44 -06:00
Éric Araujo 29a0b57e4e Backport source links from 3.x.
Existing links have been updated to use the new reST role.  In some
files, I have also made cosmetic changes to the header.
2011-08-19 02:14:03 +02:00
Raymond Hettinger e0e082281e Add more links to Python sources where the code is short, readable and an informative adjunct to the docs. 2010-11-06 07:10:31 +00:00
Georg Brandl 3219df1562 Argh, I read it wrong. Reverted 64036 and added a clarifying remark. 2008-06-08 08:59:38 +00:00
Georg Brandl ebd662d6f2 #3028: tokenize passes the physical line. 2008-06-08 08:54:40 +00:00
Georg Brandl 907a720f89 A lot more typo fixes by Ori Avtalion. 2008-02-22 12:31:45 +00:00
Georg Brandl cf3fb25932 Add :term: for generators. 2007-10-21 10:52:38 +00:00
Georg Brandl 8ec7f65613 Move the 2.6 reST doc tree in place. 2007-08-15 14:28:01 +00:00