traverseda
/
cpython
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
cpython/Lib/test/test_parser.py

449 lines
14 KiB
Python
Raw Normal View History

Add a minimal test suite for the parser module.
2000-08-21 19:30:53 -03:00
import parser
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
import unittest
Get rid of relative imports in all unittests. Now anything that imports e.g. test_support must do so using an absolute package name such as "import test.test_support" or "from test import test_support". This also updates the README in Lib/test, and gets rid of the duplicate data dirctory in Lib/test/data (replaced by Lib/email/test/data). Now Tim and Jack can have at it. :)
2002-07-23 16:04:11 -03:00
from test import test_support
Add a minimal test suite for the parser module.
2000-08-21 19:30:53 -03:00
#
# First, we test that we can generate trees from valid source fragments,
# and that these valid trees are indeed allowed by the tree-loading side
# of the parser module.
#
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
class RoundtripLegalSyntaxTestCase(unittest.TestCase):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def roundtrip(self, f, s):
st1 = f(s)
t = st1.totuple()
try:
Use the "st" versions of the "ast" calls in the parser module -- there is no reason to pretend the syntax trees we're dealing with are abstract.
2001-07-17 16:33:25 -03:00
st2 = parser.sequence2st(t)
PEP-0318, @decorator-style. In Guido's words: "@ seems the syntax that everybody can hate equally" Implementation by Mark Russell, from SF #979728.
2004-08-02 03:10:11 -03:00
except parser.ParserError, why:
self.fail("could not roundtrip %r: %s" % (s, why))
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.assertEquals(t, st2.totuple(),
"could not re-generate syntax tree")
def check_expr(self, s):
self.roundtrip(parser.expr, s)
def check_suite(self, s):
self.roundtrip(parser.suite, s)
Added tests for the new yield support in the parser module. (Should be merged with descr branch.)
2001-07-17 00:01:29 -03:00
def test_yield_statement(self):
Remove some now-obsolete generator future statements. I left the email pkg alone; I'm not sure how Barry would like to handle that.
2002-03-31 20:28:59 -04:00
self.check_suite("def f(): yield 1")
PEP 342 implementation. Per Guido's comments, the generator throw() method still needs to support string exceptions, and allow None for the third argument. Documentation updates are needed, too.
2005-08-01 21:46:46 -03:00
self.check_suite("def f(): yield")
self.check_suite("def f(): x += yield")
self.check_suite("def f(): x = yield 1")
self.check_suite("def f(): x = y = yield 1")
self.check_suite("def f(): x = yield")
self.check_suite("def f(): x = y = yield")
self.check_suite("def f(): 1 + (yield)*2")
self.check_suite("def f(): (yield 1)*2")
Remove some now-obsolete generator future statements. I left the email pkg alone; I'm not sure how Barry would like to handle that.
2002-03-31 20:28:59 -04:00
self.check_suite("def f(): return; yield 1")
self.check_suite("def f(): yield 1; return")
self.check_suite("def f():\n"
Added tests for the new yield support in the parser module. (Should be merged with descr branch.)
2001-07-17 00:01:29 -03:00
" for x in range(30):\n"
" yield x\n")
PEP 342 implementation. Per Guido's comments, the generator throw() method still needs to support string exceptions, and allow None for the third argument. Documentation updates are needed, too.
2005-08-01 21:46:46 -03:00
self.check_suite("def f():\n"
" if (yield):\n"
" yield x\n")
Added tests for the new yield support in the parser module. (Should be merged with descr branch.)
2001-07-17 00:01:29 -03:00
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def test_expressions(self):
self.check_expr("foo(1)")
self.check_expr("[1, 2, 3]")
self.check_expr("[x**3 for x in range(20)]")
self.check_expr("[x**3 for x in range(20) if x % 3]")
Add another little test to make sure we roundtrip multiple list comp ifs ok. Add tests for generator expressions too.
2006-04-12 02:27:46 -03:00
self.check_expr("[x**3 for x in range(20) if x % 2 if x % 3]")
self.check_expr("list(x**3 for x in range(20))")
self.check_expr("list(x**3 for x in range(20) if x % 3)")
self.check_expr("list(x**3 for x in range(20) if x % 2 if x % 3)")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_expr("foo(*args)")
self.check_expr("foo(*args, **kw)")
self.check_expr("foo(**kw)")
self.check_expr("foo(key=value)")
self.check_expr("foo(key=value, *args)")
self.check_expr("foo(key=value, *args, **kw)")
self.check_expr("foo(key=value, **kw)")
self.check_expr("foo(a, b, c, *args)")
self.check_expr("foo(a, b, c, *args, **kw)")
self.check_expr("foo(a, b, c, **kw)")
self.check_expr("foo + bar")
Teach the parsermodule about floor division. Fixes [ 676521 ] parser module validation failure bugfix candidate.
2003-01-29 10:20:23 -04:00
self.check_expr("foo - bar")
self.check_expr("foo * bar")
self.check_expr("foo / bar")
self.check_expr("foo // bar")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_expr("lambda: 0")
self.check_expr("lambda x: 0")
self.check_expr("lambda *y: 0")
self.check_expr("lambda *y, **z: 0")
self.check_expr("lambda **z: 0")
self.check_expr("lambda x, y: 0")
self.check_expr("lambda foo=bar: 0")
self.check_expr("lambda foo=bar, spaz=nifty+spit: 0")
self.check_expr("lambda foo=bar, **z: 0")
self.check_expr("lambda foo=bar, blaz=blat+2, **z: 0")
self.check_expr("lambda foo=bar, blaz=blat+2, *y, **z: 0")
self.check_expr("lambda x, *y, **z: 0")
SF patch #872326: Generator expression implementation (Code contributed by Jiwon Seo.) The documentation portion of the patch is being re-worked and will be checked-in soon. Likewise, PEP 289 will be updated to reflect Guido's rationale for the design decisions on binding behavior (as described in in his patch comments and in discussions on python-dev). The test file, test_genexps.py, is written in doctest format and is meant to exercise all aspects of the the patch. Further additions are welcome from everyone. Please stress test this new feature as much as possible before the alpha release.
2004-05-19 05:20:33 -03:00
self.check_expr("(x for x in range(10))")
self.check_expr("foo(x for x in range(10))")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def test_print(self):
self.check_suite("print")
self.check_suite("print 1")
self.check_suite("print 1,")
self.check_suite("print >>fp")
self.check_suite("print >>fp, 1")
self.check_suite("print >>fp, 1,")
def test_simple_expression(self):
# expr_stmt
self.check_suite("a")
def test_simple_assignments(self):
self.check_suite("a = b")
self.check_suite("a = b = c = d = e")
def test_simple_augmented_assignments(self):
self.check_suite("a += b")
self.check_suite("a -= b")
self.check_suite("a *= b")
self.check_suite("a /= b")
Teach the parsermodule about floor division. Fixes [ 676521 ] parser module validation failure bugfix candidate.
2003-01-29 10:20:23 -04:00
self.check_suite("a //= b")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_suite("a %= b")
self.check_suite("a &= b")
self.check_suite("a |= b")
self.check_suite("a ^= b")
self.check_suite("a <<= b")
self.check_suite("a >>= b")
self.check_suite("a **= b")
def test_function_defs(self):
self.check_suite("def f(): pass")
self.check_suite("def f(*args): pass")
self.check_suite("def f(*args, **kw): pass")
self.check_suite("def f(**kw): pass")
self.check_suite("def f(foo=bar): pass")
self.check_suite("def f(foo=bar, *args): pass")
self.check_suite("def f(foo=bar, *args, **kw): pass")
self.check_suite("def f(foo=bar, **kw): pass")
self.check_suite("def f(a, b): pass")
self.check_suite("def f(a, b, *args): pass")
self.check_suite("def f(a, b, *args, **kw): pass")
self.check_suite("def f(a, b, **kw): pass")
self.check_suite("def f(a, b, foo=bar): pass")
self.check_suite("def f(a, b, foo=bar, *args): pass")
self.check_suite("def f(a, b, foo=bar, *args, **kw): pass")
self.check_suite("def f(a, b, foo=bar, **kw): pass")
PEP-0318, @decorator-style. In Guido's words: "@ seems the syntax that everybody can hate equally" Implementation by Mark Russell, from SF #979728.
2004-08-02 03:10:11 -03:00
self.check_suite("@staticmethod\n"
"def f(): pass")
self.check_suite("@staticmethod\n"
"@funcattrs(x, y)\n"
"def f(): pass")
self.check_suite("@funcattrs()\n"
"def f(): pass")
Flush out support for ``class B(): pass`` syntax by adding support to the 'parser' module and 'compiler' package. Closes patch #1176012. Thanks logistix.
2005-04-08 23:30:16 -03:00
def test_class_defs(self):
self.check_suite("class foo():pass")
Whitespace normalization.
2005-04-20 14:45:13 -03:00
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def test_import_from_statement(self):
self.check_suite("from sys.path import *")
self.check_suite("from sys.path import dirname")
SF patch #1007189, multi-line imports, for instance: "from blah import (foo, bar baz, bongo)"
2004-08-31 07:07:13 -03:00
self.check_suite("from sys.path import (dirname)")
self.check_suite("from sys.path import (dirname,)")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_suite("from sys.path import dirname as my_dirname")
SF patch #1007189, multi-line imports, for instance: "from blah import (foo, bar baz, bongo)"
2004-08-31 07:07:13 -03:00
self.check_suite("from sys.path import (dirname as my_dirname)")
self.check_suite("from sys.path import (dirname as my_dirname,)")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_suite("from sys.path import dirname, basename")
SF patch #1007189, multi-line imports, for instance: "from blah import (foo, bar baz, bongo)"
2004-08-31 07:07:13 -03:00
self.check_suite("from sys.path import (dirname, basename)")
self.check_suite("from sys.path import (dirname, basename,)")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_suite(
"from sys.path import dirname as my_dirname, basename")
SF patch #1007189, multi-line imports, for instance: "from blah import (foo, bar baz, bongo)"
2004-08-31 07:07:13 -03:00
self.check_suite(
"from sys.path import (dirname as my_dirname, basename)")
self.check_suite(
"from sys.path import (dirname as my_dirname, basename,)")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
self.check_suite(
"from sys.path import dirname, basename as my_basename")
SF patch #1007189, multi-line imports, for instance: "from blah import (foo, bar baz, bongo)"
2004-08-31 07:07:13 -03:00
self.check_suite(
"from sys.path import (dirname, basename as my_basename)")
self.check_suite(
"from sys.path import (dirname, basename as my_basename,)")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def test_basic_import_statement(self):
self.check_suite("import sys")
self.check_suite("import sys as system")
self.check_suite("import sys, math")
self.check_suite("import sys as system, math")
self.check_suite("import sys, math as my_math")
Add a minimal test suite for the parser module.
2000-08-21 19:30:53 -03:00
Add tests and news entry about parser errors from bug #678518.
2003-02-09 21:54:06 -04:00
def test_pep263(self):
self.check_suite("# -*- coding: iso-8859-1 -*-\n"
"pass\n")
def test_assert(self):
self.check_suite("assert alo < ahi and blo < bhi\n")
Add a minimal test suite for the parser module.
2000-08-21 19:30:53 -03:00
#
# Second, we take *invalid* trees and make sure we get ParserError
# rejections for them.
#
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
class IllegalSyntaxTestCase(unittest.TestCase):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def check_bad_tree(self, tree, label):
try:
Use the "st" versions of the "ast" calls in the parser module -- there is no reason to pretend the syntax trees we're dealing with are abstract.
2001-07-17 16:33:25 -03:00
parser.sequence2st(tree)
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
except parser.ParserError:
pass
else:
self.fail("did not detect invalid tree for %r" % label)
def test_junk(self):
# not even remotely valid:
self.check_bad_tree((1, 2, 3), "<junk>")
Added tests for the new yield support in the parser module. (Should be merged with descr branch.)
2001-07-17 00:01:29 -03:00
def test_illegal_yield_1(self):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
# Illegal yield statement: def f(): return 1; yield 1
Added tests for the new yield support in the parser module. (Should be merged with descr branch.)
2001-07-17 00:01:29 -03:00
tree = \
(257,
(264,
(285,
(259,
(1, 'def'),
(1, 'f'),
(260, (7, '('), (8, ')')),
(11, ':'),
(291,
(4, ''),
(5, ''),
(264,
(265,
(266,
(272,
(275,
(1, 'return'),
(313,
(292,
(293,
(294,
(295,
(297,
(298,
(299,
(300,
(301,
(302, (303, (304, (305, (2, '1')))))))))))))))))),
(264,
(265,
(266,
(272,
(276,
(1, 'yield'),
(313,
(292,
(293,
(294,
(295,
(297,
(298,
(299,
(300,
(301,
(302,
(303, (304, (305, (2, '1')))))))))))))))))),
(4, ''))),
(6, ''))))),
(4, ''),
(0, ''))))
self.check_bad_tree(tree, "def f():\n return 1\n yield 1")
def test_illegal_yield_2(self):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
# Illegal return in generator: def f(): return 1; yield 1
Added tests for the new yield support in the parser module. (Should be merged with descr branch.)
2001-07-17 00:01:29 -03:00
tree = \
(257,
(264,
(265,
(266,
(278,
(1, 'from'),
(281, (1, '__future__')),
(1, 'import'),
(279, (1, 'generators')))),
(4, ''))),
(264,
(285,
(259,
(1, 'def'),
(1, 'f'),
(260, (7, '('), (8, ')')),
(11, ':'),
(291,
(4, ''),
(5, ''),
(264,
(265,
(266,
(272,
(275,
(1, 'return'),
(313,
(292,
(293,
(294,
(295,
(297,
(298,
(299,
(300,
(301,
(302, (303, (304, (305, (2, '1')))))))))))))))))),
(264,
(265,
(266,
(272,
(276,
(1, 'yield'),
(313,
(292,
(293,
(294,
(295,
(297,
(298,
(299,
(300,
(301,
(302,
(303, (304, (305, (2, '1')))))))))))))))))),
(4, ''))),
(6, ''))))),
(4, ''),
(0, ''))))
self.check_bad_tree(tree, "def f():\n return 1\n yield 1")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
def test_print_chevron_comma(self):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
# Illegal input: print >>fp,
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
tree = \
(257,
(264,
(265,
(266,
(268,
(1, 'print'),
(35, '>>'),
(290,
(291,
(292,
(293,
(295,
(296,
(297,
(298, (299, (300, (301, (302, (303, (1, 'fp')))))))))))))),
(12, ','))),
(4, ''))),
(0, ''))
self.check_bad_tree(tree, "print >>fp,")
def test_a_comma_comma_c(self):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
# Illegal input: a,,c
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
tree = \
(258,
(311,
(290,
(291,
(292,
(293,
(295,
(296,
(297,
(298, (299, (300, (301, (302, (303, (1, 'a')))))))))))))),
(12, ','),
(12, ','),
(290,
(291,
(292,
(293,
(295,
(296,
(297,
(298, (299, (300, (301, (302, (303, (1, 'c'))))))))))))))),
(4, ''),
(0, ''))
self.check_bad_tree(tree, "a,,c")
def test_illegal_operator(self):
Standardize behavior: no docstrings in test functions.
2002-08-22 16:45:32 -03:00
# Illegal input: a $= b
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
tree = \
(257,
(264,
(265,
(266,
(267,
(312,
(291,
(292,
(293,
(294,
(296,
(297,
(298,
(299,
(300, (301, (302, (303, (304, (1, 'a'))))))))))))))),
(268, (37, '$=')),
(312,
(291,
(292,
(293,
(294,
(296,
(297,
(298,
(299,
(300, (301, (302, (303, (304, (1, 'b'))))))))))))))))),
(4, ''))),
(0, ''))
self.check_bad_tree(tree, "a $= b")
Add tests and news entry about parser errors from bug #678518.
2003-02-09 21:54:06 -04:00
def test_malformed_global(self):
#doesn't have global keyword in ast
tree = (257,
(264,
(265,
(266,
(282, (1, 'foo'))), (4, ''))),
(4, ''),
Whitespace normalization.
2003-02-18 22:35:07 -04:00
(0, ''))
Add tests and news entry about parser errors from bug #678518.
2003-02-09 21:54:06 -04:00
self.check_bad_tree(tree, "malformed global ast")
Convert the parser module test to use PyUnit.
2001-06-04 00:56:24 -03:00
Merge ast-branch to head This change implements a new bytecode compiler, based on a transformation of the parse tree to an abstract syntax defined in Parser/Python.asdl. The compiler implementation is not complete, but it is in stable enough shape to run the entire test suite excepting two disabled tests.
2005-10-20 16:59:25 -03:00
class CompileTestCase(unittest.TestCase):
# These tests are very minimal. :-(
def test_compile_expr(self):
st = parser.expr('2 + 3')
code = parser.compilest(st)
self.assertEquals(eval(code), 5)
def test_compile_suite(self):
st = parser.suite('x = 2; y = x + 3')
code = parser.compilest(st)
globs = {}
exec code in globs
self.assertEquals(globs['y'], 5)
def test_compile_error(self):
st = parser.suite('1 = 3 + 4')
self.assertRaises(SyntaxError, parser.compilest, st)
Change the PyUnit-based tests to use the test_main() approach. This allows using the tests with unittest.py as a script. The tests will still run when run as a script themselves.
2001-09-20 18:33:42 -03:00
def test_main():
Combine the functionality of test_support.run_unittest() and test_support.run_classtests() into run_unittest() and use it wherever possible. Also don't use "from test.test_support import ...", but "from test import test_support" in a few spots. From SF patch #662807.
2003-05-01 14:45:56 -03:00
test_support.run_unittest(
RoundtripLegalSyntaxTestCase,
Merge ast-branch to head This change implements a new bytecode compiler, based on a transformation of the parse tree to an abstract syntax defined in Parser/Python.asdl. The compiler implementation is not complete, but it is in stable enough shape to run the entire test suite excepting two disabled tests.
2005-10-20 16:59:25 -03:00
IllegalSyntaxTestCase,
CompileTestCase,
Combine the functionality of test_support.run_unittest() and test_support.run_classtests() into run_unittest() and use it wherever possible. Also don't use "from test.test_support import ...", but "from test import test_support" in a few spots. From SF patch #662807.
2003-05-01 14:45:56 -03:00
)
Change the PyUnit-based tests to use the test_main() approach. This allows using the tests with unittest.py as a script. The tests will still run when run as a script themselves.
2001-09-20 18:33:42 -03:00
if __name__ == "__main__":
test_main()