cpython/Lib/test
Thomas Wouters 628e3bb808 One more fix to consider missing SSL support. 2007-08-30 22:35:31 +00:00
..
crashers Add a crasher for the thread-unsafety of file objects. 2007-08-28 18:54:44 +00:00
decimaltestdata Remove test of obsolete trim() operation which was supplanted by 2004-08-17 16:27:04 +00:00
leakers This test no longer leaks, and test_generators sufficiently tests it to 2006-04-16 15:11:33 +00:00
output Port test_class to unittest. Patch #1671298. 2007-08-24 19:33:53 +00:00
185test.db Data file for bsddb185 test 2003-05-06 20:37:25 +00:00
README Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
__init__.py
audiotest.au
autotest.py
bad_coding.py - Fix segfault with invalid coding. 2005-10-02 01:48:49 +00:00
bad_coding2.py Set svn:eol-style to native. 2006-03-01 06:19:04 +00:00
badsyntax_future3.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future4.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future5.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future6.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future7.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future8.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_future9.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
badsyntax_nocaret.py
cfgparser.1 ConfigParser: 2004-05-18 04:24:02 +00:00
check_soundcard.vbs Set eol-style to native. 2006-03-16 18:55:20 +00:00
cjkencodings_test.py Add cheot-ga-keut composed make-up sequence support in EUC-KR codec. 2007-08-20 06:49:18 +00:00
doctest_aliases.py Get rid of the ignore_imports argument to DocTestFinder.find(). 2004-08-08 06:11:48 +00:00
double_const.py
empty.vbs Add a simple test for os.startfile(). 2006-04-04 18:31:35 +00:00
exception_hierarchy.txt Slightly revised version of patch #1538956: 2006-08-14 10:55:19 +00:00
fork_wait.py Restore rev 47014: 2006-07-07 06:03:15 +00:00
greyrgb.uue
infinite_reload.py Bug #742342: make Python stop segfaulting on infinitely-recursive reload()s. Fixed by patch #922167. 2007-03-12 16:11:39 +00:00
inspect_fodder.py Patch #736962: port test_inspect to unittest. As part of this, move out 2004-12-12 16:20:22 +00:00
inspect_fodder2.py Make tabnanny recognize IndentationErrors raised by tokenize. 2006-08-14 21:34:08 +00:00
keycert.pem > Regardless, building a fixed test certificate and checking it in sounds like 2007-08-27 17:19:42 +00:00
list_tests.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
mapping_tests.py Rename class attribute containing the class to be tested, so the name is the 2004-06-02 18:42:25 +00:00
outstanding_bugs.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
pickletester.py Patch #1462488: prevent a segfault in object_reduce_ex() by splitting 2007-03-15 11:44:55 +00:00
pyclbr_input.py Whitespace normalization. 2004-08-04 02:36:18 +00:00
pydocfodder.py
pystone.py Whitespace normalization. 2004-01-18 20:29:55 +00:00
re_tests.py More work on bug #672491 and patch #712900. 2003-04-20 07:35:44 +00:00
regex_tests.py
regrtest.py Patch #1680959: add test suite for pipes module. 2007-08-30 10:38:56 +00:00
reperf.py SF patch #701494: more apply removals 2003-04-06 09:01:11 +00:00
sample_doctest.py Bug 772091: doctest.DocTestSuite does not support __test__ 2004-08-07 05:37:52 +00:00
seq_tests.py Whitespace normalization (via reindent.py). 2005-08-26 15:20:46 +00:00
sgml_input.html Forward port of 51850 from release25-maint branch. 2006-09-11 04:24:09 +00:00
sortperf.py
ssl_cert.pem Added a SSL server to test_socket_ssl.py to be able to test 2007-04-03 17:29:48 +00:00
ssl_key.pem Added a SSL server to test_socket_ssl.py to be able to test 2007-04-03 17:29:48 +00:00
string_tests.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
test.xml
test.xml.out
test_MimeWriter.py Have MimeWriter raise a DeprecationWarning as per PEP 4 and its documentation. 2007-05-30 20:46:26 +00:00
test_StringIO.py Revert the fix for #1548891, it broke backwards compatibility with arbitrary read buffers. 2007-08-08 13:03:41 +00:00
test___all__.py Have mimify raise a DeprecationWarning. The docs and PEP 4 have listed the 2007-05-30 21:48:58 +00:00
test___future__.py Whitespace normalization. 2006-11-03 02:32:46 +00:00
test__locale.py Bug #1417699: Reject locale-specific decimal point in float() 2006-07-03 12:19:50 +00:00
test_aepack.py
test_al.py Fix all wrong instances of "it's". 2005-07-22 21:49:32 +00:00
test_anydbm.py
test_applesingle.py This patches fixes a number of byteorder problems in MacOSX specific code. 2006-04-17 13:40:08 +00:00
test_array.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
test_ast.py Fix AST compiler bug #1501934: incorrect LOAD/STORE_GLOBAL generation. 2006-07-09 16:16:34 +00:00
test_asynchat.py When running asynchat tests on OS X (darwin), the test client now 2007-07-31 03:03:34 +00:00
test_asyncore.py Moved all of the capture_server socket setup code into the try block 2007-07-28 14:21:22 +00:00
test_atexit.py Whitespace normalization. 2004-11-07 04:52:29 +00:00
test_audioop.py SF [ 1231053 ] audioop - alaw encoding/decoding added, code updated 2006-03-20 05:21:58 +00:00
test_augassign.py whitespace normalisation 2006-03-30 12:59:11 +00:00
test_base64.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_bastion.py
test_bigaddrspace.py Concatenation on a long string breaks (SF #1526585). 2006-08-09 15:37:26 +00:00
test_bigmem.py Add missing period in comment. 2006-06-16 04:31:28 +00:00
test_binascii.py Patch #1185447: binascii.b2a_qp() now correctly quotes binary characters 2007-03-13 22:49:43 +00:00
test_binhex.py
test_binop.py Fix error in a docstring where a single quote started the docstring but triple 2005-04-30 05:50:19 +00:00
test_bisect.py SF #1313496: bisect C replacement doesn't accept named args 2005-10-05 11:39:12 +00:00
test_bool.py Whitespace normalization. 2003-06-29 05:46:54 +00:00
test_bsddb.py Fix bug 1725856. 2007-08-24 05:11:38 +00:00
test_bsddb3.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_bsddb185.py simpler temp dir cleanup 2003-05-17 02:54:11 +00:00
test_buffer.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
test_bufio.py Whitespace normalization. 2006-11-03 02:32:46 +00:00
test_builtin.py Patch #1444529: the builtin compile() now accepts keyword arguments. 2007-03-13 20:46:32 +00:00
test_bz2.py Deprecate os.popen* and popen2 module in favor of the subprocess module. 2007-05-11 06:57:33 +00:00
test_cProfile.py Added the cProfile module. 2006-02-08 12:53:56 +00:00
test_calendar.py Fix test output. 2007-08-28 23:35:33 +00:00
test_call.py SF #904720: dict.update should take a 2-tuple sequence like dict.__init_ 2004-03-04 08:25:44 +00:00
test_capi.py Try to repair at least one segfault on the Mac buildbot, 2006-03-21 03:58:41 +00:00
test_cd.py Fix all wrong instances of "it's". 2005-07-22 21:49:32 +00:00
test_cfgparser.py Patch #1603688: ConfigParser.SafeConfigParser now checks values that 2007-03-13 17:43:32 +00:00
test_cgi.py Convert test_cgi to unittest. 2006-10-29 20:09:12 +00:00
test_charmapcodec.py Fix the encodings package codec search function to only search 2006-02-19 15:22:22 +00:00
test_cl.py Fix all wrong instances of "it's". 2005-07-22 21:49:32 +00:00
test_class.py Port test_class to unittest. Patch #1671298. 2007-08-24 19:33:53 +00:00
test_cmath.py Patch #1675423: PyComplex_AsCComplex() now tries to convert an object 2007-03-17 16:08:45 +00:00
test_cmd_line.py Fix bug 1764407 - the -i switch now does the right thing when using the -m switch 2007-08-25 10:50:41 +00:00
test_code.py Bug #1333982: string/number constants were inappropriately stored 2006-08-04 05:09:28 +00:00
test_codeccallbacks.py Backport r57105 and r57145 from the py3k branch: UTF-32 codecs. 2007-08-17 16:41:28 +00:00
test_codecencodings_cn.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecencodings_hk.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecencodings_jp.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecencodings_kr.py Add cheot-ga-keut composed make-up sequence support in EUC-KR codec. 2007-08-20 06:49:18 +00:00
test_codecencodings_tw.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecmaps_cn.py Fix gb18030 codec's bug that doesn't map two-byte characters on 2007-08-04 04:10:18 +00:00
test_codecmaps_hk.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecmaps_jp.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecmaps_kr.py Add cheot-ga-keut composed make-up sequence support in EUC-KR codec. 2007-08-20 06:49:18 +00:00
test_codecmaps_tw.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_codecs.py Backport r57105 and r57145 from the py3k branch: UTF-32 codecs. 2007-08-17 16:41:28 +00:00
test_codeop.py Whitespace normalization. 2003-06-15 23:26:30 +00:00
test_coding.py Fix Bug #1378022, UTF-8 files with a leading BOM crashed the interpreter. 2005-12-18 05:29:30 +00:00
test_coercion.py Missed test for rev. 46933; infinite recursion from __coerce__() returning its arguments reversed. 2006-06-13 22:26:13 +00:00
test_collections.py Allow all alphanumeric and underscores in type and field names. 2007-05-21 16:40:10 +00:00
test_colorsys.py Fix SF #1345263, colorsys tests, bug in frange 2005-11-02 05:54:27 +00:00
test_commands.py Get rid of deprecation warning when testing commands.getstatus() 2007-03-20 05:21:21 +00:00
test_compare.py Convert test_compare to use unittest. Hopefully we can find out 2006-04-09 04:50:18 +00:00
test_compile.py Disallow function calls like foo(None=1). 2007-06-07 13:23:24 +00:00
test_compiler.py Patch #1638243: the compiler package is now able to correctly compile 2007-01-27 17:43:02 +00:00
test_complex.py Patch #1491866: change the complex() constructor to allow parthensized forms. This means complex(repr(x)) now works instead of raising a ValueError. 2007-03-09 20:33:07 +00:00
test_complex_args.py Bug #1557232: fix seg fault with def f((((x)))) and def f(((x),)). 2006-09-22 08:18:10 +00:00
test_contains.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_contextlib.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_cookie.py Convert test_cookie to unittest. 2006-10-29 19:51:16 +00:00
test_cookielib.py Add test for rev. 45934. 2006-05-08 17:28:47 +00:00
test_copy.py - Patch 1433928: 2006-02-25 22:38:04 +00:00
test_copy_reg.py Patch #1462313, bug #1443328: the pickle modules now can handle classes 2006-03-31 18:25:44 +00:00
test_cpickle.py Use absolute import. 2006-03-24 08:58:38 +00:00
test_crypt.py Import cleanup in test_crypt. 2007-04-06 19:32:32 +00:00
test_csv.py Sane humans would call these invalid tests, but Andrew McNamara pointed out 2007-03-12 03:30:50 +00:00
test_ctypes.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_curses.py Add window.chgat() method, submitted via e-mail by Fabian Kreutz 2007-04-11 13:39:00 +00:00
test_datetime.py Fix silly typo in test name. 2007-08-24 14:53:14 +00:00
test_dbm.py Backported r51621 from p3yk: 2007-02-25 22:12:31 +00:00
test_decimal.py Make decimal.ContextManager a private implementation detail of decimal.localcontext() 2006-09-02 03:54:17 +00:00
test_decorators.py Rewrite test_order so as to be more "proper". Originally relied on an 2004-08-19 03:48:24 +00:00
test_defaultdict.py Deprecate BaseException.message as per PEP 352. 2007-05-05 01:34:02 +00:00
test_deque.py Bug #1486663: don't reject keyword arguments for subclasses of builtin 2007-01-21 10:28:43 +00:00
test_descr.py Fix for #1303614 and #1174712: 2007-05-02 19:23:31 +00:00
test_descrtut.py Use descriptors. 2005-01-16 00:25:31 +00:00
test_dict.py Whitespace normalization. 2007-03-12 18:07:52 +00:00
test_difflib.py Fix tests so they pass in -R mode 2006-04-09 08:36:46 +00:00
test_difflib_expect.html Whitespace normalization. test_difflib passes again. 2004-08-29 22:38:38 +00:00
test_dircache.py fix typos, mostly in comments 2005-10-28 14:39:47 +00:00
test_dis.py Clean up imports. 2007-04-04 18:14:17 +00:00
test_distutils.py One unit test for distutils is not much, but is more than we had yesterday. 2004-06-15 15:49:46 +00:00
test_dl.py Python on OS X 10.3 and above now uses dlopen() (via dynload_shlib.c) 2006-04-09 15:07:40 +00:00
test_doctest.py Bug #1529297: The rewrite of doctest for Python 2.4 unintentionally 2006-07-27 23:44:37 +00:00
test_doctest.txt Merging from tim-doctest-branch, which is now closed. 2004-08-06 22:02:59 +00:00
test_doctest2.py Use descriptors. 2005-01-16 00:25:31 +00:00
test_doctest2.txt Fixed a small bug. doctest didn't handle unicode docstrings containing 2004-10-13 14:15:32 +00:00
test_doctest3.txt add __file__ to the globals available for tests loaded via DocFileSuite; 2004-12-21 23:46:34 +00:00
test_doctest4.txt Patch #1080727: add "encoding" parameter to doctest.DocFileSuite 2006-05-28 16:39:09 +00:00
test_dumbdbm.py Whitespace normalization. 2007-01-30 03:03:46 +00:00
test_dummy_thread.py Whitespace normalization. 2003-06-15 23:26:30 +00:00
test_dummy_threading.py Make time.sleep calls go to 0 for common testing. 2003-04-30 03:03:37 +00:00
test_email.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_email_codecs.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_email_renamed.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_enumerate.py Convert iterator __len__() methods to a private API. 2005-09-24 21:23:05 +00:00
test_eof.py Merge ast-branch to head 2005-10-20 19:59:25 +00:00
test_errno.py Fix a bunch of typos in documentation, docstrings and comments. 2003-10-20 14:01:56 +00:00
test_exception_variations.py Set svn:eol-style to native. 2006-03-01 06:19:04 +00:00
test_exceptions.py Revert accidental checkins from last commit. 2007-08-21 06:03:43 +00:00
test_extcall.py Patch #1686487: you can now pass any mapping after '**' in function calls. 2007-05-21 20:34:16 +00:00
test_fcntl.py Patch #1540470, for OpenBSD 4.0. Backport candidate for 2.[34]. 2006-09-05 02:57:01 +00:00
test_file.py Test file.__exit__. 2006-06-09 18:29:52 +00:00
test_filecmp.py Don't fail if the directory already exists 2006-07-22 17:00:57 +00:00
test_fileinput.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_float.py Fix compile.c so that it records 0.0 and -0.0 as separate constants in a code 2007-08-22 21:14:17 +00:00
test_fnmatch.py
test_fork1.py Restore rev 47014: 2006-07-07 06:03:15 +00:00
test_format.py Patch #1673759: add a missing overflow check when formatting floats 2007-07-12 08:38:00 +00:00
test_fpformat.py
test_frozen.py Port test_frozen to unittest. 2007-08-24 18:22:54 +00:00
test_ftplib.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_funcattrs.py Fix 2005-02-17 10:37:21 +00:00
test_functools.py [Bug #1576241] Let functools.wraps work with built-in functions 2006-10-27 16:39:10 +00:00
test_future.py Fix a bug in the parser's future statement handling that led to "with" 2006-09-24 12:35:36 +00:00
test_future1.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
test_future2.py SF #736962, port test_future to unittest, add a bit more coverage, by Walter Dörwald 2003-12-13 22:43:34 +00:00
test_future3.py Fixed test and converted to unittest format. 2003-07-15 20:57:35 +00:00
test_gc.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_gdbm.py Backported r51621 from p3yk: 2007-02-25 22:12:31 +00:00
test_generators.py When printing an unraisable error, don't print exceptions. before the name. 2007-02-26 22:41:45 +00:00
test_genericpath.py - Move functions common to all path modules into genericpath.py and have the 2006-08-26 18:42:06 +00:00
test_genexps.py Patch #1507676: improve exception messages in abstract.c, object.c and typeobject.c. 2006-06-18 22:17:29 +00:00
test_getargs.py
test_getargs2.py Whitespace normalization. 2006-07-26 23:23:15 +00:00
test_getopt.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_gettext.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_gl.py
test_glob.py Patch #1001604: glob.glob() now returns unicode filenames if it was 2007-03-07 08:31:51 +00:00
test_global.py Convert test_global, test_scope and test_grammar to unittest. 2006-10-28 13:10:17 +00:00
test_grammar.py Backport PEP 3110's new 'except' syntax to 2.6. 2007-05-18 23:11:24 +00:00
test_grp.py Change test_values so that it compares the lowercasing of group names since getgrall() can return all lowercase names while getgrgid() returns proper casing. 2006-05-25 21:33:11 +00:00
test_gzip.py Patch #1647484: Renamed GzipFile's filename attribute to name. The 2007-02-13 16:09:24 +00:00
test_hash.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_hashlib.py [ sf.net patch # 1121611 ] 2005-08-21 18:45:59 +00:00
test_heapq.py Add test for merge stability 2007-02-19 07:30:21 +00:00
test_hexoct.py - Removed FutureWarnings related to hex/oct literals and conversions 2003-11-29 23:52:13 +00:00
test_hmac.py Have the sha module raise a DeprecationWarning as specified in PEP 4. 2007-05-31 19:20:00 +00:00
test_hotshot.py _hotshot hotshot_profiler(): If write_header() returned 2006-03-07 23:53:32 +00:00
test_htmllib.py Patch #545300: Support marked sections. 2003-03-30 14:25:40 +00:00
test_htmlparser.py Patch #912410: Replace HTML entity references for attribute values 2007-03-06 14:43:00 +00:00
test_httplib.py One more fix to consider missing SSL support. 2007-08-30 22:35:31 +00:00
test_imageop.py Move imgfile import to the global namespace to trigger an import error ASAP to 2007-05-20 23:56:18 +00:00
test_imaplib.py
test_imgfile.py
test_imp.py Convert test_imp over to unittest. 2006-10-03 23:23:14 +00:00
test_import.py Remove test.test_support.guard_warnings_filter. 2007-08-14 05:51:06 +00:00
test_importhooks.py Update graminit.c for the fix for #1488915, Multiple dots in relative import 2006-05-25 11:26:25 +00:00
test_index.py Fix those parts in the testsuite that assumed that sys.maxint would cause overflow on x64. Now the testsuite is well behaved on that platform. 2007-05-03 20:09:56 +00:00
test_inspect.py Fix the speed regression in inspect.py by adding another cache to speed up getmodule(). Patch #1553314 2006-09-07 10:50:34 +00:00
test_ioctl.py - Changes donated by Elemental Security to make it work on AIX 5.3 2005-09-14 18:09:42 +00:00
test_isinstance.py Disable a few other tests, that can't work if Python is compiled without 2005-08-03 17:09:04 +00:00
test_iter.py As discussed on python-dev, changed builtin.zip() to handle zero arguments 2003-08-02 07:42:57 +00:00
test_iterlen.py Whitespace normalization. 2006-07-27 15:11:00 +00:00
test_itertools.py Fix those parts in the testsuite that assumed that sys.maxint would cause overflow on x64. Now the testsuite is well behaved on that platform. 2007-05-03 20:09:56 +00:00
test_largefile.py test_largefile can leave its temp file open if one of many tests fail. On 2003-08-26 11:59:27 +00:00
test_linuxaudiodev.py Catch the correct errors. 2007-08-24 19:22:34 +00:00
test_list.py Improve test coverage. 2004-09-29 08:03:17 +00:00
test_locale.py The locale "En" appears not to be valid on windows underi VisualStudio.2005. Added "English" to the test_locale.py to make the testsuite pass for that build 2007-04-26 13:44:16 +00:00
test_logging.py Fix resource leak reported in SF #1516995. 2007-03-11 18:32:07 +00:00
test_long.py Forward-port of r52136,52138: a review of overflow-detecting code. 2006-10-04 12:17:45 +00:00
test_long_future.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_longexp.py SF patch #736962: Port tests to unittest 2003-08-30 22:54:55 +00:00
test_macostools.py Fix a missed instance of test.test_support.guard_warnings_filter (which was 2007-08-14 17:53:30 +00:00
test_macpath.py Bug #1115886: os.path.splitext('.cshrc') gives now ('.cshrc', ''). 2007-03-07 11:04:33 +00:00
test_mailbox.py Avoid exception if there's a stray directory inside a Maildir folder. 2007-07-14 21:56:19 +00:00
test_marshal.py Verify neither dumps or loads overflow the stack and segfault. 2007-05-18 05:47:16 +00:00
test_math.py Make test_math error messages more meaningful for small discrepancies in results 2007-07-27 10:36:30 +00:00
test_md5.py Have md5 raise a DeprecationWarning as per PEP 4. 2007-05-30 22:24:28 +00:00
test_mhlib.py
test_mimetools.py Remove usage of sets module (patch #1500609). 2006-07-17 13:23:46 +00:00
test_mimetypes.py Remove usage of sets module (patch #1500609). 2006-07-17 13:23:46 +00:00
test_minidom.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_mmap.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
test_module.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_modulefinder.py Fix test_modulefinder so it doesn't fail when run after test_distutils. 2006-10-28 21:56:49 +00:00
test_multibytecodec.py Fix for Windows: close a temporary file before trying to delete it. 2007-06-05 19:28:15 +00:00
test_multibytecodec_support.py Fix gb18030 codec's bug that doesn't map two-byte characters on 2007-08-04 04:10:18 +00:00
test_multifile.py More "noone expected this to run twice"ness removal. 2004-08-03 11:14:09 +00:00
test_mutants.py Fix SF bug #1546288, crash in dict_equal. 2006-09-05 02:24:03 +00:00
test_netrc.py Unconditionally opening the temp file in text mode causes this test to fail 2003-08-11 12:13:14 +00:00
test_new.py Port test_new.py to unittest. 2007-01-20 23:07:28 +00:00
test_nis.py Convert test_nis to unittest. 2006-10-29 19:24:43 +00:00
test_normalization.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_ntpath.py Patch 1339796: add a relpath() function to os.path. 2007-03-16 22:16:08 +00:00
test_old_mailbox.py Whitespace normalization. 2007-01-30 03:03:46 +00:00
test_opcodes.py Convert test_opcodes to unittest. 2006-10-28 13:56:58 +00:00
test_openpty.py Move the check for openpty to the beginning. 2006-10-29 21:54:18 +00:00
test_operator.py Patch #1654417: make operator.{get,set,del}slice use the full range 2007-03-06 18:59:11 +00:00
test_optparse.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_os.py Bug #1709599: Run test_1565150 only if the file system is NTFS. 2007-08-30 19:04:09 +00:00
test_ossaudiodev.py Catch IOError for when the device file doesn't exist or the user doesn't have 2007-08-26 22:16:23 +00:00
test_parser.py SF patch# 1755885 by Kurt Kaiser: show location of Unicode escape errors. 2007-07-18 17:19:14 +00:00
test_peepholer.py Fix embarrassing typo and fix constantification of None 2007-03-02 19:20:46 +00:00
test_pep247.py Have the sha module raise a DeprecationWarning as specified in PEP 4. 2007-05-31 19:20:00 +00:00
test_pep263.py Add a comment explaining -kb. 2004-10-13 05:29:39 +00:00
test_pep277.py Stop printing listdir bytestring output, as the precise list of strings 2004-11-07 20:01:56 +00:00
test_pep292.py Fix bug in passing tuples to string.Template. All other values (with working 2006-07-05 11:03:49 +00:00
test_pep352.py Remove test.test_support.guard_warnings_filter. 2007-08-14 05:51:06 +00:00
test_pickle.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_pickletools.py
test_pipes.py * Skip test_pipes on non-POSIX. 2007-08-30 12:32:23 +00:00
test_pkg.py Convert test_pkg to use unittest. 2007-08-24 19:13:58 +00:00
test_pkgimport.py Removed reliance on damaged module object appearing in sys.modules 2004-08-02 03:59:57 +00:00
test_platform.py Fix test_platform on cygwin. When running from build area, sys.executable 2006-04-04 15:52:00 +00:00
test_plistlib.py On second thought: "Errors should never pass silently", so barf when a 2004-11-12 09:36:12 +00:00
test_poll.py Whitespace normalization. 2006-11-03 02:32:46 +00:00
test_popen.py Port test_popen.py to unittest. 2007-01-24 00:42:19 +00:00
test_popen2.py Deprecate os.popen* and popen2 module in favor of the subprocess module. 2007-05-11 06:57:33 +00:00
test_poplib.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_posix.py Patch #1490190: posixmodule now includes os.chflags() and os.lchflags() 2007-02-19 10:55:19 +00:00
test_posixpath.py Better tests for posixpath.commonprefix 2007-05-11 17:59:59 +00:00
test_pow.py Add explicit test for a misbehaving math.floor 2007-07-26 14:03:00 +00:00
test_pprint.py pprint functions used to sort a dict (by key) if and only if 2006-06-02 23:22:51 +00:00
test_profile.py Added the cProfile module. 2006-02-08 12:53:56 +00:00
test_profilehooks.py Enable the profiling of C functions (builtins and extensions) 2004-03-24 21:57:10 +00:00
test_pty.py This gets the test working on Solaris. It seems a little hokey to me, 2007-04-27 06:45:32 +00:00
test_pwd.py skip NIS entries, empty entries, etc 2005-12-12 20:53:40 +00:00
test_pyclbr.py Bug #1560617: in pyclbr, return full module name not only for classes, 2006-09-30 11:06:47 +00:00
test_pyexpat.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_queue.py fix typo 2006-03-25 13:12:56 +00:00
test_quopri.py Relax result test for program mode of quopri. 2006-03-23 19:14:23 +00:00
test_random.py Remove test.test_support.guard_warnings_filter. 2007-08-14 05:51:06 +00:00
test_re.py Remove test.test_support.guard_warnings_filter. 2007-08-14 05:51:06 +00:00
test_repr.py Bug #1734723: Fix repr.Repr() so it doesn't ignore the maxtuple attribute. 2007-06-11 07:29:43 +00:00
test_resource.py Try to get rid of spurious failure in test_resource on the Debian buildbots by changing the file size limit before attempting to close the file 2007-07-24 14:39:23 +00:00
test_rfc822.py Port forward from 2.4 branch: 2006-05-01 03:03:02 +00:00
test_richcmp.py Exceptions should inherit from Exception now. 2006-03-24 07:03:44 +00:00
test_robotparser.py fixes 813986 2007-08-28 23:22:52 +00:00
test_runpy.py Fix bug 1764407 - the -i switch now does the right thing when using the -m switch 2007-08-25 10:50:41 +00:00
test_sax.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_scope.py Do not copy free variables to locals in class namespaces. 2007-02-26 18:41:18 +00:00
test_scriptpackages.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_select.py Add new utility function, reap_children(), to test_support. This should 2006-06-29 04:10:08 +00:00
test_set.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_sets.py Deprecate the sets module. 2007-01-13 00:29:49 +00:00
test_sgmllib.py Forward port of 51850 from release25-maint branch. 2006-09-11 04:24:09 +00:00
test_sha.py Have the sha module raise a DeprecationWarning as specified in PEP 4. 2007-05-31 19:20:00 +00:00
test_shelve.py Removed deprecated method arguments from the shelve module. 2004-12-05 03:58:17 +00:00
test_shlex.py Whitespace normalization. 2003-04-24 16:02:54 +00:00
test_shutil.py test_copytree_simple(): This was leaving behind two new temp 2006-08-10 03:01:26 +00:00
test_signal.py Patch #1008: port test_signal to unittest. 2007-08-24 18:07:52 +00:00
test_site.py Fix test_site to not call open('...', 'wU'), as that now raises an error. 2005-05-27 14:58:06 +00:00
test_slice.py SF 1191699: Make slices picklable 2007-04-11 18:40:58 +00:00
test_smtplib.py Added test for behavior of operations on an unconnected SMTP object, 2007-08-21 16:57:18 +00:00
test_socket.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_socket_ssl.py This contains a number of things: 2007-08-29 22:35:05 +00:00
test_socketserver.py Reap children before the test starts so hopefully SocketServer 2007-08-26 06:29:57 +00:00
test_softspace.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_sort.py move test into a unittest.TestCase, no functional changes 2005-11-24 21:58:51 +00:00
test_sqlite.py Updated the sqlite3 module to the external pysqlite 2.2.2 version. 2006-04-23 15:24:26 +00:00
test_ssl.py > Regardless, building a fixed test certificate and checking it in sounds like 2007-08-27 17:19:42 +00:00
test_startfile.py we need os.path too for the normal run on windows 2006-04-04 19:29:29 +00:00
test_str.py Prevent these tests from running on Win64 since they don\'t apply there either 2007-06-11 02:14:39 +00:00
test_strftime.py Deal with case of when locale time values has characters that can be mistaken 2004-03-20 23:09:40 +00:00
test_string.py Fix bug: 2005-10-21 11:45:01 +00:00
test_stringprep.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_strop.py
test_strptime.py Make _strptime.TimeRE().pattern() use ``\s+`` for matching whitespace instead 2007-06-03 23:13:41 +00:00
test_struct.py Remove test.test_support.guard_warnings_filter. 2007-08-14 05:51:06 +00:00
test_structmembers.py Make test_structmembers pass when run with regrtests's -R flag. 2007-08-24 21:09:42 +00:00
test_structseq.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
test_subprocess.py Applied patch 1669481, slightly modified: Support close_fds on Win32 2007-05-26 22:18:20 +00:00
test_sunaudiodev.py
test_sundry.py Patch #1680959: add test suite for pipes module. 2007-08-30 10:38:56 +00:00
test_support.py Port test_frozen to unittest. 2007-08-24 18:22:54 +00:00
test_symtable.py Use unittest and make sure a few other cases don't crash 2006-01-23 07:49:36 +00:00
test_syntax.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_sys.py current_frames_with_threads(): There's actually no way 2006-07-25 04:07:22 +00:00
test_tarfile.py TarFile.__init__() no longer fails if no name argument is passed and 2007-08-28 12:31:09 +00:00
test_tcl.py Make use of new str.startswith/endswith semantics. 2006-06-09 20:43:48 +00:00
test_telnetlib.py Whitespace normalization. Ugh, we really need to do this more often. 2007-04-25 06:30:05 +00:00
test_tempfile.py Patch #1630118: add a SpooledTemporaryFile class to tempfile. 2007-03-19 18:52:08 +00:00
test_textwrap.py Patch #1581073: add a flag to textwrap that prevents the dropping of 2007-03-13 18:15:41 +00:00
test_thread.py Increase the small thread stack size to get the test 2006-06-13 19:02:35 +00:00
test_threaded_import.py Repair KeyError when running test_threaded_import under -R, 2006-06-19 08:14:28 +00:00
test_threadedtempfile.py Whitespace normalization. 2007-03-12 18:07:52 +00:00
test_threading.py Patch #1731049: make threading.py use a proper "raise" when checking internal state, rather than assert statements (which get stripped out by -O). 2007-06-06 00:17:35 +00:00
test_threading_local.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_threadsignals.py test_signal: Signal handling on the Tru64 buildbot 2006-08-12 04:42:47 +00:00
test_time.py Make output on test_strptime() be more verbose in face of failure. This is in 2006-09-23 19:53:20 +00:00
test_timeout.py Try to fix several networking tests. The problem is that if hosts have 2006-06-11 20:25:56 +00:00
test_tokenize.py Hmm, this test has failed at least twice recently on the OpenBSD and 2006-09-02 19:40:19 +00:00
test_trace.py Bug #1191458: tracing over for loops now produces a line event 2006-08-04 04:58:47 +00:00
test_traceback.py Fix a bug in traceback.format_exception_only() that led to an error 2006-09-24 12:50:24 +00:00
test_transformer.py compiler.transformer: correct lineno attribute when possible 2004-09-07 15:28:01 +00:00
test_tuple.py Improve test coverage. 2004-09-30 07:47:20 +00:00
test_types.py Convert test_types to unittest. 2006-10-29 19:35:03 +00:00
test_ucn.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_unary.py
test_unicode.py Fix failing unicode test caused by change to ast.c at r56441 2007-07-18 19:58:42 +00:00
test_unicode_file.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_unicodedata.py Bug #1704793: Return UTF-16 pair if unicodedata.lookup cannot 2007-07-28 07:03:05 +00:00
test_unittest.py Fix those parts in the testsuite that assumed that sys.maxint would cause overflow on x64. Now the testsuite is well behaved on that platform. 2007-05-03 20:09:56 +00:00
test_univnewlines.py Replace backticks with repr() or "%r" 2004-02-12 17:35:32 +00:00
test_unpack.py Patch #1682205: a TypeError while unpacking an iterable is no longer 2007-03-21 09:00:39 +00:00
test_urllib.py Get test passing again by commenting out the reference to the test class. 2007-05-25 05:13:40 +00:00
test_urllib2.py Patch #1752270, #1750931: complain if urllib2 add_handler called 2007-07-12 08:05:45 +00:00
test_urllib2_localnet.py More buildbot cleanup - let the OS assign the port for test_urllib2_localnet 2007-07-25 12:57:48 +00:00
test_urllib2net.py Added an optional timeout parameter to function urllib2.urlopen, 2007-06-06 17:15:23 +00:00
test_urllibnet.py Try to fix several networking tests. The problem is that if hosts have 2006-06-11 20:25:56 +00:00
test_urlparse.py Patch #624325: urlparse.urlparse() and urlparse.urlsplit() results 2006-04-01 22:14:43 +00:00
test_userdict.py Fix a bug in test_dict and test_userdict, found at the PyPy sprint. 2007-03-04 17:18:54 +00:00
test_userlist.py Move list and tuple tests from test_types.py to their own scripts: 2003-12-08 11:38:45 +00:00
test_userstring.py Improve extended slicing support in builtin types and classes. Specifically: 2007-08-28 15:28:19 +00:00
test_uu.py Try reverting part of r53145 that seems to cause the Windows buildbots to fail in test_uu.UUFileTest.test_encode 2007-01-18 05:40:58 +00:00
test_uuid.py Bug #1541863: uuid.uuid1 failed to generate unique identifiers 2006-08-18 03:47:18 +00:00
test_wait3.py Restore rev 47014: 2006-07-07 06:03:15 +00:00
test_wait4.py Restore rev 47014: 2006-07-07 06:03:15 +00:00
test_warnings.py Make test_warnings re-entrant. 2007-08-17 20:16:15 +00:00
test_wave.py
test_weakref.py Fix crasher for when an object's __del__ creates a new weakref to itself. 2007-01-23 23:21:22 +00:00
test_whichdb.py Treat empty dat/dir pairs as dumbdbm. Fixes #744687. 2003-06-14 08:16:34 +00:00
test_winreg.py * Skip test_pipes on non-POSIX. 2007-08-30 12:32:23 +00:00
test_winsound.py Update test_winsound to check for a configured sound card (using a VBScript 2006-03-16 17:34:41 +00:00
test_with.py Finish bringing SVN into line with latest version of PEP 343 by getting rid of all remaining references to context objects that I could find. Without a __context__() method context objects no longer exist. Also get test_with working again, and adopt a suggestion from Neal for decimal.Context.get_manager() 2006-05-03 13:02:47 +00:00
test_wsgiref.py Standardize on test.test_support.run_unittest() (as opposed to a mix of run_unittest() and run_suite()). Also, add functionality to run_unittest() that admits usage of unittest.TestLoader.loadTestsFromModule(). 2007-04-25 17:29:52 +00:00
test_xdrlib.py Move xdrlib tests from the module into a separate test script, 2006-12-01 16:59:47 +00:00
test_xml_etree.py restore test un-intentionally removed in the xmlcore purge (revision 50941) 2006-07-29 18:19:19 +00:00
test_xml_etree_c.py SF#1534630 2006-08-16 16:47:07 +00:00
test_xmllib.py Do not use the default namespace for attributes. 2004-05-02 20:37:13 +00:00
test_xmlrpc.py Ignore test failures caused by 'resource temporarily unavailable' 2007-08-29 10:28:28 +00:00
test_xpickle.py Combine the functionality of test_support.run_unittest() 2003-05-01 17:45:56 +00:00
test_xrange.py Make xrange more Py_ssize_t aware, by assuming a Py_ssize_t is always at 2006-04-04 17:28:12 +00:00
test_zipfile.py Patch #1675424: Added tests for uncovered code in the zipfile module. 2007-07-12 09:59:22 +00:00
test_zipfile64.py Disable this test until we can determine what to do about it 2006-06-16 04:30:34 +00:00
test_zipimport.py Whitespace normalization. 2006-04-11 01:44:26 +00:00
test_zlib.py Remove code that hasn't been called in years. 2007-04-24 04:09:52 +00:00
testall.py
testcodec.py
testimg.uue
testimgr.uue
testrgb.uue
testtar.tar Added errors argument to TarFile class that allows the user to 2007-05-27 19:49:30 +00:00
tf_inherit_check.py
threaded_import_hangers.py SF bug #1473760 TempFile can hang on Windows. 2006-04-21 21:18:10 +00:00
time_hashlib.py Renamed test_hashlib_speed.py to time_hashlib.py. 2006-03-14 22:48:56 +00:00
tokenize_tests.txt PEP-0318, @decorator-style. In Guido's words: 2004-08-02 06:10:11 +00:00
warning_tests.py Add tests for the filename. 2007-04-03 16:53:43 +00:00
xmltests.py added cElementTree tests 2005-12-15 18:41:22 +00:00

README

+++++++++++++++++++++++++++++++
Writing Python Regression Tests
+++++++++++++++++++++++++++++++

:Author: Skip Montanaro
:Contact: skip@mojam.com

Introduction
============

If you add a new module to Python or modify the functionality of an existing
module, you should write one or more test cases to exercise that new
functionality.  There are different ways to do this within the regression
testing facility provided with Python; any particular test should use only
one of these options.  Each option requires writing a test module using the
conventions of the selected option:

    - unittest_ based tests
    - doctest_ based tests
    - "traditional" Python test modules

Regardless of the mechanics of the testing approach you choose,
you will be writing unit tests (isolated tests of functions and objects
defined by the module) using white box techniques.  Unlike black box
testing, where you only have the external interfaces to guide your test case
writing, in white box testing you can see the code being tested and tailor
your test cases to exercise it more completely.  In particular, you will be
able to refer to the C and Python code in the CVS repository when writing
your regression test cases.

.. _unittest: http://www.python.org/doc/current/lib/module-unittest.html
.. _doctest: http://www.python.org/doc/current/lib/module-doctest.html

unittest-based tests
------------------
The unittest_ framework is based on the ideas of unit testing as espoused
by Kent Beck and the `Extreme Programming`_ (XP) movement.  The specific
interface provided by the framework is tightly based on the JUnit_
Java implementation of Beck's original SmallTalk test framework.  Please
see the documentation of the unittest_ module for detailed information on
the interface and general guidelines on writing unittest-based tests.

The test_support helper module provides a function for use by
unittest-based tests in the Python regression testing framework,
``run_unittest()``. This is the primary way of running tests in the
standard library. You can pass it any number of the following:

- classes derived from or instances of ``unittest.TestCase`` or
  ``unittest.TestSuite``. These will be handed off to unittest for
  converting into a proper TestSuite instance.

- a string; this must be a key in sys.modules. The module associated with
  that string will be scanned by ``unittest.TestLoader.loadTestsFromModule``.
  This is usually seen as ``test_support.run_unittest(__name__)`` in a test
  module's ``test_main()`` function. This has the advantage of picking up
  new tests automatically, without you having to add each new test case
  manually.
   
All test methods in the Python regression framework have names that
start with "``test_``" and use lower-case names with words separated with
underscores.

Test methods should *not* have docstrings!  The unittest module prints
the docstring if there is one, but otherwise prints the function name
and the full class name.  When there's a problem with a test, the
latter information makes it easier to find the source for the test
than the docstring.

All unittest-based tests in the Python test suite use boilerplate that
looks like this (with minor variations)::

    import unittest
    from test import test_support

    class MyTestCase1(unittest.TestCase):

        # Define setUp and tearDown only if needed

        def setUp(self):
            unittest.TestCase.setUp(self)
            ... additional initialization...

        def tearDown(self):
            ... additional finalization...
            unittest.TestCase.tearDown(self)

        def test_feature_one(self):
            # Testing feature one
            ...unit test for feature one...

        def test_feature_two(self):
            # Testing feature two
            ...unit test for feature two...

        ...etc...

    class MyTestCase2(unittest.TestCase):
        ...same structure as MyTestCase1...

    ...etc...

    def test_main():
        test_support.run_unittest(__name__)

    if __name__ == "__main__":
        test_main()

This has the advantage that it allows the unittest module to be used
as a script to run individual tests as well as working well with the
regrtest framework.

.. _Extreme Programming: http://www.extremeprogramming.org/
.. _JUnit: http://www.junit.org/

doctest based tests
-------------------
Tests written to use doctest_ are actually part of the docstrings for
the module being tested.  Each test is written as a display of an
interactive session, including the Python prompts, statements that would
be typed by the user, and the output of those statements (including
tracebacks, although only the exception msg needs to be retained then).
The module in the test package is simply a wrapper that causes doctest
to run over the tests in the module.  The test for the difflib module
provides a convenient example::

    import difflib
    from test import test_support
    test_support.run_doctest(difflib)

If the test is successful, nothing is written to stdout (so you should not
create a corresponding output/test_difflib file), but running regrtest
with -v will give a detailed report, the same as if passing -v to doctest.

A second argument can be passed to run_doctest to tell doctest to search
``sys.argv`` for -v instead of using test_support's idea of verbosity.  This
is useful for writing doctest-based tests that aren't simply running a
doctest'ed Lib module, but contain the doctests themselves.  Then at
times you may want to run such a test directly as a doctest, independent
of the regrtest framework.  The tail end of test_descrtut.py is a good
example::

    def test_main(verbose=None):
        from test import test_support, test_descrtut
        test_support.run_doctest(test_descrtut, verbose)

    if __name__ == "__main__":
        test_main(1)

If run via regrtest, ``test_main()`` is called (by regrtest) without
specifying verbose, and then test_support's idea of verbosity is used.  But
when run directly, ``test_main(1)`` is called, and then doctest's idea of
verbosity is used.

See the documentation for the doctest module for information on
writing tests using the doctest framework.

"traditional" Python test modules
---------------------------------
The mechanics of how the "traditional" test system operates are fairly
straightforward.  When a test case is run, the output is compared with the
expected output that is stored in .../Lib/test/output.  If the test runs to
completion and the actual and expected outputs match, the test succeeds, if
not, it fails.  If an ``ImportError`` or ``test_support.TestSkipped`` error
is raised, the test is not run.

Executing Test Cases
====================
If you are writing test cases for module spam, you need to create a file
in .../Lib/test named test_spam.py.  In addition, if the tests are expected
to write to stdout during a successful run, you also need to create an
expected output file in .../Lib/test/output named test_spam ("..."
represents the top-level directory in the Python source tree, the directory
containing the configure script).  If needed, generate the initial version
of the test output file by executing::

    ./python Lib/test/regrtest.py -g test_spam.py

from the top-level directory.

Any time you modify test_spam.py you need to generate a new expected
output file.  Don't forget to desk check the generated output to make sure
it's really what you expected to find!  All in all it's usually better
not to have an expected-out file (note that doctest- and unittest-based
tests do not).

To run a single test after modifying a module, simply run regrtest.py
without the -g flag::

    ./python Lib/test/regrtest.py test_spam.py

While debugging a regression test, you can of course execute it
independently of the regression testing framework and see what it prints::

    ./python Lib/test/test_spam.py

To run the entire test suite:

- [UNIX, + other platforms where "make" works] Make the "test" target at the
  top level::

    make test

- [WINDOWS] Run rt.bat from your PCBuild directory.  Read the comments at
  the top of rt.bat for the use of special -d, -O and -q options processed
  by rt.bat.

- [OTHER] You can simply execute the two runs of regrtest (optimized and
  non-optimized) directly::

    ./python Lib/test/regrtest.py
    ./python -O Lib/test/regrtest.py

But note that this way picks up whatever .pyc and .pyo files happen to be
around.  The makefile and rt.bat ways run the tests twice, the first time
removing all .pyc and .pyo files from the subtree rooted at Lib/.

Test cases generate output based upon values computed by the test code.
When executed, regrtest.py compares the actual output generated by executing
the test case with the expected output and reports success or failure.  It
stands to reason that if the actual and expected outputs are to match, they
must not contain any machine dependencies.  This means your test cases
should not print out absolute machine addresses (e.g. the return value of
the id() builtin function) or floating point numbers with large numbers of
significant digits (unless you understand what you are doing!).


Test Case Writing Tips
======================
Writing good test cases is a skilled task and is too complex to discuss in
detail in this short document.  Many books have been written on the subject.
I'll show my age by suggesting that Glenford Myers' `"The Art of Software
Testing"`_, published in 1979, is still the best introduction to the subject
available.  It is short (177 pages), easy to read, and discusses the major
elements of software testing, though its publication predates the
object-oriented software revolution, so doesn't cover that subject at all.
Unfortunately, it is very expensive (about $100 new).  If you can borrow it
or find it used (around $20), I strongly urge you to pick up a copy.

The most important goal when writing test cases is to break things.  A test
case that doesn't uncover a bug is much less valuable than one that does.
In designing test cases you should pay attention to the following:

    * Your test cases should exercise all the functions and objects defined
      in the module, not just the ones meant to be called by users of your
      module.  This may require you to write test code that uses the module
      in ways you don't expect (explicitly calling internal functions, for
      example - see test_atexit.py).

    * You should consider any boundary values that may tickle exceptional
      conditions (e.g. if you were writing regression tests for division,
      you might well want to generate tests with numerators and denominators
      at the limits of floating point and integer numbers on the machine
      performing the tests as well as a denominator of zero).

    * You should exercise as many paths through the code as possible.  This
      may not always be possible, but is a goal to strive for.  In
      particular, when considering if statements (or their equivalent), you
      want to create test cases that exercise both the true and false
      branches.  For loops, you should create test cases that exercise the
      loop zero, one and multiple times.

    * You should test with obviously invalid input.  If you know that a
      function requires an integer input, try calling it with other types of
      objects to see how it responds.

    * You should test with obviously out-of-range input.  If the domain of a
      function is only defined for positive integers, try calling it with a
      negative integer.

    * If you are going to fix a bug that wasn't uncovered by an existing
      test, try to write a test case that exposes the bug (preferably before
      fixing it).

    * If you need to create a temporary file, you can use the filename in
      ``test_support.TESTFN`` to do so.  It is important to remove the file
      when done; other tests should be able to use the name without cleaning
      up after your test.

.. _"The Art of Software Testing": 
        http://www.amazon.com/exec/obidos/ISBN=0471043281

Regression Test Writing Rules
=============================
Each test case is different.  There is no "standard" form for a Python
regression test case, though there are some general rules (note that
these mostly apply only to the "classic" tests; unittest_- and doctest_-
based tests should follow the conventions natural to those frameworks)::

    * If your test case detects a failure, raise ``TestFailed`` (found in
      ``test.test_support``).

    * Import everything you'll need as early as possible.

    * If you'll be importing objects from a module that is at least
      partially platform-dependent, only import those objects you need for
      the current test case to avoid spurious ``ImportError`` exceptions
      that prevent the test from running to completion.

    * Print all your test case results using the ``print`` statement.  For
      non-fatal errors, print an error message (or omit a successful
      completion print) to indicate the failure, but proceed instead of
      raising ``TestFailed``.

    * Use ``assert`` sparingly, if at all.  It's usually better to just print
      what you got, and rely on regrtest's got-vs-expected comparison to
      catch deviations from what you expect.  ``assert`` statements aren't
      executed at all when regrtest is run in -O mode; and, because they
      cause the test to stop immediately, can lead to a long & tedious
      test-fix, test-fix, test-fix, ... cycle when things are badly broken
      (and note that "badly broken" often includes running the test suite
      for the first time on new platforms or under new implementations of
      the language).

Miscellaneous
=============
There is a test_support module in the test package you can import for
your test case.  Import this module using either::

    import test.test_support

or::

    from test import test_support

test_support provides the following useful objects:

    * ``TestFailed`` - raise this exception when your regression test detects
      a failure.

    * ``TestSkipped`` - raise this if the test could not be run because the
      platform doesn't offer all the required facilities (like large
      file support), even if all the required modules are available.

    * ``ResourceDenied`` - this is raised when a test requires a resource that
      is not available.  Primarily used by 'requires'.

    * ``verbose`` - you can use this variable to control print output.  Many
      modules use it.  Search for "verbose" in the test_*.py files to see
      lots of examples.

    * ``forget(module_name)`` - attempts to cause Python to "forget" that it
      loaded a module and erase any PYC files.

    * ``is_resource_enabled(resource)`` - Returns a boolean based on whether
      the resource is enabled or not.

    * ``requires(resource [, msg])`` - if the required resource is not
      available the ResourceDenied exception is raised.
    
    * ``verify(condition, reason='test failed')``.  Use this instead of::

          assert condition[, reason]

      ``verify()`` has two advantages over ``assert``:  it works even in -O
      mode, and it raises ``TestFailed`` on failure instead of
      ``AssertionError``.

    * ``have_unicode`` - true if Unicode is available, false otherwise.

    * ``is_jython`` - true if the interpreter is Jython, false otherwise.

    * ``TESTFN`` - a string that should always be used as the filename when
      you need to create a temp file.  Also use ``try``/``finally`` to
      ensure that your temp files are deleted before your test completes.
      Note that you cannot unlink an open file on all operating systems, so
      also be sure to close temp files before trying to unlink them.

    * ``sortdict(dict)`` - acts like ``repr(dict.items())``, but sorts the
      items first.  This is important when printing a dict value, because
      the order of items produced by ``dict.items()`` is not defined by the
      language.

    * ``findfile(file)`` - you can call this function to locate a file
      somewhere along sys.path or in the Lib/test tree - see
      test_linuxaudiodev.py for an example of its use.

    * ``fcmp(x,y)`` - you can call this function to compare two floating
      point numbers when you expect them to only be approximately equal
      withing a fuzz factor (``test_support.FUZZ``, which defaults to 1e-6).

    * ``check_syntax_error(testcase, statement)`` - make sure that the
      statement is *not* correct Python syntax.


Python and C statement coverage results are currently available at

    http://www.musi-cal.com/~skip/python/Python/dist/src/

As of this writing (July, 2000) these results are being generated nightly.
You can refer to the summaries and the test coverage output files to see
where coverage is adequate or lacking and write test cases to beef up the
coverage.

Some Non-Obvious regrtest Features
==================================
    * Automagic test detection:  When you create a new test file
      test_spam.py, you do not need to modify regrtest (or anything else)
      to advertise its existence.  regrtest searches for and runs all
      modules in the test directory with names of the form test_xxx.py.

    * Miranda output:  If, when running test_spam.py, regrtest does not
      find an expected-output file test/output/test_spam, regrtest
      pretends that it did find one, containing the single line

      test_spam

      This allows new tests that don't expect to print anything to stdout
      to not bother creating expected-output files.

    * Two-stage testing:  To run test_spam.py, regrtest imports test_spam
      as a module.  Most tests run to completion as a side-effect of
      getting imported.  After importing test_spam, regrtest also executes
      ``test_spam.test_main()``, if test_spam has a ``test_main`` attribute.
      This is rarely required with the "traditional" Python tests, and
      you shouldn't create a module global with name test_main unless
      you're specifically exploiting this gimmick.  This usage does
      prove useful with unittest-based tests as well, however; defining
      a ``test_main()`` which is run by regrtest and a script-stub in the
      test module ("``if __name__ == '__main__': test_main()``") allows
      the test to be used like any other Python test and also work
      with the unittest.py-as-a-script approach, allowing a developer
      to run specific tests from the command line.