2 Commits

Author	SHA1	Message	Date
Tim Peters	863ac44b74	Whitespace normalization.	2002-04-16 01:38:40 +00:00
Martin v. Löwis	1c63f6e489	Correct various errors: ... - Use substring search, not re search for user-agent and paths. - Consider * entry last. Unquote, then requote URLs. - Treat empty Disallow as "allow everything". Add test cases. Fixes #523041	2002-02-28 15:24:47 +00:00