traverseda
/
cpython
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

update norobots link

This commit is contained in:
Skip Montanaro 2003-07-14 17:04:50 +00:00
parent 6d06815b56
commit 7233117960
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
Doc/lib/librobotparser.tex
View File

@ -15,7 +15,7 @@ This module provides a single class, \class{RobotFileParser}, which answers
questions about whether or not a particular user agent can fetch a URL on
the Web site that published the \file{robots.txt} file. For more details on
the structure of \file{robots.txt} files, see
\url{http://info.webcrawler.com/mak/projects/robots/norobots.html}.
\url{http://www.robotstxt.org/wc/norobots.html}.
\begin{classdesc}{RobotFileParser}{}