database of robots.txt-derived permissions

Edit Package perl-WWW-RobotRules
http://search.cpan.org/dist/WWW-RobotRules/

This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.

Refresh
Refresh
Source Files
Filename Size Changed
WWW-RobotRules-6.02.tar.gz 0000009059 8.85 KB
perl-WWW-RobotRules.changes 0000000344 344 Bytes
perl-WWW-RobotRules.spec 0000002918 2.85 KB
Revision 5 (latest revision is 9)
Stephan Kulow's avatar Stephan Kulow (coolo) accepted request 106004 from Stephan Kulow's avatar Stephan Kulow (coolo) (revision 5)
- updated to 6.02
 * Restore perl-5.8.1 compatiblity.
Comments 0
openSUSE Build Service is sponsored by