git.shiar.nl / sheet.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 77ea108) | patch
robots: disallow crawlers to sources of perl modules
authorMischa POSLAWSKY <perl@shiar.org>
Sun, 22 Nov 2009 06:18:12 +0000 (06:18 +0000)
committerMischa POSLAWSKY <perl@shiar.org>
Wed, 2 Dec 2009 20:58:37 +0000 (20:58 +0000)
commit706180618dd0dd43d6569359cb35bca84bc5ce51
tree0bdd8fcf1fa96d97272eb3010ebbb67241508db8tree | snapshot
parent77ea10832a3458193b8cee47bc0fdfd239a3e63dcommit | diff
robots: disallow crawlers to sources of perl modules

As far as they support * in Disallow.
Advantage of indexing all related modules is limited: source is (better)
available at official repository site.
robots.txt diff | blob | history
sheet.shiar.nl - software cheat sheets