make download rule to retrieve all (new) external data
[sheet.git] / robots.txt
2009-12-02 Mischa POSLAWSKYrobots: disallow crawlers to sources of perl modules
2009-12-02 Mischa POSLAWSKYsitemap to help robots prioritise pages