PageRenderTime 4ms CodeModel.GetById 1ms app.highlight 1ms RepoModel.GetById 1ms app.codeStats 0ms

/src/robots.txt

http://github.com/perlorg/cpanorg
Plain Text | 8 lines | 6 code | 2 blank | 0 comment | 0 complexity | 3146ee3515b68345e93078ad07230b6b MD5 | raw file 
1# Hello Robots!
2# Welcome to CPAN.
3
4User-agent: *
5Disallow: /badrobot/
6
7User-Agent: The Knowledge AI
8Disallow: /