/kai/templates/home/robots.mako
https://bitbucket.org/bbangert/kai/ · Mako · 15 lines · 15 code · 0 blank · 0 comment · 0 complexity · 3fa171c8ff5df03bcda771c6ff250296 MD5 · raw file
- User-agent: *
- Crawl-delay: 2
- Request-rate: 2/3
- Visit-time: 0800-1600
- Disallow: /project/pylonshq*rev=*
- Disallow: /project/pylonshq*format=*
- Disallow: /project/pylonshq/query
- Disallow: /project/pylonshq/search
- Disallow: /project/pylonshq/wiki
- Disallow: /project/pylonshq/newticket
- Disallow: /project/pylonshq/changeset
- Disallow: /project/pylonshq/log
- Disallow: /project/pylonshq/milestone
- Disallow: /project/pylonshq/timeline
- Disallow: /project/pylonshq/roadmap