1
0
mirror of https://github.com/mitb-archive/filebot synced 2024-11-04 16:35:08 -05:00
filebot/website/robots.txt
Reinhard Pointner 8c7d6985c5 * update web
2014-11-02 17:17:54 +00:00

13 lines
219 B
Plaintext

User-agent: *
Disallow: /forums/ucp.php
Disallow: /forums/mcp.php
Disallow: /forums/member
Disallow: /forums/memberlist.php
Disallow: /forums/faq.php
User-agent: TurnitinBot
Disallow: /
User-agent: Yandex
Disallow: /