moparisthebest/filebot
1
0
Fork 0
mirror of https://github.com/mitb-archive/filebot synced 2024-11-17 23:05:03 -05:00
Code Issues Releases Wiki Activity
0e852e033c
filebot/website/robots.txt

14 lines
242 B
Plaintext
Raw Normal View History

* block TurnitinBot
2014-10-07 11:16:46 -04:00
User-agent: *
Disallow: /forums/ucp.php
Disallow: /forums/mcp.php
Disallow: /forums/member
Disallow: /forums/memberlist.php
Disallow: /forums/faq.php
Disallow: /forums/adm/
2016-04-02 15:17:25 -04:00
Disallow: /forums/adm/
* block TurnitinBot
2014-10-07 11:16:46 -04:00
User-agent: TurnitinBot
Disallow: /
* update web
2014-11-02 12:17:54 -05:00
User-agent: Yandex
Disallow: /
Reference in New Issue Copy Permalink