# bad robots User-agent: CopyRightCheck User-agent: EmailCollector User-agent: EmailSiphon User-agent: EmailWolf User-agent: HTTrack User-agent: Microsoft.URL.Control User-agent: NetAnts User-agent: Offline Explorer User-agent: penthesilea User-agent: SpankBot User-agent: stress-agent User-agent: URL_Spider_Pro User-agent: WebBandit User-agent: WebCopier User-agent: WebmasterWorldForumBot User-agent: WebReaper User-agent: WebSauger User-agent: WebStripper User-agent: WWW-Collector-E Disallow: / # exclude from google User-agent: googlebot User-agent: bingbot Disallow: /typo3_*/ # exclude from all robots User-agent: * Disallow: /awstats/ Disallow: /cgi-bin/ Disallow: /usage2/ Disallow: /t3lib/ Disallow: /typo3/ Disallow: /typo3_src/ Disallow: /no_cache/