User-Agent: * Disallow: */out.php* Disallow: */cgi-bin/* Disallow: */te3/* Disallow: *p=* Disallow: /library/*.mp4 Disallow: /library/ User-agent: BLEXBot Crawl-delay: 10 User-agent: dotbot Crawl-delay: 10 User-agent: CCBot Crawl-Delay: 10 User-agent: VelenPublicWebCrawler Crawl-Delay: 10 User-agent: YandexBot Crawl-Delay: 10 User-agent: SemrushBot Crawl-Delay: 10 User-agent: bingbot Crawl-Delay: 10 User-agent: Barkrowler Crawl-Delay: 10