User-Agent: * Disallow: /149060/ Disallow: /error/ Disallow: /remote/ User-Agent: Opera Disallow: / User-Agent: Mozilla Disallow: / User-Agent: Java Disallow: / User-agent: BaiDuSpider Disallow: / User-agent: Baidu Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: WebReaper Disallow: / User-agent: NPBot Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: wget Disallow: / User-agent: k2spider Disallow: / User-agent: grub-client Disallow: / User-agent: Webinator Disallow: / User-agent: BSpider Disallow: / User-agent: TencentTraveler Disallow: / User-agent: Speedy Spider Disallow: / User-agent: Jakarta commons-httpclient Disallow: / User-agent: MJ12bot Disallow: / User-agent: Voila Disallow: / User-agent: legs Disallow: / User-agent: The web archive (IA Archiver) Disallow: / User-agent: Powermarks Disallow: / User-agent: WebCollage Disallow: / User-agent: yacy Disallow: / User-agent: StackRambler Disallow: / User-agent: Holmes Disallow: / User-agent: Heritrix Disallow: / User-agent: Custo Disallow: / User-agent: psbot Disallow: User-agent: CFNetwork Disallow: / User-agent: MSRBOT Disallow: / User-agent: Netcraft Disallow: / User-agent: Yandex bot Disallow: / User-agent: Gigabot Disallow: / User-agent: Scrubby Disallow: / User-agent: Robozilla Disallow: / User-agent: ia_archiver Disallow: / User-agent: naverbot Disallow: / User-agent: yeti Disallow: / User-agent: asterias Disallow: /