User-agent: Bingbot Crawl-delay: 5 User-agent: msnbot Crawl-delay: 5 User-agent: msnbot-media Crawl-delay: 5 User-agent: YandexBot Crawl-delay: 5 User-agent: 360Spider Disallow:/ Crawl-delay: 10 User-agent: 404checker Disallow:/ Crawl-delay: 10 User-agent: 404enemy Disallow:/ Crawl-delay: 10 User-agent: 80legs Disallow:/ Crawl-delay: 10 User-agent: Abonti Disallow:/ Crawl-delay: 10 User-agent: Aboundex Disallow:/ Crawl-delay: 10 User-agent: Aboundexbot Disallow:/ Crawl-delay: 10 User-agent: Acunetix Disallow:/ Crawl-delay: 10 User-agent: ADmantX Disallow:/ Crawl-delay: 10 User-agent: AfD-Verbotsverfahren Disallow:/ Crawl-delay: 10 User-agent: AhrefsBot Disallow:/ Crawl-delay: 10 User-agent: AIBOT Disallow:/ Crawl-delay: 10 User-agent: AiHitBot Disallow:/ Crawl-delay: 10 User-agent: Aipbot Disallow:/ Crawl-delay: 10 User-agent: Alexibot Disallow:/ Crawl-delay: 10 User-agent: Alligator Disallow:/ Crawl-delay: 10 User-agent: AllSubmitter Disallow:/ Crawl-delay: 10 User-agent: AlphaBot Disallow:/ Crawl-delay: 10 User-agent: Anarchie Disallow:/ Crawl-delay: 10 User-agent: Ankit Disallow:/ Crawl-delay: 10 User-agent: Apexoo Disallow:/ Crawl-delay: 10 User-agent: archive.org_bot Disallow:/ Crawl-delay: 10 User-agent: arquivo.pt Disallow:/ Crawl-delay: 10 User-agent: arquivo-web-crawler Disallow:/ Crawl-delay: 10 User-agent: Aspiegel Disallow:/ Crawl-delay: 10 User-agent: ASPSeek Disallow:/ Crawl-delay: 10 User-agent: Asterias Disallow:/ Crawl-delay: 10 User-agent: Attach Disallow:/ Crawl-delay: 10 User-agent: autoemailspider Disallow:/ Crawl-delay: 10 User-agent: AwarioRssBot Disallow:/ Crawl-delay: 10 User-agent: AwarioSmartBot Disallow:/ Crawl-delay: 10 User-agent: BackDoorBot Disallow:/ Crawl-delay: 10 User-agent: Backlink-Ceck Disallow:/ Crawl-delay: 10 User-agent: backlink-check Disallow:/ Crawl-delay: 10 User-agent: BacklinkCrawler Disallow:/ Crawl-delay: 10 User-agent: BackStreet Disallow:/ Crawl-delay: 10 User-agent: BackWeb Disallow:/ Crawl-delay: 10 User-agent: Badass Disallow:/ Crawl-delay: 10 User-agent: Bandit Disallow:/ Crawl-delay: 10 User-agent: Barkrowler Disallow:/ Crawl-delay: 10 User-agent: BatchFTP Disallow:/ Crawl-delay: 10 User-agent: Battleztar Bazinga Disallow:/ Crawl-delay: 10 User-agent: BBBike Disallow:/ Crawl-delay: 10 User-agent: BDCbot Disallow:/ Crawl-delay: 10 User-agent: BDFetch Disallow:/ Crawl-delay: 10 User-agent: BetaBot Disallow:/ Crawl-delay: 10 User-agent: Bigfoot Disallow:/ Crawl-delay: 10 User-agent: Bitacle Disallow:/ Crawl-delay: 10 User-agent: Blackboard Disallow:/ Crawl-delay: 10 User-agent: Black Hole Disallow:/ Crawl-delay: 10 User-agent: BlackWidow Disallow:/ Crawl-delay: 10 User-agent: BLEXBot Disallow:/ Crawl-delay: 10 User-agent: Blow Disallow:/ Crawl-delay: 10 User-agent: BlowFish Disallow:/ Crawl-delay: 10 User-agent: Boardreader Disallow:/ Crawl-delay: 10 User-agent: Bolt Disallow:/ Crawl-delay: 10 User-agent: BotALot Disallow:/ Crawl-delay: 10 User-agent: Brandprotect Disallow:/ Crawl-delay: 10 User-agent: Brandwatch Disallow:/ Crawl-delay: 10 User-agent: Buddy Disallow:/ Crawl-delay: 10 User-agent: BuiltBotTough Disallow:/ Crawl-delay: 10 User-agent: BuiltWith Disallow:/ Crawl-delay: 10 User-agent: Bullseye Disallow:/ Crawl-delay: 10 User-agent: BunnySlippers Disallow:/ Crawl-delay: 10 User-agent: BuzzSumo Disallow:/ Crawl-delay: 10 User-agent: Calculon Disallow:/ Crawl-delay: 10 User-agent: CATExplorador Disallow:/ Crawl-delay: 10 User-agent: CazoodleBot Disallow:/ Crawl-delay: 10 User-agent: CCBot Disallow:/ Crawl-delay: 10 User-agent: Cegbfeieh Disallow:/ Crawl-delay: 10 User-agent: CheeseBot Disallow:/ Crawl-delay: 10 User-agent: CherryPicker Disallow:/ Crawl-delay: 10 User-agent: CheTeam Disallow:/ Crawl-delay: 10 User-agent: ChinaClaw Disallow:/ Crawl-delay: 10 User-agent: Chlooe Disallow:/ Crawl-delay: 10 User-agent: Claritybot Disallow:/ Crawl-delay: 10 User-agent: Cliqzbot Disallow:/ Crawl-delay: 10 User-agent: Cloud mapping Disallow:/ Crawl-delay: 10 User-agent: coccocbot-web Disallow:/ Crawl-delay: 10 User-agent: Cogentbot Disallow:/ Crawl-delay: 10 User-agent: cognitiveseo Disallow:/ Crawl-delay: 10 User-agent: Collector Disallow:/ Crawl-delay: 10 User-agent: com.plumanalytics Disallow:/ Crawl-delay: 10 User-agent: Copier Disallow:/ Crawl-delay: 10 User-agent: CopyRightCheck Disallow:/ Crawl-delay: 10 User-agent: Copyscape Disallow:/ Crawl-delay: 10 User-agent: Cosmos Disallow:/ Crawl-delay: 10 User-agent: Craftbot Disallow:/ Crawl-delay: 10 User-agent: crawler4j Disallow:/ Crawl-delay: 10 User-agent: crawler.feedback Disallow:/ Crawl-delay: 10 User-agent: crawl.sogou.com Disallow:/ Crawl-delay: 10 User-agent: CrazyWebCrawler Disallow:/ Crawl-delay: 10 User-agent: Crescent Disallow:/ Crawl-delay: 10 User-agent: CrunchBot Disallow:/ Crawl-delay: 10 User-agent: CSHttp Disallow:/ Crawl-delay: 10 User-agent: Curious Disallow:/ Crawl-delay: 10 User-agent: Custo Disallow:/ Crawl-delay: 10 User-agent: DatabaseDriverMysqli Disallow:/ Crawl-delay: 10 User-agent: DataCha0s Disallow:/ Crawl-delay: 10 User-agent: DBLBot Disallow:/ Crawl-delay: 10 User-agent: demandbase-bot Disallow:/ Crawl-delay: 10 User-agent: Demon Disallow:/ Crawl-delay: 10 User-agent: Deusu Disallow:/ Crawl-delay: 10 User-agent: Devil Disallow:/ Crawl-delay: 10 User-agent: Digincore Disallow:/ Crawl-delay: 10 User-agent: DigitalPebble Disallow:/ Crawl-delay: 10 User-agent: DIIbot Disallow:/ Crawl-delay: 10 User-agent: Dirbuster Disallow:/ Crawl-delay: 10 User-agent: Disco Disallow:/ Crawl-delay: 10 User-agent: Discobot Disallow:/ Crawl-delay: 10 User-agent: Discoverybot Disallow:/ Crawl-delay: 10 User-agent: Dispatch Disallow:/ Crawl-delay: 10 User-agent: DittoSpyder Disallow:/ Crawl-delay: 10 User-agent: DnyzBot Disallow:/ Crawl-delay: 10 User-agent: DomainAppender Disallow:/ Crawl-delay: 10 User-agent: DomainCrawler Disallow:/ Crawl-delay: 10 User-agent: DomainSigmaCrawler Disallow:/ Crawl-delay: 10 User-agent: Domains Project Disallow:/ Crawl-delay: 10 User-agent: domainsproject.org Disallow:/ Crawl-delay: 10 User-agent: DomainStatsBot Disallow:/ Crawl-delay: 10 User-agent: Dotbot Disallow:/ Crawl-delay: 10 User-agent: Download Wonder Disallow:/ Crawl-delay: 10 User-agent: Dragonfly Disallow:/ Crawl-delay: 10 User-agent: Drip Disallow:/ Crawl-delay: 10 User-agent: DSearch Disallow:/ Crawl-delay: 10 User-agent: DTS Agent Disallow:/ Crawl-delay: 10 User-agent: EasyDL Disallow:/ Crawl-delay: 10 User-agent: Ebingbong Disallow:/ Crawl-delay: 10 User-agent: eCatch Disallow:/ Crawl-delay: 10 User-agent: ECCP/1.0 Disallow:/ Crawl-delay: 10 User-agent: Ecxi Disallow:/ Crawl-delay: 10 User-agent: EirGrabber Disallow:/ Crawl-delay: 10 User-agent: EMail Siphon Disallow:/ Crawl-delay: 10 User-agent: EMail Wolf Disallow:/ Crawl-delay: 10 User-agent: EroCrawler Disallow:/ Crawl-delay: 10 User-agent: evc-batch Disallow:/ Crawl-delay: 10 User-agent: Evil Disallow:/ Crawl-delay: 10 User-agent: Exabot Disallow:/ Crawl-delay: 10 User-agent: Express WebPictures Disallow:/ Crawl-delay: 10 User-agent: ExtLinksBot Disallow:/ Crawl-delay: 10 User-agent: Extractor Disallow:/ Crawl-delay: 10 User-agent: ExtractorPro Disallow:/ Crawl-delay: 10 User-agent: Extreme Picture Finder Disallow:/ Crawl-delay: 10 User-agent: EyeNetIE Disallow:/ Crawl-delay: 10 User-agent: Ezooms Disallow:/ Crawl-delay: 10 User-agent: facebookscraper Disallow:/ Crawl-delay: 10 User-agent: FDM Disallow:/ Crawl-delay: 10 User-agent: FemtosearchBot Disallow:/ Crawl-delay: 10 User-agent: FHscan Disallow:/ Crawl-delay: 10 User-agent: Fimap Disallow:/ Crawl-delay: 10 User-agent: Firefox/7.0 Disallow:/ Crawl-delay: 10 User-agent: FlashGet Disallow:/ Crawl-delay: 10 User-agent: Flunky Disallow:/ Crawl-delay: 10 User-agent: Foobot Disallow:/ Crawl-delay: 10 User-agent: Freeuploader Disallow:/ Crawl-delay: 10 User-agent: FrontPage Disallow:/ Crawl-delay: 10 User-agent: FyberSpider Disallow:/ Crawl-delay: 10 User-agent: Fyrebot Disallow:/ Crawl-delay: 10 User-agent: GalaxyBot Disallow:/ Crawl-delay: 10 User-agent: Genieo Disallow:/ Crawl-delay: 10 User-agent: GermCrawler Disallow:/ Crawl-delay: 10 User-agent: Getintent Disallow:/ Crawl-delay: 10 User-agent: GetRight Disallow:/ Crawl-delay: 10 User-agent: GetWeb Disallow:/ Crawl-delay: 10 User-agent: Gigablast Disallow:/ Crawl-delay: 10 User-agent: Gigabot Disallow:/ Crawl-delay: 10 User-agent: G-i-g-a-b-o-t Disallow:/ Crawl-delay: 10 User-agent: Go-Ahead-Got-It Disallow:/ Crawl-delay: 10 User-agent: Gotit Disallow:/ Crawl-delay: 10 User-agent: GoZilla Disallow:/ Crawl-delay: 10 User-agent: Go!Zilla Disallow:/ Crawl-delay: 10 User-agent: Grabber Disallow:/ Crawl-delay: 10 User-agent: GrabNet Disallow:/ Crawl-delay: 10 User-agent: Grafula Disallow:/ Crawl-delay: 10 User-agent: GrapeFX Disallow:/ Crawl-delay: 10 User-agent: GrapeshotCrawler Disallow:/ Crawl-delay: 10 User-agent: GridBot Disallow:/ Crawl-delay: 10 User-agent: GT::WWW Disallow:/ Crawl-delay: 10 User-agent: Haansoft Disallow:/ Crawl-delay: 10 User-agent: HaosouSpider Disallow:/ Crawl-delay: 10 User-agent: Harvest Disallow:/ Crawl-delay: 10 User-agent: Havij Disallow:/ Crawl-delay: 10 User-agent: HEADMasterSEO Disallow:/ Crawl-delay: 10 User-agent: heritrix Disallow:/ Crawl-delay: 10 User-agent: Heritrix Disallow:/ Crawl-delay: 10 User-agent: Hloader Disallow:/ Crawl-delay: 10 User-agent: HMView Disallow:/ Crawl-delay: 10 User-agent: HTMLparser Disallow:/ Crawl-delay: 10 User-agent: HTTP::Lite Disallow:/ Crawl-delay: 10 User-agent: HTTrack Disallow:/ Crawl-delay: 10 User-agent: Humanlinks Disallow:/ Crawl-delay: 10 User-agent: HybridBot Disallow:/ Crawl-delay: 10 User-agent: Iblog Disallow:/ Crawl-delay: 10 User-agent: IDBot Disallow:/ Crawl-delay: 10 User-agent: Id-search Disallow:/ Crawl-delay: 10 User-agent: IlseBot Disallow:/ Crawl-delay: 10 User-agent: Image Fetch Disallow:/ Crawl-delay: 10 User-agent: Image Sucker Disallow:/ Crawl-delay: 10 User-agent: IndeedBot Disallow:/ Crawl-delay: 10 User-agent: Indy Library Disallow:/ Crawl-delay: 10 User-agent: InfoNaviRobot Disallow:/ Crawl-delay: 10 User-agent: InfoTekies Disallow:/ Crawl-delay: 10 User-agent: instabid Disallow:/ Crawl-delay: 10 User-agent: Intelliseek Disallow:/ Crawl-delay: 10 User-agent: InterGET Disallow:/ Crawl-delay: 10 User-agent: Internet Ninja Disallow:/ Crawl-delay: 10 User-agent: InternetSeer Disallow:/ Crawl-delay: 10 User-agent: internetVista monitor Disallow:/ Crawl-delay: 10 User-agent: ips-agent Disallow:/ Crawl-delay: 10 User-agent: Iria Disallow:/ Crawl-delay: 10 User-agent: IRLbot Disallow:/ Crawl-delay: 10 User-agent: Iskanie Disallow:/ Crawl-delay: 10 User-agent: IstellaBot Disallow:/ Crawl-delay: 10 User-agent: JamesBOT Disallow:/ Crawl-delay: 10 User-agent: Jbrofuzz Disallow:/ Crawl-delay: 10 User-agent: JennyBot Disallow:/ Crawl-delay: 10 User-agent: JetCar Disallow:/ Crawl-delay: 10 User-agent: Jetty Disallow:/ Crawl-delay: 10 User-agent: JikeSpider Disallow:/ Crawl-delay: 10 User-agent: JOC Web Spider Disallow:/ Crawl-delay: 10 User-agent: Joomla Disallow:/ Crawl-delay: 10 User-agent: Jorgee Disallow:/ Crawl-delay: 10 User-agent: JustView Disallow:/ Crawl-delay: 10 User-agent: Jyxobot Disallow:/ Crawl-delay: 10 User-agent: Kenjin Spider Disallow:/ Crawl-delay: 10 User-agent: Keyword Density Disallow:/ Crawl-delay: 10 User-agent: Kinza Disallow:/ Crawl-delay: 10 User-agent: Kozmosbot Disallow:/ Crawl-delay: 10 User-agent: Lanshanbot Disallow:/ Crawl-delay: 10 User-agent: Larbin Disallow:/ Crawl-delay: 10 User-agent: LeechFTP Disallow:/ Crawl-delay: 10 User-agent: LeechGet Disallow:/ Crawl-delay: 10 User-agent: LexiBot Disallow:/ Crawl-delay: 10 User-agent: Lftp Disallow:/ Crawl-delay: 10 User-agent: LibWeb Disallow:/ Crawl-delay: 10 User-agent: Libwhisker Disallow:/ Crawl-delay: 10 User-agent: LieBaoFast Disallow:/ Crawl-delay: 10 User-agent: Lightspeedsystems Disallow:/ Crawl-delay: 10 User-agent: Likse Disallow:/ Crawl-delay: 10 User-agent: Linkdexbot Disallow:/ Crawl-delay: 10 User-agent: LinkextractorPro Disallow:/ Crawl-delay: 10 User-agent: LinkpadBot Disallow:/ Crawl-delay: 10 User-agent: LinkScan Disallow:/ Crawl-delay: 10 User-agent: LinksManager Disallow:/ Crawl-delay: 10 User-agent: LinkWalker Disallow:/ Crawl-delay: 10 User-agent: LinqiaMetadataDownloaderBot Disallow:/ Crawl-delay: 10 User-agent: LinqiaRSSBot Disallow:/ Crawl-delay: 10 User-agent: LinqiaScrapeBot Disallow:/ Crawl-delay: 10 User-agent: Lipperhey Disallow:/ Crawl-delay: 10 User-agent: Lipperhey Spider Disallow:/ Crawl-delay: 10 User-agent: Litemage_walker Disallow:/ Crawl-delay: 10 User-agent: Lmspider Disallow:/ Crawl-delay: 10 User-agent: LNSpiderguy Disallow:/ Crawl-delay: 10 User-agent: Ltx71 Disallow:/ Crawl-delay: 10 User-agent: lwp-request Disallow:/ Crawl-delay: 10 User-agent: LWP::Simple Disallow:/ Crawl-delay: 10 User-agent: lwp-trivial Disallow:/ Crawl-delay: 10 User-agent: Magnet Disallow:/ Crawl-delay: 10 User-agent: Mag-Net Disallow:/ Crawl-delay: 10 User-agent: magpie-crawler Disallow:/ Crawl-delay: 10 User-agent: Mail.RU_Bot Disallow:/ Crawl-delay: 10 User-agent: Majestic12 Disallow:/ Crawl-delay: 10 User-agent: Majestic SEO Disallow:/ Crawl-delay: 10 User-agent: Majestic-SEO Disallow:/ Crawl-delay: 10 User-agent: MarkMonitor Disallow:/ Crawl-delay: 10 User-agent: MarkWatch Disallow:/ Crawl-delay: 10 User-agent: Masscan Disallow:/ Crawl-delay: 10 User-agent: Mass Downloader Disallow:/ Crawl-delay: 10 User-agent: Mata Hari Disallow:/ Crawl-delay: 10 User-agent: MauiBot Disallow:/ Crawl-delay: 10 User-agent: Mb2345Browser Disallow:/ Crawl-delay: 10 User-agent: meanpathbot Disallow:/ Crawl-delay: 10 User-agent: Meanpathbot Disallow:/ Crawl-delay: 10 User-agent: MeanPath Bot Disallow:/ Crawl-delay: 10 User-agent: Mediatoolkitbot Disallow:/ Crawl-delay: 10 User-agent: mediawords Disallow:/ Crawl-delay: 10 User-agent: MegaIndex.ru Disallow:/ Crawl-delay: 10 User-agent: Metauri Disallow:/ Crawl-delay: 10 User-agent: MFC_Tear_Sample Disallow:/ Crawl-delay: 10 User-agent: MicroMessenger Disallow:/ Crawl-delay: 10 User-agent: Microsoft Data Access Disallow:/ Crawl-delay: 10 User-agent: Microsoft URL Control Disallow:/ Crawl-delay: 10 User-agent: MIDown tool Disallow:/ Crawl-delay: 10 User-agent: MIIxpc Disallow:/ Crawl-delay: 10 User-agent: Mister PiX Disallow:/ Crawl-delay: 10 User-agent: MJ12bot Disallow:/ Crawl-delay: 10 User-agent: Mojeek Disallow:/ Crawl-delay: 10 User-agent: Mojolicious Disallow:/ Crawl-delay: 10 User-agent: Morfeus Fucking Scanner Disallow:/ Crawl-delay: 10 User-agent: MQQBrowser Disallow:/ Crawl-delay: 10 User-agent: Mr.4x3 Disallow:/ Crawl-delay: 10 User-agent: MSFrontPage Disallow:/ Crawl-delay: 10 User-agent: MSIECrawler Disallow:/ Crawl-delay: 10 User-agent: Msrabot Disallow:/ Crawl-delay: 10 User-agent: muhstik-scan Disallow:/ Crawl-delay: 10 User-agent: Musobot Disallow:/ Crawl-delay: 10 User-agent: Name Intelligence Disallow:/ Crawl-delay: 10 User-agent: Nameprotect Disallow:/ Crawl-delay: 10 User-agent: Navroad Disallow:/ Crawl-delay: 10 User-agent: NearSite Disallow:/ Crawl-delay: 10 User-agent: Needle Disallow:/ Crawl-delay: 10 User-agent: Nessus Disallow:/ Crawl-delay: 10 User-agent: NetAnts Disallow:/ Crawl-delay: 10 User-agent: Netcraft Disallow:/ Crawl-delay: 10 User-agent: netEstate NE Crawler Disallow:/ Crawl-delay: 10 User-agent: NetLyzer Disallow:/ Crawl-delay: 10 User-agent: NetMechanic Disallow:/ Crawl-delay: 10 User-agent: NetSpider Disallow:/ Crawl-delay: 10 User-agent: Nettrack Disallow:/ Crawl-delay: 10 User-agent: Net Vampire Disallow:/ Crawl-delay: 10 User-agent: Netvibes Disallow:/ Crawl-delay: 10 User-agent: NetZIP Disallow:/ Crawl-delay: 10 User-agent: NextGenSearchBot Disallow:/ Crawl-delay: 10 User-agent: Nibbler Disallow:/ Crawl-delay: 10 User-agent: NICErsPRO Disallow:/ Crawl-delay: 10 User-agent: Niki-bot Disallow:/ Crawl-delay: 10 User-agent: Nikto Disallow:/ Crawl-delay: 10 User-agent: NimbleCrawler Disallow:/ Crawl-delay: 10 User-agent: Nimbostratus Disallow:/ Crawl-delay: 10 User-agent: Ninja Disallow:/ Crawl-delay: 10 User-agent: Nmap Disallow:/ Crawl-delay: 10 User-agent: NPbot Disallow:/ Crawl-delay: 10 User-agent: Nutch Disallow:/ Crawl-delay: 10 User-agent: oBot Disallow:/ Crawl-delay: 10 User-agent: Octopus Disallow:/ Crawl-delay: 10 User-agent: Offline Explorer Disallow:/ Crawl-delay: 10 User-agent: Offline Navigator Disallow:/ Crawl-delay: 10 User-agent: OnCrawl Disallow:/ Crawl-delay: 10 User-agent: Openfind Disallow:/ Crawl-delay: 10 User-agent: OpenLinkProfiler Disallow:/ Crawl-delay: 10 User-agent: Openvas Disallow:/ Crawl-delay: 10 User-agent: OpenVAS Disallow:/ Crawl-delay: 10 User-agent: OPPO A33 Disallow:/ Crawl-delay: 10 User-agent: OrangeBot Disallow:/ Crawl-delay: 10 User-agent: OrangeSpider Disallow:/ Crawl-delay: 10 User-agent: OutclicksBot Disallow:/ Crawl-delay: 10 User-agent: OutfoxBot Disallow:/ Crawl-delay: 10 User-agent: PageAnalyzer Disallow:/ Crawl-delay: 10 User-agent: Page Analyzer Disallow:/ Crawl-delay: 10 User-agent: PageGrabber Disallow:/ Crawl-delay: 10 User-agent: page scorer Disallow:/ Crawl-delay: 10 User-agent: PageScorer Disallow:/ Crawl-delay: 10 User-agent: Pandalytics Disallow:/ Crawl-delay: 10 User-agent: Panscient Disallow:/ Crawl-delay: 10 User-agent: Papa Foto Disallow:/ Crawl-delay: 10 User-agent: Pavuk Disallow:/ Crawl-delay: 10 User-agent: pcBrowser Disallow:/ Crawl-delay: 10 User-agent: PECL::HTTP Disallow:/ Crawl-delay: 10 User-agent: PeoplePal Disallow:/ Crawl-delay: 10 User-agent: PHPCrawl Disallow:/ Crawl-delay: 10 User-agent: Picscout Disallow:/ Crawl-delay: 10 User-agent: Picsearch Disallow:/ Crawl-delay: 10 User-agent: PictureFinder Disallow:/ Crawl-delay: 10 User-agent: Pimonster Disallow:/ Crawl-delay: 10 User-agent: Pi-Monster Disallow:/ Crawl-delay: 10 User-agent: Pixray Disallow:/ Crawl-delay: 10 User-agent: PleaseCrawl Disallow:/ Crawl-delay: 10 User-agent: plumanalytics Disallow:/ Crawl-delay: 10 User-agent: Pockey Disallow:/ Crawl-delay: 10 User-agent: POE-Component-Client-HTTP Disallow:/ Crawl-delay: 10 User-agent: polaris version Disallow:/ Crawl-delay: 10 User-agent: Probethenet Disallow:/ Crawl-delay: 10 User-agent: ProPowerBot Disallow:/ Crawl-delay: 10 User-agent: ProWebWalker Disallow:/ Crawl-delay: 10 User-agent: Psbot Disallow:/ Crawl-delay: 10 User-agent: Pump Disallow:/ Crawl-delay: 10 User-agent: PxBroker Disallow:/ Crawl-delay: 10 User-agent: PyCurl Disallow:/ Crawl-delay: 10 User-agent: QueryN Metasearch Disallow:/ Crawl-delay: 10 User-agent: Quick-Crawler Disallow:/ Crawl-delay: 10 User-agent: RankActive Disallow:/ Crawl-delay: 10 User-agent: RankActiveLinkBot Disallow:/ Crawl-delay: 10 User-agent: RankFlex Disallow:/ Crawl-delay: 10 User-agent: RankingBot Disallow:/ Crawl-delay: 10 User-agent: RankingBot2 Disallow:/ Crawl-delay: 10 User-agent: Rankivabot Disallow:/ Crawl-delay: 10 User-agent: RankurBot Disallow:/ Crawl-delay: 10 User-agent: RealDownload Disallow:/ Crawl-delay: 10 User-agent: Reaper Disallow:/ Crawl-delay: 10 User-agent: RebelMouse Disallow:/ Crawl-delay: 10 User-agent: Recorder Disallow:/ Crawl-delay: 10 User-agent: RedesScrapy Disallow:/ Crawl-delay: 10 User-agent: ReGet Disallow:/ Crawl-delay: 10 User-agent: RepoMonkey Disallow:/ Crawl-delay: 10 User-agent: Ripper Disallow:/ Crawl-delay: 10 User-agent: RocketCrawler Disallow:/ Crawl-delay: 10 User-agent: Rogerbot Disallow:/ Crawl-delay: 10 User-agent: RSSingBot Disallow:/ Crawl-delay: 10 User-agent: s1z.ru Disallow:/ Crawl-delay: 10 User-agent: SalesIntelligent Disallow:/ Crawl-delay: 10 User-agent: SBIder Disallow:/ Crawl-delay: 10 User-agent: ScanAlert Disallow:/ Crawl-delay: 10 User-agent: Scanbot Disallow:/ Crawl-delay: 10 User-agent: scan.lol Disallow:/ Crawl-delay: 10 User-agent: ScoutJet Disallow:/ Crawl-delay: 10 User-agent: Scrapy Disallow:/ Crawl-delay: 10 User-agent: Screaming Disallow:/ Crawl-delay: 10 User-agent: ScreenerBot Disallow:/ Crawl-delay: 10 User-agent: Searchestate Disallow:/ Crawl-delay: 10 User-agent: SearchmetricsBot Disallow:/ Crawl-delay: 10 User-agent: Semrush Disallow:/ Crawl-delay: 10 User-agent: SemrushBot Disallow:/ Crawl-delay: 10 User-agent: SEOkicks Disallow:/ Crawl-delay: 10 User-agent: SEOkicks-Robot Disallow:/ Crawl-delay: 10 User-agent: SEOlyticsCrawler Disallow:/ Crawl-delay: 10 User-agent: Seomoz Disallow:/ Crawl-delay: 10 User-agent: SEOprofiler Disallow:/ Crawl-delay: 10 User-agent: seoscanners Disallow:/ Crawl-delay: 10 User-agent: SeoSiteCheckup Disallow:/ Crawl-delay: 10 User-agent: SEOstats Disallow:/ Crawl-delay: 10 User-agent: serpstatbot Disallow:/ Crawl-delay: 10 User-agent: sexsearcher Disallow:/ Crawl-delay: 10 User-agent: Shodan Disallow:/ Crawl-delay: 10 User-agent: Siphon Disallow:/ Crawl-delay: 10 User-agent: SISTRIX Disallow:/ Crawl-delay: 10 User-agent: Sitebeam Disallow:/ Crawl-delay: 10 User-agent: SiteExplorer Disallow:/ Crawl-delay: 10 User-agent: Siteimprove Disallow:/ Crawl-delay: 10 User-agent: SiteLockSpider Disallow:/ Crawl-delay: 10 User-agent: SiteSnagger Disallow:/ Crawl-delay: 10 User-agent: SiteSucker Disallow:/ Crawl-delay: 10 User-agent: Site Sucker Disallow:/ Crawl-delay: 10 User-agent: Sitevigil Disallow:/ Crawl-delay: 10 User-agent: SlySearch Disallow:/ Crawl-delay: 10 User-agent: SmartDownload Disallow:/ Crawl-delay: 10 User-agent: SMTBot Disallow:/ Crawl-delay: 10 User-agent: Snake Disallow:/ Crawl-delay: 10 User-agent: Snapbot Disallow:/ Crawl-delay: 10 User-agent: Snoopy Disallow:/ Crawl-delay: 10 User-agent: SocialRankIOBot Disallow:/ Crawl-delay: 10 User-agent: Sociscraper Disallow:/ Crawl-delay: 10 User-agent: sogouspider Disallow:/ Crawl-delay: 10 User-agent: Sogou web spider Disallow:/ Crawl-delay: 10 User-agent: Sosospider Disallow:/ Crawl-delay: 10 User-agent: Sottopop Disallow:/ Crawl-delay: 10 User-agent: SpaceBison Disallow:/ Crawl-delay: 10 User-agent: Spammen Disallow:/ Crawl-delay: 10 User-agent: SpankBot Disallow:/ Crawl-delay: 10 User-agent: Spanner Disallow:/ Crawl-delay: 10 User-agent: sp_auditbot Disallow:/ Crawl-delay: 10 User-agent: Spbot Disallow:/ Crawl-delay: 10 User-agent: Spinn3r Disallow:/ Crawl-delay: 10 User-agent: SputnikBot Disallow:/ Crawl-delay: 10 User-agent: spyfu Disallow:/ Crawl-delay: 10 User-agent: Sqlmap Disallow:/ Crawl-delay: 10 User-agent: Sqlworm Disallow:/ Crawl-delay: 10 User-agent: Sqworm Disallow:/ Crawl-delay: 10 User-agent: Steeler Disallow:/ Crawl-delay: 10 User-agent: Stripper Disallow:/ Crawl-delay: 10 User-agent: Sucker Disallow:/ Crawl-delay: 10 User-agent: Sucuri Disallow:/ Crawl-delay: 10 User-agent: SuperBot Disallow:/ Crawl-delay: 10 User-agent: SuperHTTP Disallow:/ Crawl-delay: 10 User-agent: Surfbot Disallow:/ Crawl-delay: 10 User-agent: SurveyBot Disallow:/ Crawl-delay: 10 User-agent: Suzuran Disallow:/ Crawl-delay: 10 User-agent: Swiftbot Disallow:/ Crawl-delay: 10 User-agent: sysscan Disallow:/ Crawl-delay: 10 User-agent: Szukacz Disallow:/ Crawl-delay: 10 User-agent: T0PHackTeam Disallow:/ Crawl-delay: 10 User-agent: T8Abot Disallow:/ Crawl-delay: 10 User-agent: tAkeOut Disallow:/ Crawl-delay: 10 User-agent: Teleport Disallow:/ Crawl-delay: 10 User-agent: TeleportPro Disallow:/ Crawl-delay: 10 User-agent: Telesoft Disallow:/ Crawl-delay: 10 User-agent: Telesphoreo Disallow:/ Crawl-delay: 10 User-agent: Telesphorep Disallow:/ Crawl-delay: 10 User-agent: The Intraformant Disallow:/ Crawl-delay: 10 User-agent: TheNomad Disallow:/ Crawl-delay: 10 User-agent: Thumbor Disallow:/ Crawl-delay: 10 User-agent: TightTwatBot Disallow:/ Crawl-delay: 10 User-agent: Titan Disallow:/ Crawl-delay: 10 User-agent: Toata Disallow:/ Crawl-delay: 10 User-agent: Toweyabot Disallow:/ Crawl-delay: 10 User-agent: Tracemyfile Disallow:/ Crawl-delay: 10 User-agent: Trendiction Disallow:/ Crawl-delay: 10 User-agent: Trendictionbot Disallow:/ Crawl-delay: 10 User-agent: trendiction.com Disallow:/ Crawl-delay: 10 User-agent: trendiction.de Disallow:/ Crawl-delay: 10 User-agent: True_Robot Disallow:/ Crawl-delay: 10 User-agent: Turingos Disallow:/ Crawl-delay: 10 User-agent: Turnitin Disallow:/ Crawl-delay: 10 User-agent: TurnitinBot Disallow:/ Crawl-delay: 10 User-agent: TwengaBot Disallow:/ Crawl-delay: 10 User-agent: Twice Disallow:/ Crawl-delay: 10 User-agent: Typhoeus Disallow:/ Crawl-delay: 10 User-agent: UnisterBot Disallow:/ Crawl-delay: 10 User-agent: Upflow Disallow:/ Crawl-delay: 10 User-agent: URLy Warning Disallow:/ Crawl-delay: 10 User-agent: URLy.Warning Disallow:/ Crawl-delay: 10 User-agent: Vacuum Disallow:/ Crawl-delay: 10 User-agent: Vagabondo Disallow:/ Crawl-delay: 10 User-agent: VB Project Disallow:/ Crawl-delay: 10 User-agent: VCI Disallow:/ Crawl-delay: 10 User-agent: VeriCiteCrawler Disallow:/ Crawl-delay: 10 User-agent: VidibleScraper Disallow:/ Crawl-delay: 10 User-agent: Virusdie Disallow:/ Crawl-delay: 10 User-agent: VoidEYE Disallow:/ Crawl-delay: 10 User-agent: Voil Disallow:/ Crawl-delay: 10 User-agent: Voltron Disallow:/ Crawl-delay: 10 User-agent: Wallpapers/3.0 Disallow:/ Crawl-delay: 10 User-agent: WallpapersHD Disallow:/ Crawl-delay: 10 User-agent: WASALive-Bot Disallow:/ Crawl-delay: 10 User-agent: WBSearchBot Disallow:/ Crawl-delay: 10 User-agent: Webalta Disallow:/ Crawl-delay: 10 User-agent: WebAuto Disallow:/ Crawl-delay: 10 User-agent: Web Auto Disallow:/ Crawl-delay: 10 User-agent: WebBandit Disallow:/ Crawl-delay: 10 User-agent: WebCollage Disallow:/ Crawl-delay: 10 User-agent: Web Collage Disallow:/ Crawl-delay: 10 User-agent: WebCopier Disallow:/ Crawl-delay: 10 User-agent: WEBDAV Disallow:/ Crawl-delay: 10 User-agent: WebEnhancer Disallow:/ Crawl-delay: 10 User-agent: Web Enhancer Disallow:/ Crawl-delay: 10 User-agent: WebFetch Disallow:/ Crawl-delay: 10 User-agent: Web Fetch Disallow:/ Crawl-delay: 10 User-agent: WebFuck Disallow:/ Crawl-delay: 10 User-agent: Web Fuck Disallow:/ Crawl-delay: 10 User-agent: WebGo IS Disallow:/ Crawl-delay: 10 User-agent: WebImageCollector Disallow:/ Crawl-delay: 10 User-agent: WebLeacher Disallow:/ Crawl-delay: 10 User-agent: WebmasterWorldForumBot Disallow:/ Crawl-delay: 10 User-agent: webmeup-crawler Disallow:/ Crawl-delay: 10 User-agent: WebPix Disallow:/ Crawl-delay: 10 User-agent: Web Pix Disallow:/ Crawl-delay: 10 User-agent: WebReaper Disallow:/ Crawl-delay: 10 User-agent: WebSauger Disallow:/ Crawl-delay: 10 User-agent: Web Sauger Disallow:/ Crawl-delay: 10 User-agent: Webshag Disallow:/ Crawl-delay: 10 User-agent: WebsiteExtractor Disallow:/ Crawl-delay: 10 User-agent: WebsiteQuester Disallow:/ Crawl-delay: 10 User-agent: Website Quester Disallow:/ Crawl-delay: 10 User-agent: Webster Disallow:/ Crawl-delay: 10 User-agent: WebStripper Disallow:/ Crawl-delay: 10 User-agent: WebSucker Disallow:/ Crawl-delay: 10 User-agent: Web Sucker Disallow:/ Crawl-delay: 10 User-agent: WebWhacker Disallow:/ Crawl-delay: 10 User-agent: WebZIP Disallow:/ Crawl-delay: 10 User-agent: WeSEE Disallow:/ Crawl-delay: 10 User-agent: Whack Disallow:/ Crawl-delay: 10 User-agent: Whacker Disallow:/ Crawl-delay: 10 User-agent: Whatweb Disallow:/ Crawl-delay: 10 User-agent: Who.is Bot Disallow:/ Crawl-delay: 10 User-agent: Widow Disallow:/ Crawl-delay: 10 User-agent: WinHTTrack Disallow:/ Crawl-delay: 10 User-agent: WiseGuys Robot Disallow:/ Crawl-delay: 10 User-agent: WISENutbot Disallow:/ Crawl-delay: 10 User-agent: Wonderbot Disallow:/ Crawl-delay: 10 User-agent: Woobot Disallow:/ Crawl-delay: 10 User-agent: Wotbox Disallow:/ Crawl-delay: 10 User-agent: Wprecon Disallow:/ Crawl-delay: 10 User-agent: WPScan Disallow:/ Crawl-delay: 10 User-agent: WWW-Collector-E Disallow:/ Crawl-delay: 10 User-agent: WWW-Mechanize Disallow:/ Crawl-delay: 10 User-agent: WWW::Mechanize Disallow:/ Crawl-delay: 10 User-agent: WWWOFFLE Disallow:/ Crawl-delay: 10 User-agent: x09Mozilla Disallow:/ Crawl-delay: 10 User-agent: x22Mozilla Disallow:/ Crawl-delay: 10 User-agent: Xaldon WebSpider Disallow:/ Crawl-delay: 10 User-agent: Xaldon_WebSpider Disallow:/ Crawl-delay: 10 User-agent: Xenu Disallow:/ Crawl-delay: 10 User-agent: xpymep1.exe Disallow:/ Crawl-delay: 10 User-agent: YoudaoBot Disallow:/ Crawl-delay: 10 User-agent: Zade Disallow:/ Crawl-delay: 10 User-agent: Zauba Disallow:/ Crawl-delay: 10 User-agent: zauba.io Disallow:/ Crawl-delay: 10 User-agent: Zermelo Disallow:/ Crawl-delay: 10 User-agent: Zeus Disallow:/ Crawl-delay: 10 User-agent: zgrab Disallow:/ Crawl-delay: 10 User-agent: Zitebot Disallow:/ Crawl-delay: 10 User-agent: ZmEu Disallow:/ Crawl-delay: 10 User-agent: ZumBot Disallow:/ Crawl-delay: 10 User-agent: ZyBorg Disallow:/ Crawl-delay: 10
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)