User-agent: * Disallow: /stats/ Disallow: /logs/ Disallow: /check/ Disallow: /contao/ Disallow: /system/ Disallow: /templates/ Disallow: /share/index.php Disallow: /contao-check.php Disallow: /flash.php Disallow: /README.md Allow: /assets/ User-agent: 008 Disallow: / User-agent: 200PleaseBot Disallow: / User-agent: 360Spider Disallow: / User-agent: adbeat_bot Disallow: / User-agent: ADmantX Platform Semantic Analyzer - ADmantX Inc. - www.admantx.com - [email protected] Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AOLbot/4.0 Disallow: / User-agent: Attribot/1.1 (compatible; Attribot-Site; http://static.attribyte.com/robotreadme.txt) Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: bitlybot Disallow: / User-agent: Bot.AraTurka.com Disallow: / User-agent: Butterfly/1.0 Disallow: / User-agent: ClarityDailyBot Disallow: / User-agent: CMS Crawler Disallow: / User-agent: CRAZYWEBCRAWLER Disallow: / User-agent: diffbot Disallow: / User-agent: DomainAppender Disallow: / User-agent: DomainSigmaCrawler Disallow: / User-agent: Domain Re-Animator Bot Disallow: / User-agent: Ezooms Robot Disallow: / User-agent: Exabot Disallow: / User-agent: FavOrg Disallow: / User-agent: Findxbot Disallow: / User-agent: FlipboardProxy Disallow: / User-agent: GigablastOpenSource/1.0 Disallow: / User-agent: Grapeshot Disallow: / User-agent: Heritrix Disallow: / User-agent: heritrix/2.0.2 +http://www.adsafemedia.com Disallow: / User-agent: HTTrack 3 Disallow: / User-agent: InAGist URL Resolver Disallow: / User-agent: Insitesbot Disallow: / User-agent: jack Disallow: / User-agent: James BOT Disallow: / User-agent: Java Disallow: / User-agent: JS-Kit URL Resolver, http://js-kit.com/ Disallow: / User-agent: linkdexbot Disallow: / User-agent: LivelapBot/0.2 (http://site.livelap.com/crawler) Disallow: / User-agent: LS Session Disallow: / User-agent: ltx71 Disallow: / User-agent: meanpathbot Disallow: / User-agent: MetaURI API/2.0 +metauri.com Disallow: / User-agent: MJ12bot Disallow: / User-agent: Mozilla/4.0 (CMS Crawler: http://www.cmscrawler.com) Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)