# Created with RoboGen SE Trial # http://www.rietta.com/robogen/ # -------------------------------- # LANGSOFT -- http://www.langsoft.ch # Robot Exclusion File -- robots.txt # Author: Sprachlernmittel # Last Updated: 02/06/04 14:18:30 User-agent: SemrushBot Disallow: / User-agent: SemanticScholarBot Disallow: / User-agent: PetalBot Disallow: / User-agent: petal bot Disallow: / User-agent: petalbot Disallow: / User-agent: Petal Bot Disallow: / #Baiduspider User-agent: Baiduspider Disallow: / #Yandex User-agent: Yandex Disallow: / User-agent: * Disallow: /?petalbot User-agent: * Disallow: /?petal bot User-agent: Big Brother Disallow: /cgi-bin User-agent: AlkalineBOT Disallow: /cgi-bin User-agent: robi Disallow: /cgi-bin User-agent: petalbot Disallow: /cgi-bin User-agent: petal bot Disallow: /cgi-bin # Directories Disallow: /cgi-bin/ Disallow: /counter/ Disallow: /eag/
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)