# contact [email protected] for questions. # see http://www.robotstxt.org/ # for information about the file format. User-agent: Scooter Disallow: /ml/ User-agent: Test Crawler Disallow: / User-agent: DigExt Disallow: / User-agent: CW Crawler Disallow: / User-agent: Sosospider Disallow: / User-agent: Googlebot Disallow: donations.html User-agent: * Disallow: /bugzilla/ Disallow: /cgi-bin/ Disallow: /cgi/ Disallow: /cgi2-bin/ Disallow: /ml/overseers/ Disallow: /packages/ Disallow: /snapshots/ Disallow: /viewcvs/ Disallow: /viewvc/ Disallow: /git/ Disallow: /git-cygwin-packages/ Disallow: /cgit/ Disallow: setup-x86.exe Disallow: setup-x86_64.exe Disallow: mirrors.lst Crawl-Delay: 60
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)