#**************************************************************************** # robots.txt # : Robots, spiders, and search engines use this file to detmine which # content they should *not* crawl while indexing your website. # : This system is called "The Robots Exclusion Standard." # : It is strongly encouraged to use a robots.txt validator to check # for valid syntax before any robots read it! # # Examples: # # Instruct all robots to stay out of the admin area. # : User-agent: * # : Disallow: /admin/ # # Restrict Google and MSN from indexing your images. # : User-agent: Googlebot # : Disallow: /images/ # : User-agent: MSNBot # : Disallow: /images/ #**************************************************************************** ## Allgemein User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /cgi/ Disallow: /pagman/ ## Speziell User-agent: Googlebot User-agent: Googlebot-Image User-agent: MediaPartners-Google User-agent: Feedfetcher-Google User-agent: Googlebot-Mobile User-agent: Adsbot-Google User-agent: bingbot User-agent: msnbot User-agent: Slurp User-agent: Teoma Allow: /
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)