### # For all robots User-agent: * # Block access to specific groups of pages Disallow: /cart Disallow: /warenkorb Disallow: /bookmark-page Disallow: /comparison-page Disallow: /checkout Disallow: /mein-konto Disallow: /*?icid=* Disallow: /*?cid=* Disallow: */ajax/header-responsive/ Disallow: /ajax/productTeleSalesInfo/ Disallow: /ajax/productSetComponents/ Disallow: /ajax/productAddToCart/ Disallow: *fachcentrum*fachcentrum* Disallow: *:name:*:name:* Disallow: /ajax/productRatePay/ # Allow search crawlers to discover the sitemap Sitemap: https://www.bauhaus.ch/sitemaps/sitemap.xml # Block CazoodleBot as it does not present correct accept content headers User-agent: CazoodleBot Disallow: / # Block MJ12bot as it is just noise User-agent: MJ12bot Disallow: / # Block dotbot as it cannot parse base urls properly User-agent: dotbot/1.0 Disallow: / # Block Gigabot User-agent: Gigabot Disallow: / # Block Internet Archives User-agent: ia_archiver Disallow: / # PPS-12633, block SEOkicks crawler User-agent: SEOkicks-Robot Disallow: / # PPS-69657: block Semrush-Bot User-agent: SemrushBot Disallow: /
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)