# For all robots User-agent: * # Block access to specific groups of pages Disallow: /cart Disallow: /cs/cart Disallow: /da/cart Disallow: /de/cart Disallow: /en/cart Disallow: /es/cart Disallow: /fi/cart Disallow: /fr/cart Disallow: /it/cart Disallow: /nl/cart Disallow: /no/cart Disallow: /pl/cart Disallow: /sv/cart Disallow: /checkout Disallow: /cs/checkout Disallow: /da/checkout Disallow: /de/checkout Disallow: /en/checkout Disallow: /es/checkout Disallow: /fi/checkout Disallow: /fr/checkout Disallow: /it/checkout Disallow: /nl/checkout Disallow: /no/checkout Disallow: /pl/checkout Disallow: /sv/checkout Disallow: /my-account Disallow: /cs/my-account Disallow: /da/my-account Disallow: /de/my-account Disallow: /en/my-account Disallow: /es/my-account Disallow: /fi/my-account Disallow: /fr/my-account Disallow: /it/my-account Disallow: /nl/my-account Disallow: /no/my-account Disallow: /pl/my-account Disallow: /sv/my-account # Allow search crawlers to discover the sitemap Sitemap: https://duni.com/sitemap.xml # Block CazoodleBot as it does not present correct accept content headers User-agent: CazoodleBot Disallow: / # Block MJ12bot as it is just noise User-agent: MJ12bot Disallow: / # Block dotbot as it cannot parse base urls properly User-agent: dotbot/1.0 Disallow: / # Block Gigabot User-agent: Gigabot Disallow: /
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)