User-agent: * Disallow: /admin/ # Disallow Rules User-agent: anthropic-ai Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Baiduspider Disallow: / User-agent: Bingbot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: DuckDuckBot Disallow: / User-agent: facebot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: ia_archiver Disallow: / User-agent: magpie-crawler Disallow: / User-Agent: omgili Disallow: / User-Agent: omgilibot Disallow: / User-agent: PetalBot Disallow: / User-Agent: PerplexityBot Disallow: / User-agent: Scrapy Disallow: / User-agent: anthropic-ai Disallow: / Sitemap: https://www.deep.com/sitemap.xml
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)