User-agent: Amazonbot Disallow: / User-agent: betaBot Disallow: / User-agent: Bytespider Disallow: / User-agent: ClaudeBot Disallow: / # Common Crawl AI data bot is not permitted to crawl this site User-agent: CCBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Facebot Disallow: / User-agent: FreshpingBot Disallow: / # Alphabet/Google AI bots are not permitted to crawl this site User-agent: Google-Extended Disallow: / # OpenAI is not permitted to crawl this site User-agent: GPTBot Disallow: / User-agent: ltx71 Disallow: / User-agent: MJ12bot Disallow: / User-agent: SMTBot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: SemrushBot Disallow: / User-agent: * Disallow: /image Disallow: /texture Disallow: /cat/ Disallow: /item.do # item.do for profiles/sub-contexts; note: wildcards are not supported by all bots Disallow: /*/item.do
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)