User-agent: * Disallow: /calendar/ Disallow: /observations? Disallow: /observations/? Disallow: /observations.csv Disallow: /observations.csv? Disallow: /places/wikipedia/* Disallow: /taxa/search Disallow: /taxa/search? Disallow: /*? Disallow: /taxa/*/description$ Disallow: /taxa/*/map_layers$ Disallow: /listed_taxa/* Disallow: /lifelists/* Disallow: *.atom* Disallow: *.csv* Disallow: *.json* Disallow: *page=* Disallow: /*? User-agent: ia_archiver User-agent: Twitterbot Disallow: User-agent: AI2Bot User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: Claude-Web User-agent: ClaudeBot User-agent: cohere-ai User-agent: Diffbot User-agent: dotbot User-agent: FacebookBot User-agent: Google-Extended User-agent: GPTBot User-agent: Kangaroo Bot User-agent: Meta-ExternalAgent User-agent: omgili User-agent: Timpibot User-agent: Webzio-Extended User-agent: ChatGLM-Spider Disallow: /
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)