Sitemap: https://hicks.design/sitemap.xml User-agent: * Disallow: /assets/ Disallow: /assets/css/ Disallow: /assets/js/ Disallow: /else/ Disallow: /clients/ User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Omgilibot Disallow: / User-agent: FacebookBot Disallow: / # The example for img2dataset, although the default is *None* User-agent: img2dataset Disallow: / # Brandwatch - "AI to discover new trends" User-agent: magpie-crawler Disallow: / # webz.io - they sell data for training LLMs. User-agent: Omgilibot Disallow: / # Items below were sourced from darkvisitors.com # Categories included: "AI Data Scraper", "AI Assistant", "AI Search Crawler", "Undocumented AI Agent" # AI Search Crawler # https://darkvisitors.com/agents/amazonbot User-agent: Amazonbot Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/anthropic-ai User-agent: anthropic-ai Disallow: / # AI Search Crawler # https://darkvisitors.com/agents/applebot User-agent: Applebot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/applebot-extended User-agent: Applebot-Extended Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/bytespider User-agent: Bytespider Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/ccbot User-agent: CCBot Disallow: / # AI Assistant # https://darkvisitors.com/agents/chatgpt-user User-agent: ChatGPT-User Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/claude-web User-agent: Claude-Web Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/claudebot User-agent: ClaudeBot Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/cohere-ai User-agent: cohere-ai Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/diffbot User-agent: Diffbot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/facebookbot User-agent: FacebookBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/google-extended User-agent: Google-Extended Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/gptbot User-agent: GPTBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/omgili User-agent: omgili Disallow: / # AI Search Crawler # https://darkvisitors.com/agents/perplexitybot User-agent: PerplexityBot Disallow: / # AI Search Crawler # https://darkvisitors.com/agents/youbot User-agent: YouBot Disallow: /
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)