User-agent: * Allow: / Allow: /sitemap.html Clean-param: cid Clean-param: org Clean-param: ascicat Clean-param: linkid Sitemap: https://scialert.net/sitemaps.xml # Block problem bots # User-agent: Baiduspider # User-agent: 360Spider # User-agent: Yisouspider User-agent: PetalBot # User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / # Block OpenAI User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / # Block Google Bard AI # User-agent: Google-Extended # Disallow: / # Block Common Crawl AI scraper User-agent: CCBot Disallow: / # Block Perplexity AI User-agent: PerplexityBot Disallow: / # Block other misc AI scrapers User-agent: anthropic-ai Disallow: / User-agent: Omgilibot Disallow: / User-agent: Omgili Disallow: / User-agent: FacebookBot Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: claudebot Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)