# Global rules # ----------------- User-agent: * Disallow: /wp-json/ # Prevent crawling CF challenge URLs Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/ # Sitemap # ----------------- Sitemap: https://radicalwebdesign.co.uk/sitemap_index.xml #Crawl delay 1 request every 10 seconds crawl-delay: 10 # Ban bots that don't benefit us. # -------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)