User-Agent: * Allow: / Disallow: /portal/frn-conf Disallow: /portal/frn-login Disallow: /mantis Disallow: /portal/suche.php Disallow: /portal/comment.php Disallow: /portal/select_lang.php Allow: /portal/select_lang.php?doc=/portal/index.php #Spamt die Logs voll https://ahrefs.com/robot/, Felix - 2014-08-05 User-Agent: AhrefsBot Crawl-Delay: 10 User-Agent: GPTBot Crawl-Delay: 10 User-Agent: meta-externalagent Crawl-Delay: 10 User-Agent: Podmonbot Crawl-Delay: 10 # Block any non-specified AI crawlers (e.g., new # or unknown bots) from using content for training # AI models. This directive is still experimental # and may not be supported by all AI crawlers. User-Agent: * DisallowAITraining: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)