Sitemap: http://www.qumran.org/sitemap.xml # --=[ SEO Bots ]=-- # SEO Bot https://ahrefs.com/robot/ https://darkvisitors.com/agents/ahrefsbot user-agent: AhrefsBot disallow: / # https://darkvisitors.com/agents/ahrefssiteaudit User-agent: AhrefsSiteAudit Disallow: / # https://www.babbar.tech/crawler SEO bot; used to provide a set of online marketing and referencing tools for the SEO community. User-agent: barkrowler Disallow: / # https://darkvisitors.com/agents/rogerbot User-agent: rogerbot Disallow: / # https://darkvisitors.com/agents/zoombot for online marketing campaigns User-agent: ZoomBot Disallow: / # --=[ AI Bots used to feed LLMs ]=-- # https://darkvisitors.com/agents/bytespider allegedly used to download training data for its LLMs User-agent: Bytespider Disallow: / # https://darkvisitors.com/agents/anthropic-ai User-agent: anthropic-ai Disallow: / # https://darkvisitors.com/agents/diffbot User-agent: Diffbot Disallow: / # https://darkvisitors.com/agents/facebookbot User-agent: FacebookBot Disallow: / # https://darkvisitors.com/agents/google-extended User-agent: Google-Extended Disallow: / # https://darkvisitors.com/agents/gptbot User-agent: GPTBot Disallow: / # https://darkvisitors.com/agents/omgili User-agent: omgili Disallow: / # --=[ Scrapers ]=-- # https://darkvisitors.com/agents/dataprovider-com (paid service) User-agent: Dataprovider.com Disallow: / # --=[ Unclassified ]=-- User-agent: WBSearchBot Disallow: / user-agent: heritrix disallow: / User-agent: meanpathbot Disallow: / User-agent: JobboerseBot Disallow: / User-agent: * Disallow: /tech Disallow: /local Disallow: /phpgroupware Disallow: /inc Disallow: /templates Disallow: /homes/izzy/fotos Disallow: /homes/jjm Disallow: /ferret Disallow: /images Disallow: /sigs Disallow: /*.exe$ Disallow: /*.zip$ Disallow: /*.tar.gz$ Disallow: /*.tgz$ Disallow: /*.deb$ Disallow: /*.rpm$ Disallow: /*type=tar Disallow: /*type=rpm Disallow: /*type=deb Disallow: /hpbots
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)