# slow down Bingbot User-agent: Bingbot Crawl-delay: 1 # Block Dotbot # https://moz.com/help/moz-procedures/crawlers/dotbot User-agent: dotbot Disallow: / # Block Rogerbot # https://moz.com/help/moz-procedures/crawlers/rogerbot User-agent: rogerbot Disallow: / # Block Semrush # https://www.semrush.com/bot/ User-agent: SemrushBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-CT Disallow: / User-agent: SemrushBot-BM Disallow: / User-agent: SplitSignalBot Disallow: / User-agent: SemrushBot-COUB Disallow: / # Block Seekport # https://bot.seekport.com/ User-agent: SeekportBot Disallow: / # Block Ahrefs # https://ahrefs.com/robot User-agent: AhrefsBot Disallow: / # Block SEOkicks # https://www.seokicks.de/robot.html User-agent: SEOkicks Disallow: / # Block MegaIndex.ru # http://megaindex.ru/2.0 User-agent: MegaIndex.ru Disallow: / # Block MJ12bot # https://mj12bot.com/ User-agent: MJ12bot Disallow: / # Block BLEXBot # http://webmeup-crawler.com/ User-agent: BLEXBot Disallow: / # Block CCBot # https://commoncrawl.org/big-picture/frequently-asked-questions/ User-agent: CCBot Disallow: / # Block VelenPublicWebCrawler # https://velen.io/ User-agent: VelenPublicWebCrawler Disallow: / # Block MBCrawler # https://monitorbacklinks.com User-agent: MBCrawler Disallow: / # Block CensysInspect # https://about.censys.io/ User-agent: CensysInspect Disallow: / # Block GrapeshotCrawler # https://www.oracle.com/corporate/acquisitions/grapeshot/crawler.html User-agent: GrapeshotCrawler Disallow: / # Block DataForSeoBot # https://dataforseo.com/dataforseo-bot User-agent: DataForSeoBot Disallow: / User-agent: zoomRank/2.0 Disallow: / # Block GPTBot # https://platform.openai.com/docs/gptbot User-agent: GPTBot Disallow: / # Block Google Bard, Vertex, etc. # https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers?hl=de User-agent: Google-Extended Disallow: / User-agent: serpstatbot Disallow: /
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)