# Scraper User-agent: Aboundexbot User-agent: AhrefsBot User-agent: aiHitBot User-agent: Amazonbot User-agent: anthropic-ai User-agent: Applebot User-agent: Applebot-Extended User-agent: archive.org_bot User-agent: BacklinkCrawler User-agent: Bytespider User-agent: CCBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-Web User-agent: Cliqzbot User-agent: cohere-ai User-agent: dataprovider User-agent: Diffbot User-agent: DomainCrawler User-agent: dotbot User-agent: EasouSpider User-agent: EC2LinkFinder User-agent: Exabot User-agent: Ezooms User-agent: FacebookBot User-agent: facebookexternalhit User-agent: Fetch User-agent: FriendlyCrawler User-agent: Genieo User-agent: Go-http-client/2.0 User-agent: GPTBot User-agent: grub-client User-agent: HTTrack User-agent: ia_archiver User-agent: ia_archiver/1.6 User-agent: ia_archiver-web.archive.org User-agent: ICC-Crawler User-agent: ImagesiftBot User-agent: img2dataset User-agent: InfoPath User-agent: InfoPath.2 User-agent: ip-web-crawler.com User-agent: libwww User-agent: LinkpadBot User-agent: Mail.Ru User-agent: meanpathbot User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: Microsoft.URL.Control User-agent: MJ12bot User-agent: Mozilla/4.0 User-agent: MSIECrawler User-agent: netEstate NE Crawler User-agent: NPBot User-agent: OAI-SearchBot User-agent: Offline Explorer User-agent: omgili User-agent: omgilibot User-agent: panscient.com User-agent: PerplexityBot User-agent: psbot User-agent: Scrapy User-agent: Screaming Frog SEO Spider User-agent: SearchmetericsBot User-agent: Searchspider User-agent: SemrushBot User-agent: SEOkicks-Robot User-agent: sitebot User-agent: sitecheck.internetseer.com User-agent: SiteSnagger User-agent: Sosospider User-agent: spbot User-agent: swebot User-agent: taptubot User-agent: Teleport User-agent: TeleportPro User-agent: Timpibot User-agent: TurnitinBot User-agent: TwengaBot User-agent: twiceler User-agent: UbiCrawler User-agent: VelenPublicWebCrawler User-agent: vscooter User-agent: WBSearchBot User-agent: WebCapture User-agent: WebCopier User-agent: WebReaper User-agent: WebStripper User-agent: WebZIP User-agent: wget User-agent: wotbox User-agent: Xenu User-agent: Xenu's User-agent: Xenu's Link Sleuth 1.1c User-agent: Yandex User-agent: YouBot User-agent: Zealbot Disallow: / # Generell User-agent: * Disallow: *&preview=* Disallow: *?s=* Disallow: /?s= Disallow: /comments/ Disallow: */comments/ Disallow: /feed/ Disallow: */feed/ Disallow: /rss/ Disallow: */rss/ Disallow: /trackback/ Disallow: */trackback/ Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /usage/ Disallow: /youtube/ Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /webalizer/ Disallow: /images/autor.jpg
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)