# Böse bots User-agent: archive.org_bot User-agent: Mail.RU_Bot User-agent: oBot User-agent: IstellaBot User-agent: EasouSpider User-agent: DBot User-agent: Zookabot User-agent: 008 User-agent: proximic User-agent: CrystalSemanticsBot User-agent: Larbin User-agent: BLEXBot User-agent: UbiCrawler User-Agent: UnisterBot User-agent: DOC User-agent: Zao User-agent: Zealbot User-agent: MSIECrawler User-agent: Fetch User-agent: Offline Explorer User-agent: Teleport User-agent: TeleportPro User-agent: WebZIP User-agent: linko User-agent: Microsoft.URL.Control User-agent: Xenu User-agent: larbin User-agent: ZyBORG User-agent: Download Ninja User-agent: grub-client User-agent: k2spider User-agent: NPBot User-agent: SmartViper User-agent: URLMetriken User-agent: psbot User-agent: gigabot User-agent: baiduspider User-agent: nutch User-agent: cityreview User-agent: penthesilea User-agent: Prlog User-agent: Zealbot User-agent: libwww User-agent: ZyBORG User-agent: Sogou web spider User-agent: Java User-agent: Add Catalog User-agent: VoilaBot User-agent: Vagabondo User-agent: TurnitinBot User-agent: NerdyBot User-agent: SeznamBot User-agent: wsr-agent User-agent: coccoc User-agent: CareerBot User-agent: CPython User-agent: meanpathbot User-agent: EuripBot User-agent: python-requests Disallow: / # Ausländische Suchmaschinen User-agent: YandexBot User-agent: Baiduspider User-agent: Yandex User-agent: Exabot Disallow: / # Web Scraper User-agent: SiteSnagger User-agent: WebStripper User-agent: WebCopier User-agent: WebReaper User-agent: HTTrack Disallow: / # Email Scraper User-agent: EmailCollector User-agent: WebEMailExtrac User-agent: TrackBack User-agent: EmailSiphon User-agent: EmailSpider User-agent: EmailWolf Disallow: / # undefined crawler User-agent: Trident Crawl-delay: 5 # Trusted crawler User-agent: * Disallow: /*.css$ Disallow: /*.js$ Disallow: /deeplink/id/ Disallow: /angebot/id/ Disallow: //id//entry/ Disallow: /service Disallow: /datenschutz Disallow: /reisecheckliste Disallow: /home Disallow: /blacklisted-airlines Sitemap: https://schmetterlingflug.de/sitemap.xml
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)