# Observed spamming large amounts of https://en.wikipedia.org/?curid=NNNNNN # and ignoring 429 ratelimit responses, claims to respect robots: # http://mj12bot.com/ User-agent: MJ12bot Disallow: / # advertising-related bots: User-agent: Mediapartners-Google* Disallow: / # Wikipedia work bots: User-agent: IsraBot Disallow: User-agent: Orthogaffe Disallow: # Crawlers that are kind enough to obey, but which we'd rather not have # unless they're feeding search engines. User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / # Some bots are known to be trouble, particularly those designed to copy # entire sites. Please obey robots.txt. User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / # Misbehaving: requests much too fast: User-agent: fast Disallow: / # # Sorry, wget in its recursive mode is a frequent problem. # Please read the man page and use it properly; there is a # --wait option you can use to set the delay between hits, # for instance. # User-agent: wget Disallow: / # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Disallow: / # # Doesn't follow robots.txt anyway, but... # User-agent: k2spider Disallow: / # # Hits many times per second, not acceptable # http://www.nameprotect.com/botinfo.html User-agent: NPBot Disallow: / # A capture bot, downloads gazillions of pages with no public benefit # http://www.webreaper.net/ User-agent: WebReaper Disallow: / # Wayback Machine: defaults and whether to index user-pages # FIXME: Complete the removal of this block, per T7582. # User-agent: archive.org_bot # Allow: / # # Friendly, low-speed bots are welcome viewing article pages, but not # dynamically-generated pages please. # # Inktomi's "Slurp" can read a minimum delay between hits; if your # bot supports such a thing using the 'Crawl-delay' or another # instruction, please let us know. # # There is a special exception for API mobileview to allow dynamic # mobile web & app views to load section content. # These views aren't HTTP-cached but use parser cache aggressively # and don't expose special: pages etc. # # Another exception is for REST API documentation, located at # /api/rest_v1/?doc. # User-agent: * # ar: Disallow: /%D8%AE%D8%A7%D8%B5:Search Disallow: /%D8%AE%D8%A7%D8%B5%3ASearch # Allow: /api.php?action=mobileview& Allow: /load.php? Allow: /api/rest_v1/?doc Disallow: /api/ Disallow: /trap/ Disallow: /Special: Disallow: /Spezial: Disallow: /Spesial: Disallow: /Special%3A Disallow: /Spezial%3A Disallow: /Spesial%3A # # /skins/ are needed for rendering previews, therefor we will be mercyful - Disallow: /skins/ # # # Old long Url Format - English # Disallow: /index.php?diff= Disallow: /index.php?oldid= Disallow: /index.php?title=/login/ Disallow: /index.php?title=/logout/ Disallow: /index.php?title=*?printable=yes$ Disallow: /index.php?title=/Media: Disallow: /index.php?title=/Special: Disallow: /index.php?title=/Talk: Disallow: /index.php?title=/User: Disallow: /index.php?title=/User_talk: Disallow: /index.php?title=/Project: Disallow: /index.php?title=/Project_talk: Disallow: /index.php?title=/File: Disallow: /index.php?title=/File_talk: Disallow: /index.php?title=/MediaWiki: Disallow: /index.php?title=/MediaWiki_talk: Disallow: /index.php?title=/Template: Disallow: /index.php?title=/Template_talk: Disallow: /index.php?title=/Help: Disallow: /index.php?title=/Help_talk: Disallow: /index.php?title=/Category: Disallow: /index.php?title=/Category_talk: Disallow: /index.php?title=/WienGeschichteWiki: Disallow: /index.php?title=/WienGeschichteWiki_talk: Disallow: /index.php?title=/Relation Disallow: /index.php?title=/Relation_talk Disallow: /index.php?title=/Property Disallow: /index.php?title=/Property_talk Disallow: /index.php?title=/Type Disallow: /index.php?title=/Type_talk Disallow: /index.php?title=/Concept Disallow: /index.php?title=/Concept_talk Disallow: /index.php?title=/smw/schema Disallow: /index.php?title=/smw/schema_talk Disallow: /index.php?title=/Form Disallow: /index.php?title=/Form_talk Disallow: /index.php?title=/Filter: Disallow: /index.php?title=/Filter_talk: Disallow: /index.php?title=/Widget: Disallow: /index.php?title=/Widget_talk: # # Old long Url Format - German # Disallow: /index.php?title=/Media: Disallow: /index.php?title=/Spezial: Disallow: /index.php?title=/Diskussion: Disallow: /index.php?title=/Benutzer: Disallow: /index.php?title=/Benutzer_Diskussion: Disallow: /index.php?title=/Projekt: Disallow: /index.php?title=/Projekt_Diskussion: Disallow: /index.php?title=/Datei: Disallow: /index.php?title=/Datei_Diskussion: Disallow: /index.php?title=/MediaWiki: Disallow: /index.php?title=/MediaWiki_Diskussion: Disallow: /index.php?title=/Vorlage: Disallow: /index.php?title=/Vorlage_Diskussion: Disallow: /index.php?title=/Hilfe: Disallow: /index.php?title=/Hilfe_Diskussion: Disallow: /index.php?title=/Kategorie: Disallow: /index.php?title=/Kategorie_Diskussion: Disallow: /index.php?title=/WienGeschichteWiki: Disallow: /index.php?title=/WienGeschichteWiki_Diskussion: Disallow: /index.php?title=/Attribut: Disallow: /index.php?title=/Attribut_Diskussion: Disallow: /index.php?title=/Datentyp: Disallow: /index.php?title=/Datentyp_Diskussion: Disallow: /index.php?title=/Formular: Disallow: /index.php?title=/Formular_Diskussion: Disallow: /index.php?title=/Konzept: Disallow: /index.php?title=/Konzept_Diskussion: Disallow: /index.php?title=/Filter: Disallow: /index.php?title=/Filter_Diskussion: Disallow: /index.php?title=/Widget: Disallow: /index.php?title=/Widget_Diskussion: # # New shiny Short Urls - English # Disallow: /diff Disallow: /oldid Disallow: /login/ Disallow: /logout/ Disallow: *?printable=yes$ Disallow: /Media: Disallow: /Special: Disallow: /Talk: Disallow: /User: Disallow: /User talk: Disallow: /Project: Disallow: /Project talk: Disallow: /File: Disallow: /File talk: Disallow: /MediaWiki: Disallow: /MediaWiki talk: Disallow: /Template: Disallow: /Template talk: Disallow: /Help: Disallow: /Help talk: Disallow: /Category: Disallow: /Category talk: Disallow: /WienGeschichteWiki: Disallow: /WienGeschichteWiki_talk: Disallow: /Relation: Disallow: /Relation_talk: Disallow: /Property: Disallow: /Property_talk: Disallow: /Type: Disallow: /Type_talk: Disallow: /Concept: Disallow: /Concept_talk: Disallow: /smw/schema: Disallow: /smw/schema_talk: Disallow: /Form: Disallow: /Form_talk: Disallow: /Filter: Disallow: /Filter_talk: Disallow: /Widget: Disallow: /Widget_talk: # # New shiny Short Urls - German # Disallow: /Media: Disallow: /Spezial: Disallow: /Diskussion: Disallow: /Benutzer: Disallow: /Benutzer_Diskussion: Disallow: /Projekt: Disallow: /Projekt_Diskussion: Disallow: /Datei: Disallow: /Datei_Diskussion: Disallow: /MediaWiki: Disallow: /MediaWiki_Diskussion: Disallow: /Vorlage: Disallow: /Vorlage_Diskussion: Disallow: /Hilfe: Disallow: /Hilfe_Diskussion: Disallow: /Kategorie: Disallow: /Kategorie_Diskussion: Disallow: /WienGeschichteWiki: Disallow: /WienGeschichteWiki_Diskussion: Disallow: /Attribut: Disallow: /Attribut_Diskussion: Disallow: /Datentyp: Disallow: /Datentyp_Diskussion: Disallow: /Formular: Disallow: /Formular_Diskussion: Disallow: /Konzept: Disallow: /Konzept_Diskussion: Disallow: /Filter: Disallow: /Filter_Diskussion: Disallow: /Widget: Disallow: /Widget_Diskussion: # # Apache Style - English Urls # Disallow: /index.php/diff Disallow: /index.php/oldid Disallow: /index.php/login/ Disallow: /index.php/logout/ Disallow: /index.php*?printable=yes$ Disallow: /index.php/Media: Disallow: /index.php/Special: Disallow: /index.php/Talk: Disallow: /index.php/User: Disallow: /index.php/User talk: Disallow: /index.php/Project: Disallow: /index.php/Project talk: Disallow: /index.php/File: Disallow: /index.php/File talk: Disallow: /index.php/MediaWiki: Disallow: /index.php/MediaWiki talk: Disallow: /index.php/Template: Disallow: /index.php/Template talk: Disallow: /index.php/Help: Disallow: /index.php/Help talk: Disallow: /index.php/Category: Disallow: /index.php/Category talk: Disallow: /index.php/WienGeschichteWiki: Disallow: /index.php/WienGeschichteWiki_talk: Disallow: /index.php/Relation: Disallow: /index.php/Relation_talk: Disallow: /index.php/Property: Disallow: /index.php/Property_talk: Disallow: /index.php/Type: Disallow: /index.php/Type_talk: Disallow: /index.php/Concept: Disallow: /index.php/Concept_talk: Disallow: /index.php/smw/schema: Disallow: /index.php/smw/schema_talk: Disallow: /index.php/Form: Disallow: /index.php/Form_talk: Disallow: /index.php/Filter: Disallow: /index.php/Filter_talk: Disallow: /index.php/Widget: Disallow: /index.php/Widget_talk: # # Apache Style - German Urls # Disallow: /index.php/Media: Disallow: /index.php/Spezial: Disallow: /index.php/Diskussion: Disallow: /index.php/Benutzer: Disallow: /index.php/Benutzer_Diskussion: Disallow: /index.php/Projekt: Disallow: /index.php/Projekt_Diskussion: Disallow: /index.php/Datei: Disallow: /index.php/Datei_Diskussion: Disallow: /index.php/MediaWiki: Disallow: /index.php/MediaWiki_Diskussion: Disallow: /index.php/Vorlage: Disallow: /index.php/Vorlage_Diskussion: Disallow: /index.php/Hilfe: Disallow: /index.php/Hilfe_Diskussion: Disallow: /index.php/Kategorie: Disallow: /index.php/Kategorie_Diskussion: Disallow: /index.php/WienGeschichteWiki: Disallow: /index.php/WienGeschichteWiki_Diskussion: Disallow: /index.php/Attribut: Disallow: /index.php/Attribut_Diskussion: Disallow: /index.php/Datentyp: Disallow: /index.php/Datentyp_Diskussion: Disallow: /index.php/Formular: Disallow: /index.php/Formular_Diskussion: Disallow: /index.php/Konzept: Disallow: /index.php/Konzept_Diskussion: Disallow: /index.php/Filter: Disallow: /index.php/Filter_Diskussion: Disallow: /index.php/Widget: Disallow: /index.php/Widget_Diskussion: # # Mediawiki Fixes: T16075 # Disallow: /MediaWiki:Spam-blacklist Disallow: /MediaWiki%3ASpam-blacklist Disallow: /MediaWiki_talk:Spam-blacklist Disallow: /MediaWiki_talk%3ASpam-blacklist sitemap: https://www.geschichtewiki.wien.gv.at/sitemap-index-WienGeschichteWiki.xml
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)