# global User-agent: * Disallow: /cgi-bin/ Disallow: /readme.html Disallow: /trackback/ Disallow: /feeds/ Disallow: /comments/ Disallow: /details/ Disallow: /wp-admin/* Disallow: /*add-to-cart=* User-agent: Googlebot Allow: /wp-admin/admin-ajax.php User-agent: Bingbot Allow: /wp-admin/admin-ajax.php Sitemap: https://www.schneeketten4u.com/sitemap_index.xml # Buitenlandse Search Engines en bots die je niet wil hebben # For specific bots (on all domains) User-Agent: Baiduspider User-Agent: CazoodleBot User-Agent: Fasterfox User-Agent: Jyxobot User-Agent: ShopWiki User-agent: Alexibot User-agent: Aqua_Products User-agent: BLEXBot User-agent: BackDoorBot/1.0 User-agent: BlowFish/1.0 User-agent: Bookmark search tool User-agent: BotALot User-agent: BotRightHere User-agent: BuiltBotTough User-agent: Bullseye/1.0 User-agent: BunnySlippers User-agent: CheeseBot User-agent: CherryPicker User-agent: CherryPickerElite/1.0 User-agent: CherryPickerSE/1.0 User-agent: Copernic User-agent: CopyRightCheck User-agent: Crescent User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: DittoSpyder User-agent: EmailCollector User-agent: EmailSiphon User-agent: EmailWolf User-agent: EroCrawler User-agent: ExtractorPro User-agent: ExtractorPro User-agent: FairAd Client User-agent: Flaming AttackBot User-agent: Foobot User-agent: FunWebProducts User-agent: Gaisbot User-agent: GetRight/4.2 User-agent: GomezAgent # gomeznetworks.com/help/gpn/MySettings/Last_Mile_PP_Test_Settings.htm User-agent: GomezAgent 1.0 User-agent: GomezAgent 2.0 User-agent: GomezAgent 3.0 User-agent: HTTrack 3.0 User-agent: Harvest/1.5 User-agent: HubSpot Links Crawler User-agent: HubSpot Webcrawler User-agent: InfoNaviRobot User-agent: Iron33/1.0.2 User-agent: JennyBot User-agent: Kenjin Spider User-agent: Keyword Density/0.9 User-agent: LNSpiderguy User-agent: LexiBot User-agent: LinkScan/8.1a Unix User-agent: LinkWalker User-agent: LinkextractorPro User-agent: MIIxpc User-agent: MIIxpc/4.2 User-agent: MJ12bot User-agent: MSIECrawler User-agent: Mata Hari User-agent: Microsoft URL Control User-agent: Microsoft URL Control - 5.01.4511 User-agent: Microsoft URL Control - 6.00.8169 User-agent: Mister PiX User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) User-agent: NICErsPRO User-agent: NetAnts User-agent: Offline Explorer User-agent: Openbot User-agent: Openfind User-agent: Openfind data gatherer User-agent: Oracle Ultra Search User-agent: PerMan User-agent: ProPowerBot/2.14 User-agent: ProWebWalker User-agent: Python-urllib User-agent: QueryN Metasearch User-agent: RMA User-agent: Radiation Retriever 1.1 User-agent: RepoMonkey User-agent: RepoMonkey Bait & Tackle/v1.01 User-agent: SemrushBot User-agent: SiteCon # siteconfidence.com/services/load-testing/website.aspx User-agent: SiteSnagger User-agent: SpankBot User-agent: Szukacz/1.4 User-agent: Teleport User-agent: TeleportPro User-agent: Telesoft User-agent: The Intraformant User-agent: TheNomad User-agent: TightTwatBot User-agent: True_Robot User-agent: True_Robot/1.0 User-agent: TurnitinBot User-agent: TurnitinBot/1.5 User-agent: URL Control User-agent: URL_Spider_Pro User-agent: URLy Warning User-agent: VCI User-agent: VCI WebViewer VCI WebViewer Win32 User-agent: WWW-Collector-E User-agent: Web Image Collector User-agent: WebAuto User-agent: WebBandit User-agent: WebBandit/3.50 User-agent: WebCapture 2.0 User-agent: WebCopier User-agent: WebCopier v.2.2 User-agent: WebCopier v3.2a User-agent: WebEnhancer User-agent: WebSauger User-agent: WebStripper User-agent: WebZIP/4.21 User-agent: WebZIP/5.0 User-agent: WebZip User-agent: WebZip/4.0 User-agent: Website Quester User-agent: Webster Pro User-agent: Wget User-agent: Wget/1.5.3 User-agent: Wget/1.6 User-agent: Xenu's User-agent: Xenu's Link Sleuth 1.1c User-agent: YottaaMonitor User-agent: Zeus User-agent: Zeus 32297 Webster Pro V2.9 Win32 User-agent: Zeus Link Scout User-agent: asterias User-agent: b2w/0.1 User-agent: cosmos User-agent: hloader User-agent: httplib User-agent: humanlinks User-agent: larbin User-agent: libWeb/clsHTTP User-agent: lwp-trivial User-agent: lwp-trivial/1.34 User-agent: moget User-agent: moget/2.1 User-agent: naverbot # South Korean search engine User-agent: psbot User-agent: searchpreview User-agent: spanner User-agent: suzuran User-agent: teracent-feed-processing User-agent: toCrawl/UrlDispatcher User-agent: turingos User-agent: 360Spider User-agent: 360Spider-Image User-agent: 360Spider-Video # baidu.com chinese search engine User-agent: Baiduspider User-agent: Baiduspider-image User-agent: Baiduspider-news User-agent: Baiduspider-video # bublup.com suggestion/search engine User-agent: BublupBot # commoncrawl.org open repository of web crawl data User-agent: CCBot # cliqz.com german in-product search engine User-agent: Cliqzbot # coccoc.com vietnamese search engine User-agent: coccoc User-agent: coccocbot-image User-agent: coccocbot-web # daum.net korean search engine User-agent: Daumoa # dazoo.fr french search engine User-agent: Dazoobot # deusu.de german search engine User-agent: DeuSu # eurip.com european search engine User-agent: EuripBot # exploratodo.com latin search engine User-agent: Exploratodo # feedly.com feed fetcher User-agent: Feedly # findx.com european search engine User-agent: Findxbot # goo.ne.jp japanese search engine User-agent: gooblog # so.com chinese search engine User-agent: HaoSouSpider # goo.ne.jp japanese search engine User-agent: ichiro # istella.it italian search engine User-agent: istellabot # jike.com / chinaso.com chinese search engine User-agent: JikeSpider # mail.ru russian search engine User-agent: Mail.Ru # mojeek.com search engine User-agent: MojeekBot # orange.com international search engine User-agent: OrangeBot # pinterest.com social networtk User-agent: Pinterest # botje.nl dutch search engine User-agent: Plukkie # qwant.com french search engine User-agent: Qwantify # rambler.ru russian search engine User-agent: Rambler # seznam.cz czech search engine User-agent: SeznamBot # soso.com chinese search engine User-agent: Sosospider # sogou.com chinese search engine User-agent: Sogou blog User-agent: Sogou inst spider User-agent: Sogou News Spider User-agent: Sogou Orion spider User-agent: Sogou spider2 User-agent: Sogou web spider # sputnik.ru russian search engine User-agent: SputnikBot # ask.com international search engine User-agent: Teoma # twitter.com bot User-agent: Twitterbot # wotbox.com international search engine User-agent: wotbox # yacy.net p2p search software User-agent: yacybot # search.naver.com south korean search engine user-agent: Yeti # yioop.com international search engine User-agent: YioopBot # yooz.ir iranian search engine User-agent: yoozBot # youdao.com chinese search engine User-agent: YoudaoBot Disallow: / # Block MJ12bot User-Agent: MJ12bot Disallow: / User-Agent:MJ12bot/v1.4.5 Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider/2.0 Disallow: / User-agent: 360Spider Disallow: / User-agent: Steeler Disallow: / User-agent: Steeler/3.5 Disallow: / User-agent: DotBot/1.1 Disallow: / User-agent: BLEXBot/1.0 Disallow: / User-agent: spbot/5.0.1 Disallow: / User-agent: Uptimebot/1.0 Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: Aboundex/0.3 Disallow:/ User-agent: UCY/Nutch-1.2 Disallow:/ User-agent: SeznamBot/3.2 Disallow:/ User-agent: BLock Genieo/1.0 Disallow:/ User-agent: Mail.RU_Bot/2.0 Disallow:/ User-agent: LTX71 Disallow:/ User-agent: Mozilla/5.0 (compatible; MSIE or Firefox mutant;) Daum 4.1 Disallow:/ User-agent: InfluenceBot Disallow:/ User-agent: semanticbot Disallow:/ User-agent: SurveyBot/2.3 Disallow:/ User-agent: Dataprovider/6.92 Disallow:/ User-agent: wotbox Disallow: / User-agent: NetSeer crawler/2.0 Disallow: / User-agent: GrapeshotCrawler/2.0 Disallow: / User-agent:woobot/1.1 Disallow: / User-agent: woobot/2.0 Disallow: / User-agent: HubSpot Connect 2.0 Disallow: / User-agent: Exabot/3.0 Disallow: / User-agent: WbSrch/1.1 Disallow: / User-agent: seoscanners.net/1 Disallow: / User-agent: Scrapy/1.1.0 Disallow: / #23/06/2016 User-agent: Sogou web spider/4.0 Disallow: / #27/06/2016 User-agent: spbot/5.0.2 Disallow: / User-agent: seoscanners.net/1 Disallow: / # 30/06/2016 User-agent: Daum 4.1 Disallow: / User-agent: Scrapy/1.1.0rc4 Disallow: / #04/07/2016 User-agent: grapeshot Disallow: / #05/07/2016 User-agent: viz/Nutch-1.7 Disallow: / User-agent: oBot/2.3.1 Disallow: / #08/07/2016 User-agent: AdnormCrawler Disallow: / #11/07/2016 User-agent: CrazyWebCrawler-Spider Disallow: / #13/07/2016 User-agent: istellabot/t.1 Disallow: / User-agent: Mechanize/2.7.2 Ruby/2.0.0p481 (http://github.com/sparklemotion/mechanize/) Disallow: / User-agent:GrapeshotCrawler/2.0 Disallow: / User-agent: DomainAppender /1.0 Disallow: / #19/07/2016 User-agent: SiteExplorer/1.0b Disallow: / #03/08/2016 User-agent: CRAZYWEBCRAWLER 0.9.10 Disallow: / #04/08/2016 User-agent: bd/Nutch-1.7 Disallow: / #05/08/2016 User-agent: DomainSONOCrawler/0.1 Disallow: / User-agent: Dataprovider/6.101 Disallow: / #09/08/2016 User-agent: SemrushBot/1.1~bl Disallow: / User-agent: ZoomInformation Bot Disallow: / #26082016 User-agent: Uptimebot/0.2.43 Disallow: / #31082016 User-agent: MojeekBot/0.6 Disallow: / #01092016 User-agent: DowntimeDetector/1.0 Disallow: / #02092016 User-agent: nutch-1.4/Nutch-1.4 Disallow: / #05082016 User-agent: Cliqzbot/1.0 Disallow: / #07092016 User-agent: TinEye-bot/0.51 Disallow: / #13092016 User-agent: Gluten Free Crawler/1.0 Disallow: / #23092016 User-agent: Qwantify/2.2w Disallow: / #29092016 User-agent: psbot/0.1 Disallow: / User-agent: psbot-page Disallow: / #07102016 User-agent: MegaIndex.ru/2.0 Disallow: / #14102016 User-agent: DomainAppender /1.0 Disallow: / #29112016 User-agent: vebidoobot Disallow: / #21122016 User-agent: SemrushBot/1.1~bl Disallow:/ #19012017 User-agent: MixrankBot Disallow:/ #31012017 User-agent: SemrushBot/1.2~bl Disallow:/ #01022017 User-agent: Plukkie/1.6 Disallow:/ #22032017 User-agent: SiteExplorer/1.1b Disallow:/ #033042017 User-agent: okhttp/2.5.0 Disallow:/ #05042017 User-agent: YisouSpider Disallow:/ User-agent: DataMiner/3.14 Disallow:/ #13042017 User-agent: NetcraftSurveyAgent/1.0 Disallow:/ #18042017 User-agent: Daum/4.1 Disallow:/ User-agent: Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/) Disallow:/ #21042017 User-agent: Gobyus Disallow:/ # 25052017 User-agent: Go-http-client/1.1 Disallow:/ User-agent: Scrapy/1.4.0 Disallow:/ User-agent: GarlikCrawler/1.2 Disallow:/ User-agent: Virusdie crawler/3.0 Disallow:/ User-agent: Qwantify/2.4w Disallow:/ User-agent: spbot/5.0.3 Disallow:/ User-agent: Barkrowler 0.1.6 Disallow:/ User-agent: SeaMonkey/17.8 Disallow:/ User-agent: Contacts-Crawler/0.2 Disallow:/ User-agent: CipaCrawler/3.0 Disallow:/ User-agent:AwarioRssBot/1.0 Disallow:/ User-agent:IAS crawler Disallow:/ User-agent:007ac9 Crawler Disallow:/ User-agent:SeaMonkey/3.6 Disallow:/ User-agent: DnyzBot/1.0 Disallow:/ User-agent: Cliqzbot/2.0 Disallow:/ User-agent: Barkrowler/0.7 Disallow:/ User-agent: Neangan Spider/Nutch-2.3.1 Disallow:/ User-agent: BUbiNG Disallow: / User-agent: Gigabot Disallow: / User-agent: Barkrowler/0.7 Disallow: / User-agent: SurdotlyBot/1.0 Disallow: / User-agent: Apache OpenOffice/4.1.5 Disallow: / User-agent: TinEye-bot/1.31 Disallow: / User-agent: Iceweasel/44.0 Disallow: / User-agent: curl/7.45.0-DEV Disallow: / User-agent: Tarantula/Tarantula-1.14 Disallow: / User-agent: tracemyfile/1.0 Disallow: / User-agent: Quick-Crawler Disallow: / User-agent: curl/7.52.1 Disallow: / User-agent: CCBot/2.0 Disallow: / User-agent: MauiBot Disallow: / User-agent: Naaraa/Nutch-1.14 Disallow: / User-agent: PulsePoint-Ads.txt-Crawler/1.0 Disallow: / User-agent: Dispatch/0.11.3 Disallow: / User-agent: Python-urllib/2.7 Disallow: / User-agent: pyspider/0.3.9 Disallow: / User-agent: Wayback Machine Live Record Disallow: / User-agent: Apache-HttpClient/4.5.2 Disallow:/ User-agent: PhantomJS/2.1.1 Disallow:/ User-agent: bidswitchbot/1.0 Disallow:/ User-agent: Applebot/0.1 Disallow:/ USer-agent: Photon/1.0 Disallow:/ User-agent: SemrushBot/2~bl Disallow:/ User-agent: Scrapy/1.5.1 Disallow:/ User-agent: elenPublicWebCrawler Disallow:/ User-agent: Presto/2.8.131 Disallow:/ User-agent: Barkrowler/0.9 Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: evc-batch/2.0 Disallow: / User-agent: WebDataStats/1.0 Disallow: / User-agent: VelenPublicWebCrawler/1.0 Disallow:/ User-agent: libwww-perl/6.08 Disallow:/ User-agent: Scrapy/1.6.0 Disallow:/ User-agent: MJ12bot/v1.4.8 Disallow:/ User-agent: Xenu Link Sleuth/1.3.8 Disallow:/ User-agent: zgrab/0.x Disallow:/ User-agent: MojeekBot/0.7 Disallow:/ User-agent:SEOkicks Disallow:/ User-agent: Darwin/19.3.0 Disallow: / User-agent: DomainStatsBot/1.0 Disallow: / User-agent: cortex/1.0 Disallow: / User-agent: AspiegelBot Disallow: / User-agent: Darwin/17.7.0 Disallow: / User-agent: Hexometer Disallow: / User-agent: AwarioSmartBot/1.0 Disallow: / User-agent: Gowikibot/1.0 Disallow: / User-Agent: Ingrid Crawl-delay: 20 User-agent: rogerbot Crawl-delay: 2 User-agent: AhrefsBot Crawl-Delay: 5
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)