#User-agent: * # advertising-related bots: User-agent: Mediapartners-Google* Allow: / User-agent: Purebot Allow: / # Wikipedia work bots: User-agent: IsraBot Allow: / User-agent: Orthogaffe Allow: / # Crawlers that are kind enough to obey, but which we'd rather not have # unless they're feeding search engines. User-agent: UbiCrawler Allow: / User-agent: DOC Allow: / User-agent: Zao Allow: / # Some bots are known to be trouble, particularly those designed to copy # entire sites. Please obey robots.txt. User-agent: sitecheck.internetseer.com Allow: / User-agent: Zealbot Allow: / User-agent: MSIECrawler Allow: / User-agent: SiteSnagger Allow: / User-agent: WebStripper Allow: / User-agent: WebCopier Allow: / User-agent: Fetch Allow: / User-agent: Offline Explorer Allow: / User-agent: Teleport Allow: / User-agent: TeleportPro Allow: / User-agent: WebZIP Allow: / User-agent: linko Allow: / User-agent: HTTrack Allow: / User-agent: Microsoft.URL.Control Allow: / User-agent: Xenu Allow: / User-agent: larbin Allow: / User-agent: libwww Allow: / User-agent: ZyBORG Allow: / User-agent: Download Ninja Allow: / # # Sorry, wget in its recursive mode is a frequent problem. # Please read the man page and use it properly; there is a # --wait option you can use to set the delay between hits, # for instance. # User-agent: wget Allow: / # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Allow: / # # Doesn't follow robots.txt anyway, but... # User-agent: k2spider Allow: / # # Hits many times per second, not acceptable # http://www.nameprotect.com/botinfo.html User-agent: NPBot Allow: / # A capture bot, downloads gazillions of pages with no public benefit # http://www.webreaper.net/ User-agent: WebReaper Allow: / User-agent: WBSearchBot Allow: / User-Agent: panscient.com Allow: / # User-agent: * Disallow: /de/de_AT/pricelist/ Disallow: /de/de_AT/searchoffer/ Disallow: /de/de_AT/contact/ Disallow: /de/de_AT/callback/ Disallow: /de/de_AT/user/ Disallow: /de/de_AT/search.html Disallow: /de/de_AT/login.html Disallow: /uploads/ Disallow: /de/de_DE/pricelist/ Disallow: /de/de_DE/searchoffer/ Disallow: /de/de_DE/contact/ Disallow: /de/de_DE/callback/ Disallow: /de/de_DE/user/ Disallow: /de/de_DE/search.html Disallow: /de/de_DE/login.html Disallow: /fr/fr_FR/pricelist/ Disallow: /fr/fr_FR/searchoffer/ Disallow: /fr/fr_FR/contact/ Disallow: /fr/fr_FR/callback/ Disallow: /fr/fr_FR/user/ Disallow: /fr/fr_FR/search.html Disallow: /fr/fr_FR/login.html Disallow: /it/it_IT/pricelist/ Disallow: /it/it_IT/searchoffer/ Disallow: /it/it_IT/contact/ Disallow: /it/it_IT/callback/ Disallow: /it/it_IT/user/ Disallow: /it/it_IT/search.html Disallow: /it/it_IT/login.html Disallow: /en/en_US/pricelist/ Disallow: /en/en_US/searchoffer/ Disallow: /en/en_US/contact/ Disallow: /en/en_US/callback/ Disallow: /en/en_US/user/ Disallow: /en/en_US/search.html Disallow: /en/en_US/login.html Disallow: /en/en_GB/pricelist/ Disallow: /en/en_GB/searchoffer/ Disallow: /en/en_GB/contact/ Disallow: /en/en_GB/callback/ Disallow: /en/en_GB/user/ Disallow: /en/en_GB/search.html Disallow: /en/en_GB/login.html Disallow: /en/en_AU/pricelist/ Disallow: /en/en_AU/searchoffer/ Disallow: /en/en_AU/contact/ Disallow: /en/en_AU/callback/ Disallow: /en/en_AU/user/ Disallow: /en/en_AU/search.html Disallow: /en/en_AU/login.html Allow: /*? Sitemap: http://www.number-1-mm.com/sitemap.xml
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)