# * User-agent: * Allow: / Crawl-delay: 10 # YandexBot User-agent: YandexBot Disallow: / # Yandex User-agent: Yandex Disallow: / # archive.org_bot User-agent: archive.org_bot # SEMrushBot User-agent: SEMrushBot # YandexImages User-agent: YandexImages Disallow: / # MSIECrawler User-agent: MSIECrawler Disallow: / # WebCopier User-agent: WebCopier Disallow: / # HTTrack User-agent: HTTrack Disallow: / # Microsoft.URL.Control User-agent: Microsoft.URL.Control Disallow: / # libwww User-agent: libwww Disallow: / # Orthogaffe User-agent: Orthogaffe Disallow: / # UbiCrawler User-agent: UbiCrawler Disallow: / # DOC User-agent: DOC Disallow: / # Zao User-agent: Zao Disallow: / # sitecheck.internetseer.com User-agent: sitecheck.internetseer.com Disallow: / # Zealbot User-agent: Zealbot Disallow: / # MSIECrawler User-agent: MSIECrawler Disallow: / # SiteSnagger User-agent: SiteSnagger Disallow: / # WebStripper User-agent: WebStripper Disallow: / # WebCopier User-agent: WebCopier Disallow: / # Fetch User-agent: Fetch Disallow: / # Offline Explorer User-agent: Offline Explorer Disallow: / # Teleport User-agent: Teleport Disallow: / # TeleportPro User-agent: TeleportPro Disallow: / # WebZIP User-agent: WebZIP Disallow: / # linko User-agent: linko Disallow: / # HTTrack User-agent: HTTrack Disallow: / # Microsoft.URL.Control User-agent: Microsoft.URL.Control Disallow: / # Xenu User-agent: Xenu Disallow: / # larbin User-agent: larbin Disallow: / # libwww User-agent: libwww Disallow: / # ZyBORG User-agent: ZyBORG Disallow: / # Download Ninja User-agent: Download Ninja Disallow: / # wget User-agent: wget Disallow: / # grub-client User-agent: grub-client Disallow: / # k2spider User-agent: k2spider Disallow: / # NPBot User-agent: NPBot Disallow: / # WebReaper User-agent: WebReaper Disallow: / # Baiduspider User-agent: Baiduspider Disallow: / # Yahoo! Slurp China User-agent: Yahoo! Slurp China Disallow: / # Baiduspider-image User-agent: Baiduspider-image Disallow: / # noxtrumbot User-agent: noxtrumbot Crawl-delay: 50 # msnbot User-agent: msnbot Crawl-delay: 30 # Slurp User-agent: Slurp Crawl-delay: 10 # AhrefsBot User-agent: AhrefsBot # MSIECrawler User-agent: MSIECrawler Disallow: / # WebCopier User-agent: WebCopier Disallow: / # Python-urllib User-agent: Python-urllib Disallow: / # URL_Spider_Pro User-agent: URL_Spider_Pro Disallow: / # EmailCollector User-agent: EmailCollector Disallow: / # EmailSiphon User-agent: EmailSiphon Disallow: / # WebBandit User-agent: WebBandit Disallow: / # EmailWolf User-agent: EmailWolf Disallow: / # ExtractorPro User-agent: ExtractorPro Disallow: / # CopyRightCheck User-agent: CopyRightCheck Disallow: / # Alexibot User-agent: Alexibot Disallow: / # * User-agent: * Disallow: /mifi/ # * User-agent: * Disallow: /HTTP/ # * User-agent: * Disallow: /www.finetwork.com/ # * User-agent: * Disallow: /pdf/* # Host Host: https://www.finetwork.com # Sitemaps Sitemap: https://www.finetwork.com/sitemap.xml
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)