# Bloqueo basico para todos los bots y crawlers User-agent: * Allow: /blog/wp-content/uploads/* Allow: /blog/wp-content/*.js Allow: /blog/wp-content/*.css Allow: /blog/wp-includes/*.js Allow: /blog/wp-includes/*.css Disallow: /blog/cgi-bin Disallow: /blog/wp-content/plugins/ Disallow: /blog/wp-content/themes/ Disallow: /wp-includes/ Disallow: /blog/*/attachment/ Disallow: /blog/tag/*/page/ Disallow: /tag/*/feed/ Disallow: /page/ Disallow: /comments/ Disallow: /xmlrpc.php Disallow: /?attachment_id* Disallow: /admin Disallow: /admin-v2 #Disallow: /cookies #Disallow: /aviso-legal #Disallow: /privacidad Disallow: /reset-password Disallow: /login Disallow: /reag-ppv Disallow: /register Disallow: /blog/author/*/ Disallow: /blog/tag/*/ Disallow: /blog/page/*/?nb* # Bloqueo de las URL dinamicas Disallow: /blog/*? #Bloqueo de busquedas User-agent: * Disallow: /blog/?s= Disallow: /blog/search # Bloqueo de trackbacks User-agent: * Disallow: /blog/trackback Disallow: /blog/*trackback Disallow: /blog/*trackback* Disallow: /blog/*/trackback # Bloqueo de feeds para crawlers User-agent: * Allow: /blog/feed/$ Disallow: /blog/feed/ Disallow: /blog/comments/feed/ Disallow: /blog/*/feed/$ Disallow: /blog/*/feed/rss/$ Disallow: /blog/*/trackback/$ Disallow: /blog/*/*/feed/$ Disallow: /blog/*/*/feed/rss/$ Disallow: /blog/*/*/trackback/$ Disallow: /blog/*/*/*/feed/$ Disallow: /blog/*/*/*/feed/rss/$ Disallow: /blog/*/*/*/trackback/$ # Ralentizamos algunos bots que se suelen volver locos User-agent: noxtrumbot Crawl-delay: 20 User-agent: msnbot Crawl-delay: 20 User-agent: Slurp Crawl-delay: 20 # Bloqueo de bots y crawlers poco utiles User-agent: MSIECrawler Disallow: / User-agent: WebCopier Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: libwww Disallow: / User-agent: Orthogaffe Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: wget Disallow: / User-agent: grub-client Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / User-agent: WebReaper Disallow: / # Previene problemas de recursos bloqueados en Google Webmaster Tools User-Agent: Googlebot Allow: /*.css$ Allow: /*.js$ Allow: /blog/*.css$ Allow: /blog/*.js$ Sitemap: https://www.wolorent.com/sitemap.xml Sitemap: https://www.wolorent.com/blog/sitemap.xml
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)