Sitemap: https://economipedia.com/sitemap_index.xml User-agent: * Disallow: /wp-login Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /*/wp-content/plugins/ Disallow: /*/wp-content/cache/ Disallow: /*/wp-content/themes/ Disallow: /*/robots.txt Disallow: /*/attachment/ Disallow: /*/clip/ Disallow: /*/econo_estilos/ Disallow: /*/certificados/ Disallow: /*/extra/ Disallow: /*/episodio/ Disallow: /*/producto/ Disallow: /*/post_tag/ Disallow: /*/post_format/ Disallow: /*/econo_preguntas/ Disallow: /*/categoria-producto/ Disallow: /*/etiqueta-producto/ Disallow: /*/product_cat/ Disallow: /*/product_tag/ Disallow: /*/product_shipping_class/ Disallow: /page/ Disallow: /*/page/ Disallow: /page/*/ Disallow: /*/p/ Disallow: /p/*/ Disallow: /p/ Disallow: /campus/landings/ Disallow: /downloads/*/ Disallow: /*/category/ Disallow: /category/*/ Disallow: /azglossary/*/ Disallow: /*/azglossary/ Disallow: /tag/*/page/ Disallow: /tag/*/feed/ Disallow: /comments/ Disallow: /xmlrpc.php Disallow: /?attachment_id* Disallow: *.pdf$ Disallow: *.xls$ Disallow: *.xlsx$ Disallow: *.csv$ # Disallow: *.html# # Desindexar enlaces con redireccion ftp Disallow: /ir/*/ Disallow: /ir-*/ Disallow: /*-ir/ Disallow: /email-ir/*/ Disallow: /rs-ir/*/ # Desindexar páginas y etiquetas #Noindex: /*/page/ #Noindex: /tag/*/ # Bloqueo de las URL dinamicas Disallow: /*? #Bloqueo de busquedas User-agent: * Disallow: /*?s= Disallow: /search # Bloqueo de trackbacks User-agent: * Disallow: /trackback Disallow: /*trackback Disallow: /*trackback* Disallow: /*/trackback # Bloqueo basico para todos los bots y crawlers # puede dar problemas por bloqueo de recursos en Google Search Console # Bloqueo de feeds para crawlers User-agent: * Allow: /feed/$ Disallow: /feed/ Disallow: /comments/feed/ Disallow: /*/feed/ Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$ Disallow: /*/*/feed/$ Disallow: /*/*/feed/rss/$ Disallow: /*/*/trackback/$ Disallow: /*/*/*/feed/$ Disallow: /*/*/*/feed.xml Disallow: /*/*/*/feed/rss/$ Disallow: /*/*/*/trackback/$ # Ralentizamos algunos bots que se suelen volver locos User-agent: noxtrumbot Crawl-delay: 20 User-agent: msnbot Crawl-delay: 20 User-agent: Slurp Crawl-delay: 20 # Previene problemas de recursos bloqueados en Google Webmaster Tools User-Agent: Googlebot Allow: /*.css$ Allow: /*.js$ # Bloqueo de bots y crawlers poco utiles User-agent: Orthogaffe Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: Twiceler Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: Nutch Disallow: / User-agent: spock Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: BecomeBot Disallow: / User-agent: genieBot Disallow: / User-agent: dotbot Disallow: / User-agent: MLBot Disallow: / User-agent: 80bot Disallow: / User-agent: Linguee Bot Disallow: / User-agent: aiHitBot Disallow: / User-agent: Exabot Disallow: / User-agent: SBIder/Nutch Disallow: / User-agent: Jyxobot Disallow: / User-agent: mAgent Disallow: / User-agent: MJ12bot Disallow: / User-agent: Speedy Spider Disallow: / User-agent: ShopWiki Disallow: / User-agent: Huasai Disallow: / User-agent: DataCha0s Disallow: / User-agent: Baiduspider Disallow: / User-agent: Atomic_Email_Hunter Disallow: / User-agent: Mp3Bot Disallow: / User-agent: WinHttp Disallow: / User-agent: betaBot Disallow: / User-agent: core-project Disallow: / User-agent: panscient.com Disallow: / User-agent: Java Disallow: / User-agent: libwww-perl Disallow: / User-agent: wget Disallow: / User-agent: WebReaper Disallow: / User-agent: grub-client Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / # Codigo para no rastrear paginas que no existen User-agent: * Disallow: /news/ Disallow: /find/ Disallow: /search/ Disallow: /foros/
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)