This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://www.icrea.cat
# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html # # For syntax checking, see: # http://www.frobee.com/robots-txt-check User-agent: * #Crawl-delay: 10 Sitemap: https://www.icrea.cat/sitemap.xml Allow: /$ Allow: /sitemap.xml Allow: /Web/ScientificStaff/ # EN pages Allow: /en$ Allow: /en/sitemap.xml Allow: /en/who-we-are Allow: /en/welcome-conseller Allow: /en/annual-report Allow: /en/intro Allow: /en/icrea-community Allow: /en/director Allow: /en/executive-team Allow: /en/board Allow: /en/icrea-selection Allow: /en/icrea-evaluators Allow: /en/calls Allow: /en/icreas Allow: /en/new-icreas Allow: /en/host-institutions Allow: /en/scientific-contribution Allow: /en/highlights Allow: /en/icrea-academia-awardees Allow: /en/upcoming-events Allow: /en/past-events Allow: /en/bringing-ideas-market Allow: /en/spin-companies Allow: /en/patents Allow: /en/news Allow: /en/news-archive Allow: /en/videos Allow: /en/external-reports Allow: /en/brand-image Allow: /en/contact Allow: /en/transparency # CA pages Allow: /ca$ Allow: /ca/sitemap.xml Allow: /ca/qui-som Allow: /ca/benvinguda-del-conseller Allow: /ca/informe-anual Allow: /ca/la-comunitat-icrea Allow: /ca/el-director Allow: /ca/equip-de-gestio Allow: /ca/patronat Allow: /ca/la-seleccio-dicrea Allow: /ca/avaluadors Allow: /ca/convocatories Allow: /ca/els-icrea Allow: /ca/nous-icrea Allow: /ca/institucions-dacollida Allow: /ca/contribucio-cientifica Allow: /ca/destacats Allow: /ca/icrea-academia Allow: /ca/properes-activitats Allow: /ca/activitats-anteriors Allow: /ca/aportacio-didees-al-mercat Allow: /ca/empreses-derivades Allow: /ca/patents Allow: /ca/noticies Allow: /ca/arxiu-de-noticies Allow: /ca/videos Allow: /ca/informes-externs Allow: /ca/imatge-de-marca Allow: /ca/contacte Allow: /ca/transparencia # ES pages Allow: /es$ Allow: /es/sitemap.xml Allow: /es/quienes-somos Allow: /es/bienvenida-del-conseller Allow: /es/informe-anual Allow: /es/la-comunidad-icrea Allow: /es/el-director Allow: /es/equipo-de-gestion Allow: /es/patronato Allow: /es/la-seleccion-de-icrea Allow: /es/evaluadores Allow: /es/convocatorias Allow: /es/los-icrea Allow: /es/nuevos-icrea Allow: /es/instituciones-de-acogida Allow: /es/contribucion-cientifica Allow: /es/destacados Allow: /es/icrea-academia Allow: /es/proximas-actividades Allow: /es/actividades-anteriores Allow: /es/aportacion-de-ideas-al-mercado Allow: /es/empresas-derivadas Allow: /es/patentes Allow: /es/noticias Allow: /es/archivo-de-noticias Allow: /es/videos Allow: /es/informes-externos Allow: /es/imagen-de-marca Allow: /es/contacto Allow: /es/transparencia Disallow: /* # Directories Disallow: /includes/ Disallow: /misc/ Disallow: /modules/ Disallow: /profiles/ Disallow: /scripts/ Disallow: /themes/ # Files Disallow: /CHANGELOG.txt Disallow: /cron.php Disallow: /INSTALL.mysql.txt Disallow: /INSTALL.pgsql.txt Disallow: /INSTALL.sqlite.txt Disallow: /install.php Disallow: /INSTALL.txt Disallow: /LICENSE.txt Disallow: /MAINTAINERS.txt Disallow: /update.php Disallow: /UPGRADE.txt Disallow: /xmlrpc.php # Paths (clean URLs) Disallow: /admin/ Disallow: /comment/reply/ Disallow: /filter/tips/ Disallow: /node/add/ Disallow: /search/ Disallow: /user/register/ Disallow: /user/password/ Disallow: /user/login/ Disallow: /user/logout/ # Paths (no clean URLs) Disallow: /?q=admin/ Disallow: /?q=comment/reply/ Disallow: /?q=filter/tips/ Disallow: /?q=node/add/ Disallow: /?q=search/ Disallow: /?q=user/password/ Disallow: /?q=user/register/ Disallow: /?q=user/login/ Disallow: /?q=user/logout/