Esta página no es accesible para el bot de Seobility porque está excluido en el archivo Robots.txt. El bot de Seobility no rastrea nada que excluya a Seobility o *.
URL problemática: http://oparu.uni-ulm.de
####COPY OF ROBOTS.TXT IN /var/www/ DIRECTORY### # The URL to the DSpace sitemaps # XML sitemap is listed first as it is preferred by most search engines Sitemap: https://oparu.uni-ulm.de/sitemap_index.xml Sitemap: https://oparu.uni-ulm.de/sitemap_index.html # Genral delay of 10 secounds per request User-agent: * Crawl-delay: 15 # Dissalllow all for spcific bots # List of agressiv bots User-agent: ClaudeBot Disallow: / User-agent: claudebot Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AmazonBot Disallow: / #User-agent: Googlebot #Disallow: / User-agent: UT-Dorkbot Disallow: / User-agent: bingbot Disallow: / User-agent: gptbot Disallow: / User-agent: GPTBot Disallow: / User-agent: Applebot Disallow: / User-agent: UT-Dorkbot Disallow: / # Allow for the others (MUST)) # documentation: https://wiki.lyrasis.org/display/DSDOC7x/Search+Engine+Optimization User-agent: * Allow: /bitstreams/ User-agent: * Allow: /browse/* User-agent: * Allow: /collections/ User-agent: * Allow: /communities/ User-agent: * Allow: /community-list/ User-agent: * Allow: /entities/* User-agent: * Allow: /handle/ User-agent: * Allow: /items/ User-agent: Googlebot Allow: / User-agent: Google Allow: / # Dissallow everthing for others # For all unkown bots User-agent: * Disallow: /