This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://oparu.uni-ulm.de
####COPY OF ROBOTS.TXT IN /var/www/ DIRECTORY### # The URL to the DSpace sitemaps # XML sitemap is listed first as it is preferred by most search engines Sitemap: https://oparu.uni-ulm.de/sitemap_index.xml Sitemap: https://oparu.uni-ulm.de/sitemap_index.html # Genral delay of 10 secounds per request User-agent: * Crawl-delay: 15 # Dissalllow all for spcific bots # List of agressiv bots User-agent: ClaudeBot Disallow: / User-agent: claudebot Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AmazonBot Disallow: / #User-agent: Googlebot #Disallow: / User-agent: UT-Dorkbot Disallow: / User-agent: bingbot Disallow: / User-agent: gptbot Disallow: / User-agent: GPTBot Disallow: / User-agent: Applebot Disallow: / # Allow for the others (MUST)) # documentation: https://wiki.lyrasis.org/display/DSDOC7x/Search+Engine+Optimization User-agent: * Allow: /bitstreams/ User-agent: * Allow: /browse/* User-agent: * Allow: /collections/ User-agent: * Allow: /communities/ User-agent: * Allow: /community-list/ User-agent: * Allow: /entities/* User-agent: * Allow: /handle/ User-agent: * Allow: /items/ User-agent: Googlebot Allow: / User-agent: Google Allow: / # Dissallow everthing for others # For all unkown bots User-agent: * Disallow: /