This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://dw-karlsruhe.de
User-agent: Googlebot Crawl-delay: 5 Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: msnbot Crawl-delay: 10 Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: Slurp Crawl-delay: 5 Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: bingbot Crawl-delay: 10 Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: bingbot/2.0 Crawl-delay: 10 Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: W3C-checklink Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: sistrix Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: facebookexternalhit Allow: /dynamic/generated/ Allow: /dynamic/sitemaps/ Disallow: /admintools/ Disallow: /application/ Disallow: /awstats/ Disallow: /logs/ Disallow: /reports/ Disallow: /html/tiles/ Disallow: /html/layout/ Disallow: /html/templates/ Disallow: /dynamic/ User-agent: * Disallow: /
Please select one of the following options for your request.
None of these options suit your need?
You can also download our Quick Start Guide, visit the FAQ section, our Knowledge Base or Blog.
