This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://shop.woelpert.de
# google User-agent: Googlebot User-agent: Storebot-Google # yahoo User-agent: Slurp # bing User-agent: Bingbot # sistrix User-agent: Mozilla/5.0 (compatible; Optimizer; http://crawler.sistrix.net/) # Block access to specific groups of pages Disallow: /cart Disallow: /checkout Disallow: /my-account Disallow: /suche Disallow: /login/b2bunits Disallow: /download/getPagedData Disallow: /404 Disallow: /cookiesettings Disallow: /*?*&attachment=true Disallow: /*.pdf Disallow: /*.xls # For all other robots User-agent: * # Block access to all pages Disallow: / Request-rate: 1/10 Crawl-delay: 10 Visit-time: 0000-0600 # Allow search crawlers to discover the sitemap Sitemap: https://shop.woelpert.de/sitemap.xml