This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: https://de.topps.com/
# Crawlers Setup User-agent: Googlebot User-agent: Bingbot User-agent: AdIdxBot User-agent: BingPreview User-agent: MSNBot User-agent: MSNBot-Media User-agent: Slurp User-agent: Applebot User-agent: DuckDuckBot User-agent: Baiduspider User-agent: YandexBot User-agent: facebookexternalhit/1.1 User-agent: Facebot User-agent: FacebookExternalHit User-agent: TwitterBot User-agent: LinkedINBot User-agent: Slurp User-agent: SemrushBot User-agent: Yeti User-agent: ia_archiver Crawl-delay: 5 # Allowable Index Allow: /catalog/seo_sitemap/category/ Allow: /media/sitemap_de/de_sitemap.xml Allow: /blog/category/ #Disallow search result Disallow: /catalogsearch/result/ # Directories Disallow: /404/ Disallow: /app/ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /includes/ Disallow: /lib/ Disallow: /magento/ # Disallow: /media/ // Allow this folder for google product caching Disallow: /pkginfo/ Disallow: /report/ Disallow: /stats/ Disallow: /var/ Disallow: /catalog/product/quickviewlookbook/ Disallow: /catalog/product/fullscreenmedia/ # Paths (clean URLs) Disallow: /index.php/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /catalog/product/printview/ Disallow: /catalogsearch/ Disallow: /checkout/ Disallow: /control/ Disallow: /contacts/ Disallow: /customer/ Disallow: /customize/ Disallow: /newsletter/ Disallow: /poll/ Disallow: /review/ Disallow: /sendfriend/ Disallow: /tag/ Disallow: /wishlist/ Disallow: /consult/ Disallow: /uenc/ # Files Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /STATUS.txt # Paths (no clean URLs) Disallow: /*.php$ Disallow: /*?p=*& Disallow: /*?SID= # All other Bots User-agent: * Disallow: / # Allow PowerMapper User-agent: PowerMapper Allow: / Sitemap: https://de.topps.com/pub/media/sitemap_de/de_sitemap.xml