This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://meinetierwelt.de
######################################################## # robots.txt fuer www.deine-tierwelt.de ######################################################## # Verzeichnisse bitte unten eintragen: ######################################################## ######################################################## # Allgemein ######################################################## User-agent: * Allow: /ads.txt Disallow: / ######################################################## # Speziell ######################################################## User-agent: Adsbot-Google User-agent: AhrefsSiteAudit User-agent: Applebot # Apple Siri User-agent: Baiduspider # Chinese search engine Baidu User-agent: Bingbot User-agent: Browsershots User-agent: DuckDuckBot # DuckDuckGo search engine User-agent: eBay Relevance Ad Crawler User-agent: eBay Relevance Ad Crawler powered by contentDetection (www.mindup.de) User-agent: Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails) # French search engine Exalead User-agent: Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) # French search engine Exalead User-agent: facebookcatalog/1.0 User-agent: facebookexternalhit User-agent: facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) User-agent: facebookexternalhit/1.1 User-agent: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) User-agent: Feedfetcher-Google User-agent: Googlebot User-agent: Googlebot-Image User-agent: Googlebot-Mobile User-agent: Googlebot-News User-agent: Googlebot-Video User-agent: grapeshot User-agent: GumGum User-agent: Heritrix User-agent: ia_archiver User-agent: LinkedInBot User-agent: MediaPartners-Google User-agent: Mediapartners (Googlebot) User-agent: msnbot User-agent: Pinterestbot User-agent: Slackbot User-agent: Slurp # Yahoo User-agent: Sogou # Chinese search engine Sogou User-agent: TEOMA User-agent: TermLabs User-agent: Twitterbot User-agent: YandexBot # Russian search engine Yandex Allow: / Disallow: /feed/ Disallow: /holder-template/ Disallow: /ajax/ Disallow: /payment/