This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://waz.de
User-agent: * Allow: /static/*/client.js Allow: /static/*/main.css Allow: /static/*/favicon.png Disallow: /stats/* Disallow: /*?config* Disallow: /*.xmli* Disallow: /*?service=Ajax Disallow: /*?service=ajax Disallow: /config/* Disallow: /test/* Disallow: /Test/* Disallow: /template/* Disallow: /*?*token=* Disallow: /*?*eventId=* Disallow: /static/* Disallow: /migration_import_no_section/* Disallow: /secure/ Disallow: /socialmedia/* Disallow: *reader_id=READER_ID* Disallow: /suche/* Disallow: /*?widgetid= Disallow: /newsletter-result/ Disallow: *tpcc=* Disallow: /resources/ Disallow: /bin/ Disallow: /downloads/ Disallow: /service/newsletter-adconsent Disallow: /pagespeed_static/ Disallow: /resources/img/*icon*pagespeed User-agent: Cliqzbot Disallow: / User-agent: sogou spider Disallow: / User-agent: Baiduspider Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Flamingo_SearchEngine Disallow: / User-agent: Audisto Disallow: / User-agent: GPTBot Disallow: / Sitemap: https://www.waz.de/sitemaps/news.xml User-Agent: AhrefsBot Disallow: / User-Agent: archive.org_bot Disallow: / User-Agent: arquivo-web-crawler Disallow: / User-Agent: arquivo.pt Disallow: / User-Agent: BacklinkCrawler Disallow: / User-Agent: Baiduspider Disallow: / User-Agent: Barkrowler Disallow: / User-Agent: BLEXBot Disallow: / User-Agent: browsertrix Disallow: / User-Agent: brozzler Disallow: / User-Agent: BuiltWith Disallow: / User-Agent: CCBot Disallow: / User-Agent: Cincraw Disallow: / User-Agent: coccocbot Disallow: / User-Agent: contao/crawler Disallow: / User-Agent: DataForSeoBot Disallow: / User-Agent: deepcrawl Disallow: / User-Agent: Dmbot Disallow: / User-Agent: DomainStatsBot Disallow: / User-Agent: DotBot Disallow: / User-Agent: dotbot Disallow: / User-Agent: fluid Disallow: / User-Agent: freshbot Disallow: / User-Agent: HaosouSpider Disallow: / User-Agent: HappyWing Disallow: / User-Agent: harsilbot Disallow: / User-Agent: hatena antenna Disallow: / User-Agent: Heritrix Disallow: / User-Agent: ia_archiver Disallow: / User-Agent: ImagesiftBot Disallow: / User-Agent: kazbtbot Disallow: / User-Agent: Kraken Disallow: / User-Agent: LinkChecker Disallow: / User-Agent: linkdebot Disallow: / User-Agent: Linkfluence Yak Bot Disallow: / User-Agent: mail.RU_Bot Disallow: / User-Agent: Majestic Disallow: / User-Agent: Majestic12 Disallow: / User-Agent: MetaJobBot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: Monsidobot Disallow: / User-Agent: netEstate Disallow: / User-Agent: OGDWCtcxCrawler Disallow: / User-Agent: OnPageBot Disallow: / User-Agent: OpenindexSpider Disallow: / User-Agent: openindexspider Disallow: / User-Agent: Optimizer Disallow: / User-Agent: PetalBot Disallow: / User-Agent: ResearchBot Disallow: / User-Agent: Riddler Disallow: / User-Agent: rogerbot Disallow: / User-Agent: RyteBot Disallow: / User-Agent: Semanticbot Disallow: / User-Agent: SemanticScholarBot Disallow: / User-Agent: SemrushBot Disallow: / User-Agent: Semrushbot-SI Disallow: / User-Agent: SentiBot Disallow: / User-Agent: Seobility Disallow: / User-Agent: SEOdiver Disallow: / User-Agent: SEOkicks Disallow: / User-Agent: SEOkicks-Robot Disallow: / User-Agent: SeznamBot Disallow: / User-Agent: SirdataBot Disallow: / User-Agent: sistrix Disallow: / User-Agent: SISTRIX Disallow: / User-Agent: SISTRIX Crawler Disallow: / User-Agent: SiteAuditBot Disallow: / User-Agent: spbot Disallow: / User-Agent: spbot Disallow: / User-Agent: special_archiver Disallow: / User-Agent: SplitSignalBot Disallow: / User-Agent: Tag-Crawler Disallow: / User-Agent: Testcrawler Disallow: / User-Agent: thinkers-bot Disallow: / User-Agent: Toplistbot Disallow: / User-Agent: uipbot Disallow: / User-Agent: urlsuma Disallow: / User-Agent: User-Agent Disallow: / User-Agent: ViennaTinyBot Disallow: / User-Agent: VsuSearchSpider Disallow: / User-Agent: weborama-fetcher Disallow: / User-Agent: WiseGuys Robot Disallow: / User-Agent: wpbot Disallow: / User-Agent: Yandex Disallow: / User-Agent: Yeti Disallow: /