User-agent: * Crawl-Delay: 3 User-agent: WebReaper Disallow: User-agent: SemrushBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: genieo Disallow: / User-agent: MJ12bot Disallow: / User-agent: SolomonoBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Yandex Disallow: / User-agent: sistrix Disallow: / User-agent: MoodleBot Disallow: / User-agent: moget Disallow: / User-agent: ichiro Disallow: / User-agent: sogou spider Disallow: / User-agent: sogouspider Disallow: / User-agent: YoudaoBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: IntegromeDB Disallow: / User-agent: trovitBot Disallow: / User-agent: DotBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Exabot Disallow: / User-agent: * Disallow: /emailjob.cfm Disallow: /applyjob.cfm Disallow: /add-inbox.cfm Disallow: /job-apply-ext.cfm Disallow: /search_rss.cfm
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)