User-agent: * Disallow: /wp-admin/ User-agent: rogerbot Disallow: / # Open Link Profiler # Mozilla/5.0+(compatible;+spbot/4.4.2;++http://OpenLinkProfiler.org/bot+) # http://OpenLinkProfiler.org/bot User-agent: spbot Disallow: / # SemrushBot # Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html) # http://www.semrush.com/bot.html User-agent: semrushbot Disallow: / # DotBot # Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, [email protected]) # http://www.opensiteexplorer.org/dotbot User-agent: dotbot Disallow: / # AhrefsBot # Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/) # http://ahrefs.com/robot User-agent: ahrefsbot Disallow: / # MJ12bot # Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+) # http://www.majestic12.co.uk/bot.php User-agent: mj12bot Disallow: / # MojeekBot # Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html) # https://www.mojeek.com/bot.html User-agent: mojeekbot Disallow: / # YandexImages # Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots) # http://yandex.com/bots User-agent: yandex Disallow: / # Shareaholicbot # Mozilla/5.0 (compatible; Shareaholicbot/1.0; +http://www.shareaholic.com/bot) # http://www.shareaholic.com User-agent: shareaholicbot Disallow: / # Baiduspider # Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) # http://www.baidu.com/search/spider.html User-agent: baiduspider Disallow: / # BLEXBot # Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/) # http://webmeup-crawler.com 136.243.36.100 User-agent: blexbot Disallow: /
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)