Show your SEO score to your visitors using the Seobility widget. The widget always displays the current SEO score of your homepage.
#################################################################### # Inhalte, die grunds?tzlich von keinem Bot indiziert werden sollen: #################################################################### User-agent: * Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /domains/ Disallow: /exchange/ Disallow: /files/ Disallow: /forms/ Disallow: /fonts/ Disallow: /gc/ Disallow: /images/ Disallow: /img/ Disallow: /intern/ Disallow: /internal/ Disallow: /js/ Disallow: /mailsystem/ Disallow: /perl/ Disallow: /php/ Disallow: /privat/ Disallow: /private/ Disallow: /profil/ Disallow: /temp/ Disallow: /TEMP/ Disallow: /tmp/ Disallow: /test/ Disallow: /shops/ Disallow: /veraltet/ Disallow: /_veraltet/ Disallow: /_*/ Disallow: /tools/ Disallow: /uploads/ Disallow: /users/ Disallow: /webmail/ Disallow: /*.swf Disallow: /*.log Disallow: /*.bak Disallow: /*.sid Disallow: /*.mod Disallow: /*.mid Disallow: *BotDetectCaptcha.ashx* Disallow: /WebResource* Disallow: /(* Disallow: *WebResource.axd* Disallow: *usersendpass.aspx* ################################################################### # Ausnahmen f?r Google, damit das Webmaster-Tools gut funktioniert # NACH DEM TESTEN JS WIEDER AUSKOMMENTIEREN, SONST EVTL. NEGATIVE # AUSWIRKUNGEN AUFS RANKING (Z. B. WG. GESCHWINDIGKEIT) # (in /js/ steht eh nichts drin, was indiziert werden m?sste) ################################################################### User-agent: Googlebot Allow: /css/ Disallow: /js/ # Allow: /js/ # Allow: /images/ ########################################################################################################## ############# unerw?nschte bots, die aber die robots.txt abfragen ########################################################################################################## #"TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)" User-agent: TurnitinBot Disallow: / User-agent: SlySearch Disallow: / #"findlinks/2.1.5 (+http://wortschatz.uni-leipzig.de/findlinks/)" User-agent: findlinks Disallow: / #"magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)" User-agent: magpie-crawler Disallow: / User-agent: Pixray-Seeker Disallow: / # http://www.majestic12.co.uk/projects/dsearch/mj12bot.php User-agent: MJ12bot Disallow: / # http://www.80legs.com/webcrawler.html - if 008 is crawling your website, it means that one or more 80legs users created a web crawl User-agent: 008 Disallow: / User-agent: Ezooms Disallow: / #"Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)" User-agent: AhrefsBot Disallow: / #"lb-spider/Mozilla/5.0 Gecko/20100101 Firefox/10.0.2 (lb-spider; http://www.linkbutler.de/spider; [email protected])" User-agent: lb-spider Disallow: / #"Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)" User-agent: WBSearchBot Disallow: / #"psbot/0.1 (+http://www.picsearch.com/bot.html)" User-agent: psbot Disallow: / #"HuaweiSymantecSpider/[email protected]+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/en/IRL/spider)" User-agent: HuaweiSymantecSpider Disallow: / #"Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/)" User-agent: sistrix Disallow: / #"EC2LinkFinder" User-agent: EC2LinkFinder Disallow: / #"http://SiteIntel.net Bot" #"htdig" User-agent: htdig Disallow: / #"SemrushBot/0.91" - http://de.semrush.com/? -Professionelle Software f?r SEO & SEM Professionals? User-agent: SemrushBot Disallow: / #"Mozilla/5.0 (compatible; discobot/2.0; +http://discoveryengine.com/discobot.html)" - we sell no wine before its time != trustworthy User-agent: discobot Disallow: / #"linkdex.com/v2.0" - SEO User-agent: linkdex.com Disallow: / #"SeznamBot/3.0 (+http://fulltext.sblog.cz/)" - sz-SEO User-agent: SeznamBot Disallow: / #"EdisterBot (http://www.edister.com/bot.html)" User-agent: EdisterBot Disallow: / #"Mozilla/5.0 (compatible; SWEBot/1.0; +http://swebot-crawler.net)" - versucht auf posting im forum zu replien User-agent: SWEBot Disallow: / ### ab hier noch in htaccess eintragen #"Mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com)" User-agent: picmole Disallow: / #"Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)" #"Mozilla/5.0 (iPhone; CPU iPhone OS 5_0_1 like Mac OS X) (compatible; Yeti-Mobile/0.1; +http://help.naver.com/robots/)" User-agent: Yeti Disallow: / User-agent: Yeti-Mobile Disallow: / #"PagePeeker.com (info: http://pagepeeker.com/robots)" User-agent: PagePeeker Disallow: / #"CatchBot/1.0; +http://www.catchbot.com" User-agent: CatchBot Disallow: / #"yacybot (freeworld/global; amd64 Linux 3.2.1-gentoo-r2; java 1.6.0_24; Europe/de) http://yacy.net/bot.html" User-agent: yacybot Disallow: / #"netEstate NE Crawler (+http://www.sengine.info/)" User-agent: netEstate NE Crawler Disallow: / #"Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)" User-agent: SurveyBot Disallow: / #"COMODO SSL Checker" #"Comodo-Certificates-Spider" User-agent: COMODO SSL Checker Disallow: / User-agent: Comodo-Certificates-Spider Disallow: / #"gonzo2[p] (+http://www.suchen.de/faq.html)" (Gesch?ftesuche) User-agent: gonzo Disallow: / #"crawler schrein, [email protected] id-4" User-agent: schrein Disallow: / #"BacklinkCrawler (http://www.backlinktest.com/crawler.html)" User-agent: BacklinkCrawler Disallow: / #"Mozilla/5.0 (compatible; Afilias Web Mining Tool 1.0; +http://www.afilias.info; [email protected])" User-agent: Afilias Web Mining Tool Disallow: / #"Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)" User-agent: SEOkicks Disallow: / User-agent: SEOkicks-Robot Disallow: / #"Mozilla/5.0 (compatible; suggybot v0.01a, http://blog.suggy.com/was-ist-suggy/suggy-webcrawler/)" User-agent: suggybot Disallow: / #"http://www.bdbrandprotect.com" "Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1)" User-agent: bdbrandprotect Disallow: / User-agent: BPImageWalker Disallow: / User-agent: BPImageWalker* Disallow: / #"Updownerbot (+http://www.updowner.com/bot)" User-agent: Updownerbot Disallow: / #"lex/1.0" User-agent: lex Disallow: / #"Content Crawler" User-agent: Content Crawler Disallow: / #"Mozilla/5.0 (compatible; DCPbot/1.1; +http://domains.checkparams.com/)" User-agent: DCPbot Disallow: / #"Mozilla/5.0 (compatible; KaloogaBot; http://kalooga.com/crawler)" User-agent: KaloogaBot Disallow: / #"MLBot (www.metadatalabs.com/mlbot)" User-agent: MLBot Disallow: / #"Wget/1.9" User-agent: Wget Disallow: / #"libwww-perl/5.837" User-agent: libwww-perl Disallow: / #"curl/7.21.3 (amd64-portbld-freebsd7.2) libcurl/7.21.3 OpenSSL/0.9.8e zlib/1.2.3" User-agent: curl Disallow: / #"Java/1.6.0_29" User-agent: Java Disallow: / #"Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9.0.1; compatible; iCjobs Stellenangebote Jobs; http://www.icjobs.de) Gecko/20100401 iCjobs/3.2.3" User-agent: iCjobs Disallow: / #"Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/)" User-agent: oBot Disallow: / #"Mozilla/5.0 (compatible; WebmasterCoffee/0.7; +http://webmastercoffee.com/about)" User-agent: WebmasterCoffee Disallow: / #"Mozilla/5.0 (compatible; Qualidator.com Bot 1.0;)" (http://www.qualidator.com/Web/de/Support/robotstxt_Hinweise.htm) User-agent: Qualidator* Disallow: / #"Mozilla/4.0 (compatible; http://search.thunderstone.com/texis/websearch/about.html)" (http://www.thunderstone.com/site/gw25man/page_exclusion_and_robots_txt.html) User-agent: Webinator Disallow: / User-agent: Scooter Disallow: / User-agent: *thunderstone* Disallow: / #"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) ([email protected])" User-agent: larbin Disallow: / User-agent: OpidooBOT Disallow: / #"Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.24; ips-agent) Gecko/20111107 Ubuntu/10.04 (lucid) Firefox/3.6.24" User-agent: ips-agent Disallow: / #"Mozilla/5.0 (compatible; UnisterBot; [email protected])" User-agent: UnisterBot Disallow: / User-agent: Unister* Disallow: / #"Mozilla/5.0 (compatible; en-US; ReverseGet/1.0; http://reverseget.com/; [email protected])" User-agent: ReverseGet Disallow: / ############# ### to_check: ############# #"\"Mozilla/5.0" #"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; InfoPath.2)" #"Mozilla/4.0 (compatible; MSIE 6.0; MSN 2.5; Windows 98; Win 9x 4.90; FDM)" ################ ##### monitor: ################ #"ssearch_bot (sSearch Crawler; http://www.semantissimo.de)" #"Mozilla/5.0 (compatible; Plukkie/1.4; http://www.botje.com/plukkie.htm)" #"Mozilla/5.0 (compatible; lemurwebcrawler [email protected]; +http://boston.lti.cs.cmu.edu/crawler_12/)" ######################################################################################################## ############# unerw?nschte bots, die die robots.txt NICHT abfragen, geh?ren ggf. per Rewrite gesperrt: ######################################################################################################## #"Mozilla/5.0+(compatible;+PiplBot;++http://www.pipl.com/bot/)" IGNORIERT ROBOTS.TXT #"Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)" IGNORIERT ROBOTS.TXT ############# ### to_check: ############# ########################################################################################################## ##### okay: ########################################################################################################## #"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" #"Googlebot-Image/1.0" #"Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)" #"Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)" #"Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)" #"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)" #"Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)" #"ia_archiver (+http://www.alexa.com/site/help/webmasters; [email protected])" (h?ngt auch mit archive.org zusammen) #"Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)" #"msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)" #"Mozilla/5.0 (compatible; OpenindexDeepSpider/Nutch-1.5-dev; +http://www.openindex.io/en/webmasters/spider.html)" #"CloudACL/Nutch-1.4" #"webcrawler (compatible; heritrix/1.14.4 ++http://www.onb.ac.at/about/webarchivierung.htm)" #"Mail.RU/2.0" (russ. Suchmaschine) #"Sosospider+(+http://help.soso.com/webspider.htm)" (chin. Suchmaschine) #"Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)" #"Eurobot/1.1 (http://eurobot.ayell.eu)" #"Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; +http://ws.daum.net/aboutWebSearch.html) Daumoa/2.0" (koreanische Suchmaschine) #"Acoon v4.10.3 (www.acoon.de)" #"DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)" (jap. Suchmaschine) #"ichiro/3.0 (http://help.goo.ne.jp/help/article/1142)" #"frogl-bot (Version: 1.06, powered by www.frogl.de +http://www.frogl.de/pfadzurbotseite/bot.html)" #"Mozilla/5.0 (compatible; NerdByNature.Bot; http://www.nerdbynature.net/bot)" #"Agent-SharewarePlazaBot/3.0+(+http://www.SharewarePlaza.com)" IGNORIERT ROBOTS.TXT #"Wotbox/2.0 ([email protected]; http://www.wotbox.com)" IGNORIERT ROBOTS.TXT #"www.freefileszone.com PadPollbot/1.1b (+http://www.freefileszone.com/)" IGNORIERT ROBOTS.TXT #"Mozilla/5.0 (compatible; Sitedomain-Bot 1.0; Headers only; +http://www.sitedomain.de/sitedomain-bot/)" IGNORIERT ROBOTS.TXT - checkt auf gel?schte Domains - ruft nur Hauptseite auf #"emefgebot/beta (+http://emefge.de/bot.html)" IGNORIERT ROBOTS.TXT #"TinEye/1.1 (http://tineye.com/crawler.html)" #User-agent: TinEye
Following keywords were found. You can check the keyword optimization of this page for each keyword.
Please select one of the following options for your request.
None of these options suit your need?
You can also download our Quick Start Guide, visit the FAQ section, our Knowledge Base or Blog.
Meta Title
(Nice to have)