# robots.txt # Yahoo Slurp User-agent: Slurp Disallow: /merkliste/ Disallow: /min/ Disallow: /swfupload/ Disallow: /admin/ Disallow: /galerie/galdownload/ # Yahoo News Crawler User-agent: Yahoo-Newscrawler Disallow: /merkliste/ Disallow: /min/ Disallow: /swfupload/ Disallow: /admin/ Disallow: /galerie/galdownload/ # bcube.test.crawler (caused many, many connections until apache died) User-agent: bcube.test.crawler Disallow: / User-agent: * Disallow: /merkliste/ Disallow: /min/ Disallow: /swfupload/ Disallow: /admin/ Disallow: /galerie/galdownload/ #eine robots falle, fuer alle die sich nicht dran halten wollen User-agent: * Disallow: /merkliste/ Disallow: /min/ Disallow: /swfupload/ Disallow: /admin/ Disallow: /galerie/galdownload/ #Massendownloader vom CGI Verzeichnis fernhalten User-agent: mget User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy Disallow: /merkliste/ Disallow: /min/ Disallow: /swfupload/ Disallow: /admin/ Disallow: /galerie/galdownload/ User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: ia_archiver Disallow: / User-agent: archive.org_bot Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)