# robots.txt for https://www.typolexikon.de # Autor: Wolfgang Beinert # BEGIN # Disallow Files # Update 2025-03-30 User-agent: * Disallow: /*blackhole Disallow: /?blackhole Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: /trackback/ Disallow: /feed/ Disallow: /comments/ Disallow: /category/ Disallow: /tag/ Disallow: */trackback/ Disallow: */feed/ Disallow: */comments/ Disallow: /xmlrpc.php # Disallow Bots # Update 2025-03-30 User-agent: adscanner Disallow: / User-agent: aihitbot Disallow: / User-agent: ahrefsbot Disallow: / User-agent: amazonbot Disallow: / User-agent: awariobot Disallow: / User-agent: backlinkcrawler Disallow: / User-agent: barkrowler Disallow: / User-agent: blexbot Disallow: / User-agent: bubing Disallow: / User-agent: buck Disallow: / User-agent: careerbot Disallow: / User-agent: ccBot Disallow: / User-agent: cliqzbot Disallow: / User-agent: cloudservermarketspider Disallow: / User-agent: coccoc Disallow: / User-agent: crawler4j Disallow: / User-agent: dataforseobot Disallow: / User-agent: dataprovider Disallow: / User-agent: domaincrawler Disallow: / User-agent: domainre-animatorbot Disallow: / User-agent: dnbcrawler-analytics Disallow: / User-agent: dotbot Disallow: / User-agent: eventuresinvestmentcrawler Disallow: / User-agent: exabot Disallow: / User-agent: ev-crawler Disallow: / User-agent: evc-batch Disallow: / User-agent: fr-crawler Disallow: / User-agent: garlikcrawler Disallow: / User-agent: gosign-security-crawler Disallow: / User-agent: iccrawler Disallow: / User-agent: indeedbot Disallow: / User-agent: implisensebot Disallow: / User-agent: jobboersebot Disallow: / User-agent: jobs.de-robot Disallow: / User-agent: keybottranslation Disallow: / User-agent: kraken Disallow: / User-agent: linguee Disallow: / User-agent: linkdexbot Disallow: / User-agent: linkstats Disallow: / User-agent: lipperhey-kaus-australis Disallow: / User-agent: ltx71 Disallow: / User-agent: magpie-crawler Disallow: / User-agent: mail.ru_bot Disallow: / User-agent: meanpathbot Disallow: / User-agent: mediatoolkitbot Disallow: / User-agent: megaindex Disallow: / User-agent: metajobbot Disallow: / User-agent: mindupbot Disallow: / User-agent: mj12bot Disallow: / User-agent: mojeekbot Disallow: / User-agent: netestate Disallow: / User-agent: netestateneCrawler Disallow: / User-agent: obot Disallow: / User-agent: openhosebot Disallow: / User-agent: panscient.com Disallow: / User-agent: plista Disallow: / User-agent: plukkie Disallow: / User-agent: python/3.5 aiohttp Disallow: / User-agent: qwantify Disallow: / User-agent: rc-crawler Disallow: / User-agent: rogerbot Disallow: / User-agent: r6_commentreader Disallow: / User-agent: sabsimbot Disallow: / User-agent: safednsbot Disallow: / User-agent: screamingfrogseospider Disallow: / User-agent: searchmetricsbot Disallow: / User-agent: semrushbot Disallow: / User-agent: seznambot Disallow: / User-agent: siteimprove* Disallow: / User-agent: slackbot-linkexpanding* Disallow: / User-agent: spbot Disallow: / User-agent: spiderbot Disallow: / User-agent: surveybot Disallow: / User-agent: turnitinbot Disallow: / User-agent: trendictionbot Disallow: / User-agent: thumbsniper Disallow: / User-agent: toweya.com Disallow: / User-agent: um-ic Disallow: / User-agent: unisterbot Disallow: / User-agent: vebidoobot* Disallow: / User-agent: velenpublicwebcrawler Disallow: / User-agent: wbsearchbot Disallow: / User-agent: wellknownbot Disallow: / User-agent: wotbox Disallow: / User-agent: zoombot Disallow: / User-agent: zoominfobot Disallow: / # Sitemaps # Update 2025-03-30 Sitemap: https://www.typolexikon.de/post-sitemap.xml Sitemap: https://www.typolexikon.de/attachment-sitemap.xml Sitemap: https://www.typolexikon.de/post_tag-sitemap.xml Sitemap: https://www.typolexikon.de/page-sitemap.xml # END
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)