User-agent: Scrapy Allow: / User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /calendar/action~posterboard/ Disallow: /calendar/action~agenda/ Disallow: /calendar/action~oneday/ Disallow: /calendar/action~month/ Disallow: /calendar/action~week/ Disallow: /calendar/action~stream/ Disallow: /wp-content/uploads/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)