user-agent: * sitemap: /sitemap.xml disallow: /wp-admin/ disallow: /trackback/ disallow: /xmlrpc.php disallow: /blog/author/* # Sometimes the tag pages are rated as duplicate content # # disallow: /tag # allow: /tag/mint/ # allow: /tag/feed/ # Add sections for a specific crawler below # # user-agent: bingbot # 3% # user-agent: googlebot-news # 92% - Googlebot News # user-agent: googlebot # 92% - Googlebot (Web), Googlebot Images # user-agent: MSNBOT # 3% # user-agent: Yahoo! # 2% # # see http://www.useragentstring.com/pages/Crawlerlist/
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)