# Trigger Commerce Magento Robots.txt 05/2011 # # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these robots where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/wc/robots.html # # For syntax checking, see: # http://www.sxw.org.uk/computing/robots/check.html # Website Sitemap Sitemap: https://www.trigger.de/sitemap-index.xml # Crawlers Setup # # Settings that relate to the UNDER CONSTRUCTION # # Do not allow indexing files and folders that are required during development: CVS, SVN directory and dump files User-agent: * Disallow: /CVS Disallow: /*.Svn $ Disallow: /*.Idea $ Disallow: /*.Sql $ Disallow: /*.Tgz $ # # GENERAL SETTINGS For MAGENTO # # Do not index the page Magento admin #User-agent: * Disallow: /admin/ # # Do not index the general technical Magento directory # Directories #User-agent: * Disallow: /404/ Disallow: /app/ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /includes/ #Disallow: /js/ Disallow: /lib/ Disallow: /magento/ Disallow: /pkginfo/ Disallow: /report/ #Disallow: /skin/ Disallow: /stats/ Disallow: /var/ Disallow: /errors/ Disallow: /shell/ Disallow: /blog/ # # Do not index the shared files Magento #User-agent: * Disallow: /api.php Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /get.php Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /README.txt Disallow: /RELEASE_NOTES.txt # # MAGENTO SEA IMPROVEMENT # # Do not index the page subcategories that are sorted or filtered. #User-agent: * Disallow: /*? Dir * Disallow: /*? Dir = desc Disallow: /*? Dir = asc Disallow: /*? Limit = all Disallow: /*? Mode * # # Do not index the second copy of the home page (example.com / index.php /). Un-comment only if you have activated Magento SEO URLs. # # Disallow: / index.php / # # Do not index the page checkout and user account #User-agent: * Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /customer/ Disallow: /customer/account/ Disallow: /customer/account/login/ # Paths (clean URLs) #User-agent: * Disallow: /index.php/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /catalogsearch/ Disallow: /control/ Disallow: /contacts/ Disallow: /customize/ Disallow: /newsletter/ Disallow: /poll/ Disallow: /review/ Disallow: /sendfriend/ Disallow: /tag/ Disallow: /wishlist/ # Files #User-agent: * Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /STATUS.txt Disallow: /cgi-bin/ Disallow: /cleanup.php Disallow: /apc.php Disallow: /memcache.php Disallow: /phpinfo.php # Paths (no clean URLs) #User-agent: * #Disallow: /*.js$ #Disallow: /*.css$ Disallow: /*.php$ Disallow: /*?p=*& Disallow: /*?SID=
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)