# Crawlers Setup User-agent: * # Directories Disallow: /shop/404/ Disallow: /shop/app/ Disallow: /shop/cgi-bin/ Disallow: /shop/downloader/ Disallow: /shop/errors/ Disallow: /shop/includes/ Disallow: /shop/magento/ Disallow: /shop/pkginfo/ Disallow: /shop/report/ Disallow: /shop/scripts/ Disallow: /shop/shell/ Disallow: /shop/skin/ Disallow: /shop/stats/ Disallow: /shop/var/ #Disallow: /shop/lib/ # Paths (clean URLs) Disallow: /shop/index.php/ Disallow: /shop/catalog/product_compare/ Disallow: /shop/catalog/category/view/ Disallow: /shop/catalog/product/view/ Disallow: /shop/catalog/product/gallery/ Disallow: /shop/catalogsearch/ Disallow: /shop/checkout/ Disallow: /shop/control/ Disallow: /shop/contacts/ Disallow: /shop/customer/ Disallow: /shop/customize/ Disallow: /shop/newsletter/ Disallow: /shop/poll/ Disallow: /shop/review/ Disallow: /shop/sendfriend/ Disallow: /shop/tag/ Disallow: /shop/wishlist/ # Files Disallow: /shop/cron.php Disallow: /shop/cron.sh Disallow: /shop/error_log Disallow: /shop/install.php Disallow: /shop/LICENSE.html Disallow: /shop/LICENSE.txt Disallow: /shop/LICENSE_AFL.txt Disallow: /shop/STATUS.txt # Paths (no clean URLs) #Disallow: /*.php$ Disallow: /*?SID= Disallow: /*dir= Disallow: /*order= Disallow: /*limit= Disallow: /*&p= Disallow: /*compatibilty= Disallow: /*___store= Disallow: /*screen_size= Disallow: /*main_camera= Disallow: /*price= Disallow: */?* # Paths Enabled (no clean URLs) Allow: *?p= # wikoplus Disallow:/cache/ Disallow:/moncompte/engine.php*
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)