# Crawlers Setup User-agent: * # Directories Disallow: */404/ Disallow: */app/ Disallow: */cgi-bin/ Disallow: */downloader/ Disallow: */includes/ Disallow: */lib/ Disallow: */pkginfo/ Disallow: */report/ Disallow: */magento/ Disallow: */stats/ Disallow: */var/ # Paths (clean URLs) Disallow: */home/ Disallow: */index.php/ Disallow: */catalog/product_compare/ Disallow: */catalog/category/view/ Disallow: */catalog/product/view/ Disallow: */catalogsearch/ Disallow: */checkout/ Disallow: */control/ Disallow: */contacts/ Disallow: */customer/* Disallow: */wishlist/ Disallow: */review/ Disallow: */sendfriend/ Disallow: */tag/ Disallow: */search/?q=* Disallow: */search/* Disallow: */sales/ Disallow: */enable-cookies/ Disallow: */*{{config path=* Disallow: *page_size* Disallow: */.a/* Disallow: *static.regatta* Disallow: *data.regatta* # Exceptions Allow: */clothing/shop-by/activity/dog_walking/$ Allow: */clothing/shop-by/activity/golf/$ Allow: */clothing/shop-by/activity/cycling/$ Allow: */clothing/shop-by/activity/fitness/$ Allow: /outlet/shop-by/gender/womens/size/26,28,14,16,18,20,22,24/$ Allow: */womens/jackets-coats/shop-by/colour_group/black/$ Allow: */mens/jackets-coats/shop-by/colour_group/black/$ # Paths (no clean URLs) Disallow: */*?p=*& Disallow: */?bvstate=pg* # Files Disallow: */cron.php Disallow: */cron.sh Disallow: */error_log Disallow: */install.php Disallow: */LICENSE.html Disallow: */LICENSE.txt Disallow: */LICENSE_AFL.txt Disallow: */STATUS.txt # Sort by Disallow: *price_saving_percent* Disallow: *price* Disallow: *newness* Disallow: *average_review_rating* Disallow: *promotional_category* Disallow: *recommended* # Shop By Disallow: */shop-by/price/* Disallow: */shop-by/erin_recommends/* Disallow: */shop-by/promotion_en_gb/* Disallow: */shop-by/gender/* Disallow: */shop-by/product_category/* Disallow: */shop-by/product_sub_category/* Disallow: */shop-by/productfeatures/* Disallow: */shop-by/size/* Disallow: */shop-by/size_filter_en_gb/* Disallow: */shop-by/color/* Disallow: */shop-by/promotional_category_en_gb/* Disallow: */shop-by/activity/* Disallow: */shop-by/season_code/* Disallow: */shop-by/price_saving_percent_en_gb/* Disallow: */shop-by/categories/* Disallow: */shop-by/leg_length/* Disallow: */shop-by/colour_group/* Disallow: */shop-by/price_en_gb/* Disallow: */shop-by/technology/* Disallow: */shop-by/fit/* Disallow: */shop-by/product_type/* Disallow: */shop-by/price_saving_amount_en_gb/* Disallow: */shop-by/phrase/* Disallow: */shop-by/brand/* Disallow: */shop-by/average_review_rating_en_gb/* Disallow: */shop-by/category/* Disallow: */shop-by/gender/* Disallow: */shop-by/product_type/* Disallow: */shop-by/product_sub_category/* Disallow: */shop-by/Sizes/* Disallow: */shop-by/sizes/* Disallow: */shop-by/activity/* Disallow: */shop-by/colour/* Disallow: */shop-by/colors/* Disallow: */shop-by/price/* Disallow: */shop-by/brand/* Disallow: */shop-by/features/* Disallow: */shop-by/age_group/* Disallow: */shop-by/percentage_saving/* Disallow: */shop-by/reviews_ratings/* Disallow: */shop-by/sale_price/* Disallow: */shop-by/technologies/* Disallow: */shop-by/gender/* Disallow: */shop-by/colour/* Disallow: */shop-by/price/* Disallow: */shop-by/brand/* Disallow: */shop-by/sizes/* Disallow: */shop-by/percentage_saving/* Disallow: */shop-by/reviews_ratings/* Disallow: */shop-by/sortby/* Disallow: */shop-by/product_sub_category/* Disallow: */shop-by/features/* Disallow: */shop-by/size/* Disallow: */shop-by/colour_group/* Disallow: */product_sub_category/* Disallow: */shop-by/product_types/* Disallow: */shop-by/product_category/* # Images on media Disallow: *catalog/product/cache* # Misc Disallow: *crumb.link* # Sitemaps Sitemap: https://www.regatta.com/sitemap/sitemap-rg-uk.xml Sitemap: https://www.regatta.com/ie/sitemap/sitemap-rg-ie.xml Sitemap: https://www.regatta.com/de/sitemap/sitemap-rg-de.xml Sitemap: https://www.regatta.com/fr/sitemap/sitemap-rg-fr.xml Sitemap: https://www.regatta.com/pl/sitemap/sitemap-rg-pl.xml Sitemap: https://www.regatta.com/row/sitemap/sitemap-rg-ex.xml
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)