User-agent: * Disallow: /index.php/ Disallow: /*? Disallow: /checkout/ Disallow: /app/ Disallow: /lib/ Disallow: /*.php$ Disallow: /pkginfo/ Disallow: /report/ Disallow: /var/ Disallow: /catalog/ Disallow: /customer/ Disallow: /sendfriend/ Disallow: /review/ Disallow: /*SID= Disallow: *?___store Disallow: *?gisAutoCall Disallow: /amp/ Disallow: /blog/tag/ # BLOCK GENERAL AREAS - don't need to be crawled Disallow: /wishlist Disallow: /catalog Disallow: /catalogsearch/result/?q= Disallow: /destination Disallow: /directory Disallow: /merchandising Disallow: /checkout Disallow: /admin Disallow: /productalert Disallow: */build/ Disallow: /bikes/bikebuilder/* Disallow: /dist/* User-agent: Googlebot Disallow: User-agent: Googlebot-image Disallow: # UNWANTED BOTS - disallow User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / # Throttle crawling for Baiduspider User-agent: Baiduspider Crawl-delay: 1 # Throttle crawling for Rogerbot User-agent: rogerbot Crawl-delay: 1 # SITEMAP REFERENCES Sitemap: https://checkout.ribblecycles.co.uk/pub/media/sitemaps/www.ribblecycles.co.uk/sitemap.xml
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)