# For all robots User-agent: * Allow: / User-agent: Googlebot User-agent: Google-Image User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: Google-InspectionTool User-agent: Google-Safety Allow: / # Block Search string pages Disallow: /*?q= # Block access to specific groups of pages Disallow: /login* Disallow: /register* Disallow: /search* Disallow: /searchlist* Disallow: /my-account* Disallow: /testmy-accounttest Disallow: /media/sys-master/root Disallow: /checkout* Disallow: /cart* Disallow: /retryPayment* Disallow: /orderconfirmation* # Allow search crawlers to discover the sitemap Allow: / Sitemap: https://www.builders.co.za/sitemap.xml Sitemap: https://www.builders.co.za/categorySitemap.xml Sitemap: https://www.builders.co.za/productSitemap.xml # Block CazoodleBot as it does not present correct accept content headers User-agent: CazoodleBot Disallow: / # Block MJ12bot as it is just noise User-agent: MJ12bot Disallow: / # Block dotbot as it cannot parse base urls properly User-agent: dotbot/1.0 Disallow: / # Block Gigabot User-agent: Gigabot Disallow: /
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)