User-agent: * Request-rate: 1/5 # maximum rate is one page every 5 seconds Crawl-delay: 5 # 5 seconds between page requests Visit-time: 0100-0800 # only visit between 01:00 and 08:00 UTC User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: CazoodleBot Disallow: / User-agent: adscanner Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-Agent: OnPageBot Disallow: /
Se han encontrado las siguientes palabras clave. Comprueba si esta página está bien optimizada para cada palabra clave en concreto.
(Deseable)