User-agent: * Visit-time: 0700-1100 # only visit between 07:00 and 11:00 UTC (GMT) Crawl-delay: 30 Request-rate: 1/5 # maximum rate is one page every 5 seconds User-agent: Googlebot Visit-time: 0700-1100 # only visit between 07:00 and 11:00 UTC (GMT) Crawl-delay: 50 Request-rate: 1/5 # maximum rate is one page every 5 seconds
(Nice to have)