Robots.txt
User-agent: Google-Extended
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /account/*
Disallow: /search*
Disallow: /basket*
Disallow: */search?term=
Disallow: */*&sort=*
Disallow: */*&selling_price*
Disallow: */*&format_id*
Disallow: */search?sort=price*
Disallow: */search?sort=pub*
Disallow: */search?sort=rating*
Disallow: */search?sort=relevance*
#Crawl Delay - 5 URL max per second
user-agent: Bingbot
Crawl-delay: 0.2
Sitemap: https://www.hatchards.co.uk/sitemap.xml
(Nice to have)