User-agent: Baiduspider Disallow: / User-agent: GPTBot Disallow: / User-agent: Bytespider Disallow: / User-agent: * Disallow: /index.php/ Disallow: /unsubscribe/ Disallow: /join/ Disallow: /deals/ Disallow: /shopby/limit-all Disallow: /*/shopby/limit-all Disallow: /*shopby Disallow: /limit-* Disallow: /category/
(Nice to have)