User-agent: * Disallow: /version.txt User-agent: psbot Disallow: / User-agent: msnbot-media Disallow: / Disallow: /*.jpeg$ Disallow: /*.jpg$ User-agent: Yahoo-MMCrawler Disallow: / Disallow: /*.jpeg$ Disallow: /*.jpg$ # Personal search engines User-agent: Yasni Disallow: / User-agent: Pipl Disallow: / User-agent: 123People Disallow: / User-agent: MyOnID Disallow: /
(Deseable)