This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://ratemyprofessors.com
User-agent: Googlebot Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Googlebot-Mobile Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Mediapartners-Google Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: AdsBot-Google Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ user-agent: AdsBot-Google-Mobile Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Bingbot Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: DuckDuckBot Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: MSNBot Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: BingPreview Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Slurp Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Baiduspider Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Baiduspider-mobile Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: YandexBot Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: grapeshot Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: Twitterbot Disallow: /teacher-not-found Disallow: /school-not-found Disallow: /search Disallow: /professor Disallow: /school Allow: /search/professors Allow: /search/schools Allow: /professor/ Allow: /school/ User-agent: * Disallow: / # blocking AI bots # src : https://github.com/ai-robots-txt/ai.robots.txt User-agent: Amazonbot User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: Bytespider User-agent: CCBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-Web User-agent: cohere-ai User-agent: DataForSeoBot User-agent: Diffbot User-agent: FacebookBot User-agent: FriendlyCrawler User-agent: Google-Extended User-agent: GoogleOther User-agent: GPTBot User-agent: img2dataset User-agent: ImagesiftBot User-agent: magpie-crawler User-agent: Meltwater User-agent: omgili User-agent: omgilibot User-agent: peer39_crawler User-agent: peer39_crawler/1.0 User-agent: PerplexityBot User-agent: PiplBot User-agent: scoop.it User-agent: Seekr User-agent: YouBot Disallow: / Crawl-delay: 10 Host: www.ratemyprofessors.com