This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://cuny.edu
User-Agent: googlebot User-Agent: bingbot User-Agent: msnbot User-Agent: Twitterbot User-Agent: Slurp User-Agent: DuckDuckBot Crawl-delay: 30 sitemap: https://www.cuny.edu/sitemap.xml sitemap: https://policy.cuny.edu/sitemap.xml Disallow: /global-components/ Disallow: /d-i/ Disallow: /cgi-bin/ Disallow: /search/ Disallow: /wp-admin Disallow: /alumni-test/ Disallow: /role-template/ Disallow: /home-preview/ Disallow: /about/administration/offices/sa/ Disallow: /homepage/digital-displays/ Disallow: /employment/search-jobs/ Disallow: /old-version/ Disallow: /policyimport/ # Added June 15, 2024 Disallow: /*?utm=* User-agent: SemanticScholarBot Disallow: / User-agent: Go-http-client Disallow: / User-agent: * Disallow: /