This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.
Problem URL: http://cuny.edu
User-Agent: googlebot User-Agent: bingbot User-Agent: msnbot User-Agent: Twitterbot User-Agent: Slurp User-Agent: LinkedInBot User-Agent: DuckDuckBot Crawl-delay: 30 sitemap: https://www.cuny.edu/sitemap.xml sitemap: https://policy.cuny.edu/sitemap.xml Disallow: /global-components/ Disallow: /d-i/ Disallow: /cgi-bin/ Disallow: /search/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ Disallow: /alumni-test/ Disallow: /role-template/ Disallow: /home-preview/ Disallow: /about/administration/offices/sa/ Disallow: /homepage/digital-displays/ Disallow: /employment/search-jobs/ Disallow: /old-version/ Disallow: /policyimport/ # Added June 15, 2024 Disallow: /*?utm=* User-agent: SemanticScholarBot Disallow: / User-agent: facebookexternalhit Disallow: User-agent: Go-http-client Disallow: / User-agent: * Disallow: /