# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html User-agent: * Crawl-delay: 10 # Non-user-facing pages Disallow: /admin Disallow: /admin/ Disallow: /connect-more/programme-2023/connect-more-2023-programme-file Disallow: /contact/your-relationship-manager/import-salesforce-data Disallow: /dcdc-conference/programme-2023/dcdc23-programme-file Disallow: /networkshop/programme-2023/networkshop-2023-programme-file Disallow: /security-conference/programme-2023/security-conference-programme-2023-file # User-facing pages Disallow: /about-us/stakeholder-strategic-updates/stakeholder-strategic-update-event-2023 Disallow: /cyber-security-for-independent-education Disallow: /cyber-security-for-local-authorities Disallow: /cyber-security-for-research-and-innovation Disallow: /heidi-plus/planned-maintenance Disallow: /heidi-plus/unavailable Disallow: /purchasing-consultancy-services-terms Disallow: /supplying-consultancy-services-terms Disallow: /website/accessibility-statement/data-explorer Disallow: /website/accessibility-statement/eduroam-app Disallow: /website/accessibility-statement/govroam-app Disallow: /website/accessibility-statement/heidi-plus Disallow: /website/accessibility-statement/jisc-support Disallow: /website/accessibility-statement/study-goal Disallow: /website/privacy-notice/data-explorer
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)