# Created by Phil 14 May 2024 (revision) # All bots are allowed to crawl the entire site except for specific directories and files User-agent: * Disallow: /wp-admin/ Disallow: /cgi-bin/ Disallow: /cdn-cgi/ Disallow: /wp-login.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: /category/ Disallow: /loginpress Noindex: /loginpress Disallow: */trackback Disallow: */feed Disallow: */comments Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.gz$ Disallow: /*.swf$ Disallow: /*.wmv$ Disallow: /*.cgi$ Disallow: /*.xhtml$ Disallow: /?s= Disallow: /search/ Disallow: /page/*/?s= # Allow specific files Allow: /wp-admin/admin-ajax.php # Specify the location of the XML sitemap Sitemap: https://unric.org/sitemap_index.xml Sitemap: https://unric.org/en/sitemap_index.xml Sitemap: https://unric.org/fr/sitemap_index.xml Sitemap: https://unric.org/it/sitemap_index.xml Sitemap: https://unric.org/pt/sitemap_index.xml Sitemap: https://unric.org/nl/sitemap_index.xml Sitemap: https://unric.org/es/sitemap_index.xml Sitemap: https://unric.org/de/sitemap_index.xml Sitemap: https://unric.org/sv/sitemap_index.xml Sitemap: https://unric.org/da/sitemap_index.xml Sitemap: https://unric.org/no/sitemap_index.xml Sitemap: https://unric.org/fi/sitemap_index.xml Sitemap: https://unric.org/is/sitemap_index.xml Sitemap: https://unric.org/el/sitemap_index.xml User-agent: Bingbot Disallow: /wp-content/cache/ # Crawl delay to reduce server load (example: 10 seconds) User-agent: * Crawl-delay: 10
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)