This page is not available

This site can not be crawled by the Seobility bot. The robots.txt file restricts access for our bot. No URLs can be crawled that deny access to the user agent Seobility or *.

Problem URL: http://fsf.org

# robots.txt for https://www.fsf.org/

User-agent: *
Crawl-delay: 10
Disallow: /.git/
Disallow: /?set_language
Disallow: /@@search
Disallow: /associate/forum/
Disallow: /norobotsnorhumansshouldevervisithispage/
Disallow: /search
Disallow: /search_rss
Disallow: /share
Disallow: /software/
Disallow: /software/winboard/whats_new/
Sitemap: https://www.fsf.org/sitemap.xml

# Majestic - SEO
User-agent: MJ12bot
Disallow: /

# DataForSeo - SEO
User-agent: DataForSeoBot
Disallow: /

# webmeup - SEO
User-agent: BLEXBot
Disallow: /

# Ahrefs - SEO
User-agent: AhrefsBot
Disallow: /

# babbar - SEO
User-agent: barkrowler
Disallow: /

# Screamingfrog - SEO
User-agent: Screaming Frog SEO Spider
Disallow: /

# Seozoom - SEO
User-Agent: ZoomBot
Disallow: /

# Brandwatch - SEO
User-agent: magpie-crawler
Disallow: /

# Begin Moz - SEO
# Not to be confused with Mozilla.
User-agent: DotBot
Disallow: /

User-agent: rogerbot
Disallow: /
# End Moz - SEO

# Begin Semrush - SEO
User-agent: SemrushBot
Disallow: /

User-agent: SiteAuditBot
Disallow: /

User-agent: SemrushBot-BA
Disallow: /

User-agent: SemrushBot-SI
Disallow: /

User-agent: SemrushBot-SWA
Disallow: /

User-agent: SplitSignalBot
Disallow: /

User-agent: SemrushBot-OCOB
Disallow: /
# End Semrush - SEO

# cognitiveSEO - SEO
User-agent: JamesBOT
Disallow: /

# oncrawl - SEO
User-agent: Oncrawl
Disallow: /

# BEGIN Awario - Marketing
User-agent: AwarioRssBot
Disallow: /

User-agent: AwarioSmartBot
Disallow: /

User-agent: AwarioBot
Disallow: /
# END Awario - Marketing

# SERPSTAT - SEO
User-agent: serpstatbot
Disallow: /

# website-datenbank.de - Search engine?
User-agent: netEstate NE Crawler
Disallow: /

# Ignores crawl-delay and does not help us.
User-Agent: panscient.com
Disallow: /

# Aggressive Latvian Academic Integrity bot that does not help us.
User-agent: AcademicBotRTU
Disallow: /

# SEOkicks - SEO
User-agent: SEOkicks
Disallow: /

# Timpi NFT
User-Agent: Timpibot
Disallow: /

# Seobility - SEO
User-agent: Seobility
Disallow: /

# BigSight - Sec
User-agent: BitSightBot

# Meltwater - SEO
User-agent: linkfluence
Disallow: /

Cookie Policy

We use cookies to make our site work and also for analytics and advertising purposes. You can enable or disable optional cookies as desired. See the following links for more information.

We need these so the site can function properly

So we can better understand how visitors use our website

So we can serve you tailored ads and promotions