Show your SEO score to your visitors using the Seobility widget. The widget always displays the current SEO score of your homepage.
### # postcrossing.com robots.txt file # # NOTE: Entries in robots.txt don't inherit from '*'. Or not all bots know how to anyway, hence the repetition ### User-Agent: * # only the right user can open it, so stop doing 403's Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Allow: / # # Don't need the extra load # User-agent: Googlebot-Image # only the right user can open it, so stop doing 403's Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ # extra Disallow: /postcards/* Disallow: /user/*/gallery Disallow: /gallery Disallow: /country/* Allow: / User-agent: ImagesiftBot Disallow: / User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: /postcards/ # # AdSense crawler # User-agent: Mediapartners-Google Allow: / # # Wayback machine: don't overdue it # User-agent: archive.org_bot Disallow: /user/* Disallow: /postcards/* Disallow: /gallery Allow: / # # If you don't know how to behave, you are not welcome # User-agent: Screaming Frog SEO Spider Disallow: / # # Please respect our Terms of Service: spiders/scrappers are only allowed with explicit permission # User-agent: Scrapy Disallow: / User-agent: scrapybot Disallow: / # # below here is primarily from https://en.wikipedia.org/robots.txt # # Some bots are known to be trouble, particularly those designed to copy # entire sites. Please obey robots.txt. User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / # Misbehaving: requests much too fast: User-agent: fast Disallow: / # # Sorry, wget in its recursive mode is a frequent problem. # Please read the man page and use it properly; there is a # --wait option you can use to set the delay between hits, # for instance. # User-agent: wget Disallow: / # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Disallow: / # # Doesn't follow robots.txt anyway, but... # User-agent: k2spider Disallow: / # # Hits many times per second, not acceptable # http://www.nameprotect.com/botinfo.html User-agent: NPBot Disallow: / # A capture bot, downloads gazillions of pages with no public benefit # http://www.webreaper.net/ User-agent: WebReaper Disallow: / # # AI bots create needless extra load, so limiting to just basics # User-agent: Amazonbot Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /postcards/ Disallow: /user/ Disallow: /gallery # below is from https://darkvisitors.com/docs/robots-txt User-agent: Applebot-Extended Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: Bytespider Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: CCBot Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: ClaudeBot Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: Diffbot Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: FacebookBot Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: Google-Extended Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: GPTBot Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: omgili Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: anthropic-ai Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: Claude-Web Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery User-agent: cohere-ai Disallow: /travelingpostcard/ Disallow: /user/*/traveling Disallow: /user/*/gallery/popular Disallow: /user/*/map Disallow: /pm/send/ Disallow: /postcards/ Disallow: /user/ Disallow: /gallery
Following keywords were found. You can check the keyword optimization of this page for each keyword.
Please select one of the following options for your request.
None of these options suit your need?
You can also download our Quick Start Guide, visit the FAQ section, our Knowledge Base or Blog.
Meta Title
(Nice to have)