User-Agent: * Disallow: /directorysearch Disallow: /latest Disallow: /search Disallow: /tools/tellafriend # # Blocked journals aren't listed here because robots.txt files # can't be above 50k or so, depending on the spider. # # Instead, blocked journals have HTML inserted in them which # should prevent behaved spiders from indexing it. # # Note that https://username.dreamwidth.org journals have an # autogenerated robots.txt, since it can be small. #
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)