Die Seite ist nicht abrufbar

Diese Seite ist für den Seobility Bot nicht erreichbar. Unser Bot wird von der Robots.txt Datei ausgeschlossen. Der Seobility Bot crawlt nichts was Seobility oder * ausschließt.

Problematische URL: http://tummee.com

# /robots.txt file for https://www.tummee.com

User-agent: *
Disallow: /tummee/
Disallow: /user/
Disallow: /yoga-sequence/
Disallow: /yoga-sequence-builder/poses/
Disallow: /yoga-sequence-builder/list/
Disallow: /yoga-sequence-builder/1*
Disallow: /sec*
Disallow: /auth/a*
Disallow: /auth/o*
Disallow: /auth/p*
Disallow: /auth/r*
Disallow: /auth/t*
Disallow: /ad*
Disallow: /pos*
Disallow: /pro*
Disallow: /pa*
Disallow: /su*
Allow: /*sitemap/*
Disallow: /about-us$
Disallow: /our-story$
Disallow: /*/about-us$
Disallow: /*/our-story$
Disallow: /yoga-poses/*/video-tutorial$

User-agent: Yandex
Disallow: /

User-agent: Wget
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: OOZBOT/SETOOZBOT/oozbot/setoozbot
Disallow: /

User-agent: Ezooms
Disallow: /

User-agent: yacybot
Disallow: /

User-agent: crawler4j
Disallow: /

User-agent: stress-agent
Disallow: /

User-agent: Ultraseek
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: SJUUPBot
Disallow: /

User-agent: Baidu
Disallow: /

User-agent: Baiduspider
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: proximic
Disallow: /

User-agent: SEOkicks
Disallow: /

User-agent: Barkrowler
Disallow: /

User-agent: SemanticScholarBot
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: BuckBot
Disallow: /

User-agent: Seekport Crawler
Disallow: /

User-agent: TurnitinBot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: AhrefsSiteAudit
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SiteAuditBot
Disallow: /

User-agent: SemrushBot-BA
Disallow: /

User-agent: SemrushBot-SI
Disallow: /

User-agent: SemrushBot-SWA
Disallow: /

User-agent: SemrushBot-CT
Disallow: /

User-agent: SplitSignalBot
Disallow: /

User-agent: SemrushBot-COUB
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: webprosbot
Disallow: /

User-agent: Seobility
Disallow: /

User-agent: AwarioRssBot
Disallow: /

User-agent: AwarioSmartBot
Disallow: /

User-agent: AwarioBot
Disallow: /

User-agent: Sogou web spider
Disallow: /

User-agent: Sogou inst spider
Disallow: /

User-agent: Youbot
Disallow: /

User-agent: ZoomBot
Disallow: /

User-agent: Screaming Frog SEO Spider
Disallow: /

User-agent: Mojolicious (Perl)
Disallow: /

User-agent: Buck
Disallow: /

User-agent: SMTBot
Disallow: /

User-agent: SurdotlyBot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: 007ac9 Crawler
Disallow: /

User-agent: 2ip.ru
Disallow: /

User-agent: 360Spider
Disallow: /

User-agent: [wW]get
Disallow: /

User-agent: A6-Indexer
Disallow: /

User-agent: Aboundex
Disallow: /

User-agent: acapbot
Disallow: /

User-agent: acoonbot
Disallow: /

User-agent: adbeat_bot
Disallow: /

User-agent: AddSearchBot
Disallow: /

User-agent: AddThis
Disallow: /

User-agent: Adidxbot
Disallow: /

User-agent: ADmantX
Disallow: /

User-agent: adscanner
Disallow: /

User-agent: AdsTxtCrawler
Disallow: /

User-agent: AdvBot
Disallow: /

User-agent: AHC
Disallow: /

User-agent: Ahrefs
Disallow: /

User-agent: aiHitBot
Disallow: /

User-agent: AISearchBot
Disallow: /

User-agent: AlphaBot
Disallow: /

User-agent: AndersPinkBot
Disallow: /

User-agent: antibot
Disallow: /

User-agent: AnyEvent
Disallow: /

User-agent: Apercite
Disallow: /

User-agent: AppInsights
Disallow: /

User-agent: arabot
Disallow: /

User-agent: archive.org_bot
Disallow: /

User-agent: ArchiveBot
Disallow: /

User-agent: AspiegelBot
Disallow: /

User-agent: Atom Feed Robot
Disallow: /

User-agent: awesomecrawler
Disallow: /

User-agent: axios
Disallow: /

User-agent: B2B Bot
Disallow: /

User-agent: backlinkcrawler
Disallow: /

User-agent: Bark[rR]owler
Disallow: /

User-agent: BazQux
Disallow: /

User-agent: BDCbot
Disallow: /

User-agent: BehloolBot
Disallow: /

User-agent: betaBot
Disallow: /

User-agent: bidswitchbot
Disallow: /

User-agent: BIGLOTRON
Disallow: /

User-agent: binlar
Disallow: /

User-agent: BitBot
Disallow: /

User-agent: bitlybot
Disallow: /

User-agent: Blackboard
Disallow: /

User-agent: blogmuraBot
Disallow: /

User-agent: BlogTrafficd.d+ Feed-Fetcher
Disallow: /

User-agent: BLP_bbot
Disallow: /

User-agent: bnf.fr_bot
Disallow: /

User-agent: BomboraBot
Disallow: /

User-agent: bot-pge.chlooe.com
Disallow: /

User-agent: Bot.AraTurka.com
Disallow: /

User-agent: botify
Disallow: /

User-agent: BoxcarBot
Disallow: /

User-agent: brainobot
Disallow: /

User-agent: BrandONbot
Disallow: /

User-agent: BrandVerity
Disallow: /

User-agent: BTWebClient
Disallow: /

User-agent: BUbiNG
Disallow: /

User-agent: BublupBot
Disallow: /

User-agent: buzzbot
Disallow: /

User-agent: Caliperbot
Disallow: /

User-agent: CapsuleChecker
Disallow: /

User-agent: careerbot
Disallow: /

User-agent: CC Metadata Scaper
Disallow: /

User-agent: changedetection
Disallow: /

User-agent: check_http
Disallow: /

User-agent: CheckMarkNetwork/1.0 (+https://www.checkmarknetwork.com/spider.html)
Disallow: /

User-agent: Cincraw
Disallow: /

User-agent: citeseerxbot
Disallow: /

User-agent: Clickagy
Disallow: /

User-agent: Cliqzbot
Disallow: /

User-agent: CloudFlare-AlwaysOnline
Disallow: /

User-agent: [email protected]
Disallow: /

User-agent: Companybook-Crawler
Disallow: /

User-agent: content crawler spider
Disallow: /

User-agent: ContextAd Bot
Disallow: /

User-agent: contxbot
Disallow: /

User-agent: convera
Disallow: /

User-agent: CrunchBot
Disallow: /

User-agent: CrystalSemanticsBot
Disallow: /

User-agent: Curebot
Disallow: /

User-agent: Cutbot
Disallow: /

User-agent: cXensebot
Disallow: /

User-agent: CyberPatrol
Disallow: /

User-agent: DareBoost
Disallow: /

User-agent: Datafeedwatch
Disallow: /

User-agent: datagnionbot
Disallow: /

User-agent: Datanyze
Disallow: /

User-agent: Dataprovider.com
Disallow: /

User-agent: Daum
Disallow: /

User-agent: dcrawl
Disallow: /

User-agent: deadlinkchecker
Disallow: /

User-agent: DeuSu
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: Digg Deeper
Disallow: /

User-agent: Digincore bot
Disallow: /

User-agent: discobot
Disallow: /

User-agent: Disqus
Disallow: /

User-agent: DnyzBot
Disallow: /

User-agent: Domain Re-Animator Bot
Disallow: /

User-agent: domaincrawler
Disallow: /

User-agent: Domains Project
Disallow: /

User-agent: DomainStatsBot
Disallow: /

User-agent: Dragonbot
Disallow: /

User-agent: drupact
Disallow: /

User-agent: Dubbotbot
Disallow: /

User-agent: ec2linkfinder
Disallow: /

User-agent: edisterbot
Disallow: /

User-agent: electricmonk
Disallow: /

User-agent: elisabot
Disallow: /

User-agent: Embedly
Disallow: /

User-agent: epicbot
Disallow: /

User-agent: eright
Disallow: /

User-agent: europarchive.org
Disallow: /

User-agent: EveryoneSocialBot
Disallow: /

User-agent: exabot
Disallow: /

User-agent: Experibot
Disallow: /

User-agent: ExtLinksBot
Disallow: /

User-agent: Eyeotabot
Disallow: /

User-agent: EZID
Disallow: /

User-agent: FAST Enterprise Crawler
Disallow: /

User-agent: FAST-WebCrawler
Disallow: /

User-agent: fedoraplanet
Disallow: /

User-agent: feedbot
Disallow: /

User-agent: Feedly
Disallow: /

User-agent: Feedspot
Disallow: /

User-agent: FeedValidator
Disallow: /

User-agent: FemtosearchBot
Disallow: /

User-agent: Fetch
Disallow: /

User-agent: Fever
Disallow: /

User-agent: filterdb.iss.netcrawler
Disallow: /

User-agent: FindITAnswersbot
Disallow: /

User-agent: findlink
Disallow: /

User-agent: findthatfile
Disallow: /

User-agent: findxbot
Disallow: /

User-agent: Flamingo_SearchEngine
Disallow: /

User-agent: FlipboardProxy
Disallow: /

User-agent: fluffy
Disallow: /

User-agent: fr-crawler
Disallow: /

User-agent: FreeWebMonitoring SiteChecker
Disallow: /

User-agent: FreshRSS
Disallow: /

User-agent: Friendica
Disallow: /

User-agent: fuelbot
Disallow: /

User-agent: Fyrebot
Disallow: /

User-agent: g00g1e.net
Disallow: /

User-agent: G2 Web Services
Disallow: /

User-agent: g2reader-bot
Disallow: /

User-agent: GarlikCrawler
Disallow: /

User-agent: Genieo
Disallow: /

User-agent: Gigablast
Disallow: /

User-agent: Gigabot
Disallow: /

User-agent: GingerCrawler
Disallow: /

User-agent: Gluten Free Crawler
Disallow: /

User-agent: gnam gnam spider
Disallow: /

User-agent: GnowitNewsbot
Disallow: /

User-agent: Gowikibot
Disallow: /

User-agent: GrapeshotCrawler
Disallow: /

User-agent: Grobbot
Disallow: /

User-agent: GroupHigh
Disallow: /

User-agent: grub.org
Disallow: /

User-agent: gslfbot
Disallow: /

User-agent: Gwene
Disallow: /


User-agent: HeadlessChrome
Disallow: /

User-agent: heritrix
Disallow: /

User-agent: http_get
Disallow: /

User-agent: httpunit
Disallow: /

User-agent: HttpUrlConnection
Disallow: /

User-agent: HTTrack
Disallow: /

User-agent: HubSpot
Disallow: /

User-agent: IAS crawler
Disallow: /

User-agent: ICBot
Disallow: /

User-agent: ICC-Crawler
Disallow: /

User-agent: ichiro
Disallow: /

User-agent: imrbot
Disallow: /

User-agent: IndeedBot
Disallow: /

User-agent: infoobot
Disallow: /

User-agent: integromedb
Disallow: /

User-agent: intelium_bot
Disallow: /

User-agent: InterfaxScanBot
Disallow: /

User-agent: ip-web-crawler.com
Disallow: /

User-agent: ips-agent
Disallow: /

User-agent: iskanie
Disallow: /

User-agent: IstellaBot
Disallow: /

User-agent: it2media-domain-crawler
Disallow: /

User-agent: James BOT
Disallow: /

User-agent: Jamie's Spider
Disallow: /

User-agent: Jetslide
Disallow: /

User-agent: Jetty
Disallow: /

User-agent: JobboerseBot
Disallow: /

User-agent: Jooblebot
Disallow: /

User-agent: jpg-newsbot
Disallow: /

User-agent: Jugendschutzprogramm-Crawler
Disallow: /

User-agent: jyxobot
Disallow: /

User-agent: K7MLWCBot
Disallow: /

User-agent: Kemvibot
Disallow: /

User-agent: KosmioBot
Disallow: /

User-agent: Landau-Media-Spider
Disallow: /

User-agent: Laserlikebot
Disallow: /

User-agent: lb-spider
Disallow: /

User-agent: Leikibot
Disallow: /

User-agent: libwww-perl
Disallow: /

User-agent: Linguee Bot
Disallow: /

User-agent: linkapediabot
Disallow: /

User-agent: LinkArchiver
Disallow: /

User-agent: linkdex
Disallow: /

User-agent: LinkedInBot
Disallow: /

User-agent: LinkisBot
Disallow: /

User-agent: lipperhey
Disallow: /

User-agent: Livelap[bB]ot
Disallow: /

User-agent: lssbot
Disallow: /

User-agent: lssrocketcrawler
Disallow: /

User-agent: ltx71
Disallow: /

User-agent: Luminator-robots
Disallow: /

User-agent: magpie-crawler
Disallow: /

User-agent: Mail.RU_Bot
Disallow: /

User-agent: mappydata
Disallow: /

User-agent: Mastodon
Disallow: /

User-agent: MauiBot
Disallow: /

User-agent: MBCrawler
Disallow: /

User-agent: Mediatoolkitbot
Disallow: /

User-agent: MegaIndex
Disallow: /

User-agent: MeltwaterNews
Disallow: /

User-agent: memorybot
Disallow: /

User-agent: MetaJobBot
Disallow: /

User-agent: MetaURI
Disallow: /

User-agent: mindUpBot
Disallow: /

User-agent: Miniflux
Disallow: /

User-agent: MixnodeCache
Disallow: /

User-agent: mlbot
Disallow: /

User-agent: moatbot
Disallow: /

User-agent: MoodleBot
Disallow: /

User-agent: Moreover
Disallow: /

User-agent: msrbot
Disallow: /

User-agent: MuckRack
Disallow: /

User-agent: Multiviewbot
Disallow: /

User-agent: NerdByNature.Bot
Disallow: /

User-agent: nerdybot
Disallow: /

User-agent: NetcraftSurveyAgent
Disallow: /

User-agent: netEstate NE Crawler
Disallow: /

User-agent: Neticle Crawler
Disallow: /

User-agent: netresearchserver
Disallow: /

User-agent: Netvibes
Disallow: /

User-agent: newsharecounts
Disallow: /

User-agent: NextCloud
Disallow: /

User-agent: niki-bot
Disallow: /

User-agent: Nimbostratus-Bot
Disallow: /

User-agent: NING
Disallow: /

User-agent: NINJA bot
Disallow: /

User-agent: NIXStatsbot
Disallow: /

User-agent: Nmap Scripting Engine
Disallow: /

User-agent: NTENTbot
Disallow: /

User-agent: nutch
Disallow: /

User-agent: Nuzzel
Disallow: /

User-agent: Ocarinabot
Disallow: /

User-agent: officestorebot
Disallow: /

User-agent: omgili
Disallow: /

User-agent: online-webceo-bot
Disallow: /

User-agent: OpenHoseBot
Disallow: /

User-agent: openindexspider
Disallow: /

User-agent: OrangeBot
Disallow: /

User-agent: outbrain
Disallow: /

User-agent: OutclicksBot
Disallow: /

User-agent: page2rss
Disallow: /

User-agent: PagePeeker
Disallow: /

User-agent: Pandalytics
Disallow: /

User-agent: panscient
Disallow: /

User-agent: PaperLiBot
Disallow: /

User-agent: Pcore-HTTP
Disallow: /

User-agent: PhantomJS
Disallow: /

User-agent: phpcrawl
Disallow: /

User-agent: pingdom
Disallow: /

User-agent: PiplBot
Disallow: /

User-agent: PocketParser
Disallow: /

User-agent: postrank
Disallow: /

User-agent: PR-CY.RU
Disallow: /

User-agent: Primalbot
Disallow: /

User-agent: PrivacyAwareBot
Disallow: /

User-agent: psbot
Disallow: /

User-agent: Pulsepoint
Disallow: /

User-agent: purebot
Disallow: /

User-agent: RankActiveLinkBot
Disallow: /

User-agent: Refindbot
Disallow: /

User-agent: RegionStuttgartBot
Disallow: /

User-agent: RetrevoPageAnalyzer
Disallow: /

User-agent: RidderBot
Disallow: /

User-agent: Rivva
Disallow: /

User-agent: rogerbot
Disallow: /

User-agent: rssbot
Disallow: /

User-agent: RSSingBot
Disallow: /

User-agent: RyteBot
Disallow: /

User-agent: SafeDNSBot
Disallow: /

User-agent: SafeSearch microdata crawler
Disallow: /

User-agent: SBL-BOT
Disallow: /

User-agent: ScoutJet
Disallow: /

User-agent: Scrapy
Disallow: /

User-agent: scribdbot
Disallow: /

User-agent: SearchAtlas
Disallow: /

User-agent: seekbot
Disallow: /

User-agent: seewithkids
Disallow: /

User-agent: semanticbot
Disallow: /

User-agent: SentiBot
Disallow: /

User-agent: SeobilityBot
Disallow: /

User-agent: seoscanners
Disallow: /

User-agent: SerendeputyBot
Disallow: /

User-agent: serpstatbot
Disallow: /

User-agent: SimpleCrawler
Disallow: /

User-agent: SimplePie
Disallow: /

User-agent: SimpleScraper
Disallow: /

User-agent: sistrix crawler
Disallow: /

User-agent: sitebot
Disallow: /

User-agent: siteexplorer.info
Disallow: /

User-agent: Siteimprove.com
Disallow: /

User-agent: Snacktory
Disallow: /

User-agent: SocialRankIOBot
Disallow: /

User-agent: Sogou
Disallow: /

User-agent: Sonic
Disallow: /

User-agent: spbot
Disallow: /

User-agent: speedy
Disallow: /

User-agent: StorygizeBot
Disallow: /

User-agent: Streamline3Bot
Disallow: /

User-agent: summify
Disallow: /

User-agent: Superfeedr
Disallow: /

User-agent: SurveyBot
Disallow: /

User-agent: SWIMGBot
Disallow: /

User-agent: Sysomos
Disallow: /

User-agent: Taboolabot
Disallow: /

User-agent: tagoobot
Disallow: /

User-agent: TangibleeBot
Disallow: /

User-agent: theoldreader.com
Disallow: /

User-agent: Thinklab
Disallow: /

User-agent: tigerbot
Disallow: /

User-agent: TinEye
Disallow: /

User-agent: Tiny Tiny RSS
Disallow: /

User-agent: toplistbot
Disallow: /

User-agent: ToutiaoSpider
Disallow: /

User-agent: Traackr.com
Disallow: /

User-agent: tracemyfile
Disallow: /

User-agent: trendictionbot
Disallow: /

User-agent: TrendsmapResolver
Disallow: /

User-agent: Trove
Disallow: /

User-agent: tweetedtimes
Disallow: /

User-agent: twengabot
Disallow: /

User-agent: Twingly
Disallow: /

User-agent: Twurly
Disallow: /

User-agent: um-LN
Disallow: /

User-agent: Upflow
Disallow: /

User-agent: urlappendbot
Disallow: /

User-agent: UsineNouvelleCrawler
Disallow: /

User-agent: UT-Dorkbot
Disallow: /

User-agent: vebidoobot
Disallow: /

User-agent: VelenPublicWebCrawler
Disallow: /

User-agent: Veoozbot
Disallow: /

User-agent: Vigil
Disallow: /

User-agent: VKRobot
Disallow: /

User-agent: vkShare
Disallow: /

User-agent: voilabot
Disallow: /

User-agent: VoluumDSP-content-bot
Disallow: /

User-agent: wbsearchbot
Disallow: /

User-agent: webcompanycrawler
Disallow: /

User-agent: WebDataStats
Disallow: /

User-agent: webmon
Disallow: /

User-agent: WeSEE:Search
Disallow: /

User-agent: wocbot
Disallow: /

User-agent: woobot
Disallow: /

User-agent: WordupInfoSearch
Disallow: /

User-agent: woriobot
Disallow: /

User-agent: wotbox
Disallow: /

User-agent: Xenu Link Sleuth
Disallow: /

User-agent: xovibot
Disallow: /

User-agent: Y!J
Disallow: /

User-agent: YaK
Disallow: /

User-agent: yanga
Disallow: /

User-agent: YisouSpider
Disallow: /

User-agent: yoozBot
Disallow: /

User-agent: Zabbix
Disallow: /

User-agent: zenback bot
Disallow: /

User-agent: zgrab
Disallow: /

User-agent: ZoominfoBot
Disallow: /

User-agent: ZumBot
Disallow: /

User-agent: ZuperlistBot
Disallow: /

User-agent: ABCdatos BotLink
Disallow: /

User-agent: Acme.Spider
Disallow: /

User-agent: Ahoy! The Homepage Finder
Disallow: /

User-agent: Alkaline
Disallow: /

User-agent: Anthill
Disallow: /

User-agent: Walhello appie
Disallow: /

User-agent: Arachnophilia
Disallow: /

User-agent: Arale
Disallow: /

User-agent: Araneo
Disallow: /

User-agent: AraybOt
Disallow: /

User-agent: ArchitextSpider
Disallow: /

User-agent: Aretha
Disallow: /

User-agent: ARIADNE
Disallow: /

User-agent: arks
Disallow: /

User-agent: AskJeeves
Disallow: /

User-agent: ASpider (Associative Spider)
Disallow: /

User-agent: ATN Worldwide
Disallow: /

User-agent: Atomz.com Search Robot
Disallow: /

User-agent: AURESYS
Disallow: /

User-agent: BackRub
Disallow: /

User-agent: Bay Spider
Disallow: /

User-agent: Big Brother
Disallow: /

User-agent: Bjaaland
Disallow: /

User-agent: BlackWidow
Disallow: /

User-agent: Die Blinde Kuh
Disallow: /

User-agent: Bloodhound
Disallow: /

User-agent: Borg-Bot
Disallow: /

User-agent: BoxSeaBot
Disallow: /

User-agent: bright.net caching robot
Disallow: /

User-agent: BSpider
Disallow: /

User-agent: CACTVS Chemistry Spider
Disallow: /

User-agent: Calif
Disallow: /

User-agent: Cassandra
Disallow: /

User-agent: Digimarc Marcspider/CGI
Disallow: /

User-agent: Checkbot
Disallow: /

User-agent: ChristCrawler.com
Disallow: /

User-agent: churl
Disallow: /

User-agent: cIeNcIaFiCcIoN.nEt
Disallow: /

User-agent: CMC/0.01
Disallow: /

User-agent: Collective
Disallow: /

User-agent: Combine System
Disallow: /

User-agent: Conceptbot
Disallow: /

User-agent: ConfuzzledBot
Disallow: /

User-agent: CoolBot
Disallow: /

User-agent: Web Core / Roots
Disallow: /

User-agent: XYLEME Robot
Disallow: /

User-agent: Internet Cruiser Robot
Disallow: /

User-agent: Cusco
Disallow: /

User-agent: CyberSpyder Link Test
Disallow: /

User-agent: CydralSpider
Disallow: /

User-agent: Desert Realm Spider
Disallow: /

User-agent: DeWeb(c) Katalog/Index
Disallow: /

User-agent: DienstSpider
Disallow: /

User-agent: Digger
Disallow: /

User-agent: Digital Integrity Robot
Disallow: /

User-agent: Direct Hit Grabber
Disallow: /

User-agent: DNAbot
Disallow: /

User-agent: DownLoad Express
Disallow: /

User-agent: DragonBot
Disallow: /

User-agent: DWCP (Dridus' Web Cataloging Project)
Disallow: /

User-agent: e-collector
Disallow: /

User-agent: EbiNess
Disallow: /

User-agent: EIT Link Verifier Robot
Disallow: /

User-agent: ELFINBOT
Disallow: /

User-agent: Emacs-w3 Search Engine
Disallow: /

User-agent: ananzi
Disallow: /

User-agent: esculapio
Disallow: /

User-agent: Esther
Disallow: /

User-agent: Evliya Celebi
Disallow: /

User-agent: FastCrawler
Disallow: /

User-agent: Fluid Dynamics Search Engine robot
Disallow: /

User-agent: Felix IDE
Disallow: /

User-agent: Wild Ferret Web Hopper #1, #2, #3
Disallow: /

User-agent: FetchRover
Disallow: /

User-agent: fido
Disallow: /

User-agent: Hämähäkki
Disallow: /

User-agent: KIT-Fireball
Disallow: /

User-agent: Fish search
Disallow: /

User-agent: Fouineur
Disallow: /

User-agent: Robot Francoroute
Disallow: /

User-agent: Freecrawl
Disallow: /

User-agent: FunnelWeb
Disallow: /

User-agent: gammaSpider, FocusedCrawler
Disallow: /

User-agent: gazz
Disallow: /

User-agent: GCreep
Disallow: /

User-agent: GetBot
Disallow: /

User-agent: GetURL
Disallow: /

User-agent: Golem
Disallow: /

User-agent: Grapnel/0.01 Experiment
Disallow: /

User-agent: Griffon
Disallow: /

User-agent: Gromit
Disallow: /

User-agent: Northern Light Gulliver
Disallow: /

User-agent: Gulper Bot
Disallow: /

User-agent: HamBot
Disallow: /

User-agent: Harvest
Disallow: /

User-agent: havIndex
Disallow: /

User-agent: HI (HTML Index) Search
Disallow: /

User-agent: Hometown Spider Pro
Disallow: /

User-agent: ht://Dig
Disallow: /

User-agent: HTMLgobble
Disallow: /

User-agent: Hyper-Decontextualizer
Disallow: /

User-agent: iajaBot
Disallow: /

User-agent: IBM_Planetwide
Disallow: /

User-agent: Popular Iconoclast
Disallow: /

User-agent: Ingrid
Disallow: /

User-agent: Imagelock
Disallow: /

User-agent: IncyWincy
Disallow: /

User-agent: Informant
Disallow: /

User-agent: InfoSeek Robot 1.0
Disallow: /

User-agent: Infoseek Sidewinder
Disallow: /

User-agent: InfoSpiders
Disallow: /

User-agent: Inspector Web
Disallow: /

User-agent: IntelliAgent
Disallow: /

User-agent: I, Robot
Disallow: /

User-agent: Iron33
Disallow: /

User-agent: JavaBee
Disallow: /

User-agent: JBot Java Web Robot
Disallow: /

User-agent: JCrawler
Disallow: /

User-agent: Jeeves
Disallow: /

User-agent: JoBo Java Web Robot
Disallow: /

User-agent: Jobot
Disallow: /

User-agent: JoeBot
Disallow: /

User-agent: JumpStation
Disallow: /

User-agent: image.kapsi.net
Disallow: /

User-agent: Katipo
Disallow: /

User-agent: KDD-Explorer
Disallow: /

User-agent: Kilroy
Disallow: /

User-agent: KO_Yappo_Robot
Disallow: /

User-agent: LabelGrabber
Disallow: /

User-agent: larbin
Disallow: /

User-agent: legs
Disallow: /

User-agent: Link Validator
Disallow: /

User-agent: LinkScan
Disallow: /

User-agent: LinkWalker
Disallow: /

User-agent: Lockon
Disallow: /

User-agent: logo.gif Crawler
Disallow: /

User-agent: Lycos
Disallow: /

User-agent: Mac WWWWorm
Disallow: /

User-agent: Magpie
Disallow: /

User-agent: marvin/infoseek
Disallow: /

User-agent: Mattie
Disallow: /

User-agent: MediaFox
Disallow: /

User-agent: MerzScope
Disallow: /

User-agent: NEC-MeshExplorer
Disallow: /

User-agent: MindCrawler
Disallow: /

User-agent: mnoGoSearch search engine software
Disallow: /

User-agent: moget
Disallow: /

User-agent: MOMspider
Disallow: /

User-agent: Monster
Disallow: /

User-agent: Motor
Disallow: /

User-agent: Muncher
Disallow: /

User-agent: Muninn
Disallow: /

User-agent: Muscat Ferret
Disallow: /

User-agent: Mwd.Search
Disallow: /

User-agent: Internet Shinchakubin
Disallow: /

User-agent: NDSpider
Disallow: /

User-agent: Nederland.zoek
Disallow: /

User-agent: NetCarta WebMap Engine
Disallow: /

User-agent: NetMechanic
Disallow: /

User-agent: NetScoop
Disallow: /

User-agent: newscan-online
Disallow: /

User-agent: NHSE Web Forager
Disallow: /

User-agent: Nomad
Disallow: /

User-agent: The NorthStar Robot
Disallow: /

User-agent: nzexplorer
Disallow: /

User-agent: ObjectsSearch
Disallow: /

User-agent: Occam
Disallow: /

User-agent: HKU WWW Octopus
Disallow: /

User-agent: OntoSpider
Disallow: /

User-agent: Openfind data gatherer
Disallow: /

User-agent: Orb Search
Disallow: /

User-agent: Pack Rat
Disallow: /

User-agent: PageBoy
Disallow: /

User-agent: ParaSite
Disallow: /

User-agent: Patric
Disallow: /

User-agent: pegasus
Disallow: /

User-agent: The Peregrinator
Disallow: /

User-agent: PerlCrawler 1.0
Disallow: /

User-agent: Phantom
Disallow: /

User-agent: PhpDig
Disallow: /

User-agent: PiltdownMan
Disallow: /

User-agent: Pimptrain.com's robot
Disallow: /

User-agent: Pioneer
Disallow: /

User-agent: html_analyzer
Disallow: /

User-agent: Portal Juice Spider
Disallow: /

User-agent: PGP Key Agent
Disallow: /

User-agent: PlumtreeWebAccessor
Disallow: /

User-agent: Poppi
Disallow: /

User-agent: PortalB Spider
Disallow: /

User-agent: GetterroboPlus Puu
Disallow: /

User-agent: The Python Robot
Disallow: /

User-agent: Raven Search
Disallow: /

User-agent: RBSE Spider
Disallow: /

User-agent: Resume Robot
Disallow: /

User-agent: RoadHouse Crawling System
Disallow: /

User-agent: RixBot
Disallow: /

User-agent: Road Runner: The ImageScape Robot
Disallow: /

User-agent: Robbie the Robot
Disallow: /

User-agent: ComputingSite Robi/1.0
Disallow: /

User-agent: RoboCrawl Spider
Disallow: /

User-agent: RoboFox
Disallow: /

User-agent: Robozilla
Disallow: /

User-agent: Roverbot
Disallow: /

User-agent: RuLeS
Disallow: /

User-agent: SafetyNet Robot
Disallow: /

User-agent: Scooter
Disallow: /

User-agent: Sleek
Disallow: /

User-agent: Search.Aus-AU.COM
Disallow: /

User-agent: SearchProcess
Disallow: /

User-agent: Senrigan
Disallow: /

User-agent: SG-Scout
Disallow: /

User-agent: ShagSeeker
Disallow: /

User-agent: Shai'Hulud
Disallow: /

User-agent: Sift
Disallow: /

User-agent: Simmany Robot Ver1.0
Disallow: /

User-agent: Site Valet
Disallow: /

User-agent: Open Text Index Robot
Disallow: /

User-agent: SiteTech-Rover
Disallow: /

User-agent: Skymob.com
Disallow: /

User-agent: SLCrawler
Disallow: /

User-agent: Smart Spider
Disallow: /

User-agent: Snooper
Disallow: /

User-agent: Solbot
Disallow: /

User-agent: Spanner
Disallow: /

User-agent: Speedy Spider
Disallow: /

User-agent: spider_monkey
Disallow: /

User-agent: SpiderBot
Disallow: /

User-agent: Spiderline Crawler
Disallow: /

User-agent: SpiderMan
Disallow: /

User-agent: SpiderView(tm)
Disallow: /

User-agent: Spry Wizard Robot
Disallow: /

User-agent: Site Searcher
Disallow: /

User-agent: Suke
Disallow: /

User-agent: suntek search engine
Disallow: /

User-agent: Sven
Disallow: /

User-agent: Sygol
Disallow: /

User-agent: TACH Black Widow
Disallow: /

User-agent: Tarantula
Disallow: /

User-agent: tarspider
Disallow: /

User-agent: Tcl W3 Robot
Disallow: /

User-agent: TechBOT
Disallow: /

User-agent: Templeton
Disallow: /

User-agent: TeomaTechnologies
Disallow: /

User-agent: TITAN
Disallow: /

User-agent: TitIn
Disallow: /

User-agent: The TkWWW Robot
Disallow: /

User-agent: TLSpider
Disallow: /

User-agent: UCSD Crawl
Disallow: /

User-agent: UdmSearch
Disallow: /

User-agent: URL Check
Disallow: /

User-agent: URL Spider Pro
Disallow: /

User-agent: Valkyrie
Disallow: /

User-agent: Verticrawl
Disallow: /

User-agent: Victoria
Disallow: /

User-agent: vision-search
Disallow: /

User-agent: void-bot
Disallow: /

User-agent: Voyager
Disallow: /

User-agent: VWbot
Disallow: /

User-agent: The NWI Robot
Disallow: /

User-agent: W3M2
Disallow: /

User-agent: WallPaper (alias crawlpaper)
Disallow: /

User-agent: the World Wide Web Wanderer
Disallow: /

User-agent: w@pSpider by wap4.com
Disallow: /

User-agent: WebBandit Web Spider
Disallow: /

User-agent: WebCatcher
Disallow: /

User-agent: WebCopy
Disallow: /

User-agent: webfetcher
Disallow: /

User-agent: The Webfoot Robot
Disallow: /

User-agent: Webinator
Disallow: /

User-agent: weblayers
Disallow: /

User-agent: WebLinker
Disallow: /

User-agent: WebMirror
Disallow: /

User-agent: The Web Moose
Disallow: /

User-agent: WebQuest
Disallow: /

User-agent: Digimarc MarcSpider
Disallow: /

User-agent: WebReaper
Disallow: /

User-agent: webs
Disallow: /

User-agent: Websnarf
Disallow: /

User-agent: WebSpider
Disallow: /

User-agent: WebVac
Disallow: /

User-agent: webwalk
Disallow: /

User-agent: WebWalker
Disallow: /

User-agent: WebWatch
Disallow: /

User-agent: whatUseek Winona
Disallow: /

User-agent: WhoWhere Robot
Disallow: /

User-agent: Wired Digital
Disallow: /

User-agent: Weblog Monitor
Disallow: /

User-agent: w3mir
Disallow: /

User-agent: WebStolperer
Disallow: /

User-agent: The Web Wombat
Disallow: /

User-agent: The World Wide Web Worm
Disallow: /

User-agent: WWWC Ver 0.2.5
Disallow: /

User-agent: WebZinger
Disallow: /

User-agent: XGET
Disallow: /

User-agent: GeedoProductSearch
Disallow: /

User-agent: Gabanzabot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-Agent:  FacebookBot
Crawl-delay: 15