Kunstdownload.de - SEO Checker

Metaetiquetas

Lista de medios

Estructura de los encabezados

Enlaces detectados en esta página

Cabecera HTTP

Backlinks desde Wikipedia

Robots.txt

#sitemap: sitemap.xml


user-agent: AhrefsBot
user-agent: semrushbot
user-agent: mj12bot
user-agent: cliqzbot
user-agent: dotbot
user-agent: sogouspider
user-agent: ia_archiver
user-agent: rogerbot
user-agent: SiteExplorer
user-agent: SEOkicks-Robot
user-agent: SISTRIX
user-agent: SearchmetricsBot
user-agent: BacklinkCrawler
user-agent: xovi
user-agent: Seekbot 
user-agent: piplbot
user-agent: spbot
user-agent: betabot
user-agent: memory
user-agent: archive
user-agent: linkdexbot
user-agent: seznam
user-agent: blexbot
Disallow:/

#Baiduspider
User-agent: Baiduspider
Disallow: /

#Yandex
User-agent: Yandex
Disallow: /

#Disallow Boitho dc Bot (Norway)
User-agent: boitho.com-dc
Disallow: /

#Disallow Busiverse Bot (Turkey Sirketce/Busiverse )
User-agent: Busiverse
Disallow: /

#Disallow CazoodleBot - from University of Illinois
User-agent: CazoodleBot
Disallow: /

#Disallow Exabot Bot - Exalead
User-agent: Exabot
Disallow: /

#Disallow heritrix Bot - from Yell.Com
User-agent: heritrix
Disallow: /

#Disallow IRLbot - IRL Texas AM research bot
User-agent: IRLbot
Disallow: /

#Disallow Jyxobot - Czech Webcrawler for Jyxo
User-agent: Jyxobot
Disallow: /


#Disallow psbot spidering of images and hub
User-agent: psbot
Disallow: /

#Disallow Sirketce Bot (Turkey Sirketce/Busiverse )
User-agent: Sirketce
Disallow: /

#Disallow Sogou - Chinese Search Engine
User-agent: Sogou
Disallow: /

#Disallow SoSo - Chinese Search Engine
User-agent: Soso
Disallow: /

#Disallow SoSoImageSpider - Chinese picture Search Engine
User-agent: Sosoimagespider
Disallow: /

#Disallow TinEye - Image trawler Search Engine
User-agent: TinEye
Disallow: /

#Disallow TurnITin - "This robot collects content from the Internet for the sole purpose of helping educational institutions prevent plagiarism"
User-agent: TurnitinBot
Disallow: /

#Disallow Twiceler - Cuill (also Barred IPs on firewall)
User-agent: twiceler
Disallow: /


#Disallow Voilabot Bot - France Telecom
User-agent: VoilaBot 
Disallow: /

#Disallow WebAlta Bot - Russian
User-agent: WebAlta 
Disallow: /

user-agent: Googlebot
user-agent: bingbot
user-agent: msnbot
user-agent: slurp
Crawl-delay: 120
disallow: /cache/
disallow: /download/
disallow: /includes/
disallow: /redirect.php
#allow: /images/

user-agent: *
Crawl-delay: 200
disallow: /cache/
disallow: /download/
disallow: /images/
disallow: /includes/
disallow: /redirect.php

Snippet (vista previa de los resultados de búsqueda)