Twelvebeauty.es - SEO Checker

Sign up for free! PDF Export
Overview of the SEO Check
Meta information
61% 
Page quality
78% 
Page structure
58% 
Link structure
25% 
Server
91% 
External factors
100% 
SEO Score
Response time
0.36 s
File size
293.00 kB
Words
712
Media files
41
Number of links
152 internal / 11 external

Task list of SEO Improvements

Meta specifications

Title
(Critically important)
TWELVE BEAUTY | Green Beauty Reinvented Reward For Radiant Skin
The page title should be shorter than 580 pixels. It is 649 pixels long. Optimize title
There are word repetitions in the page title.
Meta description
(Critically important)
Twelve Beauty es una recompensa revolucionaria para una piel radiante. Sólo usamos los ingredientes más puros en nuestras fórmulas para mantener la piel más sana por más tiempo.
The meta description is too long: 1142 pixels from max. 1000 pixels. Optimize description
Crawlability
(Critically important)
There are no problems in accessing the website.
Canonical URL
(Important)
https://www.twelvebeauty.es/
There is a valid canonical link specified.
Language
(Somewhat important)
Language detected in text: es
Language defined in HTML: es-es
Server location: United States of America
The following language is defined by HTML: es-es
Alternate/Hreflang Links
(Somewhat important)
The specified alternate links have no errors.
Other meta tags
(Somewhat important)
There is no rel next meta tag on this page.
There is no rel prev meta tag on this page.
Domain
(Somewhat important)
The domain is no subdomain.
The domain length is good.
The domain does not contain non-latin characters.
Page URL
(Somewhat important)
No parameters were found in the URL.
No session ID was found in the URL.
The URL does not have too many subdirectories.
Charset encoding
(Somewhat important)
The charset encoding (UTF-8) is set correctly.
Doctype
(Nice to have)
The doctype HTML 5 is set correctly.
The doctype is placed at first in the HTML code.
Favicon
(Nice to have)
The favicon is linked correctly.

Meta tags

NameValue
viewportwidth=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=0
descriptionTwelve Beauty es una recompensa revolucionaria para una piel radiante. Sólo usamos los ingredientes más puros en nuestras fórmulas para mantener la piel más sana por más tiempo.
robotsfollow, index, max-snippet:-1, max-video-preview:-1, max-image-preview:large
google-site-verificationfhdOlFQ--DhIQMKNhGPRGVqKlS-URrBo9e5cE59TSLc
generatorElementor 3.23.4; features: e_optimized_css_loading, additional_custom_breakpoints, e_lazyload; settings: css_print_method-external, google_font-enabled, font_display-auto
msapplication-TileImagehttps://www.twelvebeauty.es/wp-content/uploads/2022/05/favicon-twelve-300x300.png
article:published_time2022-12-08T18:41:32+01:00
article:modified_time2024-03-22T10:26:58+01:00
langes-es
twitter:cardsummary_large_image
twitter:titleTWELVE BEAUTY | Green Beauty Reinvented Reward For Radiant Skin
twitter:descriptionTwelve Beauty es una recompensa revolucionaria para una piel radiante. Sólo usamos los ingredientes más puros en nuestras fórmulas para mantener la piel más sana por más tiempo.
twitter:site@TwelveBeauty
twitter:creator@TwelveBeauty
og:localees_ES
og:typewebsite
og:titleTWELVE BEAUTY | Green Beauty Reinvented Reward For Radiant Skin
og:descriptionTwelve Beauty es una recompensa revolucionaria para una piel radiante. Sólo usamos los ingredientes más puros en nuestras fórmulas para mantener la piel más sana por más tiempo.
og:urlhttps://www.twelvebeauty.es/
og:site_nameTwelve Beauty España
og:updated_time2024-03-22T10:26:58+01:00
charsetUTF-8

Test up to 1.000 webpages of twelvebeauty.es with our free plan!

Try For Free
No trial. It's just free!

Page quality

Content
(Critically important)
There are 2 text duplicates on this page:
  • Duplicate: Este serum enriquecido con extracto de Bidens pilosa, la alternativa b...
This page contains 712 words. That's ok.
17.8% of the text are stop words.
Keywords used in the page title are also used in the page content. That's good!
The page contains a listing, which indicates a good text layout.
5 paragraphs were found on this page.
The text content is perfect.
No placeholders texts or images were found.
The average number of words per sentence of 23.17 words is good.
Frames
(Critically important)
This page does not use a frameset.
Mobile optimization
(Somewhat important)
A viewport "width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=0" is provided.
At least one Apple touch icon is specified.
Bold and strong tags
(Somewhat important)
The usage of strong and bold tags is perfect. We recommend the use of up to 14 tags for this page.
Image SEO
(Somewhat important)
41 images have no alt attribute. The content of alt attributes is used by search engines.
Social Networks
(Nice to have)
There are only a few social sharing widgets on the page. Make your website popular in social networks with social sharing widgets.
Additional markup
(Nice to have)
No additional page markup was found.
HTTPS
(Somewhat important)
This website uses HTTPS to protect privacy and integrity of the exchanged data.
All included files are also transferred via HTTPS.

Media list

URLAlt attributeTitle
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided
data:[...] Base64No alt attribute provided

Page structure

H1 heading
(Critically important)
There is no H1 heading specified.
Headings
(Important)
Some headings occur twice on the page.
The structure of headings is missing one or more levels. Do not skip heading levels.

Heading structure

Heading levelContent
H2 Green Beauty Reinvented
H2 Artemisia Power Protection Moisturiser SPF50+
H2 Glow Island
H2 Artemisia Power Protection Moisturiser SPF50+ Duplicate text
H2 Glow Island Duplicate text
H2 Artemisia Power Protection Moisturiser SPF50+ Duplicate text
H2 Glow Island Duplicate text
H2 LA ALTERNATIVA BOTÁNICA AL RETINOL
H2 Plant Perfection Gel Serum
H2 LA ALTERNATIVA BOTÁNICA AL RETINOL Duplicate text
H2 Plant Perfection Gel Serum Duplicate text
H2 Best Sellers
H2 Rapid Eye Treatment
H2 Hyaluroil Lip Treatment
H2 Glow Island Duplicate text
H2 Purifying Cleansing Beauty Cream
H2 Rapid Eye Treatment Duplicate text
H2 Hyaluroil Lip Treatment Duplicate text
H2 Glow Island Duplicate text
H2 Purifying Cleansing Beauty Cream Duplicate text
H2 Instagram
H2 Suscríbete al Newsletter
H2 Suscríbete al Newsletter Duplicate text
H2 Twelve Studio
H2 Twelve Studio Duplicate text
Some internal links have dynamic parameters. All internal URLs, which are not marked as nofollow, should not contain dynamic parameters.
Some anchor texts are used more than once.
24 links don't have an anchor text.
The number of internal links is ok.
None of the anchor texts is too long.
There are 11 external links on this page.

Found links on this page

LinkAttributesAnchor text
https://www.twelvebeauty.com/External Subdomain English
https://www.twelvebeauty.es/Subdomain Español
https://www.twelvebeauty.it/External Subdomain Italiano
https://www.twelvebeauty.es/Subdomain No Text
/tienda/Subdomain Tienda
/categoria-producto/the-collec...Subdomain The Collection
A-TITLE The Collection
/categoria-producto/limpiadore...Subdomain Limpiadores y Tónicos
A-TITLE Limpiadores y Tónicos
/categoria-producto/tratamient...Subdomain Tratamientos Específicos
A-TITLE Tratamientos Específicos
/categoria-producto/cremas-hid...Subdomain Hidratantes
A-TITLE Hidratantes
/categoria-producto/contorno-d...Subdomain Labios y Ojos
A-TITLE Labios y Ojos
/categoria-producto/cosmeticos...Subdomain Corporal
A-TITLE Corporal
/categoria-producto/cuidado-de...Subdomain Capilar
A-TITLE Capilar
/categoria-producto/maquillaje/Subdomain Maquillaje
A-TITLE Maquillaje
/categoria-producto/productos-...Subdomain Accesorios
A-TITLE Accesorios
/categoria-producto/ambientado...Subdomain Casa
A-TITLE Casa
/categoria-producto/online-exc...Subdomain No Text
/tienda/tarjeta-regalo/Subdomain No Text
/conoce-a-pedro/Subdomain No Text
/presentando-twelve-beauty/Subdomain No Text
/12-ingredientes/Subdomain No Text
/the-edit/Subdomain The Edit
/contacto/Subdomain Contacto
/asesoria-de-piel/Subdomain Asesoría de piel
https://calendly.com/twelvebea...New window External Visita el estudio
/?s=Glow Island&post_type=prod...Subdomain Glow Island
/?s=Rapid Eye Treatment&post_t...Subdomain Rapid Eye Treatment
/?s=Purifying Cleansing&post_t...Subdomain Purifying Cleansing
/mi-cuenta/Subdomain No Text
/mi-cuenta/Subdomain Mi Cuenta
/mi-cuenta/contrasena-perdida/Subdomain Lost password?
/politica-privacidad/New window Subdomain política de privacidad
/lista-de-deseos/Subdomain No Text
/lista-de-deseos/Subdomain 0 Mis favoritos
/lista-de-deseos/Subdomain Ver mis favoritos
/carrito/Subdomain $ 0.00
/carrito/Subdomain 0 Carrito
/carrito/Subdomain Carrito (0)
/carrito/Subdomain Ver carrito
/finalizar-compra/Subdomain Checkout
https://www.twelvebeauty.es/Subdomain No Text
https://www.twelvebeauty.es/Subdomain Inicio
/tienda/Subdomain Text duplicate Tienda
/categoria-producto/the-collec...Subdomain Text duplicate The Collection
/categoria-producto/limpiadore...Subdomain Limpiadores y tónicos
/categoria-producto/tratamient...Subdomain Tratamientos específicos
/categoria-producto/cremas-hid...Subdomain Text duplicate Hidratantes
/categoria-producto/contorno-d...Subdomain Labios y ojos
/categoria-producto/cosmeticos...Subdomain Text duplicate Corporal
/categoria-producto/cuidado-de...Subdomain Text duplicate Capilar
/categoria-producto/maquillaje/Subdomain Text duplicate Maquillaje
/categoria-producto/productos-...Subdomain Text duplicate Accesorios
/categoria-producto/ambientado...Subdomain Text duplicate Casa
/categoria-producto/online-exc...Subdomain Online exclusives
/tienda/tarjeta-regalo/Subdomain Tarjeta regalo
/conoce-a-pedro/Subdomain Conoce a Pedro
/presentando-twelve-beauty/Subdomain Presentando Twelve
/12-ingredientes/Subdomain 12 Ingredientes
/the-edit/Subdomain Text duplicate The Edit
/contacto/Subdomain Text duplicate Contacto
/asesoria-de-piel/Subdomain Text duplicate Asesoría de piel
https://calendly.com/twelvebea...New window External Text duplicate Visita el estudio
https://www.twelvebeauty.com/External Subdomain Text duplicate English
https://www.twelvebeauty.es/Subdomain Text duplicate Español
https://www.twelvebeauty.it/External Subdomain Text duplicate Italiano
/mi-cuenta/Subdomain Acceder
/lista-de-deseos/Subdomain Mis favoritos
https://www.twelvebeauty.es/Subdomain No Text
/carrito/Subdomain Text duplicate $ 0.00
/carrito/Subdomain Text duplicate 0 Carrito
/carrito/Subdomain Text duplicate Carrito (0)
/carrito/Subdomain Text duplicate Ver carrito
/finalizar-compra/Subdomain Text duplicate Checkout
/categoria-producto/the-collec...Subdomain Shop Now
/categoria-producto/cuidado-de...Subdomain No Text
/?add_to_wishlist=3368&_wpnonc...Nofollow Añadir a la lista de deseos
/tienda/artemisia-power-protec...Subdomain No Text
/tienda/artemisia-power-protec...Subdomain Artemisia Power Protection Moisturiser SPF50+
/tienda/artemisia-power-protec...Nofollow Subdomain Leer más
/?add_to_wishlist=4261&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/glow-island-twelve-bea...Subdomain No Text
/tienda/glow-island-twelve-bea...Subdomain Text duplicate Glow Island
/?add-to-cart=4261Nofollow Añadir al carrito
/categoria-producto/cuidado-de...Subdomain No Text
/?add_to_wishlist=3368&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/artemisia-power-protec...Subdomain No Text
/tienda/artemisia-power-protec...Subdomain Text duplicate Artemisia Power Protection Moisturiser SPF50+
/tienda/artemisia-power-protec...Nofollow Subdomain Text duplicate Leer más
/?add_to_wishlist=4261&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/glow-island-twelve-bea...Subdomain No Text
/tienda/glow-island-twelve-bea...Subdomain Text duplicate Glow Island
/?add-to-cart=4261Nofollow Text duplicate Añadir al carrito
/categoria-producto/cuidado-de...Subdomain No Text
/?add_to_wishlist=3368&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/artemisia-power-protec...Subdomain No Text
/tienda/artemisia-power-protec...Subdomain Text duplicate Artemisia Power Protection Moisturiser SPF50+
/tienda/artemisia-power-protec...Nofollow Subdomain Text duplicate Leer más
/?add_to_wishlist=4261&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/glow-island-twelve-bea...Subdomain No Text
/tienda/glow-island-twelve-bea...Subdomain Text duplicate Glow Island
/?add-to-cart=4261Nofollow Text duplicate Añadir al carrito
/tienda/plant-perfection-gel-s...Subdomain Text duplicate Shop Now
/tienda/plant-perfection-gel-s...Subdomain Text duplicate Shop Now
/?add_to_wishlist=3382&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/rapid-eye-treatment-tw...Subdomain No Text
/tienda/rapid-eye-treatment-tw...Subdomain Text duplicate Rapid Eye Treatment
/?add-to-cart=3382Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=3386&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/hyaluroil-lip-treatmen...Subdomain No Text
/tienda/hyaluroil-lip-treatmen...Subdomain Hyaluroil Lip Treatment
/?add-to-cart=3386Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=4261&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/glow-island-twelve-bea...Subdomain No Text
/tienda/glow-island-twelve-bea...Subdomain Text duplicate Glow Island
/?add-to-cart=4261Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=3387&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/purifying-cleansing-be...Subdomain No Text
/tienda/purifying-cleansing-be...Subdomain Purifying Cleansing Beauty Cream
/?add-to-cart=3387Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=3382&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/rapid-eye-treatment-tw...Subdomain No Text
/tienda/rapid-eye-treatment-tw...Subdomain Text duplicate Rapid Eye Treatment
/?add-to-cart=3382Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=3386&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/hyaluroil-lip-treatmen...Subdomain No Text
/tienda/hyaluroil-lip-treatmen...Subdomain Text duplicate Hyaluroil Lip Treatment
/?add-to-cart=3386Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=4261&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/glow-island-twelve-bea...Subdomain No Text
/tienda/glow-island-twelve-bea...Subdomain Text duplicate Glow Island
/?add-to-cart=4261Nofollow Text duplicate Añadir al carrito
/?add_to_wishlist=3387&_wpnonc...Nofollow Text duplicate Añadir a la lista de deseos
/tienda/purifying-cleansing-be...Subdomain No Text
/tienda/purifying-cleansing-be...Subdomain Text duplicate Purifying Cleansing Beauty Cream
/?add-to-cart=3387Nofollow Text duplicate Añadir al carrito
/12-ingredientesSubdomain 12 ingredientes
A-TITLE 12 ingredientes
/presentando-twelve-beauty/Subdomain Text duplicate Presentando Twelve
A-TITLE Presentando Twelve
/conoce-a-pedro/Subdomain Text duplicate Conoce a Pedro
A-TITLE Conoce a Pedro
/stockistsSubdomain Stockists
A-TITLE Stockists
/the-edit/Subdomain Text duplicate The Edit
A-TITLE The Edit
/asesoria-de-piel/Subdomain Text duplicate Asesoría de piel
A-TITLE Asesoría de piel
/contacto/Subdomain Text duplicate Contacto
A-TITLE Contacto
/politica-medioambiental/Subdomain Política medioambiental
A-TITLE Política medioambiental
/aviso-legal/Subdomain Aviso legal
A-TITLE Aviso legal
/politica-cookies/Subdomain Política de cookies
A-TITLE Política de cookies
/politica-privacidad/Subdomain Política de privacidad
A-TITLE Política de privacidad
/terminos-condiciones/Subdomain Términos y condiciones
A-TITLE Términos y condiciones
https://www.facebook.com/twelv...New window Nofollow External Subdomain Facebook
https://www.instagram.com/twel...New window Nofollow External Subdomain Instagram
/12-ingredientesSubdomain Text duplicate 12 ingredientes
A-TITLE 12 ingredientes
/introducing-twelve-beauty-3/Introducing Twelve
A-TITLE Introducing Twelve
/meet-pedro/Meet Pedro
A-TITLE Meet Pedro
https://twelvebeauty.es/stockistsText duplicate Stockists
A-TITLE Stockists
/the-edit/Subdomain The edit
A-TITLE The edit
/asesoria-de-piel/Subdomain Text duplicate Asesoría de piel
A-TITLE Asesoría de piel
/contacto/Subdomain Text duplicate Contacto
A-TITLE Contacto
/politica-medioambiental/Subdomain Text duplicate Política medioambiental
A-TITLE Política medioambiental
/aviso-legal/Subdomain Text duplicate Aviso legal
A-TITLE Aviso legal
/politica-cookies/Subdomain Text duplicate Política de cookies
A-TITLE Política de cookies
/politica-privacidad/Subdomain Text duplicate Política de privacidad
A-TITLE Política de privacidad
/terminos-condiciones/Subdomain Text duplicate Términos y condiciones
A-TITLE Términos y condiciones
https://www.facebook.com/twelv...New window Nofollow External Subdomain Text duplicate Facebook
https://www.instagram.com/twel...New window Nofollow External Subdomain Text duplicate Instagram
https://estudioentredos.es/New window External EntreDos

Server configuration

HTTP redirects
(Critically important)
This page redirects to "https://www.twelvebeauty.es/"
HTTP header
(Important)
The X-powered header is sent within the response header. (unnecessary)
This page uses GZip for compressed data transmission.
Performance
(Somewhat important)
The page response time is excellent with 0.36 seconds.
The file size of the HTML document is fine (293 kB).

HTTP Response Header

NameValue
x-powered-byPHP/7.4.33
x-dns-prefetch-controlon
content-typetext/html; charset=UTF-8
link<https://www.twelvebeauty.es/wp-json/>; rel="https://api.w.org/"
etag"23168-1727579218;gz"
x-litespeed-cachehit
content-encodinggzip
varyAccept-Encoding,User-Agent
dateSun, 29 Sep 2024 03:24:05 GMT
serverLiteSpeed
alt-svch3=":443"; ma=2592000, h3-29=":443"; ma=2592000, h3-Q050=":443"; ma=2592000, h3-Q046=":443"; ma=2592000, h3-Q043=":443"; ma=2592000, quic=":443"; ma=2592000; v="43,46"
statuscode200
http_versionHTTP/2

External factors

This website has excellent links from other websites.
This page has backlinks from 48 referring domains.
This page has 207 backlinks.
This page has backlinks from 47 different ip addresses.

Links from Wikipedia

No links from Wikipedia were found.

Robots.txt

# Fichero robots.txt de Art Project Group (https://artprojectgroup.es) para WordPress.
# Si lo usas no olvides indicar su procedencia ;-) 
# Última actualización: 15/12/2023.

# Código procedente de Wikipedia (https://en.wikipedia.org/robots.txt):

# Observed spamming large amounts of https://en.wikipedia.org/?curid=NNNNNN
# and ignoring 429 ratelimit responses, claims to respect robots:
# http://mj12bot.com/
User-agent: MJ12bot
Disallow: /

# advertising-related bots:
User-agent: Mediapartners-Google*
Disallow: /

# Wikipedia work bots:
User-agent: IsraBot
Disallow:

User-agent: Orthogaffe
Disallow:

# Crawlers that are kind enough to obey, but which we'd rather not have
# unless they're feeding search engines.
User-agent: UbiCrawler
Disallow: /

User-agent: DOC
Disallow: /

User-agent: Zao
Disallow: /

# Some bots are known to be trouble, particularly those designed to copy
# entire sites. Please obey robots.txt.
User-agent: sitecheck.internetseer.com
Disallow: /

User-agent: Zealbot
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: WebCopier
Disallow: /

User-agent: Fetch
Disallow: /

User-agent: Offline Explorer
Disallow: /

User-agent: Teleport
Disallow: /

User-agent: TeleportPro
Disallow: /

User-agent: WebZIP
Disallow: /

User-agent: linko
Disallow: /

User-agent: HTTrack
Disallow: /

User-agent: Microsoft.URL.Control
Disallow: /

User-agent: Xenu
Disallow: /

User-agent: larbin
Disallow: /

User-agent: libwww
Disallow: /

User-agent: ZyBORG
Disallow: /

User-agent: Download Ninja
Disallow: /

# Misbehaving: requests much too fast:
User-agent: fast
Disallow: /

#
# Sorry, wget in its recursive mode is a frequent problem.
# Please read the man page and use it properly; there is a
# --wait option you can use to set the delay between hits,
# for instance.
#
User-agent: wget
Disallow: /

#
# The 'grub' distributed client has been *very* poorly behaved.
#
User-agent: grub-client
Disallow: /

#
# Doesn't follow robots.txt anyway, but...
#
User-agent: k2spider
Disallow: /

#
# Hits many times per second, not acceptable
# http://www.nameprotect.com/botinfo.html
User-agent: NPBot
Disallow: /

# A capture bot, downloads gazillions of pages with no public benefit
# http://www.webreaper.net/
User-agent: WebReaper
Disallow: /

# Es hora de bloquear a otro buen puñado de bad bots y bots que generan consultas abusivas (818 User-agent diferentes).
# Algunas fuentes: 
# https://sustainablewww.org/principles/block-unwanted-and-spammy-bots-with-robotstxt-and-speed-up-your-website
# https://www.cocooncenter.es/robots.txt
# https://www.keyadvice.co.uk/robots.txt
# http://rfec.com/robots.txt
User-agent: 008
User-agent: Accoona
User-agent: adbeat_bot
User-agent: Aghaven
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
User-agent: aipbot
User-agent: aipbot*
User-agent: aipbot/1.0
User-agent: Alexa
User-agent: Alexa Bitlybot
User-agent: Alexibot
User-agent: AltaVista Intranet V2.0 AVS EVAL [email protected]
User-agent: AltaVista Intranet V2.0 Compaq Altavista Eval [email protected]
User-agent: AltaVista Intranet V2.0 evreka.com [email protected]
User-agent: AltaVista V2.0B [email protected]
User-agent: AlvinetSpider
User-agent: Amfibibot
User-agent: Anonymous
User-agent: Antenne Hatena
User-agent: antibot
User-agent: ApocalXExplorerBot
User-agent: AppEngine
User-agent: appie
User-agent: Aqua_Products
User-agent: archive
User-agent: Argus/1.1
User-agent: Artabus
User-agent: asterias
User-agent: atSpider
User-agent: attentio
User-agent: AV Fetch 1.0
User-agent: AVSearch-3.0(AltaVista/AVC)
User-agent: AWS Cloud Based
User-agent: b2w
User-agent: b2w/0.1
User-agent: BackDoorBot
User-agent: BackDoorBot/1.0
User-agent: BacklinkCrawler
User-agent: Baiduspider
User-agent: becomebot
User-agent: BecomeBot
User-agent: BigBrother
User-agent: Biglotron
User-agent: BIGLOTRON (BETA 2;GNU/Linux)
User-agent: BizInformation
User-agent: Black Hole
User-agent: Black.Hole
User-agent: BlackWidow
User-agent: BlekkoBot
User-agent: Blexbot
User-agent: BLEXBot
User-agent: BlowFish
User-agent: BlowFish/1.0
User-agent: BoardPulse
User-agent: boitho.com-dc
User-agent: Bookmark search tool
User-agent: Bot mailto:[email protected]
User-agent: bot/1.0
User-agent: BotALot
User-agent: BotRightHere
User-agent: BrandProtect
User-agent: BruinBot
User-agent: BuiltBotTough
User-agent: Bullseye
User-agent: Bullseye/1.0
User-agent: BunnySlippers
User-agent: Butterfly
User-agent: CatchBot
User-agent: CazoodleBot
User-agent: CCBot
User-agent: ccubee
User-agent: ccubee/3.5
User-agent: Cegbfeieh
User-agent: cfetch
User-agent: cfetch/1.0
User-agent: ChatGPT
User-agent: ChatGPT-User
User-agent: CheeseBot
User-agent: CherryPicker
User-agent: CherryPicker /1.0
User-agent: CherryPickerElite/1.0
User-agent: CherryPickerSE/1.0
User-agent: ChinaClaw
User-agent: chroot
User-agent: Collage
User-agent: Combine
User-agent: cometrics-bot
User-agent: complex_network_group
User-agent: convera
User-agent: Convera Internet Spider V6.x
User-agent: ConveraCrawler
User-agent: ConveraCrawler/0.2
User-agent: ConveraCrawler/0.9d
User-agent: ConveraMultiMediaCrawler
User-agent: ConveraMultiMediaCrawler/0.1
User-agent: CoolBot
User-agent: Copernic
User-agent: CopyRightCheck
User-agent: cosmos
User-agent: Crescent
User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
User-agent: Crescent Internet ToolPak HTTPOLE Control v.1.0
User-agent: Curl
User-agent: Custo
User-agent: CydralSpider
User-agent: Deepnet Explorer
User-agent: default.ida
User-agent: DigExt
User-agent: DimensioNet
User-agent: DISCo
User-agent: DISCo Pump
User-agent: DISCo Pump 3.0
User-agent: DISCo Pump 3.1
User-agent: DISCo Pump 3.2
User-agent: discobot
User-agent: DISCoFinder
User-agent: DittoSpyder
User-agent: DoCoMo
User-agent: DotBot
User-agent: dotbot
User-agent: DotBot/1.1
User-agent: Download Demon
User-agent: Download Demon/3.2.0.8
User-agent: Download Demon/3.5.0.11
User-agent: Download Wonder
User-agent: DoyoucheckBot
User-agent: Drecombot
User-agent: DSurf
User-agent: DTAAgent
User-agent: Dulance bot
User-agent: dumbot
User-agent: e-SocietyRobot
User-agent: eCatch
User-agent: eCatch/3.0
User-agent: echo!
User-agent: EchO!/2.0
User-agent: EirGrabber
User-agent: EliteSys Entry
User-agent: Email Extractor
User-agent: EmailCollector
User-agent: EmailSiphon
User-agent: EmailSmartz
User-agent: EmailWolf
User-agent: Enterprise_Search
User-agent: Enterprise_Search/1.0
User-agent: envolk
User-agent: EroCrawler
User-agent: erowz
User-agent: es
User-agent: ESIRover
User-agent: EverbeeCrawler
User-agent: Exabot
User-agent: exabot
User-agent: Exabot-Images
User-agent: Exabot/2.0
User-agent: Express WebPictures
User-agent: Express WebPictures (www.express-soft.com)
User-agent: ExtractorPro
User-agent: EyeNetIE
User-agent: Ezooms
User-agent: FairAd Client
User-agent: Fairshare
User-agent: Fasterfox
User-agent: FDSE
User-agent: findlinks
User-agent: Flaming AttackBot
User-agent: Flamingo_SearchEngine
User-agent: FlashGet
User-agent: FlashGet WebWasher 3.2
User-agent: Foobot
User-agent: FreeFind
User-agent: FreeWebMonitoring SiteChecker/0.1
User-agent: FrontPage
User-agent: FrontPage [NC,OR]
User-agent: FurlBot
User-agent: g2Crawler
User-agent: g2reader-bot/1.0
User-agent: Gaisbot
User-agent: Gaisbot/3.0
User-agent: genieBot
User-agent: GetBot
User-agent: GetRight
User-agent: GetRight/2.11
User-agent: GetRight/3.1
User-agent: GetRight/3.2
User-agent: GetRight/3.3
User-agent: GetRight/3.3.3
User-agent: GetRight/3.3.4
User-agent: GetRight/4.0.0
User-agent: GetRight/4.1.0
User-agent: GetRight/4.1.1
User-agent: GetRight/4.1.2
User-agent: GetRight/4.2
User-agent: GetRight/4.2b (Portuguxeas)
User-agent: GetRight/4.2c
User-agent: GetRight/4.3
User-agent: GetRight/4.5
User-agent: GetRight/4.5a
User-agent: GetRight/4.5b
User-agent: GetRight/4.5b1
User-agent: GetRight/4.5b2
User-agent: GetRight/4.5b3
User-agent: GetRight/4.5b6
User-agent: GetRight/4.5b7
User-agent: GetRight/4.5c
User-agent: GetRight/4.5d
User-agent: GetRight/4.5e
User-agent: GetRight/5.0beta1
User-agent: GetRight/5.0beta2
User-agent: GetUrl
User-agent: GetWeb!
User-agent: Gigabot
User-agent: gigabot
User-agent: Gigabot/3.0
User-agent: Go-Ahead-Got-It
User-agent: Go-http-client
User-agent: Go!Zilla
User-agent: Go!Zilla (www.gozilla.com)
User-agent: Go!Zilla 3.3 (www.gozilla.com)
User-agent: Go!Zilla 3.5 (www.gozilla.com)
User-agent: GrabNet
User-agent: Grafula
User-agent: grub
User-agent: gsa-crawler
User-agent: Hackertarget.com
User-agent: Harvest
User-agent: Harvest/1.5
User-agent: Hatena Antenna
User-agent: HavIndex
User-agent: heritrix
User-agent: hloader
User-agent: HMView
User-agent: HooWWWer
User-agent: http://www.SearchEngineWorld.com bot
User-agent: http://www.WebmasterWorld.com bot
User-agent: Httpful/0.2.20
User-agent: httplib
User-agent: httrack
User-agent: HTTrack [NC,OR]
User-agent: HTTrack 3.0
User-agent: HTTrack 3.0x
User-agent: humanlinks
User-agent: ia_archiver
User-agent: ia_archiver/1.6
User-agent: ichiro
User-agent: IconSurf
User-agent: Igentia
User-agent: Image Collector
User-agent: Image Stripper
User-agent: Image Sucker
User-agent: Indy Library
User-agent: InfoNaviRobot
User-agent: InfoSpiders
User-agent: innosense
User-agent: InterGET
User-agent: Internet Explore
User-agent: Internet Ninja
User-agent: Internet Ninja 4.0
User-agent: Internet Ninja 5.0
User-agent: Internet Ninja 6.0
User-agent: InternetSupervision
User-agent: Ipselonbot
User-agent: IRLbot
User-agent: Iron
User-agent: Iron33/1.0.2
User-agent: Jakarta Commons
User-agent: JamesBOT
User-agent: Java
User-agent: Jeeves
User-agent: JennyBot
User-agent: Jetbot
User-agent: Jetbot/1.0
User-agent: JetCar
User-agent: JikeSpider
User-agent: JobCrawlerBot
User-agent: Jobo
User-agent: Jobrapido
User-agent: JOC Web Spider
User-agent: Jorgee
User-agent: Jyxobot
User-agent: K2spider
User-agent: kalooga
User-agent: KavamRingCrawler
User-agent: KDD Exploror
User-agent: Kenjin Spider
User-agent: Kenjin.Spider
User-agent: Keyword Density
User-agent: Keyword Density/0.9
User-agent: Keyword.Density
User-agent: Larbin
User-agent: larbin ([email protected])
User-agent: larbin [email protected]
User-agent: larbin_2.6.2 ([email protected])
User-agent: larbin_2.6.2 ([email protected])
User-agent: larbin_2.6.2 (listonATccDOTgatechDOTedu)
User-agent: larbin_2.6.2 ([email protected])
User-agent: larbin_2.6.2 [email protected]
User-agent: larbin_2.6.2 [email protected]
User-agent: larbin_2.6.2 [email protected]
User-agent: larbin_2.6.2 listonATccDOTgatechDOTedu
User-agent: larbin_2.6.2 [email protected]
User-agent: LBot
User-agent: LeechFTP
User-agent: LexiBot
User-agent: libWeb/clsHTTP
User-agent: libwww-perl
User-agent: LightningDownload
User-agent: Linguee
User-agent: LinkedIn
User-agent: LinkextractorPro
User-agent: Linknzbot
User-agent: Linknzbot 2004
User-agent: Linknzbot*
User-agent: LinkpadBot
User-agent: LinkScan
User-agent: LinkScan/8.1a Unix
User-agent: LinkScan/8.1a.Unix
User-agent: linksmanager
User-agent: LinksManager
User-agent: LinksManager.com_bot
User-agent: LinkWalker
User-agent: LjSEEK
User-agent: lmspider
User-agent: LNSpiderguy
User-agent: looksmart
User-agent: LWP
User-agent: lwp-trivial
User-agent: lwp-trivial/1.34
User-agent: LWP*
User-agent: magpie-crawler
User-agent: Mail Sweeper
User-agent: Marketwirebot
User-agent: Mass Downloader
User-agent: Mass Downloader/2.2
User-agent: Mata Hari
User-agent: Mata.Hari
User-agent: MegaIndex.ru
User-agent: MegaIndex.ru/2.0
User-agent: Megalodon
User-agent: MetagerBot
User-agent: MetaURI
User-agent: Microsoft URL Control
User-agent: Microsoft URL Control - 5.01.4511
User-agent: Microsoft URL Control - 6.00.8169
User-agent: Microsoft URL Control - 6.01.9782
User-agent: Microsoft URL Control – 5.01.4511
User-agent: Microsoft URL Control – 6.00.8169
User-agent: Microsoft URL Control*
User-agent: Microsoft.URL
User-agent: MIDown tool
User-agent: MIIxpc
User-agent: MIIxpc/4.2
User-agent: minibot(NaverRobot)/1.0
User-agent: Missigua Locator
User-agent: Mister PiX
User-agent: Mister Pix II 2.01
User-agent: Mister Pix II 2.02a
User-agent: Mister PiX version.dll
User-agent: Mister.PiX
User-agent: MLBot
User-agent: moget
User-agent: moget/2.1
User-agent: mozilla
User-agent: Mozilla
User-agent: Mozilla/2.0 (compatible; Ask Jeeves)
User-agent: mozilla/3
User-agent: mozilla/4
User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 2000)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 98)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows ME)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT)
User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows XP)
User-agent: mozilla/5
User-agent: Mozilla/5.0 (compatible; Jobrapido/1.1; +http://www.jobrapido.com)
User-agent: Mozilla/5.0 (JobRapido WebPump)
User-agent: MRSPUTNIK
User-agent: MS Search 4.0 Robot
User-agent: MS Search 5.0 Robot
User-agent: MSRBOT
User-agent: munky
User-agent: MyFamilyBot
User-agent: naver
User-agent: Naverbot
User-agent: NaverBot
User-agent: NaverBot-1.0
User-agent: Navroad
User-agent: NearSite
User-agent: NerdyBot
User-agent: Net Vampire
User-agent: Net Vampire/3.0
User-agent: NetAnts
User-agent: NetAnts/1.10
User-agent: NetAnts/1.23
User-agent: NetAnts/1.24
User-agent: NetAnts/1.25
User-agent: NetAttache
User-agent: NetAttache Light 1.1
User-agent: Netcraft Web Server Survey
User-agent: NetMechanic
User-agent: NetResearchServer
User-agent: NetSpider
User-agent: NetZIP
User-agent: NetZip Downloader 1.0 Win32(Nov 12 1998)
User-agent: NetZip-Downloader
User-agent: NetZip-Downloader/1.0.62 (Win32; Dec 7 1998)
User-agent: NetZippy+(http://www.innerprise.net/usp-spider.asp)
User-agent: NetZippy+(http:/www.innerprise.net/usp-spider.asp)
User-agent: NextGenSearchBot
User-agent: NICErsPRO
User-agent: NimbleCrawler
User-agent: NING/1.0
User-agent: noxtrumbot
User-agent: NPbot
User-agent: NPBot/3
User-agent: Nutch
User-agent: Nutch*
User-agent: NutchCVS
User-agent: NutchCVS/0.06-dev
User-agent: NutchCVS/0.7.1
User-agent: NutchOrg
User-agent: Nutraspace
User-agent: oBot
User-agent: Ocelli
User-agent: Octopus
User-agent: OffByOne
User-agent: Offline Explorer/1.2
User-agent: Offline Explorer/1.4
User-agent: Offline Explorer/1.6
User-agent: Offline Explorer/1.7
User-agent: Offline Explorer/1.9
User-agent: Offline Explorer/2.0
User-agent: Offline Explorer/2.1
User-agent: Offline Explorer/2.3
User-agent: Offline Explorer/2.4
User-agent: Offline Explorer/2.5
User-agent: Offline Navigator
User-agent: Offline.Explorer
User-agent: OmniExplorer_Bot
User-agent: oneriot
User-agent: OpenAI
User-agent: Openbot
User-agent: Openfind
User-agent: Openfind data gathere
User-agent: Openfind data gatherer
User-agent: OpenindexSpider
User-agent: OpenIntelligenceData
User-agent: Oracle Ultra Search
User-agent: OutfoxBot/0.5
User-agent: Owlin Bot
User-agent: PageGrabber
User-agent: Papa Foto
User-agent: pavuk
User-agent: PBWF
User-agent: pcBrowser
User-agent: penthesilea
User-agent: PerMan
User-agent: PetalBot
User-agent: PGBot
User-agent: PhpDig
User-agent: Pingdom GIGRIB (http://www.pingdom.com)
User-agent: Pingdom.com_bot
User-agent: pompos
User-agent: postrank
User-agent: Powermarks
User-agent: ProPowerBot
User-agent: ProPowerBot/2.14
User-agent: ProWebWalker
User-agent: psbot
User-agent: psycheclone
User-agent: Psycheclone
User-agent: python-requests
User-agent: Python-urllib
User-agent: QuepasaCreep
User-agent: QuepasaCreep 
User-agent: QueryN Metasearch
User-agent: QueryN.Metasearch
User-agent: R6_CommentReader
User-agent: R6_FeedFetcher
User-agent: Radian6
User-agent: radian6 comment reader
User-agent: radian6 Feedfetcher
User-agent: Radiation Retriever
User-agent: Radiation Retriever 1.1
User-agent: RB2B-bot
User-agent: RealDownload
User-agent: RealDownload/4.0.0.40
User-agent: RealDownload/4.0.0.41
User-agent: RealDownload/4.0.0.42
User-agent: ReGet
User-agent: RepoMonkey
User-agent: RepoMonkey Bait & Tackle/v1.01
User-agent: RepoMonkey Bait &amp; Tackle
User-agent: RepoMonkey Bait &amp; Tackle/v1.01
User-agent: RepoMonkey Bait &amp;amp; Tackle/v1.01
User-agent: research-spider
User-agent: RMA
User-agent: Robozilla
User-agent: rogerbot
User-agent: Roverbot
User-agent: RufusBot
User-agent: sbider
User-agent: schibstedsokbot
User-agent: scooter
User-agent: Scooter_bh0-3.0.3
User-agent: Scooter_trk3-3.0.3
User-agent: Scooter-3.0.EU
User-agent: Scooter-3.0.FS
User-agent: Scooter-3.0.HD
User-agent: Scooter-3.0.VNS
User-agent: Scooter-3.0QI
User-agent: Scooter-3.2
User-agent: Scooter-3.2.BT
User-agent: Scooter-3.2.DIL
User-agent: Scooter-3.2.EX
User-agent: Scooter-3.2.JT
User-agent: Scooter-3.2.NIV
User-agent: Scooter-3.2.SF0
User-agent: Scooter-3.2.snippet
User-agent: Scooter-3.3dev
User-agent: Scooter-ARS-1.1
User-agent: Scooter-ARS-1.1-ih
User-agent: scooter-venus-3.0.vns
User-agent: Scooter-W3-1.0
User-agent: Scooter-W3.1.2
User-agent: Scooter/1.0
User-agent: Scooter/1.0 [email protected]
User-agent: Scooter/1.1 (custom)
User-agent: Scooter/2.0 G.R.A.B. V1.1.0
User-agent: Scooter/2.0 G.R.A.B. X2.0
User-agent: Scooter/3.3
User-agent: Scooter/3.3_SF
User-agent: Scooter/3.3.QA.pczukor
User-agent: Scooter/3.3.vscooter
User-agent: Scooter2_Mercator_x-x.0
User-agent: ScoutJet
User-agent: Screaming Frog SEO Spider
User-agent: Scrubby
User-agent: ScSpider
User-agent: SearchDaimon.com-dc
User-agent: SearchmetricsBot
User-agent: searchpreview
User-agent: seekbot
User-agent: Seekbot
User-agent: Seekbot/1.0
User-agent: semalt.com
User-agent: semanticdiscovery
User-agent: SEMrushBot
User-agent: SemrushBot
User-agent: SemrushBot-SA
User-agent: SEOkicks-Robot
User-agent: SEOprofiler
User-agent: SeznamBot
User-agent: Shai&#39;Hulud
User-agent: Shim-Crawler
User-agent: ShopWiki
User-agent: ShopWiki/1.0
User-agent: SightupBot
User-agent: silk
User-agent: sistrix
User-agent: SISTRIX Crawler
User-agent: SiteBot
User-agent: SiteSucker
User-agent: Slurp
User-agent: Slurp China
User-agent: SlySearch
User-agent: SmartDownload
User-agent: SmartDownload/1.2.76 (Win32; Apr 1 1999)
User-agent: SmartDownload/1.2.77 (Win32; Aug 17 1999)
User-agent: SmartDownload/1.2.77 (Win32; Feb 1 2000)
User-agent: SmartDownload/1.2.77 (Win32; Jun 19 2001)
User-agent: Snapbot
User-agent: Snappy
User-agent: SocialShare/1.0
User-agent: Softlayer Server
User-agent: Sogou web spider
User-agent: sootle
User-agent: sosospider
User-agent: SpankBot
User-agent: spanner
User-agent: spbot
User-agent: Speedy
User-agent: Speedy Spider
User-agent: SpiderBot
User-agent: Spiderbot/Nutch-1.7
User-agent: Sproose
User-agent: Sqworm
User-agent: Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux
User-agent: ssearcher100
User-agent: Stanford
User-agent: Stanford Comp Sci
User-agent: Stanford CompClub
User-agent: Stanford CompSciClub
User-agent: Stanford Spiderboys
User-agent: Steeler
User-agent: suggybot
User-agent: SuperBot
User-agent: SuperBot/2.6
User-agent: SuperBot/3.0 (Win32)
User-agent: SuperBot/3.1 (Win32)
User-agent: SuperHTTP
User-agent: SuperHTTP/1.0
User-agent: Surfbot
User-agent: SurveyBot
User-agent: SurveyBot_IgnoreIP
User-agent: suzuran
User-agent: Szukacz
User-agent: Szukacz/1.4
User-agent: tAkeOut
User-agent: Tarantula
User-agent: Teleport Pro
User-agent: Teleport Pro/1.29
User-agent: Teleport Pro/1.29.1590
User-agent: Teleport Pro/1.29.1634
User-agent: Teleport Pro/1.29.1718
User-agent: Teleport Pro/1.29.1820
User-agent: Teleport Pro/1.29.1847
User-agent: Telesoft
User-agent: Templeton
User-agent: Teoma
User-agent: The Intraformant
User-agent: The.Intraformant
User-agent: TheNomad
User-agent: Theophrastus
User-agent: TightTwatBot
User-agent: Titan
User-agent: toCrawl
User-agent: toCrawl/UrlDispatcher
User-agent: TosCrawler
User-agent: trendictionbot
User-agent: TridentSpider
User-agent: trovitBot
User-agent: True_Robot
User-agent: True_Robot/1.0
User-agent: turingos
User-agent: TurnitinBot
User-agent: TurnitinBot/1.5
User-agent: Tweetmeme
User-agent: TwengaBot
User-agent: Twiceler
User-agent: twiceler
User-agent: Typhoeus
User-agent: Ultraseek
User-agent: URL Control
User-agent: URL_Spider_Pro
User-agent: UrlDispatcher
User-agent: UrlPouls
User-agent: URLy Warning
User-agent: URLy.Warning
User-agent: Vagabondo
User-agent: VCI
User-agent: VCI WebViewer VCI WebViewer Win32
User-agent: Verticrawlbot
User-agent: vobsub
User-agent: VoidEYE
User-agent: VoilaBot
User-agent: voyager
User-agent: voyager/1.0
User-agent: vscooter
User-agent: w3mir
User-agent: WatchDog/3.0
User-agent: Web Image Collector
User-agent: Web Reaper
User-agent: Web Sucker
User-agent: Web.Image.Collector
User-agent: WebAuto
User-agent: WebAuto/3.40 (Win98; I)
User-agent: WebBandit
User-agent: WebBandit/3.50
User-agent: WebCapture
User-agent: WebCapture 2.0
User-agent: WebCatcher
User-agent: webcopier
User-agent: WebCopier v.2.2
User-agent: WebCopier v2.5
User-agent: WebCopier v2.6
User-agent: WebCopier v2.7a
User-agent: WebCopier v2.8
User-agent: WebCopier v3.0
User-agent: WebCopier v3.0.1
User-agent: WebCopier v3.2
User-agent: WebCopier v3.2a
User-agent: WebCopy
User-agent: webcopy
User-agent: webcrawl.net
User-agent: WebEmailExtrac
User-agent: WebEMailExtrac.*
User-agent: WebEnhancer
User-agent: WebFetch
User-agent: webfetch/2.1.0
User-agent: WebFetcher
User-agent: WebGo IS
User-agent: WebIndexer
User-agent: WebLeacher
User-agent: WebmasterWorld Extractor
User-agent: WebmasterWorldForumBot
User-agent: webmirror
User-agent: WebMirror
User-agent: WebReaper [[email protected]]
User-agent: WebReaper [[email protected]]
User-agent: WebReaper v9.1 - www.otway.com/webreaper
User-agent: WebReaper v9.7 - www.webreaper.net
User-agent: WebReaper v9.8 - www.webreaper.net
User-agent: WebReaper vWebReaper v7.3 - www,otway.com/webreaper
User-agent: WebSauger
User-agent: WebSauger 1.20b
User-agent: WebSauger 1.20j
User-agent: WebSauger 1.20k
User-agent: website extractor
User-agent: Website eXtractor (http:/www.asona.org)
User-agent: Website Quester
User-agent: Website Quester - www.asona.org
User-agent: Website Quester - www.esalesbiz.com/extra/
User-agent: Website.Quester
User-agent: Webster Pro
User-agent: Webster.Pro
User-agent: WebStripper/2.02
User-agent: WebStripper/2.03
User-agent: WebStripper/2.10
User-agent: WebStripper/2.12
User-agent: WebStripper/2.13
User-agent: WebStripper/2.15
User-agent: WebStripper/2.16
User-agent: WebStripper/2.19
User-agent: webvac
User-agent: WebVac
User-agent: WebVulnCrawl
User-agent: WebVulnScan
User-agent: WebWalk
User-agent: WebWasher
User-agent: WebWhacker
User-agent: WebZip
User-agent: WebZIP/2.75 (http:/www.spidersoft.com)
User-agent: WebZIP/3.65 (http://www.spidersoft.com)
User-agent: WebZIP/3.80 (http://www.spidersoft.com)
User-agent: WebZip/4.0
User-agent: WebZIP/4.0 (http://www.spidersoft.com)
User-agent: WebZIP/4.1 (http:/www.spidersoft.com)
User-agent: WebZIP/4.21
User-agent: WebZIP/4.21 (http:/www.spidersoft.com)
User-agent: WebZIP/5.0
User-agent: WebZIP/5.0 (http:/www.spidersoft.com)
User-agent: WebZIP/5.0 PR1 (http://www.spidersoft.com)
User-agent: wGet
User-agent: Wget
User-agent: Wget/1.10.2
User-agent: Wget/1.5.2
User-agent: Wget/1.5.3
User-agent: Wget/1.6
User-agent: Wget/1.8
User-agent: Wget/1.8.1
User-agent: Wget/1.8.2
User-agent: Wget/1.9-beta
User-agent: whitevector crawler
User-agent: Whitevector+Crawler
User-agent: Widow
User-agent: WijuBot
User-agent: WijuBot/1.0
User-agent: WikioFeedBot
User-agent: wikiwix-bot-3.0
User-agent: Willow
User-agent: WinHTTrack
User-agent: Wise-Guys
User-agent: wise-guys
User-agent: woozweb-monitoring
User-agent: woriobot
User-agent: WWW-Collector-E
User-agent: WWW-Mechanize
User-agent: WWWOFFLE
User-agent: Xaldon WebSpider
User-agent: Xaldon WebSpider 2.5.b3
User-agent: Xenu Link Sleuth
User-agent: Xenu Link Sleuth/1.3.8
User-agent: Xenu's
User-agent: Xenu's Link Sleuth 1.1c
User-agent: Xenu&#39;s
User-agent: Xenu&#39;s Link Sleuth 1.1c
User-agent: xGet
User-agent: xirq
User-agent: yacy
User-agent: yandex
User-agent: YandexBot
User-agent: YandexCatalog
User-agent: YandexDirect
User-agent: YandexFavicons
User-agent: YandexImages
User-agent: Yeti
User-agent: YodaoBot
User-agent: YoudaoBot
User-agent: YRSPider
User-agent: ZeBot
User-agent: ZeBot_www.ze.bz
User-agent: Zeus
User-agent: Zeus 11389 Webster Pro V2.9 Win32
User-agent: Zeus 11652 Webster Pro V2.9 Win32
User-agent: Zeus 18018 Webster Pro V2.9 Win32
User-agent: Zeus 26378 Webster Pro V2.9 Win32
User-agent: Zeus 30747 Webster Pro V2.9 Win32
User-agent: Zeus 32297 Webster Pro V2.9 Win32
User-agent: Zeus 39206 Webster Pro V2.9 Win32
User-agent: Zeus 41641 Webster Pro V2.9 Win32
User-agent: Zeus 44238 Webster Pro V2.9 Win32
User-agent: Zeus 51070 Webster Pro V2.9 Win32
User-agent: Zeus 51674 Webster Pro V2.9 Win32
User-agent: Zeus 51837 Webster Pro V2.9 Win32
User-agent: Zeus 63567 Webster Pro V2.9 Win32
User-agent: Zeus 6694 Webster Pro V2.9 Win32
User-agent: Zeus 71129 Webster Pro V2.9 Win32
User-agent: Zeus 82016 Webster Pro V2.9 Win32
User-agent: Zeus 82900 Webster Pro V2.9 Win32
User-agent: Zeus 84842 Webster Pro V2.9 Win32
User-agent: Zeus 90872 Webster Pro V2.9 Win32
User-agent: Zeus 94934 Webster Pro V2.9 Win32
User-agent: Zeus 95245 Webster Pro V2.9 Win32
User-agent: Zeus 95351 Webster Pro V2.9 Win32
User-agent: Zeus 97371 Webster Pro V2.9 Win32
User-agent: Zeus Link Scout
User-agent: Zookabot
User-agent: ZyBorg
Disallow: /

# Si has llegado hasta aquí es que eres un buen bot así que toma y lee:

User-agent: *
Allow: /feed/$
Allow: /wp-content/uploads/
Allow: */wp-content/uploads/
Allow: /wp-content/*.js
Allow: /wp-content/*.css
Allow: /wp-includes/*.js
Allow: /wp-includes/*.css
Allow: /*.js$
Allow: /*.css$

# Pero no todo:
Disallow: /cgi-bin
Disallow: /wp-content/plugins/   
Disallow: /wp-content/themes/   
Disallow: /wp-includes/   
Disallow: /wp-admin/
Disallow: /wp-login
Disallow: /readme.html
Disallow: /refer/
Disallow: /archives/
# Ninguna carpeta que empiece por wp-:
Disallow: /wp-*
Disallow: /wp-*.php
# Nada de esto no te interesa:
Disallow: /trackback
Disallow: /*trackback
Disallow: /*trackback*
Disallow: /*/trackback
Disallow: */trackback/
Disallow: /author/
Disallow: /page/
Disallow: /*/page/*
Disallow: /*/*/page/*
Disallow: /*/*/*/page/*
Disallow: /*/*/*/*/page/*
Disallow: /tag/*/page/
Disallow: /tag/*/feed/
Disallow: /comments/
Disallow: /comments/feed/
Disallow: /xmlrpc.php
# Nada de contenido dinámico:
Disallow: /*?
# Nada de búsquedas:
Disallow: /*?s=
Disallow: /?s=   
Disallow: /search
Disallow: /busqueda
# Ningún adjunto:
Disallow: /*/attachment/
Disallow: /?attachment_id*
# Nada de feed:
Disallow: /feed   
Disallow: /comments/feed   
Disallow: /*/feed/
Disallow: /*/feed/$   
Disallow: /*/feed/rss/$   
Disallow: /*/trackback/$   
Disallow: /*/*/feed/$   
Disallow: /*/*/feed/rss/$   
Disallow: /*/*/trackback/$   
Disallow: /*/*/*/feed/$   
Disallow: /*/*/*/feed/rss/$   
Disallow: /*/*/*/trackback/$
Disallow: /*/*/*/feed.xml
# Ni carpetas que no te interesan:
Disallow: /tmp/
Disallow: /imagenes/

# Limitamos las consultas excesivas de Yahoo!, Noxtrum y el bot de MSN:

User-agent: noxtrumbot
Crawl-delay: 50

User-agent: msnbot
Crawl-delay: 30

User-agent: Slurp
Crawl-delay: 10

# Estos bots deben de entrar hasta la cocina:

User-agent: Twitterbot
Allow: /wp-content/uploads/

User-agent: Googlebot-Image
Allow: /wp-content/uploads/

User-agent: Adsbot-Google
Allow: /

User-agent: Googlebot-Mobile
Allow: /

# Y aqui­ tienes nuestros sitemaps:

Sitemap: https://www.twelvebeauty.com/sitemap_index.xml
Sitemap: https://www.twelvebeauty.es/sitemap_index.xml
Sitemap: https://www.twelvebeauty.it/sitemap_index.xml

# ¡Y eso es todo amigo!

Similar sites

Search preview

www.twelvebeauty.es
TWELVE BEAUTY | Green Beauty Reinvented Reward For Radiant Skin
Twelve Beauty es una recompensa revolucionaria para una piel radiante. Sólo usamos los ingredientes más puros en nuestras fórmulas para mantener la piel más sana por más tiempo.

Most important keywords

Following keywords were found. You can check the keyword optimization of this page for each keyword.

KeywordResultRecheck
Twelve79%Check
Beauty79%Check
Twelve Beauty79%Check
Green Beauty66%Check
Beauty Reinvented66%Check
Green Beauty Reinvented61%Check
Green Beauty Reinvented Reward57%Check
Reinvented50%Check
Radiant Skin49%Check
Skin47%Check
Show more keywords and terms

Test up to 1.000 webpages of twelvebeauty.es with our free plan!

Try For Free
No trial. It's just free!

Cookie Policy

We use cookies to make our site work and also for analytics and advertising purposes. You can enable or disable optional cookies as desired. See the following links for more information.

Contact | Privacy

We need these so the site can function properly

So we can better understand how visitors use our website

So we can serve you tailored ads and promotions