Esta página no es accesible para el bot de Seobility porque está excluido en el archivo Robots.txt. El bot de Seobility no rastrea nada que excluya a Seobility o *.
URL problemática: http://djmag.com
# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html User-agent: Bad-Robot Disallow: * User-agent: GPTBot Disallow: / User-agent: PiplBot Disallow: / User-agent: CCbot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: trendictionbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: PetalBot Disallow: / User-agent: viberbot Disallow: / User-agent: YaK Disallow: / User-agent: Yandex Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-Agent: FacebookBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SplitSignalBot Disallow: / User-agent: SemrushBot-OCOB Disallow: / User-Agent: PerplexityBot Disallow: / User-agent: Mail.Ru Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: Mediatoolkitbot Disallow: / User-agent: MojeekBot Disallow: / User-agent: Majestic Disallow: / User-agent: PetalBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Seekr Disallow: / User-agent: SeznamBot Disallow: / User-agent: keys-so-bot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: SummalyBot Disallow: / User-agent: Applebot-Extended Disallow: / User-Agent: ZoomBot Disallow: / User-agent: dotbot Disallow: / User-agent: Gabanzabot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: YandexBot Disallow: / User-agent: YandexUserproxy Disallow: / User-agent: PubMatic Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: coccocbot-web Disallow: / #scraper User-agent: SummalyBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/bytespider User-agent: Bytespider Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/ccbot User-agent: CCBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/claudebot User-agent: ClaudeBot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/diffbot User-agent: Diffbot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/meta-externalagent User-agent: Meta-ExternalAgent Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/omgili User-agent: omgili Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/timpibot User-agent: Timpibot Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/claude-web User-agent: Claude-Web Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/cohere-ai User-agent: cohere-ai Disallow: / User-agent: Siphon Disallow:/ User-agent: Site Sucker Disallow:/ User-agent: SiteCheckerBotCrawler Disallow:/ User-agent: SiteExplorer Disallow:/ User-agent: SiteLockSpider Disallow:/ User-agent: SiteSnagger Disallow:/ User-agent: SiteSucker Disallow:/ User-agent: Sitebeam Disallow:/ User-agent: Siteimprove Disallow:/ User-agent: Sitevigil Disallow:/ User-agent: SlySearch Disallow:/ User-agent: SmartDownload Disallow:/ User-agent: Snake Disallow:/ User-agent: Snapbot Disallow:/ User-agent: Snoopy Disallow:/ User-agent: SocialRankIOBot Disallow:/ User-agent: Sociscraper Disallow:/ User-agent: Sogou web spider Disallow:/ User-agent: Sosospider Disallow:/ User-agent: Sottopop Disallow:/ User-agent: SpaceBison Disallow:/ User-agent: Spammen Disallow:/ User-agent: SpankBot Disallow:/ User-agent: Spanner Disallow:/ User-agent: Spbot Disallow:/ User-agent: Spider_Bot Disallow:/ User-agent: Spider_Bot/3.0 Disallow:/ User-agent: Spinn3r Disallow:/ User-agent: SputnikBot Disallow:/ User-agent: Sqlmap Disallow:/ User-agent: Sqlworm Disallow:/ User-agent: Sqworm Disallow:/ User-agent: Steeler Disallow:/ User-agent: Stripper Disallow:/ User-agent: Sucker Disallow:/ User-agent: Sucuri Disallow:/ User-agent: SuperBot Disallow:/ User-agent: SuperHTTP Disallow:/ User-agent: Surfbot Disallow:/ User-agent: SurveyBot Disallow:/ User-agent: Suzuran Disallow:/ User-agent: Swiftbot Disallow:/ User-agent: Szukacz Disallow:/ User-agent: T0PHackTeam Disallow:/ User-agent: T8Abot Disallow:/ User-agent: Teleport Disallow:/ User-agent: TeleportPro Disallow:/ User-agent: Telesoft Disallow:/ User-agent: Telesphoreo Disallow:/ User-agent: Telesphorep Disallow:/ User-agent: The Intraformant Disallow:/ User-agent: TheNomad Disallow:/ User-agent: Thumbor Disallow:/ User-agent: TightTwatBot Disallow:/ User-agent: TinyTestBot Disallow:/ User-agent: Titan Disallow:/ User-agent: Toata Disallow:/ User-agent: Toweyabot Disallow:/ User-agent: Tracemyfile Disallow:/ User-agent: Trendiction Disallow:/ User-agent: Trendictionbot Disallow:/ User-agent: True_Robot Disallow:/ User-agent: Turingos Disallow:/ User-agent: Turnitin Disallow:/ User-agent: TurnitinBot Disallow:/ User-agent: TwengaBot Disallow:/ User-agent: Twice Disallow:/ User-agent: Typhoeus Disallow:/ User-agent: URLy Warning Disallow:/ User-agent: URLy.Warning Disallow:/ User-agent: UnisterBot Disallow:/ User-agent: Upflow Disallow:/ User-agent: V-BOT Disallow:/ User-agent: VB Project Disallow:/ User-agent: VCI Disallow:/ User-agent: Vacuum Disallow:/ User-agent: Vagabondo Disallow:/ User-agent: VelenPublicWebCrawler Disallow:/ User-agent: VeriCiteCrawler Disallow:/ User-agent: VidibleScraper Disallow:/ User-agent: Virusdie Disallow:/ User-agent: VoidEYE Disallow:/ User-agent: Voil Disallow:/ User-agent: Voltron Disallow:/ User-agent: WASALive-Bot Disallow:/ User-agent: WBSearchBot Disallow:/ User-agent: WEBDAV Disallow:/ User-agent: WISENutbot Disallow:/ User-agent: WPScan Disallow:/ User-agent: WWW-Collector-E Disallow:/ User-agent: WWW-Mechanize Disallow:/ User-agent: WWW::Mechanize Disallow:/ User-agent: WWWOFFLE Disallow:/ User-agent: Wallpapers Disallow:/ User-agent: Wallpapers/3.0 Disallow:/ User-agent: WallpapersHD Disallow:/ User-agent: WeSEE Disallow:/ User-agent: Web Auto Disallow:/ User-agent: Web Collage Disallow:/ User-agent: Web Enhancer Disallow:/ User-agent: Web Fetch Disallow:/ User-agent: Web Fuck Disallow:/ User-agent: Web Pix Disallow:/ User-agent: Web Sauger Disallow:/ User-agent: Web Sucker Disallow:/ User-agent: WebAuto Disallow:/ User-agent: WebBandit Disallow:/ User-agent: WebCollage Disallow:/ User-agent: WebCopier Disallow:/ User-agent: WebEnhancer Disallow:/ User-agent: WebFetch Disallow:/ User-agent: WebFuck Disallow:/ User-agent: WebGo IS Disallow:/ User-agent: WebImageCollector Disallow:/ User-agent: WebLeacher Disallow:/ User-agent: WebPix Disallow:/ User-agent: WebReaper Disallow:/ User-agent: WebSauger Disallow:/ User-agent: WebStripper Disallow:/ User-agent: WebSucker Disallow:/ User-agent: WebWhacker Disallow:/ User-agent: WebZIP Disallow:/ User-agent: Webalta Disallow:/ User-agent: WebmasterWorldForumBot Disallow:/ User-agent: Webshag Disallow:/ User-agent: Website Quester Disallow:/ User-agent: WebsiteExtractor Disallow:/ User-agent: WebsiteQuester Disallow:/ User-agent: Webster Disallow:/ User-agent: Whack Disallow:/ User-agent: Whacker Disallow:/ User-agent: Whatweb Disallow:/ User-agent: Who.is Bot Disallow:/ User-agent: Widow Disallow:/ User-agent: WinHTTrack Disallow:/ User-agent: WiseGuys Robot Disallow:/ User-agent: Wonderbot Disallow:/ User-agent: Woobot Disallow:/ User-agent: Wotbox Disallow:/ User-agent: Wprecon Disallow:/ User-agent: Xaldon WebSpider Disallow:/ User-agent: Xaldon_WebSpider Disallow:/ User-agent: Xenu Disallow:/ User-agent: YaK Disallow:/ User-agent: YoudaoBot Disallow:/ User-agent: Zade Disallow:/ User-agent: Zauba Disallow:/ User-agent: Zermelo Disallow:/ User-agent: Zeus Disallow:/ User-agent: Zitebot Disallow:/ User-agent: ZmEu Disallow:/ User-agent: ZoomBot Disallow:/ User-agent: ZoominfoBot Disallow:/ User-agent: ZumBot Disallow:/ User-agent: ZyBorg Disallow:/ User-agent: adscanner Disallow:/ User-agent: anthropic-ai Disallow:/ User-agent: archive.org_bot Disallow:/ User-agent: arquivo-web-crawler Disallow:/ User-agent: arquivo.pt Disallow:/ User-agent: autoemailspider Disallow:/ User-agent: awario.com Disallow:/ User-agent: backlink-check Disallow:/ User-agent: cah.io.community Disallow:/ User-agent: check1.exe Disallow:/ User-agent: clark-crawler Disallow:/ User-agent: coccocbot Disallow:/ User-agent: cognitiveseo Disallow:/ User-agent: cohere-ai Disallow:/ User-agent: com.plumanalytics Disallow:/ User-agent: crawl.sogou.com Disallow:/ User-agent: crawler.feedback Disallow:/ User-agent: crawler4j Disallow:/ User-agent: dataforseo.com Disallow:/ User-agent: dataforseobot Disallow:/ User-agent: demandbase-bot Disallow:/ User-agent: domainsproject.org Disallow:/ User-agent: eCatch Disallow:/ User-agent: evc-batch Disallow:/ User-agent: facebookscraper Disallow:/ User-agent: gopher Disallow:/ User-agent: heritrix Disallow:/ User-agent: imagesift.com Disallow:/ User-agent: instabid Disallow:/ User-agent: internetVista monitor Disallow:/ User-agent: ips-agent Disallow:/ User-agent: isitwp.com Disallow:/ User-agent: iubenda-radar Disallow:/ User-agent: linkdexbot Disallow:/ User-agent: linkfluence Disallow:/ User-agent: lwp-request Disallow:/ User-agent: lwp-trivial Disallow:/ User-agent: magpie-crawler Disallow:/ User-agent: meanpathbot Disallow:/ User-agent: mediawords Disallow:/ User-agent: muhstik-scan Disallow:/ User-agent: netEstate NE Crawler Disallow:/ User-agent: oBot Disallow:/ User-agent: omgili Disallow:/ User-agent: openai Disallow:/ User-agent: openai.com Disallow:/ User-agent: page scorer Disallow:/ User-agent: pcBrowser Disallow:/ User-agent: plumanalytics Disallow:/ User-agent: polaris version Disallow:/ User-agent: probe-image-size Disallow:/ User-agent: ripz Disallow:/ User-agent: s1z.ru Disallow:/ User-agent: satoristudio.net Disallow:/ User-agent: scalaj-http Disallow:/ User-agent: scan.lol Disallow:/ User-agent: seobility Disallow:/ User-agent: seocompany.store Disallow:/ User-agent: seoscanners Disallow:/ User-agent: seostar Disallow:/ User-agent: serpstatbot Disallow:/ User-agent: sexsearcher Disallow:/ User-agent: sitechecker.pro Disallow:/ User-agent: siteripz Disallow:/ User-agent: sogouspider Disallow:/ User-agent: sp_auditbot Disallow:/ User-agent: spyfu Disallow:/ User-agent: sysscan Disallow:/ User-agent: tAkeOut Disallow:/ User-agent: trendiction.com Disallow:/ User-agent: trendiction.de Disallow:/ User-agent: ubermetrics-technologies.com Disallow:/ User-agent: voyagerx.com Disallow:/ User-agent: webgains-bot Disallow:/ User-agent: webmeup-crawler Disallow:/ User-agent: webpros.com Disallow:/ User-agent: webprosbot Disallow:/ User-agent: x09Mozilla Disallow:/ User-agent: x22Mozilla Disallow:/ User-agent: xpymep1.exe Disallow:/ User-agent: zauba.io Disallow:/ User-agent: zgrab Disallow:/ User-agent: Googlebot-Image Disallow: /path/to/visitor/jpg/files/*.jpg$ Disallow: /path/to/visitor/gif/files/*.gif$ Disallow: /path/to/visitor/png/files/*.png$ User-agent: * Crawl-delay: 8 # CSS, JS, Images Allow: /core/*.css$ Allow: /core/*.css? Allow: /core/*.js$ Allow: /core/*.js? Allow: /core/*.gif Allow: /core/*.jpg Allow: /core/*.jpeg Allow: /core/*.png Allow: /core/*.svg Allow: /profiles/*.css$ Allow: /profiles/*.css? Allow: /profiles/*.js$ Allow: /profiles/*.js? Allow: /profiles/*.gif Allow: /profiles/*.jpg Allow: /profiles/*.jpeg Allow: /profiles/*.png Allow: /profiles/*.svg # Directories Disallow: /core/ Disallow: /profiles/ # Files Disallow: /README.txt Disallow: /web.config # Paths (clean URLs) Disallow: /admin/ Disallow: /comment/reply/ Disallow: /filter/tips Disallow: /node/add/ Disallow: /search/ Disallow: /user/register Disallow: /user/password Disallow: /user/login Disallow: /user/logout Disallow: /media/oembed Disallow: /*/media/oembed # Paths (no clean URLs) Disallow: /index.php/admin/ Disallow: /index.php/comment/reply/ Disallow: /index.php/filter/tips Disallow: /index.php/node/add/ Disallow: /index.php/search/ Disallow: /index.php/user/password Disallow: /index.php/user/register Disallow: /index.php/user/login Disallow: /index.php/user/logout Disallow: /index.php/media/oembed Disallow: /index.php/*/media/oembed Disallow: /search Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /wp-admin/ User-agent: * Disallow: /*minmax= Disallow: /*bst= Disallow: /*of=