User-agent: * Disallow: /install_* Disallow: /core Disallow: /application # 禁止 SemrushBot (Semrush) User-agent: SemrushBot Disallow: / # 禁止 python (一般用于自定义爬虫) User-agent: python Disallow: / # 禁止 Linespider User-agent: Linespider Disallow: / # 禁止 crawler (一般用于自定义爬虫) User-agent: crawler Disallow: / # 禁止 DingTalkBot (阿里巴巴) User-agent: DingTalkBot Disallow: / # 禁止 simplecrawler (一般用于自定义爬虫) User-agent: simplecrawler Disallow: / # 禁止 ZoominfoBot (Zoominfo) User-agent: ZoominfoBot Disallow: / # 禁止 zoombot (Zoominfo) User-agent: zoombot Disallow: / # 禁止 Neevabot (Neeva) User-agent: Neevabot Disallow: / # 禁止 coccocbot (Cốc Cốc) User-agent: coccocbot Disallow: / # 禁止 Facebot (Facebook) User-agent: Facebot Disallow: / # 禁止 YandexBot (Yandex) User-agent: YandexBot Disallow: / # 禁止 Adsbot (Google Ads) User-agent: Adsbot Disallow: / # 禁止 DotBot (Moz/SEOmoz) User-agent: DotBot Disallow: / # 禁止 Applebot (Apple) User-agent: Applebot Disallow: / # 禁止 DataForSeoBot (DataForSEO) User-agent: DataForSeoBot Disallow: / # 禁止 MJ12bot (Majestic) User-agent: MJ12bot Disallow: / # 禁止 BLEXBot (BLEXBot) User-agent: BLEXBot Disallow: / # 禁止 trendictionbot0 (Trendiction) User-agent: trendictionbot0 Disallow: / # 禁止 trendictionbot (Trendiction) User-agent: trendictionbot Disallow: / # 禁止 AhrefsBot (Ahrefs) User-agent: AhrefsBot Disallow: / # 禁止 hubspot (HubSpot) User-agent: hubspot Disallow: / # 禁止 opensiteexplorer (Moz/SEOmoz) User-agent: opensiteexplorer Disallow: / # 禁止 leiki (Leiki) User-agent: leiki Disallow: / # 禁止 webmeup (WebMeUp) User-agent: webmeup Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)