User-agent: * Disallow: /admin/ Disallow: /Core/ Disallow: /tmp/ Disallow: /views/ Disallow: /Setup/ Disallow: /log/ # Disallow: /newsletter/ Disallow: /en/newsletter/ Disallow: /index.php?cl=newsletter # Disallow: /AGB/ Disallow: /en/Terms-and-Conditions/ # Disallow: /warenkorb/ Disallow: /en/cart/ Disallow: /index.php?cl=basket # Disallow: /mein-konto/ Disallow: /en/my-account/ Disallow: /index.php?cl=account # Disallow: /mein-merkzettel/ Disallow: /en/my-wishlist/ Disallow: /index.php?cl=account_noticelist # Disallow: /mein-wunschzettel/ Disallow: /en/my-gift-registry/ Disallow: /index.php?cl=account_wishlist # Disallow: /konto-eroeffnen/ Disallow: /en/open-account/ Disallow: /index.php?cl=register # Disallow: /passwort-vergessen/ Disallow: /en/forgot-password/ Disallow: /index.php?cl=forgotpwd # Disallow: /index.php?cl=moredetails # Disallow: /index.php?cl=review # Disallow: /index.php?cl=search # Disallow: /EXCEPTION_LOG.txt # # wildcards at the end, because of some crawlers see it as errors Disallow: /*?cl=newsletter Disallow: /*&cl=newsletter # Disallow: /*?cl=basket Disallow: /*&cl=basket # Disallow: /*?cl=account Disallow: /*&cl=account # Disallow: /*?cl=account_noticelist Disallow: /*&cl=account_noticelist # Disallow: /*?cl=account_wishlist Disallow: /*&cl=account_wishlist # Disallow: /*?cl=register Disallow: /*&cl=register # Disallow: /*?cl=forgotpwd Disallow: /*&cl=forgotpwd # Disallow: /*?cl=moredetails Disallow: /*&cl=moredetails # Disallow: /*?cl=review Disallow: /*&cl=review # Disallow: /*?cl=search Disallow: /*&cl=search # Disallow: /*&fnc=tobasket Disallow: /*&fnc=tocomparelist Disallow: /*&addcompare= # Disallow: /*/sid/ Disallow: /*?sid= Disallow: /*&sid= # Disallow: /*?cur= Disallow: /*&cur # Folgenden Bots ist das Spidern der gesamten Webseite verboten: User-agent: Barkrowler/0.9 User-agent: BLEXBot/1.0 User-agent: 008 User-agent: 80legs.com User-agent: Aqua_Products User-agent: Ahrefs.com User-agent: AhrefsBot User-agent: AhrefsBot/7.0 User-agent: BackDoorBot/1.0 User-agent: Baiduspider User-agent: BlowFish/1.0 User-agent: Bookmark search tool User-agent: BotALot User-agent: BuiltBotTough User-agent: BLEXBot User-agent: Bullseye/1.0 User-agent: BunnySlippers User-agent: CheeseBot User-agent: CherryPicker User-agent: CherryPickerElite/1.0 User-agent: CherryPickerSE/1.0 User-agent: CligooRobot User-agent: CopyRightCheck User-agent: Crescent User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 User-agent: DittoSpyder User-agent: EmailCollector User-agent: EmailSiphon User-agent: EmailWolf User-agent: EroCrawler User-agent: ExtractorPro User-agent: FairAd Client User-agent: Flaming AttackBot User-agent: Foobot User-agent: Gaisbot User-agent: GetRight/4.2 User-agent: Harvest/1.5 User-agent: InfoNaviRobot User-agent: Iron33/1.0.2 User-agent: JennyBot User-agent: Kenjin Spider User-agent: Keyword Density/0.9 User-agent: LNSpiderguy User-agent: LexiBot User-agent: LinkScan/8.1a Unix User-agent: LinkWalker User-agent: LinkextractorPro User-agent: MIIxpc User-agent: MIIxpc/4.2 User-agent: MJ12bot User-agent: MLBot User-agent: MSIECrawler User-agent: Mata Hari User-agent: Microsoft URL Control User-agent: Microsoft URL Control - 5.01.4511 User-agent: Microsoft URL Control - 6.00.8169 User-agent: Mister PiX User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) User-agent: NICErsPRO User-agent: NetAnts User-agent: NetMechanic User-agent: Offline Explorer User-agent: Openbot User-agent: Openfind User-agent: Openfind data gathere User-agent: Oracle Ultra Search User-agent: PerMan User-agent: Pixray User-agent: Pixray-Seeker User-agent: Pixray-Seeker/1.1 User-agent: Pixray-Seeker/1.1 (Pixray-Seeker; crawler@pixray.com) User-agent: ProPowerBot/2.14 User-agent: ProWebWalker User-agent: Python-urllib User-agent: QueryN Metasearch User-agent: RMA User-agent: PetalBot User-agent: Radiation Retriever 1.1 User-agent: RepoMonkey User-agent: RepoMonkey Bait & Tackle/v1.01 User-agent: SEOkicks-Robot User-agent: ScoutJet User-agent: Sistrix User-agent: SiteSnagger User-agent: SpankBot User-agent: Speedy User-agent: SurveyBot User-agent: Szukacz/1.4 User-agent: Tagoobot User-agent: Teleport User-agent: TeleportPro User-agent: Telesoft User-agent: The Intraformant User-agent: TheNomad User-agent: True_Robot User-agent: True_Robot/1.0 User-agent: URL Control User-agent: URL_Spider_Pro User-agent: URLy Warning User-agent: VCI User-agent: VCI WebViewer VCI WebViewer Win32 User-agent: WWW-Collector-E User-agent: Web Image Collector User-agent: WebAuto User-agent: WebBandit User-agent: WebBandit/3.50 User-agent: WebCopier User-agent: WebEnhancer User-agent: WebSauger User-agent: WebStripper User-agent: WebZip User-agent: WebZip/4.0 User-agent: WebmasterWorldForumBot User-agent: Website Quester User-agent: Webster Pro User-agent: Wget User-agent: Wget/1.5.3 User-agent: Wget/1.6 User-agent: Xenu's User-agent: Xenu's Link Sleuth 1.1c User-agent: Yandex User-agent: YoudaoBot User-agent: Zeus User-agent: Zeus 32297 Webster Pro V2.9 Win32 User-agent: Zeus Link Scout User-agent: asterias User-agent: b2w/0.1 User-agent: cosmos User-agent: dotbot User-agent: grub User-agent: grub-client User-agent: hloader User-agent: httplib User-agent: humanlinks User-agent: ia_archiver User-agent: ia_archiver/1.6 User-agent: kalooga User-agent: larbin User-agent: libWeb/clsHTTP User-agent: looksmart User-agent: lwp-trivial User-agent: lwp-trivial/1.34 User-agent: moget User-agent: moget/2.1 User-agent: netEstate NE Crawler User-agent: pixray User-agent: pixray-seeker User-agent: plukkie User-agent: psbot User-agent: searchpreview User-agent: sogou User-agent: spanner User-agent: suzuran User-agent: toCrawl/UrlDispatcher User-agent: turingos User-agent: twiceler Disallow: /
Shares / Likes / Kommentare |
---|
388 |
Es werden nur die Daten zu der angegebenen URL abgefragt und nicht zu einer eventuell vorhandenen und auf der Seite verlinkten Facebook Seite.
Folgende Keywords wurden erkannt. Überprüfe die Optimierung dieser Keywords für Deine Seite.
(Nice to have)