User-agent: * Disallow: /impressum.php Disallow: /agb.php Disallow: /dev/ # Meta / Facebook / Instagram User-agent: meta-externalagent Disallow: / User-agent: FacebookExternalHit Disallow: / User-agent: Facebot Disallow: / User-agent: instagram Disallow: / # Yandex User-agent: Yandex Disallow: / User-agent: YandexBot Disallow: / User-agent: YandexImages Disallow: / User-agent: YandexAccessibilityBot Disallow: / User-agent: YandexMobileBot Disallow: / User-agent: YandexMetrika Disallow: / # China (Baidu) User-agent: Baiduspider Disallow: / # SEO-Crawler & Analyse-Bots User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-CT Disallow: / User-agent: SemrushBot-BM Disallow: / User-agent: SplitSignalBot Disallow: / # Daten- und Preisvergleichs-Bots User-agent: DataForSeoBot Disallow: / User-agent: Amazonbot Disallow: / # ----------------------------------------- # Alle anderen dürfen crawlen # ----------------------------------------- User-agent: * Allow: /