User-Agent: * Crawl-delay: 15 Disallow: /suchen? Disallow: /web/guest/ Disallow: /*/suchen? Disallow: /*/dai/ Disallow: /*/forschung/ Disallow: /*/karriere/ Disallow: /*/mitarbeiter-detailansicht/ Disallow: /*/projekt/ Disallow: /*/publikationen/ Disallow: /*/standort/ #Baiduspider User-agent: Baiduspider Disallow: / #Linguee User-agent: Linguee Disallow: / # MegaIndex User-agent: MegaIndex Disallow: / #SemrushBot User-agent: SemrushBot Disallow: / #http://openlinkprofiler.org/bot User-agent: spbot Disallow: / #Yandex User-agent: YandexBot Disallow: /