# Blocking SEO crawlers and backlink scanners. # They are not search engines: blocking them costs no traffic, it only # makes your backlink profile harder for competitors to look up, and # saves the bandwidth they spend crawling every page you have. User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SerpstatBot Disallow: / User-agent: PetalBot Disallow: / User-agent: * Disallow: