User-agent: AhrefsBot Disallow: / User-agent: Bytespider Disallow: / User-agent: SeekportBot Disallow: / User-agent: SemrushBot Disallow: /