User-agent: * Disallow: /errors/ Disallow: /members/ Disallow: /secure/ Disallow: /racemap/ Disallow: /registerconfirm Disallow: /registerraceppdone Disallow: /registerracepaywait Disallow: /passrconfirm Disallow: /passraceppdone Disallow: /passracepaywait Disallow: /controls Disallow: /*.axd$ Disallow: /v1/features/ User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: /