User-agent: * Allow: / User-agent: ia_archiver Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: /