# Allow all crawlers by default User-agent: * Allow: / # Block Wayback Machine User-agent: ia_archiver Disallow: / # Block Archive.today User-agent: archiveis Disallow: /