User-agent: * Disallow: /cdn-cgi Disallow: /jobs/external/*