User-agent: * Disallow: / Crawl-Delay: 10 User-agent: Bingbot User-agent: Googlebot User-agent: Applebot Allow: / Disallow: