User-agent: * Content-Signal: search=yes,ai-input=yes,use=reference Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth Disallow: /profile Disallow: /applications Disallow: /messages Disallow: /packs Disallow: /internal Disallow: /job/private/ User-agent: Amazonbot User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: ClaudeBot User-agent: FacebookBot User-agent: Google-Extended User-agent: GPTBot User-agent: meta-externalagent Allow: /$ Allow: /research Allow: /blog Allow: /how-to Allow: /agents Disallow: / Sitemap: https://www.dreamworkhq.com/sitemap.xml