# Content Signals let site owners express how automated systems may use # this site's content after access; see https://contentsignals.org/ for the # meaning of each signal. # search = building a search index and showing links/snippets in results # ai-input = using content as grounded input to an AI answer (e.g. RAG) # ai-train = training or fine-tuning AI models User-Agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Disallow: /api/ Sitemap: https://www.montanaeg.com/sitemap.xml Host: https://www.montanaeg.com # AI crawler policies — per-bot rules for major automated systems. # Montana wants to be discovered by AI search tools (ai-input=yes above). # Training-only crawlers are blocked; search/indexing crawlers are allowed. User-agent: GPTBot Allow: /news/ Disallow: / User-agent: Claude-SearchBot Allow: / Disallow: /api/ User-agent: Claude-User Allow: / Disallow: /api/ User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Applebot Allow: / Disallow: /api/ # llms.txt — AI agent site discovery (https://llmstxt.org/) User-agent: * Allow: /llms.txt Allow: /llms-full.txt