# Jamie McKaye - Web Design & AI Agency # https://jamiemckaye.com # ============ Standard Search Crawlers ============ User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / # ============ AI Search Crawlers - ALLOW for AEO/GEO ============ User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Claude-Web Allow: / User-agent: Anthropic-AI Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: cohere-ai Allow: / User-agent: CCBot Allow: / User-agent: Amazonbot Allow: / # ============ All Other Bots ============ User-agent: * Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /static/ # ============ Sitemap Location ============ Sitemap: https://jamiemckaye.com/sitemap.xml # ============ AI-Friendly Resources ============ # Plain text version for LLMs LLMsTxt: https://jamiemckaye.com/llms.txt # HTML version for AI crawlers # https://jamiemckaye.com/llm.html # ============ Crawl Delay (optional - be polite) ============ # Crawl-delay: 1