# ============================================================================== # GOLDSIGNAL.UK — Autonomous Quantitative Gold Intelligence & Market Observatory # Production Robots Exclusion Standard (RFC 9309 Compliant) # Host: https://goldsignal.uk # ============================================================================== User-agent: * Allow: / Allow: /login Allow: /terms Allow: /privacy Allow: /static/ Allow: /sitemap.xml Allow: /llms.txt Allow: /llms-full.txt # Strictly protect authenticated research applications & private administrative routes Disallow: /app Disallow: /terminal Disallow: /admin Disallow: /api/admin/ Disallow: /api/studio/ Disallow: /api/alerts/test-smtp Disallow: /data/ Disallow: /*?*token= # Dedicated Crawlers - Search Engines & Generative AI Indexers User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: /static/assets/ Allow: /static/ User-agent: Bingbot Allow: / User-agent: Applebot Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / # Generative AI & Answer Engine Crawlers (AEO / GEO Optimization) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: CCBot Allow: / # Sitemap Index Declaration Sitemap: https://goldsignal.uk/sitemap.xml Host: https://goldsignal.uk