# llmstxt.studio robots.txt # Let everything be crawled. Auth protects private data. User-agent: * Allow: / # Block API endpoints (no HTML to index) Disallow: /api/ # Block utility routes Disallow: /cdn-cgi/ Sitemap: https://llmstxt.studio/sitemap.xml