Gratispel.se's 180-line llms.txt shows what thorough AI preparation looks like

# ===========================================
# llms.txt – Policy for AI & LLM Crawlers
# Site: https://gratispel.se/
# Last updated: 2025-11-17
# ===========================================
# PURPOSE
# This file defines how Large Language Models (LLMs),
# AI crawlers and Retrieval-Augmented Generation (RAG)
# systems may access and use public content from Gratispel.se.
#
# This file does NOT replace robots.txt. Robots.txt controls
# crawling. llms.txt describes content usage policy.
# ===========================================


# ===========================================
# 1. Allowed AI Crawlers
# ===========================================
User-Agent: GPTBot
User-Agent: Google-Extended
User-Agent: ClaudeBot
User-Agent: CCBot
User-Agent: PerplexityBot
User-Agent: AppleBot-Extended
User-Agent: meta-externalagent

Allow: /


# ===========================================
# 2. SITE OWNER & CONTACT
# ===========================================
Site: https://gratispel.se/
Owner: Gratispel.se
Contact: https://gratispel.se/kontakta-oss


# ===========================================
# 3. GENERAL AI / LLM POLICY
# ===========================================
# ALLOWED USES (under fair and respectful use):
# - Indexing content for search, answer snippets and RAG
# - Quoting short excerpts with clear source attribution
# - Generating summaries that link back to original URLs
#
# NOT ALLOWED without explicit written permission:
# - Using content to train or fine-tune commercial LLMs
# - Building or selling datasets based on our content
# - Systematic mirroring / cloning of our game library
# - Reproducing full articles, rules or guides verbatim
# - Copying UI, game flows, or design as a competing service
#
# REQUIREMENTS:
# - Always credit "Gratispel.se" as the source
# - Always include a clickable URL to the original page
# - Do not present our content as your own original work
# - Do not expose private, internal or non-public URLs
# ===========================================


# ===========================================
# 4. PUBLIC CONTENT INCLUDED FOR RAG / INDEXING
# ===========================================
# These sections of the site may be used for:
# - Retrieval-augmented generation (RAG)
# - Answering user questions with attribution
# - Short excerpts and summaries
# ===========================================

# --- CORE PAGES ---
ALLOW: /

ALLOW: /spel
ALLOW: /om-oss
ALLOW: /kontakta-oss

# Legal & policy pages
ALLOW: /integritetspolicy
ALLOW: /ansvarsfriskrivning
ALLOW: /upphovsrattspolicy
ALLOW: /anvandarvillkor


# --- GAME CATEGORY PAGES ---
ALLOW: /kortspel
ALLOW: /patiens
ALLOW: /harpan


# --- GAME PAGES ---
ALLOW: /kungen-patiens
ALLOW: /spindelharpan
ALLOW: /patiens-pyramiden
ALLOW: /idioten-patiens
ALLOW: /hjarter
ALLOW: /gin-rummy
ALLOW: /spades
ALLOW: /bridge-spel