# All crawlers, including AI agents, are welcome. User-agent: * Allow: / # Private per-subscriber feeds and one-time links Disallow: /api/early/ Disallow: /api/confirm Disallow: /api/unsubscribe Disallow: /api/hit # Claim redirects and vote endpoints (counted actions, not content) Disallow: /go/ Disallow: /api/vote Disallow: /api/claim # AI search, answer and training crawlers: explicitly allowed. User-agent: OAI-SearchBot User-agent: GPTBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: ClaudeBot User-agent: Claude-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bingbot Allow: / # Private per-subscriber feeds and one-time links Disallow: /api/early/ Disallow: /api/confirm Disallow: /api/unsubscribe Disallow: /api/hit # Claim redirects and vote endpoints (counted actions, not content) Disallow: /go/ Disallow: /api/vote Disallow: /api/claim Sitemap: https://perq.sh/sitemap.xml # LLM index: https://perq.sh/llms.txt # Markdown copy of every page: append .md, or send Accept: text/markdown