- Task
- A clinic website with a blog and online booking; separately — what search and AI agents receive, and which AI agents to let in.
- Solution
- Prerendering for bots, clinic and doctor markup, llms.txt as a content map, robots.txt with a split policy for AI agents.
- Result
- robots.txt blocks seven training agents, including GPTBot, ClaudeBot and Google-Extended, and admits six search agents that cite their sources, including ChatGPT-User, OAI-SearchBot and PerplexityBot. Measured 31 July 2026. The limit: agent visits and referrals from assistants were not measured on this site — the groundwork is there, the return is unknown.