# Find-Care: robots.txt in plain language

This describes the actual rules published at https://www.find-care.co.uk/robots.txt.

## Search, citation and training

Every public page may be crawled, cited and used for training, by ordinary
search crawlers and by these named AI crawlers: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, Google-Extended, Applebot-Extended, CCBot, Bytespider, meta-externalagent.
A general rule already allows every crawler. Naming these individually
records that allowing them is deliberate.

## What is not for crawling, citation or training

- /admin (the internal onboarding and quality console)
- /provider/ (a provider's own portal and their signed agreement)
- /provider-login (the provider sign-in page)
- /api/ (the API. It returns data, not pages)
- /auth/ (the sign-in and authentication routes)

## Where to find the rest

Machine-readable rules: https://www.find-care.co.uk/robots.txt
Sitemap: https://www.find-care.co.uk/sitemap.xml