AI Crawler Access Index
A live, cited market feed
Companies · Public web data · Every field carries a source URL and evidence hash.
- Data fields
- 6
- Total records
- 400
- Refresh rate
- Daily
- From
- £236/mo
Data sample
8 of 400 records · 6 of 6 fields| Site | GPTBot | ClaudeBot | Perplexity | CCBot | Changed |
|---|---|---|---|---|---|
| google.com | allowed | allowed | allowed | allowed | baseline |
| cloudflare.com | allowed | allowed | allowed | allowed | baseline |
| gstatic.com | blocked | blocked | blocked | blocked | baseline |
| facebook.com | allowed | allowed | allowed | blocked | baseline |
| microsoft.com | allowed | allowed | allowed | allowed | baseline |
| googleapis.com | no robots | no robots | no robots | no robots | baseline |
| amazonaws.com | allowed | allowed | allowed | allowed | baseline |
| youtube.com | allowed | allowed | allowed | allowed | baseline |
Source-backed
Every accepted value links to the page it was observed on, with an evidence hash and first-seen date.
Snapshot or feed
Buy once as CSV/JSON, or subscribe and receive refreshed deliveries with a change brief.
Extend it
Need extra fields or different acceptance criteria? We recompile the feed to your brief.