llms.txt Adoption Index

A live, cited market feed

Companies · Public web data · Every field carries a source URL and evidence hash.

Data fields
6
Total records
400
Refresh rate
Daily
From
£236/mo

Data sample

8 of 400 records · 6 of 6 fields
SiteCategoryllms.txtSize (KB)llms-fullChanged
google.comsearchnono
cloudflare.cominfrastructureyes16.8yes2026-09-04
gstatic.cominfrastructurerobots-refusedrobots-refused
facebook.comsocialrobots-refusedrobots-refused
microsoft.comothernono2025-09-18
googleapis.cominfrastructurenono
amazonaws.cominfrastructurenono
youtube.commedianono

Source-backed

Every accepted value links to the page it was observed on, with an evidence hash and first-seen date.

Snapshot or feed

Buy once as CSV/JSON, or subscribe and receive refreshed deliveries with a change brief.

Extend it

Need extra fields or different acceptance criteria? We recompile the feed to your brief.

llms.txt Adoption Index dataset — Scraper.io