# AI Agent Readiness Report 2026 — 184 Popular Tool Sites, Tested

> We tested 184 popular online tool websites for AI agent readiness: llms.txt, Markdown for agents, JSON-LD, sitemaps, and AI crawler rules. Average score: 2.3 out of 9.

Source: https://toolpantry.app/ai-agent-readiness-report

## About

AI agents are learning to read the web — the web isn't ready. This study measures llms.txt adoption, Markdown negotiation, structured data, and crawler rules across 184 reachable online tool websites (October 2026).

## Quick answer

How ready is the web for AI agents? Measured across 184 popular tool websites in October 2026: 31.5% publish an llms.txt, but only 1.6% actually serve Markdown when an agent asks ( Accept: text/markdown ) — and none of the llms.txt adopters do. The average readiness score is 2.3 out of 9 ; the best sites score 6.

## Notes

Tool Pantry itself scores 9/9 on this checklist — it is the reference implementation behind the open-source kit described below. Reproduce the study with the scan script in the dataset repository.

## FAQ

**What is Markdown content negotiation?**

It is HTTP content negotiation (RFC 9110): an AI agent requests a page with Accept: text/markdown and the server replies with a clean Markdown version instead of full HTML. Same URL, two representations. It saves tokens and improves extraction accuracy for AI assistants — currently only 1.6% of the tested tool sites do it.

**Why do llms.txt adopters not serve Markdown?**

llms.txt (31.5% adoption in this study) tells AI systems where your content is; it doesn't change what the server returns when your pages are fetched. The two work best together — an index pointing at Markdown URLs — but most sites so far stop at the index.

**Does being AI-ready help a tool site get cited?**

It is necessary but not sufficient: AI answers cite sources that are crawlable, parseable, structured, and mentioned elsewhere on the web. This checklist covers the technical half; backlinks, lists, and reviews cover the other half.

**How do I check my own site?**

Use the free checker at toolpantry.app/agent-ready-checker — it runs the same seven checks as this study on any URL and explains exactly how to fix each gap. The fix kit is open source (MIT).

**Can I reproduce this study?**

Yes. The full dataset (CSV) is linked above, and the scan script plus the domain list are published in the companion GitHub repository. Re-run it any time to track adoption changes.