About AgentLitmusBot

What it fetches

For each scan, AgentLitmusBot fetches a small, fixed set of resources from the site's root, in this order:

1. 1. /robots.txt
2. 2. The homepage (/)
3. 3. /llms.txt
4. 4. /AGENTS.md
5. 5. /sitemap.xml
6. 6. /.well-known/mcp.json
7. 7. /openapi.json
8. 8. /api-docs — only as a fallback if openapi.json wasn't found and budget remains

Resources are fetched in this priority order so the highest-weight checks run first if the request budget runs out.

Limits and behavior

• Makes at most 8 requests per scan.
• Times out each request after 10 seconds.
• Respects robots.txt disallow rules for its user agent before fetching any page.
• Does not execute JavaScript — everything is read from the raw HTTP response.
• Only crawls a site when a user submits it for a scan — it does not crawl proactively or on a schedule.

Questions or issues?

If AgentLitmusBot is causing problems for your site, or you have questions about how it works, see the methodology page for the full scoring rubric, or block AgentLitmusBot in your robots.txt — it will be respected on the next scan.