Guides
The questions site owners ask about AI agents, answered in the first sentence, with the command to check it yourself and numbers from our own scans.
How to make your website ready for AI agents
What AI agents like ChatGPT, Claude and Perplexity need from a site, in order: let them in, make pages readable, then make the job they came for work without a human.
What is llms.txt?
llms.txt is a markdown file at /llms.txt that tells AI models what a site is and which pages to read. The format, an example, and which vendors publish one.
Is your site blocking ChatGPT and other AI agents?
Two things block ChatGPT, Claude and Perplexity: robots.txt rules and bot walls. How to check both in a minute, which vendors block agents today, and how to fix it.
robots.txt for AI bots: every user agent and what it does
The AI crawler and agent user-agents from OpenAI, Anthropic, Perplexity, Google, Apple and Meta, what each one does, and a robots.txt that lets assistants in while opting out of training.
Which software vendors have a remote MCP server?
Every vendor in our rankings where our scan reached a live remote MCP server, with the endpoint URL, across CRM, payments, databases, AI APIs, observability and more.
How to add a remote MCP server to your product
What a remote MCP server is, where to host it, how OAuth discovery and client registration work, and how to check agents can connect. With data on which vendors already have one.
OAuth dynamic client registration for AI agents
Why MCP clients need to register themselves with your OAuth server, how RFC 7591 and the discovery documents fit together, and which vendors support it today.
How to get your business recommended by ChatGPT
Answer engine optimization in practice: what assistants need to find, read and quote you, and the checks that make the difference, from crawler access to FAQ markup.
What is an MCP server card?
An MCP server card describes a remote MCP server before anyone connects. Where it goes under SEP-2127 (/server-card and /.well-known/ai-catalog.json), what's in it, and why not /.well-known/mcp.json.
What is an A2A agent card?
An A2A agent card is a JSON file at /.well-known/agent-card.json that tells other AI agents what your agent does and how to call it. When you need one, and how it differs from MCP.
What is agentic commerce?
Agentic commerce is shopping where an AI agent finds products, builds the cart and checks out for a person. The protocols (UCP, ACP, AP2), what happened to ChatGPT Instant Checkout, and how to get a store ready.
Does Shopify support AI agents?
Yes: Shopify syndicates products to ChatGPT, Copilot, Google AI Mode and Gemini, and stores expose a UCP profile and MCP endpoint for agents. What Shopify does for you and what's still on the merchant.
Agent readiness vs SEO vs AEO
SEO gets you ranked, AEO gets you quoted by AI assistants, and agent readiness lets an AI agent finish a job on your site. Where the three overlap, where they conflict, and what to fix first.
How do AI agents browse websites?
AI agents read a site in three ways: a plain HTTP fetch of the HTML (often without JavaScript), the browser's accessibility tree, and screenshots. What each one sees, what breaks it, and how to see your site the way they do.
How to test if ChatGPT agent and Claude can use your site
Three tests, from one-minute curl commands to a real agent run: check AI user-agents get past your bot rules, check they can read the facts, then give an agent the actual job and see where it stops.
How to make your SaaS sign-up work for AI agents
What an AI agent needs to get a new user from your homepage to a working account: public pricing, a sign-up page that opens, labelled fields, and verification a person can hand over. Plus auth.md and data on which vendors block agents at sign-up.
How to make your developer docs agent-ready
What coding agents like Claude Code, Cursor and Codex need from API docs: llms.txt, every page as markdown, pages that fit in one fetch, an OpenAPI spec, self-serve keys and a docs MCP server. With the checks and data on who does it.
Agent readiness checkers compared
The free tools that score how ready a website is for AI agents, side by side: what each one checks, how it shows results, where each is strongest, and which to use for a content site, a store, a SaaS product or developer docs.
How to write an agent playbook for your product
An agent playbook is a markdown file that tells AI agents how to use your product. Which file does what (llms.txt, SKILL.md, auth.md, AGENTS.md), how to write a good one, and where to publish it so agents find it.
What is Web Bot Auth?
Web Bot Auth lets AI agents prove who they are by signing each HTTP request, so your CDN can let ChatGPT agent through without trusting a user-agent string. How it works, who uses it, and what site owners should do.
How to serve markdown to AI agents
Serve a clean markdown version of each page when an agent sends Accept: text/markdown. The headers to get right, three ways to ship it (Cloudflare, Next.js, .md URLs), and which vendors already do.
What is WebMCP?
WebMCP lets a web page register tools that AI agents in the browser can call directly, instead of guessing which buttons to click. How it works, how it differs from a remote MCP server, and when to add it.
How to check your llms.txt
Validate an llms.txt file in a minute: status and content type, the required H1, summary and link sections, links that resolve, and size. A copy-paste checker script, the common failures, and free validators.