. AI Visibility Infrastructure
Your website is invisible to AI agents. AgentIndexr Fixes that.
AgentIndexr publishes llms.txt, skill.md, MCP & WebMCP endpoints, an API catalog and structured data — so AI agents can find, read and act on your site. One plugin. No code.
.llms.txt
.Mcp
.Webmcp
.Agent skills
.Rfc 8288
.json-ld
.Api catalog
.DNS-Aid
.content signals
The blind spot
AI Agents are the new front door. Most sites left it locked.
People increasingly ask assistants to find, compare, and act on the web. But a standard WordPress site only exposes HTML built for human browsers and Google's crawler — there's nothing for an autonomous agent to read, negotiate, or call.
No machine-readable context
Without an llms.txt summary or structured metadata, an LLM has to guess what your site is about from raw markup — or skip it entirely.
No endpoints to discover
Agents look for MCP servers, API catalogs, and /.well-known manifests. A typical site returns 404 for every one of them.
No control over crawlers
Bots like GPTBot and ClaudeBot already visit. Without signal rules, you can't say what they may read, search, or train on.
Why traditional SEO isn't enough
SEO ranks you for humans.Agents read you differently.
People increasingly ask assistants to find, compare, and act on the web. But a standard WordPress site only exposes HTML built for human browsers and Google's crawler — there's nothing for an autonomous agent to read, negotiate, or call.
Human-era Traditional SEO
Built around the search results page and the human reader.
- Optimizes keywords and backlinks for ranked blue links
- Assumes a person clicks through and reads rendered HTML
- Exposes no tools, endpoints, or negotiated machine formats
- Offers no way to signal AI training or input preferences
Agentic web AgentIndexr
Built around how agents actually discover and consume the web.
- Publishes llms.txt context and Schema.org structured data
- Exposes MCP, WebMCP, and an API catalog agents can call
- Negotiates clean Markdown when an agent asks for text
- Controls per-bot content signals for train, search, and input
How AgentIndexr works
Three moves from invisible to fully indexed.
01Install
Activate and auto-provision
Upload and activate the plugin. It securely creates its database tables and starts generating the metadata and discovery endpoints your site was missing.
aco_prompt_index · aco_bot_analytics
02Configure
Toggle the protocols you want
Flip on basic modules and advanced discovery protocols from the dashboard — robots.txt, llms.txt, sitemaps, MCP, WebMCP, and more. No code required.
Settings → Basic · Advanced
03Verify
Validate and monitor live
The Verification Engine queries your live endpoints and scores your readiness, so you always know what's healthy and what needs a fix.
Discovery Health Center
Feature showcase
Everything you need to be readable, trackable and in control.
AI Prompt Intelligence
Generate 10–30 intent-based prompts for any post or page, then track each one in the Prompt Index with a Weak, Improving, or Strong status.
> AgentIndexr meta box · Prompt Index
Search Console insights
Connect Google Search Console to see impressions, clicks, CTR and position — plus Quick Wins, Page 2 Opportunities, and Low CTR alerts.
> Keywords & Ranking
Robots.txt manager
Generate dynamic AI crawler rules and a Content-Signal header from a virtual robots.txt — no file editing, no overrides to manage.
> Content-Signal header
llms.txt generation
Publish a standard Markdown summary of your site's context for LLMs, with the exact content fully editable from the dashboard.
> /llms.txt
Agent Skills & skill.md
Expose a skill.md file and the agent-skills schema directory so agents can understand exactly what your site can do.
> /.well-known/agent-skills/index.json
Structured data / JSON-LD
Automatically inject semantic Schema.org metadata into your site's head so machines parse your entities and relationships correctly.
> Schema.org · <head>
AI-optimized sitemap
Expose a dedicated, AI-friendly XML sitemap so crawlers map your content structure without wading through human navigation.
> /ai-sitemap.xml
AI crawler traffic
See recent visits from known AI bots, intercepted natively by the plugin before they reach your discovery endpoints.
> GPTBot · ClaudeBot · PerplexityBot
Secure update engine
The plugin pings agentindexr.com daily and surfaces a notice when an update is ready. Download and install it manually — no settings or data lost.
> Manual-download updates
AI discovery standards
One plugin, every standard the agentic web speaks.
AgentIndexr implements the emerging protocols agents rely on to find and consume content — from simple text manifests to full developer-grade discovery.
Manifest
llms.txt
Markdown context summary that tells LLMs what your site is and how it's organized.
/llms.txt
Skills
skill.md
Agent Skills schema describing the capabilities your site offers to autonomous agents.
/agentindexr/skill.md
Protocol
MCP
Model Context Protocol manifest exposed for agents that connect over MCP.
/.well-known/mcp.json
Browser
WebMCP
Injects navigator.modelContext to expose tools like search directly to browser agents.
navigator.modelContext
RFC 8288
Link Headers
Injects Link: HTTP headers — for example rel="mcp" — into your responses.
Link: rel="mcp"
RFC 9727
API Catalog
Publishes a linkset that maps the APIs available on your site for agents.
/.well-known/api-catalog
Negotiation
AI Markdown
Returns clean Markdown when an agent requests text/markdown or appends .md to a URL.
Accept: text/markdown
Schema.org
JSON-LD
Semantic structured data injected into your head for accurate machine parsing.
<script type="ld+json">
Auth
OAuth Discovery
Publishes OpenID configuration so agents understand your authentication requirements.
/.well-known/openid-configuration
DNS
DNS-AID
Generates the exact TXT records to copy into your registrar for DNS-level discovery.
TXT records
Signals
Content-Signal
Sets ai-train, search, and ai-input preferences, with per-bot overrides.
ai-train=no
Index
AI Sitemap
AI-optimized XML sitemap exposing your content map to crawlers.
/ai-sitemap.xml
The control center
A SaaS-grade command center for AI discoverability.
Scores, live endpoint health, and AI crawler traffic — all in one modern dashboard built right into WordPress.
-
/.well-known/mcp.jsonPassed
-
/llms.txtPassed
-
/ai-sitemap.xmlPassed
-
/agentindexr/skill.mdPassed
-
/.well-known/api-catalogWarning
AI Visibility Score
One number that tells you if agents can find you.
Your Overall AI Visibility Score is a weighted aggregate of two things: the infrastructure that makes you reachable, and the optimization that makes you understood. Improve either and watch the number climb.
- 60%
Infrastructure
60%
Core endpoint availability — robots.txt, sitemaps, MCP, and the other manifests agents reach for first.
- 40%
Optimization
40%
Proactive configuration — llms.txt, Schema, analytics, and DNS-AID that make your content readable and ranked.
Discoverability verification
Don't assume it works. Prove it.
The automated Verification Engine actively queries your live endpoints and reports back in plain status: green when healthy, yellow when active but missing a directive, red when something's broken. Hit Fix Issue and you're taken straight to the setting that resolves it.
Green
Endpoint healthy
Yellow
Missing directive
Red
404 / misconfigured
Installation
Live in three steps. No developer required.
STEP 01
Upload the plugin
Add the ai-crawl-optimizer folder to your
/wp-content/plugins/ directory.
STEP 02
Activate it
Activate AgentIndexr through the standard WordPress Plugins menu.
STEP 03
Auto-provision
On activation the plugin securely creates the tables it needs and begins generating your discovery endpoints.
Secure, manual-download updates.
Every 24 hours your site checks agentindexr.com for a new release. When one's ready you'll see a notice in WordPress and the dashboard — download the ZIP and install it through the normal plugin uploader. No settings or data are lost.
Pricing
Get discovered for the price of one missed lead.
One license per site. Every plan includes free updates through the secure update engine.
WordPress Plugin
Core infrastructure, Full intelligence, scoring, and search data, plus Advanced protocols for client portfolios.
$39
- Robots.txt manager & Content-Signal
- AI-optimized XML sitemap
- llms.txt generation
- Structured data / JSON-LD
- Google Search Console integration
- Discovery Health Center & verification
- MCP, WebMCP & API Catalog endpoints
- RFC 8288 link headers & OAuth discovery
- AI crawler traffic analytics
- Per-bot overrides & DNS-AID records
- Priority support
Shopify App
The standard AgentIndexr customized for Shopify with core infrastructure, Full intelligence, scoring, and search data, plus Advanced protocols for client portfolios.
Coming Soon
- Robots.txt manager & Content-Signal
- AI-optimized XML sitemap
- llms.txt generation
- Structured data / JSON-LD
- Google Search Console integration
- Discovery Health Center & verification
- MCP, WebMCP & API Catalog endpoints
- RFC 8288 link headers & OAuth discovery
- AI crawler traffic analytics
- Per-bot overrides & DNS-AID records
- Priority support
FAQ
Questions? Answered.
Which AI crawlers does AgentIndexr support?
It works with major AI bots including GPTBot, ClaudeBot, and PerplexityBot. From Settings → Robots & Traffic you can explicitly allow or disallow each crawler, and the AI Crawler Traffic panel shows their recent visits as they're intercepted natively by the plugin.
Will I lose my settings when I update?
No. AgentIndexr uses a secure manual-download update engine. Your site checks agentindexr.com every 24 hours, shows a notice when an update is ready, and you install the new ZIP through the standard WordPress uploader. No settings or data are lost during updates.
Can I control what AI models train on?
Yes. The Content Signals control sets ai-train, search, and ai-input preferences in your robots.txt — with ai-train=no on by default. You can also provide per-bot overrides as JSON to give specific crawlers their own rules, for example allowing one bot to train while blocking others.
An endpoint shows "Live Validation Failed" — what now?
AgentIndexr resolves endpoints dynamically through WordPress's request parser. If one returns a 404, make sure Pretty Permalinks are enabled under Settings → Permalinks. That single setting resolves most failed validations.
A physical robots.txt is overriding the plugin.
A hardcoded robots.txt file in your site root takes priority over WordPress's virtual file. Connect via FTP or your file manager and delete the physical robots.txt — WordPress will then fall back to the dynamic file AgentIndexr generates.
WebMCP isn't being detected.
WebMCP runs via JavaScript on window load. If it's not detected, check that your caching or minification plugins aren't stripping the inline injector script from the footer. Whitelisting that script restores WebMCP support.
AI discovery standards
If your site isn't built for AI discovery, you're already behind.
Install AgentIndexr and turn your WordPress site into a hub that agents and LLMs can actually find, read, and act on.
