---
title: "ai-crawler-readiness-auditor"
description: "Check whether AI crawlers and AI search engines can read your website: robots.txt, sitemap, llms.txt, meta tags and structured data for one public page, with fixes ranked by priority. By ASTUDIO."
canonical: https://agentpluginsdirectory.com/plugins/ai-crawler-readiness-auditor
last-updated: 2026-10-12
---

# ai-crawler-readiness-auditor
Check whether AI crawlers and AI search engines can read your website: robots.txt, sitemap, llms.txt, meta tags and structured data for one public page, with fixes ranked by priority. By ASTUDIO.
- Slug: ai-crawler-readiness-auditor
- Publisher: ASTUDIO
- Repository: https://github.com/AStudio-Team/openai-plugin-tools
- Manifest: ai-crawler-readiness-auditor/plugin.json
- Version: 1.0.0
- License: MIT
- Category (editorial): other
- Skills: 1 (ai-crawler-readiness-auditor)
- MCP servers: 1 (ai-crawler-readiness-auditor)
- Stars: 0
- Repository created: 2026-10-10
- Repository last pushed: 2026-10-12
- Publisher type: Organization
- Listing: https://agentpluginsdirectory.com/plugins/ai-crawler-readiness-auditor
- Schema: https://agent-plugins.org/schemas/1.0.0/plugin.schema.json

## What ai-crawler-readiness-auditor does, in the publisher's words

A stateless, human-interactive MCP App that audits one public HTTPS page and origin-level crawler controls. It validates the target first, requires a signed 15-minute checkpoint token, then returns bounded evidence and unselected remediation choices.

The local MCP endpoint is http://127.0.0.1:8790/mcp. Production remains gated and is not deployed by this source change.

- HTTPS response, redirects, content type, and challenge signals
- Effective robots.txt rules for configured neutral crawler tokens
- X-Robots-Tag and page robots metadata
- Title, description, canonical URL, and server-delivered text
- JSON-LD parsing without execution
- Bounded sitemap XML parsing without DTD or entity processing

The app produces no numeric readiness score and makes no ranking, indexing, citation, traffic, or training guarantee.

From the project README, punctuation lightly normalized. Full text: https://raw.githubusercontent.com/AStudio-Team/openai-plugin-tools/HEAD/ai-crawler-readiness-auditor/README.md

## MCP servers

- ai-crawler-readiness-auditor: transport: streamable-http; url: https://www.astudio.agency/openai-plugins/ai-crawler-readiness-auditor/mcp

Read from the plugin's own mcp.json. Environment variable names only, never values.