# crawl-readiness-mcp

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

- Weekly downloads: 240
- GitHub stars: n/a
- Health: unknown
- Repository: https://github.com/grubbomatic/crawl-readiness-mcp
- Registry names: io.github.Grubbomatic/crawl-readiness
- Categories: Browser & web scraping, Dev tools & GitHub, AI models & media
- Snapshot: 2026-10-14

## Install

```sh
npx -y crawl-readiness-mcp
```

```json
{
  "mcpServers": {
    "crawl-readiness-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ]
    }
  }
}
```

Source: https://mcpmorning.com/mcp/grubbomatic-crawl-readiness-mcp/