Crawlerpeek

Browser & web scraping New

Crawlerpeek

What it does: Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

1,000 dl/wk
3 stars
#1635 most used

Install

npx -y crawlerpeek

Show config JSON (from registry metadata)

{
  "mcpServers": {
    "crawlerpeek": {
      "command": "npx",
      "args": [
        "-y",
        "crawlerpeek"
      ]
    }
  }
}

Transport

stdio

From registry metadata. MCP Morning does not run or test servers.

Similar servers

2
playwright-mcp
Playwright Tools for MCP
- 5.6M dl/wk
- 38.7k stars
- — 7d
3
browser-use
Browser agents and stealth cloud browsers for AI: run web tasks, fill forms, extract data.
- 1.6M dl/wk
- 119.3k stars
- — 7d
4
Chrome DevTools MCP
MCP server for Chrome DevTools
- 2.6M dl/wk
- 54.2k stars
- — 7d