MCP servers / TheCrawler
TheCrawler
at-risk io.github.manchittlab/thecrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
Downloads, last 30 days
Stars over time
Install
Run it directly:
npx -y thecrawlerOr add it to your client config (Claude Desktop claude_desktop_config.json, Cursor .cursor/mcp.json):
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Generated from the package metadata in the official MCP Registry. MCP Morning does not run or test servers; check required environment variables in the project README.
Alternatives
4
Scrapling MCP Server
254.0k/wkWeb scraping with stealth HTTP, real browsers, and Cloudflare bypass.…