# Scrape-LE

Analyse robots.txt content and report whether a path may be crawled.

- Weekly downloads: 309
- GitHub stars: n/a
- Health: unknown
- Repository: https://github.com/nolindnaidoo/scrape-le
- Registry names: io.github.nolindnaidoo/scrape-le
- Categories: Browser & web scraping, Dev tools & GitHub
- Snapshot: 2026-10-14

## Install

```sh
npx -y scrape-le-mcp
```

```json
{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}
```

Source: https://mcpmorning.com/mcp/nolindnaidoo-scrape-le/