NestDaddy

TheCrawler

io.github.manchittlab/thecrawler · v0.5.8

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Connect Runs on your machine

Terminal
claude mcp add thecrawler -- npx -y [email protected]
claude_desktop_config.json
{
  "mcpServers": {
    "thecrawler": {
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ]
    }
  }
}
~/.cursor/mcp.json
{
  "mcpServers": {
    "thecrawler": {
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ]
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "thecrawler": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ]
    }
  }
}

Tools

This server runs locally, so its tools are listed by your MCP client once it starts.

Details

Package[email protected] (NPM, stdio)
First published2 Jul 2026
Last updated2 Jul 2026
Registry nameio.github.manchittlab/thecrawler

More files and documents servers See all

Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.