Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Connect Remote server
claude mcp add --transport http website-content-crawler https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api
{
"mcpServers": {
"website-content-crawler": {
"url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
}
}
}
{
"servers": {
"website-content-crawler": {
"type": "http",
"url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
}
}
}
Settings > Connectors > Add custom connector
URL: https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api
Tools
This server asks for a key before it lists its tools. Connect it with your own key to see them.
Details
| Endpoint | https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api (Streamable HTTP) |
| First published | 8 Oct 2026 |
| Last updated | 8 Oct 2026 |
| Registry name | io.github.saulius876-lgtm/website-content-crawler |
More search and web servers See all
Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.
