Ollama / vLLM Bridge

io.github.setheerwagen/mcp-ollama-vllm · v1.0.6

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

Source code Set it up

Connect Runs on your machine

Terminal

claude mcp add mcp-ollama-vllm -e LOCAL_BACKEND=<LOCAL_BACKEND> -e LOCAL_HOST=<LOCAL_HOST> -e LOCAL_API_KEY=<LOCAL_API_KEY> -e LOCAL_TIMEOUT=<LOCAL_TIMEOUT> -e LOCAL_EMBED_MODEL=<LOCAL_EMBED_MODEL> -e LOCAL_EMBED_PATH=<LOCAL_EMBED_PATH> -e LOCAL_SCHEMA_MODE=<LOCAL_SCHEMA_MODE> -- uvx mcp-ollama-vllm==1.0.6

claude_desktop_config.json

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm==1.0.6"
      ],
      "env": {
        "LOCAL_BACKEND": "<LOCAL_BACKEND>",
        "LOCAL_HOST": "<LOCAL_HOST>",
        "LOCAL_API_KEY": "<LOCAL_API_KEY>",
        "LOCAL_TIMEOUT": "<LOCAL_TIMEOUT>",
        "LOCAL_EMBED_MODEL": "<LOCAL_EMBED_MODEL>",
        "LOCAL_EMBED_PATH": "<LOCAL_EMBED_PATH>",
        "LOCAL_SCHEMA_MODE": "<LOCAL_SCHEMA_MODE>"
      }
    }
  }
}

~/.cursor/mcp.json

{
  "mcpServers": {
    "mcp-ollama-vllm": {
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm==1.0.6"
      ],
      "env": {
        "LOCAL_BACKEND": "<LOCAL_BACKEND>",
        "LOCAL_HOST": "<LOCAL_HOST>",
        "LOCAL_API_KEY": "<LOCAL_API_KEY>",
        "LOCAL_TIMEOUT": "<LOCAL_TIMEOUT>",
        "LOCAL_EMBED_MODEL": "<LOCAL_EMBED_MODEL>",
        "LOCAL_EMBED_PATH": "<LOCAL_EMBED_PATH>",
        "LOCAL_SCHEMA_MODE": "<LOCAL_SCHEMA_MODE>"
      }
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "mcp-ollama-vllm": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "mcp-ollama-vllm==1.0.6"
      ],
      "env": {
        "LOCAL_BACKEND": "<LOCAL_BACKEND>",
        "LOCAL_HOST": "<LOCAL_HOST>",
        "LOCAL_API_KEY": "<LOCAL_API_KEY>",
        "LOCAL_TIMEOUT": "<LOCAL_TIMEOUT>",
        "LOCAL_EMBED_MODEL": "<LOCAL_EMBED_MODEL>",
        "LOCAL_EMBED_PATH": "<LOCAL_EMBED_PATH>",
        "LOCAL_SCHEMA_MODE": "<LOCAL_SCHEMA_MODE>"
      }
    }
  }
}

Replace the values in angle brackets with your own. Keys stay on your machine; we never see them.

Tools

This server runs locally, so its tools are listed by your MCP client once it starts.

Environment variables

Name	Description
`LOCAL_BACKEND` Optional	Backend to use: ollama, vllm or openai
`LOCAL_HOST` Optional	Model endpoint URL; must be local or on your own network. Required for the openai backend
`LOCAL_API_KEY` Optional, secret	Optional bearer token, openai backend only; sent as a header, never logged
`LOCAL_TIMEOUT` Optional	Read timeout in seconds
`LOCAL_EMBED_MODEL` Optional	Default embedding model
`LOCAL_EMBED_PATH` Optional	Optional, openai backend only: embedding endpoint path
`LOCAL_SCHEMA_MODE` Optional	Optional, openai backend only: auto, response_format or none

Details

Package	`[email protected]` (PYPI, stdio)
First published	22 Oct 2026
Last updated	22 Oct 2026
Registry name	`io.github.setheerwagen/mcp-ollama-vllm`

More ai and media servers See all

Live status

Local install

Installed and run on your own machine, so there is no public endpoint to check.

Pair it with live search

Agents that use Ollama / vLLM Bridge often also need current facts. NestDaddy MCP gives your AI today's internet: web search, real-time breaking news and full page reading in one connector.

See NestDaddy MCP

For maintainers

[![NestDaddy MCP](https://nestdaddy.com/mcp/servers/io-github-setheerwagen-mcp-ollama-vllm/badge.svg)](https://nestdaddy.com/mcp/servers/io-github-setheerwagen-mcp-ollama-vllm)

Add the badge to your README. It turns green while your server passes our daily check. Listing details come from the official MCP registry; update them there.

Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.