Give AI agents access to 100+ LLMs. Call any model, compare outputs.
Connect Runs on your machine
claude mcp add litellm-mcp -e OPENAI_API_KEY=<OPENAI_API_KEY> -e ANTHROPIC_API_KEY=<ANTHROPIC_API_KEY> -- uvx litellm-mcp==1.0.1
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp==1.0.1"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}
{
"mcpServers": {
"litellm-mcp": {
"command": "uvx",
"args": [
"litellm-mcp==1.0.1"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}
{
"servers": {
"litellm-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"litellm-mcp==1.0.1"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}
Replace the values in angle brackets with your own. Keys stay on your machine; we never see them.
Tools
This server runs locally, so its tools are listed by your MCP client once it starts.
Environment variables
| Name | Description |
|---|---|
OPENAI_API_KEYOptional, secret | OpenAI API key for GPT models |
ANTHROPIC_API_KEYOptional, secret | Anthropic API key for Claude models |
Details
| Package | [email protected] (PYPI, stdio) |
| First published | 7 Feb 2026 |
| Last updated | 7 Feb 2026 |
| Registry name | io.github.shin-bot-litellm/litellm-mcp |
More ai and media servers See all
Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.
