Generate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM.
Connect Runs on your machine
claude mcp add ragscore -e OPENAI_API_KEY=<OPENAI_API_KEY> -e ANTHROPIC_API_KEY=<ANTHROPIC_API_KEY> -- uvx ragscore==0.8.6
{
"mcpServers": {
"ragscore": {
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}
{
"mcpServers": {
"ragscore": {
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}
{
"servers": {
"ragscore": {
"type": "stdio",
"command": "uvx",
"args": [
"ragscore==0.8.6"
],
"env": {
"OPENAI_API_KEY": "<OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>"
}
}
}
}
Replace the values in angle brackets with your own. Keys stay on your machine; we never see them.
Tools
This server runs locally, so its tools are listed by your MCP client once it starts.
Environment variables
| Name | Description |
|---|---|
OPENAI_API_KEYOptional, secret | OpenAI API key (if using OpenAI provider) |
ANTHROPIC_API_KEYOptional, secret | Anthropic API key (if using Anthropic provider) |
Details
| Package | [email protected] (PYPI, stdio) |
| First published | 19 May 2026 |
| Last updated | 19 May 2026 |
| Registry name | io.github.HZYAI/ragscore |
More ai and media servers See all
Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.
