LLM Eval Harness

Connect Runs on your machine

claude mcp add llm-eval-harness -e ANTHROPIC_API_KEY=<ANTHROPIC_API_KEY> -e GEMINI_API_KEY=<GEMINI_API_KEY> -- docker run -i --rm ghcr.io/razilzul/llm-eval-harness:1.0.0

{
  "mcpServers": {
    "llm-eval-harness": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/razilzul/llm-eval-harness:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

{
  "mcpServers": {
    "llm-eval-harness": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/razilzul/llm-eval-harness:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

{
  "servers": {
    "llm-eval-harness": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/razilzul/llm-eval-harness:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<ANTHROPIC_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

Replace the values in angle brackets with your own. Keys stay on your machine; we never see them.

Tools

This server runs locally, so its tools are listed by your MCP client once it starts.

Environment variables

Details

More ai and media servers See all

• bv7x strategy agents

  Find bv7x prediction agents on Robinhood Chain by market; quote their sealed calls, sold via x402.

• Chronary

  Calendar API for AI agents: events, availability, Google/Microsoft setup, scheduling, and iCal.

• Mastering

  Audio mastering for AI agents: LUFS analysis, Suno artifact cleanup, free daily master.

• Modulos AI Governance Platform

  Evaluate Modulos (EU AI Act, ISO 42001, NIST AI RMF): capabilities, trust, comparisons. Book a demo.

• naulon

  Check citations and retractions by DOI, and see the x402 price an AI agent pays to cite a source.

• NextConstraint

  Your SaaS funnel's costliest leak, its fix, watchdog alerts and verdicts, from NextConstraint.