NestDaddy

A/B Test Sample Size Calculator MCP

io.github.theluckystrike/ab-test-sample-size-calculator-mcp · v1.0.0

Exact A/B test sample size, duration, z-test, chi-square, Fisher-Freeman-Halton and peeking risk.

Connect Remote server

Terminal
claude mcp add --transport http ab-test-sample-size-calculator-mcp https://ab-test-sample-size-calculator-mcp.lipmichal.workers.dev/mcp
~/.cursor/mcp.json
{
  "mcpServers": {
    "ab-test-sample-size-calculator-mcp": {
      "url": "https://ab-test-sample-size-calculator-mcp.lipmichal.workers.dev/mcp"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "ab-test-sample-size-calculator-mcp": {
      "type": "http",
      "url": "https://ab-test-sample-size-calculator-mcp.lipmichal.workers.dev/mcp"
    }
  }
}
Claude Desktop
Settings > Connectors > Add custom connector
URL: https://ab-test-sample-size-calculator-mcp.lipmichal.workers.dev/mcp

Tools 5 found in our last check

  • calculate_sample_size

    Exact sample size per variant for an A/B test on a conversion rate (two independent proportions): baseline rate, minimum detectable effect (relative or absolute), alpha, power, one or two-sided, several variants with optional Bonferroni, and unequal allocation. Uses the pooled/u…

  • estimate_test_duration

    How many days an A/B test must run: from a known sample size per variant, or from baseline rate and MDE (computed as in calculate_sample_size), plus daily visitors and the share of traffic in the test. Returns exact days and the recommended whole weeks (to cover weekday effects).

  • test_ab_significance

    Is an A/B test result statistically significant? From visitors and conversions per group: two-proportion z-test (pooled), one or two-sided p-value, Wald confidence interval for the difference, relative lift, Pearson chi-square with and without Yates correction (R prop.test), Fis…

  • fisher_exact_test

    Exact p-value for a contingency table of counts. 2x2: Fisher exact test (two-sided, greater or less, as R fisher.test). Larger r x c tables (for example 3 variants x converted/not, or 4 x 4 survey tables): Fisher-Freeman-Halton exact test by a network algorithm. Also returns Pea…

  • check_peeking_risk

    What peeking does to an A/B test: the real false positive rate if you check a fixed-horizon test K times and stop at the first p < alpha (for example about 14% at 5 looks with alpha 0.05), and the Pocock and O'Brien-Fleming group sequential boundaries (z and nominal p per look)…

Details

Endpointhttps://ab-test-sample-size-calculator-mcp.lipmichal.workers.dev/mcp (Streamable HTTP)
First published2 Nov 2026
Last updated2 Nov 2026
Registry nameio.github.theluckystrike/ab-test-sample-size-calculator-mcp

More developer tools servers See all

Listing data from the official MCP registry. Status and tools from NestDaddy's daily check. Browse all MCP servers.