experiment-design

Design lean product experiments to validate hypotheses before building features.

11|Updated Mar 20, 2026
One-click install
npx skills add https://github.com/qa-aman/next-leap-claude-code --skill experiment-design-qa-aman
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: experiment-design
Source: https://github.com/qa-aman/next-leap-claude-code/tree/main/.claude/skills/experiment-design
Command: npx skills add https://github.com/qa-aman/next-leap-claude-code --skill experiment-design-qa-aman

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Product teams often build full features based on untested assumptions, wasting engineering effort when the assumption turns out wrong. This Skill structures hypothesis-driven experiments so you can validate ideas cheaply before committing to full development. ## Core Features & Use Cases - Hypothesis Framing: Formats assumptions into the "We believe X will cause Y because Z" structure and identifies the riskiest assumption to test first. - Minimum Viable Test Selection: Chooses the cheapest experiment type from Ries's ladder, from customer interviews and fake door tests up to A/B tests and full releases. - Success Criteria and Sample Sizing: Defines pass/fail thresholds before running, calculates required sample sizes, and sets guard metrics to prevent false conclusions. - Use Case: Before building a new onboarding progress bar, run a fake door test measuring click-through to validate that users actually want progress visibility, then only build if the 15% activation lift hypothesis holds. ## Quick Start Ask the assistant to design a minimum viable experiment to test whether adding a progress bar to onboarding will increase activation rate by 15%.

Frequently Asked Questions about experiment-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an A/B test for a product feature?▼

Start by stating a hypothesis in the format "We believe X will cause Y because Z", then define success criteria before running the test. Calculate the required sample size using your baseline conversion rate and minimum detectable effect at 95% significance, and avoid peeking at results early.

What is a minimum viable test in lean experimentation?▼

A minimum viable test is the cheapest experiment that can validate your riskiest assumption. Ries's ladder ranks options from customer interviews and fake door tests up to concierge MVPs, Wizard of Oz setups, A/B tests, and full releases. Start as low on the ladder as possible.

When should I use a fake door test instead of building the feature?▼

Use a fake door test when you need to measure demand before investing in development. Show the feature entry point and measure click rates; if users do not click, the full feature likely would not be used either.

Why do A/B tests produce misleading results?▼

Common causes include undersized samples, peeking at results before the test completes, testing multiple variables at once, and moving success criteria after seeing data. Set thresholds upfront and change one variable per experiment to keep results attributable.

What are the limitations of lean experiment design?▼

Experiments require sufficient traffic or user access to reach statistical significance, and inconclusive results are common with small samples. Qualitative tests like interviews reveal attitudes but not actual behavior, so cheap tests should be confirmed with higher-fidelity methods before full release.