ab-test

Community

Master A/B testing for data-driven decisions.

Authorolavocarvalho
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill provides a robust framework for designing, analyzing, and making confident decisions from A/B tests and online controlled experiments, ensuring your product changes are backed by statistical rigor.

Core Features & Use Cases

  • Experiment Design: Calculate necessary sample sizes and estimate test durations.
  • Statistical Analysis: Perform significance testing (Frequentist and Bayesian) to compare variants.
  • Validity Checks: Identify and mitigate common pitfalls like Sample Ratio Mismatch (SRM) and peeking.
  • Use Case: You've launched a new feature and want to know if it's improving conversion rates. Use this Skill to determine how much traffic you need, run the test, and get a clear statistical answer on whether the new feature is a winner.

Quick Start

Use the ab-test skill to calculate the sample size needed for an experiment with a baseline conversion rate of 5%, a minimum detectable effect of 10%, and 80% power.

Dependency Matrix

Required Modules

scipynumpy

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: ab-test
Download link: https://github.com/olavocarvalho/data-agents/archive/main.zip#ab-test

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.