Skills
.Work. You
Rest

ab-test-analysis

Community

Ship, extend, or stop A/B tests.

Data & Analytics#conversion rate#product metrics#experiment analysis#data-driven decisions#ab testing#statistical significance
AuthorKoryakinYurij
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill helps product managers and data analysts make data-driven decisions by rigorously evaluating A/B test results, determining statistical significance, and providing clear recommendations.

Core Features & Use Cases

  • Statistical Significance Calculation: Determines if observed differences between variants are statistically significant.
  • Sample Size & Duration Validation: Checks if the test was adequately powered and ran for a sufficient period.
  • Guardrail Metric Monitoring: Assesses the impact on secondary metrics to prevent unintended negative consequences.
  • Recommendation Engine: Provides actionable advice (Ship, Extend, Stop, Investigate) based on the analysis.
  • Use Case: You've just completed an A/B test on a new feature and need to know if the observed lift in conversion rate is real and if any negative impacts on user engagement occurred, so you can decide whether to launch the feature.

Quick Start

Analyze the A/B test results for the user onboarding flow experiment using the provided data files.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: ab-test-analysis
Download link: https://github.com/KoryakinYurij/Self-Sustain-System/archive/main.zip#ab-test-analysis

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.