Ab Testing

Ab Testing

coreyhaines31

Ab Testing

Ab Testing

Design statistically valid A/B tests, calculate sample sizes, structure growth experiments, and analyze results.

New tool
0 downloads
Free

About

A/B Test Setup guides an agent through designing statistically valid, actionable experiments and building a continuous growth experimentation program. It establishes core principles such as formulating data-backed hypotheses, isolating single variables, maintaining statistical rigor, and measuring primary, secondary, and guardrail metrics. The skill covers assessment of test context, sample size reference calculations, variant design best practices, traffic allocation strategies, client-side versus server-side implementation considerations, and pre-launch checklists. It also provides a structured analysis workflow for evaluating statistical significance and interpreting results. Furthermore, it supports scaling experimentation as an ongoing growth engine through hypothesis generation from multiple data sources, ICE prioritization scoring, experiment velocity tracking, and building a reusable experiment playbook. Reach for this skill when you need to plan, design, or implement an A/B test, split test, or multivariate experiment, or when establishing a systematic product growth experimentation practice.

Key Features

Data-backed hypothesis structure and framework
Sample size and traffic allocation reference guidelines
Primary, secondary, and guardrail metrics selection
Pre-launch and analysis checklists for statistical rigor
ICE scoring and continuous growth experimentation loop

Privacy & Security

Data Collection

This tool follows industry-standard security practices and only collects data necessary for functionality.

Information

Developercoreyhaines31
Version1.0.0
Ratingeveryone
LanguagesEnglish

Actions

  • Assess test context and baseline data
  • Formulate an experiment hypothesis
  • Calculate required sample sizes
  • Select primary and guardrail metrics
  • Design test variants and traffic splits
  • Analyze test results for statistical significance
  • Prioritize hypotheses with ICE scoring