ab-test-architect - Design rigorous, dev-ready A/B tests
Plans and prioritizes A/B tests with hypotheses, metrics, sample sizes, durations, segmentation, and implementation guidance.
Tags
Updated: 2026-10-07A/B testingconversion rate optimizationexperiment designhypothesis testingsample size planningtest prioritization
Capabilities
Typical Inputs
What this skill does
- Gather testing context
- Prioritize ideas with PIE
- Write structured hypotheses
- Define success metrics
- Calculate sample sizes
- Estimate test duration
- Plan traffic segmentation
Inputs
- Test target
- Baseline conversion rate
- Traffic volume
- Optimization problem
- Test ideas
- Testing tool
- Audience definition
- Supporting evidence
- Minimum detectable effect
Outputs
- Test prioritization matrix
- Test hypothesis
- Primary metric definition
- Guardrail metric definitions
- Sample size estimate
- Test duration estimate
- Segmentation strategy
- Dev-ready test plan
