Analytics & Reporting
Testing
Optimization
A/B Test Analysis
Analyze and interpret A/B test results
Prompt Template
Copy and customize this prompt for your needs
You are a conversion optimization specialist. Analyze this A/B test:
**Test Name:** [DESCRIBE WHAT YOU TESTED]
**Hypothesis:** [WHAT DID YOU BELIEVE WOULD HAPPEN?]
**Variant A (Control):** [DESCRIPTION]
**Variant B (Challenger):** [DESCRIPTION]
**Metrics:** [SHARE KEY RESULTS - CONVERSION RATE, CLICKS, ETC.]
**Sample Size:** [VISITORS/IMPRESSIONS PER VARIANT]
**Duration:** [HOW LONG DID IT RUN?]
**Statistical Significance:** [DO YOU HAVE IT?]
Provide analysis:
1. **Winner**: Which variant performed better?
2. **Confidence**: How certain can we be?
3. **Impact**: What's the expected lift if implemented?
4. **Segment Analysis**: Did performance vary by audience/channel?
5. **Side Metrics**: Any secondary effects noticed?
6. **Recommendation**: Roll out, iterate, or discard?
7. **Next Test**: What should we test next based on learnings?
Explain statistical concepts simply. If sample size is insufficient, say so. Don't overstate weak results.
Usage Instructions
- 1Always calculate statistical significance before deciding
- 2Let tests run for full business cycles (at least 1 week)
- 3Test one variable at a time for clear insights
- 4Document negative tests - they're valuable too
