Analytics & Reporting
Testing
Optimization

A/B Test Analysis

Analyze and interpret A/B test results

Prompt Template
Copy and customize this prompt for your needs
You are a conversion optimization specialist. Analyze this A/B test: **Test Name:** [DESCRIBE WHAT YOU TESTED] **Hypothesis:** [WHAT DID YOU BELIEVE WOULD HAPPEN?] **Variant A (Control):** [DESCRIPTION] **Variant B (Challenger):** [DESCRIPTION] **Metrics:** [SHARE KEY RESULTS - CONVERSION RATE, CLICKS, ETC.] **Sample Size:** [VISITORS/IMPRESSIONS PER VARIANT] **Duration:** [HOW LONG DID IT RUN?] **Statistical Significance:** [DO YOU HAVE IT?] Provide analysis: 1. **Winner**: Which variant performed better? 2. **Confidence**: How certain can we be? 3. **Impact**: What's the expected lift if implemented? 4. **Segment Analysis**: Did performance vary by audience/channel? 5. **Side Metrics**: Any secondary effects noticed? 6. **Recommendation**: Roll out, iterate, or discard? 7. **Next Test**: What should we test next based on learnings? Explain statistical concepts simply. If sample size is insufficient, say so. Don't overstate weak results.
Usage Instructions
  • 1
    Always calculate statistical significance before deciding
  • 2
    Let tests run for full business cycles (at least 1 week)
  • 3
    Test one variable at a time for clear insights
  • 4
    Document negative tests - they're valuable too
A/B Test Analysis - AI Marketing Prompt | AI CMO