a/b testing lab
A/B Testing Lab
ARIA runs continuous experiments across every channel. Winners auto-promote at 95% confidence + 500 samples per variant.
5 live · 2 ready to ship
Live tests
5
Awaiting promotion
2
Avg measured lift
+18.4%
Auto-promote rule
95% · 500/var
CTA Button Text
Landing page
Click-through rate
hypothesis'Get Access Now' will outperform 'Start Saving Time'
A
4.2%
Click-through rate
"Start Saving Time"
3,120 samples
BLeading
5.1%
Click-through rate
"Get Access Now"
3,088 samples
Traffic split A 50% · B 50%
Statistical confidence92%
Lift 21.4% · winner Variant B
Samples to call3,088 / 4,000
Day 4 of 7 · 3 remaining
Email Subject — Question vs Statement
Welcome email
Open rate
hypothesisQuestion format outperforms statement format
A
38.4%
Open rate
"Are you losing 10 hours a week to tasks AI could do?"
5,200 samples
BLeading
41.7%
Open rate
"I saved 12 hours this week — here's the system I used"
5,180 samples
Traffic split A 50% · B 50%
Statistical confidence97%
Lift 8.6% · winner Variant B
Samples to call5,180 / 4,000
Day 10 of 14 · 4 remaining
Instagram Hook Format
Instagram Reels
Watch-through rate
hypothesisNumber hooks outperform question hooks
ALeading
48.1%
Watch-through rate
"12 hours saved this week 👇 Here's exactly how"
18,400 samples
B
42.0%
Watch-through rate
"What if your Monday was already handled by Friday? 👇"
18,120 samples
Traffic split A 50% · B 50%
Statistical confidence99%
Lift 14.5% · winner Variant A
Samples to call18,120 / 10,000
Day 6 of 7 · 1 remaining
Pricing Anchoring
Website /pricing
Purchase conversion
hypothesisShowing $47 crossed out increases $25 conversions
A
2.1%
Purchase conversion
"$25 only"
1,820 samples
BLeading
3.4%
Purchase conversion
"$47 → $25 (47% off)"
1,795 samples
Traffic split A 50% · B 50%
Statistical confidence88%
Lift 61.9% · winner Variant B
Samples to call1,795 / 3,000
Day 9 of 21 · 12 remaining
Urgency Language
All email CTAs
Click rate
hypothesisScarcity framing outperforms deadline framing
A
6.2%
Click rate
"Offer ends August 31"
4,400 samples
BLeading
7.0%
Click rate
"Only 4 days left at this price"
4,380 samples
Traffic split A 50% · B 50%
Statistical confidence71%
Lift 12.9% · winner Variant B
Samples to call4,380 / 6,000
Day 5 of 14 · 9 remaining