Page 1
SPLIT TESTING STRATEGY
Optimization & Testing Is Only As
Good As Your Methodology. Learn to
Convert Traffic Into Sales in 5-Steps
Page 2
Your Optimization Strategy
Page 3
PAGE IDENTIFICATIONIS THE
FIRST STEPTO A GREAT TEST
Page 4
“NOT ALL PAGES ARE TEST WORTHY”
Page 6
Pages With Volatile Traffic
Page 7
Overly Target Segments
After Personalization
Page 8
NEW TO TESTING?TRY A BOTTOM-UP
APPROACH
Page 9
The Bottom-Up Approach
Start Here
Page 11
Shopping Cart
36.5% LIFT IN
CHECKOUTSSource: MarketingExperiments.com
Page 12
Lead Generation Form
Page 13
Lead Generation Form
44.2% LIFTIN
COMPLETIONSSource: VWO.Com
Page 14
Search Results Page
Source: kameleon.com
Page 16
WHY YOU SHOULD START LOW
Page 17
This is your most qualified
traffic…
Page 18
…they jumped through your
hoops, finish the job!
Page 19
The Case For Starting Low
Page 20
The Case For Starting Low
31% LIFTIN
COMPLETIONS
Source: VWO.Com
Page 21
Your Optimization Strategy
Page 22
DEVELOP A PRIORITIZATION
SCALE
Page 24
WHY BIG LIFTS?
Bigger Lifts Require
Lower Sample
Sizes
Page 25
WHY BIG LIFTS?
These Are The Underperforming Pages
Page 26
Your Lowest
Hanging Fruit
WHY BIG LIFTS?
Page 27
WHY KPIS?
A Big Lift In Clicks
Doesn’t Mean A Big
Lift In Sales!
Page 28
WHY KPIS?
Contextualizes The
Conversion
Page 29
WHY KPIS?
Ask “Which Page
Has The Most
Earning Potential”
Page 30
WHY?
Ask “Which Page
Has The Most
Earning Potential”
Page 31
TWO STEPS FOR EASE
1. Ease Of Test
Implementation
Page 32
TWO STEPS FOR EASE
2. Ease Of Making
Results Live
Page 33
WHY EASE?
Your Lift Potential
On Main KPIs Is
Meaningless If You
Can’t Go Live
Page 34
YOUR CHECKLIST
Test Name
Potential Lift
30%+ = 5
25-29% = 4
10-14% = 3
5-9 = 2
<5 = 1
KPI
Direct Sale = 3
Lead = 2
Micro Conversion
= 1
Ease
1 - 5 Scale Based
On Resources
Total
Highest Number
Gets Priority
Cart Layout Test 3 3 1 6
Landing Page
Headline Test5 2 4 11
Page 35
Case Study: Local Dentist
Goal of site:
•Get inbound calls or completed
contact forms.
•Both calls & forms convert
equally to new patients.
Page 36
Where’s the Form???
Page 37
Case Study: Local Dentist
Found It Way Below the
Fold!
Page 38
Should They Optimize This Page?
Page 40
Your Optimization Strategy
Page 41
CREATE A HYPOTHESIS
Page 42
We believe that changing A
for visitors B will make C
happen.
Page 43
We believe that changing
the call to action copy on
this landing page for new
visitors will make increase
lead form submissions.
Page 44
TESTS WITHOUT HYPOTHESES
AREN’T SCALABLE
Page 45
Click Here Click Here
+17% CTR
Page 46
Click Here Click Here
+17% CTR
Page 47
YOU SELECT YOUR TEST ELEMENT
DURING THIS STAGE
Page 48
CHOOSE WISELY - USE BOTH
ANALYTICS AND UX DATA TO PICK
BIG WINNERS
Page 50
Your Optimization Strategy
Page 51
SCHEDULE YOUR TESTS & STICK TO IT!
Page 53
No Two Days Are The Same!
Source: ConversionXL
Page 54
ALWAYS COMPLETE THE
WEEK
Page 55
PROTIP: TEST PERIODS SHOULD BE IN LINE WITH YOUR
BUYING CYCLE
Page 57
THREE FACTORS THAT IMPACT
TEST TIME
Page 59
CONFIDENCE LEVELINDUSTRY
STANDARD IS 95%
Page 60
NUMBER OF VARIATIONS
Page 61
https://vwo.com/ab-split-test-duration/
Page 62
Your Optimization Strategy
Page 63
ANALYZE & ARCHIVE TEST
RESULTS
Page 64
DEVELOP STANDARD REPORTS - FOCUS ON DOLLARS NOT
MARKETING METRICS
Page 65
IF LEARNINGS ARE SCALABLE - USE AS INSPIRATION FOR
NEW CHANGES/TESTS
Page 66
FINALLY - NOTIFY INVESTED PARTIES
Page 67
• Email: [email protected]
• Twitter: @jtrondeau
• Website: digitalmarketer.com
Justin RondeauOptimization Manager,
DigitalMarketer
Thank You - Let’s Keep
This Conversation Going