Top Banner
Visual Engagement Metrics: Your Optimization Secret Weapon Visual Engagement Metrics: Your Optimization Secret Weapon Visual Engagement Metrics » Your Optimization Secret Weapon
42

How Eye Tracking Research Helps You Run Better A/B Tests

Apr 15, 2017

Download

Marketing

CXL
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret WeaponVisual Engagement Metrics: Your Optimization Secret Weapon

Visual Engagement Metrics » Your Optimization Secret Weapon

Page 2: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret WeaponVisual Engagement Metrics: Your Optimization Secret Weapon

Agenda● Quick conversion research overview ● What is visual engagement research ● How to set up an eye tracking study ● Case Studies from Sticky ● Case Studies from ConversionXL Institute

○ Ecommerce Product Pages○ Visual Cues on a Landing Page

● Q&A

Page 3: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 4: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

What’s a Winning Optimization Process?● Run as many tests as possible at all times (every day without a test

running on a page/layout is regret by default)● Win as many tests as possible● Have as high impact (uplift) per successful test as possible

Page 5: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

There are many frameworks. Here’s ours.

Page 6: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

ResearchXL● Finding opportunity areas

○ Digital analytics○ Technical analysis○ Heuristic analysis

● Finding possible solutions (and more opportunity areas)○ Qualitative surveys○ User testing○ Mouse tracking / session replay

Page 7: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Marrying qualitative & quantitative dataYou’re trying to answer a few questions:

● Who is my customer?● How are they interacting with my site?● What are their possible problems?● How can we potentially fix them?

Page 8: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

PXL Prioritization Model

Page 9: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Continuous innovation in customer understanding

● Better and better ways to answer “how are users interacting with my site?”

● These insights help form better A/B tests (and make you more money)● Introducing Sticky.AI

Page 10: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

What is Visual Engagement Analysis?It’s essentially a visual display of the user experience at a scale large enough to infer trends and insights.

Page 11: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Types Visual Engagement Analysis

<6% correlation with mouse movement and eye tracking

Scroll Click/Hover Eye Tracking

Page 12: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How Visual Engagement Analysis Helps

● See if people get stuck● See if important elements are

being missed● Know if something is being

read● Know in what order elements

are being seen● All used to optimize layout,

creative, CTA placement, and much more.

Important branding is not seen

Majority of visual attention focused on celebrity face

Page 13: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

What is Eye Tracking?Sticky is leader in web-based eye tracking

Page 14: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Why Visual Engagement is AwesomeData is displayed as an aggregate which is a valuable way to understand the overall experience of visitors

Correlates with >70% of action, purchase intent, likeability, recall and click

Page 15: How Eye Tracking Research Helps You Run Better A/B Tests

Accurate on device measurement using built-in camera

Scalable implementation and analysis

Quick data visual output - available in just hours

Simple drag and drop setup, participant interface, no install required

500,000,000 gaze points measured

amazon.com ( press Ctrl key 3 times to turn highlighting on/off)

display ad replacement (Look for the smiley face)

Innovative Technology

Page 16: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Analyzing Norwegian Airlines’ Visual Engagement

Page 17: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How to Run a Visual Engagement Study

Page 18: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

According to this map, there’s too much going on.

Page 19: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

The improved version includes smaller images and a more

prominent call to action

Page 20: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Results

The CTA button is now the main focus after the redesign:

● 1st thing seen

● Seen 10% more

● Seen 2X longer

● Button is noticed 2X

Page 21: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

UX Research with Eye-Tracking to Create Better Tests

We combine visual engagement metrics with surveys that determine things like recall, perception, and recognition to conduct better tests and find more opportunity areas.

Information Processing Theory

Incoming info (e.g., website homepage)

sensory memory

working memory

long-term memory

Page 22: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

UX Research with Eye-Tracking to Create Better Tests

We combine visual engagement metrics with surveys that determine things like recall, perception, and recognition to conduct better tests and find more opportunity areas.

Information Processing Theory

Incoming info (e.g., website homepage)

sensory memory

working memory

long-term memory

Eye-Tracking

Post-task Survey

Page 23: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Examples - 1. Optimizing the eCommerce Product page2. Visual Cue Study

Ecommerce Product Page - Three part study:

1. How Product Image Size Impacts Value Perception2. How Product Image Size Affects Attention and Engagement3. How Does Product Copy Format Affect User Engagement?

Page 24: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How Product Image Size Impacts Value Perception

● Hypothesis 1: Larger Image = Higher Value Perception● Hypothesis 2: Hypothesis 1 might change with different product classes

Page 25: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How Product Image Size Impacts Value Perception

experience good

search good

Page 26: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How Product Image Size Impacts Value Perception

experience good

search good

+ ~$2

+ ~$15

Page 27: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How Product Image Size Affects Attention & Engagement

● Hypothesis: A large product image will garner more attention than a smaller one.

Page 28: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

How Product Copy Format Affects User Engagement

● Hypothesis: Product information will be viewed differently depending on how it’s formatted

● 9 Variations based on description format - Paragraph, Bullets, Nothing (control)

Page 29: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

What can we do with all this data?

● Quantify high impact opportunity areas (copy format, image size, etc.)● Develop stronger hypotheses

○ “Increasing product image size will increase order volume”

● Improve testing prioritization/strategy○ “Higher lift for techy type products”

Page 30: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Visual Cues StudySettle debates with data, not years old case studies

Which visual cue works best?

Page 31: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

We studied 6 variations

● Human looking away form● Human looking towards form● Arrow● Triangular ● Line● Prominent form

Page 32: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 33: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 34: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 35: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 36: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 37: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Page 38: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Results?

Page 39: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Other studies using same approach:

Social Proof

Value Proposition

Pricing Page Plan Order

Trust Seals

Homepage Banner Ads

Ecommerce Benefit List Placement

Online Reading Patterns

Page 40: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Conclusion: Tying it All Together

Visual engagement studies lower the cost of A/B testing by focusing your design changes on the areas that need it most, making the live-traffic split experiments more effective.

Page 41: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

Questions?

Page 42: How Eye Tracking Research Helps You Run Better A/B Tests

Visual Engagement Metrics: Your Optimization Secret Weapon

CXL-STICKY-WEBINAR

Conversion optimization training program