Introduction to Real User Measurement
Jul 02, 2015
Introduction to
Real User Measurement
© 2013 SOASTA. All rights reserved. 2
Agenda
Introduction to RUM
Why RUM First
Demo of mPulse
Questions & Answers - input via Chat
Hosts:
Chris Addis & Oliver Hunt
© 2013 SOASTA. All rights reserved. 3
Speed is a means to an end,
not the ultimate goal
Happy
Customers
Spend &
Stay
Around
© 2013 SOASTA. All rights reserved. 5
Unhappy Customers Leave YouFrustrated customers = lost business
Boun
ce
Rate
Load Time
*Bounce Rate Defined: http://en.wikipedia.org/wiki/Bounce_rate
o Study for a cross section of
sites
o 8 Million pages
o 1.5 Million Visits
o 50 different dimensions
• Browsers
• Geographies
• Bandwidth Classifications
© 2013 SOASTA. All rights reserved. 6
Unhappy Customers Don’t BuyA case study from the world’s largest retailer
o 2011 – Walmart presents
findings from a RUM study
done to show the impact of
site performance on
revenue
o Results are staggering
• 1s improvement = 2%
conversion lift
• 100ms improvement = 1%
increase in incremental
revenueSource: SF WebPerf Meetup - http://minus.com/msM8y8nyh#2e
© 2013 SOASTA. All rights reserved. 7
Unhappy Customers Damage your Brand
© 2013 SOASTA. All rights reserved. 8
So if we want happy customers, everything we
do should put the user first,
© 2013 SOASTA. All rights reserved. 9
Which means our performance measurement
should focus on measuring users
© 2013 SOASTA. All rights reserved.
How fast am
I?
How fast should I
be?
How do I get
there?
© 2013 SOASTA. All rights reserved.
How fast am
I?
How fast should I
be?
How do I get
there?
http://www.flickr.com/photos/usnavy/
How do you
measure a
user?
© 2013 SOASTA. All rights reserved. 13
Users are different in many waysDifferent locations, browsers, pages & devices
© 2013 SOASTA. All rights reserved. 14
But all users use computers
&/or mobile devices
© 2013 SOASTA. All rights reserved. 15
So put something inside the computer
But not these computers
http://www.flickr.com/photos/luc/
http://www.flickr.com/photos/luc/
These computers
© 2013 SOASTA. All rights reserved.
How Fast Am I?
Instrument Every Interaction On Your Web Site
Copy Paste View
Results
© 2013 SOASTA. All rights reserved.
How fast am
I?
How fast should I
be?
How do I get
there?
© 2013 SOASTA. All rights reserved. 20
Start with the behaviors you care aboutMeasure them using RUM
Bounce
RateConversio
n
Revenu
e
Likes, Shares,
EtcComment
s
Items
Sold
Signup
s
© 2013 SOASTA. All rights reserved. 21
Then plot how speed changes the metricsExample: Bounce rate vs. page load time
© 2013 SOASTA. All rights reserved. 22
Choose a metric value to targetExample: 30% Bounce Rate
© 2013 SOASTA. All rights reserved. 23
Derive the required speed from the chartExample: 3.5 second load time for a 30% or better bounce rate
3.5 sec
© 2013 SOASTA. All rights reserved. 24
Understand what is need to reach goalsTo get a bounce rate of 15% the load time needs to be 2 sec
2 sec
© 2013 SOASTA. All rights reserved.
How fast am
I?
How fast should I
be?
How do I get
there?
© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 26
Find variations to focus on
o Geographic variations
o Browser variations
o Bandwidth variations
o Page variations
o Time variations
o Day variations
© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 27
Page variations
© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 28
Browser variations
© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 29
Geographic variations
© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 30
mPulse supports all of these
© 2013 SOASTA. All rights reserved.
mPulse
Collect
everything
Map to business
objectives
View real
user data in
real time
Real Time, Real User Intelligence
SOASTA mPulse
SOASTA mPulse
www.soasta.com/mpulse