Top Banner

Click here to load reader

69

Ask Measure Learn

Jun 19, 2015

Download

Business

Lutz Finger

Making sense of your data doesn't require mountains of data; it requires a systematic approach that leads to actionable insights. But how to get there? This keynote (given at "Predictive Analytics and Business Insights") shows how to extract significant business value from big data with Ask-Measure-Learn, a system that helps you ask the right questions, measure the right data, and then learn from the results. Using this system can help you learn to:

* Focus on business-related questions
* Find measures that have high causation, a low error rate and a low cost
* Create actionable insights by starting with predictions, benchmarks or recommendations
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Ask Measure Learn

Ask Measure Learn Lutz Finger

Last update: March 3, 2014

Page 2: Ask Measure Learn

The philosophy of the day is . data-ism

—DAVID BROOKS (@NYTDAVIDBROOKS)

Page 3: Ask Measure Learn

Who ? •  Lutz Finger •  Director Data Analytics at LinkedIn •  Author of Ask Measure Learn •  Co-Founder Fisheye Analytics

(sold to WPP) @LutzFinger LutzFinger.com linkedin.com/in/lutzfinger

am I

Page 4: Ask Measure Learn
Page 5: Ask Measure Learn
Page 6: Ask Measure Learn

Who ? are you

Page 7: Ask Measure Learn

Rahul Todkar Most Popular

Mario Vinasco Earliest Adopter

Bruno Aziza Most Connected

Ron Goncalves, MBA, PMP,

Most Endorsed

Page 8: Ask Measure Learn
Page 9: Ask Measure Learn
Page 10: Ask Measure Learn
Page 11: Ask Measure Learn
Page 12: Ask Measure Learn

Actionable Insights?

Page 13: Ask Measure Learn

Intellectually enriching – at most

Page 14: Ask Measure Learn

We focus too much on technology

ENGINEERS DATA SCIENTISTS

Google Search on the term “Big Data”

Page 15: Ask Measure Learn

ASK the right Questions.

MEASURE the right data – even if it is not Big data.

Take Actions and LEARN from them.

?

Page 16: Ask Measure Learn

Ask the right

Question

ASK

Page 17: Ask Measure Learn

THE HARDEST PART

ASK

Page 18: Ask Measure Learn

Let’s do “Social Media”

ASK

Page 19: Ask Measure Learn

ASK

Source: IBM Institute for Business Value.

Page 20: Ask Measure Learn

Please find an “INFLUENCER”

•  Opinion leaders (Katz 1955) •  Influentials (Merton 1968) •  Law of the Few (Gladwell 2000)

ASK

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 21: Ask Measure Learn

A few person decide what we do…

ASK

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 22: Ask Measure Learn

REALLY?

ASK

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 23: Ask Measure Learn

Dear Marketers,

There is no influencer. It’s a myth.

ASK

Page 24: Ask Measure Learn

Reality 50% is Homophily

Source: Kevin Lewisa, Marco Gonzaleza and Jason Kaufman (2012): PNAS Vol 109, no 1

•  4 years •  1001 Students on Facebook •  traditional Self-reported Data •  How did taste Spread

Influence is often overestimated. It needs:

§  Reach §  Readiness

§  Topic Dependence

ASK

Page 25: Ask Measure Learn

Aja Dior M.?

AP News?

ASK

Page 26: Ask Measure Learn

Aja Dior M. omgg, my aunt tiffany who work for whitney houston just found whitney houston dead in the tub. such ashamed & sad :(

45 min

Aja Dior M.?

AP News?

ASK

Page 27: Ask Measure Learn

I want to create “REACH”

… in order to “SELL”

ASK

Page 28: Ask Measure Learn

Measure the right Data

MEA

SURE

Page 29: Ask Measure Learn

The world is full of WRONG metrics

•  Click Rates – Media •  Low CPO advertisers •  Etc..

MEA

SURE

Page 30: Ask Measure Learn

30

What is RIGHT?

Mea

sure

M

EASU

RE

Source: WIkipedia

Page 31: Ask Measure Learn

even if it is not Big Data

MEA

SURE

Page 32: Ask Measure Learn

277+ Million Members = a lot of Data

Data Volume

Ana

lytic

al C

halle

nge

&

Com

ple

xity

Identity Data

Social Data

Behavioral Data

MEA

SURE

Page 33: Ask Measure Learn

More Data More Insights does not equal

MEA

SURE

Page 34: Ask Measure Learn

Web API

Data ELT and Aggregation

Petabyte Gigabyte Bit Terabyte 1 2 3 4

We want small data….

Analytics Portal

Reach or

No Reach

MEA

SURE

Page 35: Ask Measure Learn

Calculating Reach via Network Data

1977: Linton C. Freeman, “Centrality based on Betweenness .”

MEA

SURE

Page 36: Ask Measure Learn

“REACH” creates awareness

“SELL” needs purchase intend

MEA

SURE

Page 37: Ask Measure Learn

Correlations are important

MEA

SURE

Page 38: Ask Measure Learn

What is your behavior?

MEA

SURE

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 39: Ask Measure Learn

The issue with the Correlation / Causation

MEA

SURE

Page 40: Ask Measure Learn

Sometimes data is not easy to get.

MEA

SURE

Page 41: Ask Measure Learn

Social Behavior is ‘unstructured’

MEA

SURE

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 42: Ask Measure Learn

It is way easier to work with ‘structured data’

New York Weather in April 2013

MEA

SURE

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 43: Ask Measure Learn

43

ME

AS

UR

E

MEA

SURE

Source: Jeffrey Breen

Page 44: Ask Measure Learn

44

What is RIGHT?

MEA

SURE

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 45: Ask Measure Learn

Right and learn from them.

Actions

LEA

RN

Page 46: Ask Measure Learn

Information vs. Action…

0 Connections

59%

1 Connection

28%

2 Connections

4%

4 Connections

3%

LEA

RN

Page 47: Ask Measure Learn

47

Information vs. Action…

0 Connections

59%

1 Connection

28%

2 Connections

4%

4 Connections

3%

LEA

RN

Page 48: Ask Measure Learn

Three Types of actionable Insights

Benchmark Predictions

Recommendations &

Filter

LEA

RN

Page 49: Ask Measure Learn

BENCHMARK

LEA

RN

Page 50: Ask Measure Learn

50

Competitive Benchmark

LEA

RN

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 51: Ask Measure Learn

RECOMMEND & FILTER

LEA

RN

Page 52: Ask Measure Learn

LinkedIn Recommendation Products

People You May Know

Groups You May Like

Ads You Be Interested in

Companies you May Want to Follow

Puls

Similar Profiles

LEA

RN

Page 53: Ask Measure Learn

Recommendations Impact

More than 50% of

group joins

More than 50% of

connections

More than 50% job

applications

LEA

RN

Page 54: Ask Measure Learn

Filter

LEA

RN

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 55: Ask Measure Learn

PREDICTIONS

LEA

RN

Page 56: Ask Measure Learn

Predicting the OSCAR 2013

LEA

RN

Page 57: Ask Measure Learn

Predicting the OSCAR

LEA

RN

Page 58: Ask Measure Learn

Predicting the OSCAR

LEA

RN

Source: Farsite

Possible other Features: CROWDSOURCED: •  Box Office Results •  Movie Goer Reviews •  Critics OTHER “Hard Facts” •  Genre •  Payment of Actors •  Etc.

Page 59: Ask Measure Learn

Predicting Box Office

LEA

RN

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 60: Ask Measure Learn

Predictions are not easy, especially if they are about the Future

LEA

RN

Page 61: Ask Measure Learn

Propensity to Email Marketing

Emily

Score = 0.9

Steve Score = 0.9

Behavioral Score = 0.5

Identity Score = 0.3

Social Score = 0.1

Behavioral Score = 0.2

Identity Score = 0.3

Social Score = 0.4

... With premium account, you get more search results and access to …

... Do you know 5 of you connections have started to use premium account …

LEA

RN

Page 62: Ask Measure Learn

Which Model to use

LEA

RN

Source: ‘Ask Measure Learn’ by O’Reilly Media

Page 63: Ask Measure Learn

Which Model to use

LEA

RN

Google’s Prediction API

Page 64: Ask Measure Learn

Many more examples…

Benchmark Recommendation & Filter Predict LEA

RN

Page 65: Ask Measure Learn

Data Wrangling & Data Science is getting Easier

LEA

RN

Page 66: Ask Measure Learn

Update Training

LEA

RN

Page 67: Ask Measure Learn

Summary

Page 68: Ask Measure Learn

ASK the right Questions.

Forget Big Data but

MEASURE the right data.

Take Actions and LEARN from them.

?

Page 69: Ask Measure Learn

We are hiring!