Top Banner
Creating a Data-Driven Organization Carl Anderson
59

Creating a Data-Driven Organization, Crunchconf, October 2015

Jan 10, 2017

Download

Data & Analytics

Carl Anderson
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Creating a Data-Driven Organization, Crunchconf, October 2015

Creating a Data-Driven Organization

Carl Anderson

Page 2: Creating a Data-Driven Organization, Crunchconf, October 2015

Why data-driven?

Page 3: Creating a Data-Driven Organization, Crunchconf, October 2015
Page 4: Creating a Data-Driven Organization, Crunchconf, October 2015

5% more productive

Controlling for other factors, data-driven orgs are

Brynjolfsson, et al 2011. Strength in numbers: how does data-driven decisonmaking affect firm performance? Social Science Research Network http://bit.ly/1dg896Y

Page 5: Creating a Data-Driven Organization, Crunchconf, October 2015

$13 / $1 invested

Analytics pays back

Nucleus Research. 2014. http://bit.ly/XQFDbv

Page 6: Creating a Data-Driven Organization, Crunchconf, October 2015

What is data-driven?

Page 7: Creating a Data-Driven Organization, Crunchconf, October 2015

Having lots of reports does not make you data-driven.

Page 8: Creating a Data-Driven Organization, Crunchconf, October 2015

Having lots of dashboards does not make you data-driven.

Page 9: Creating a Data-Driven Organization, Crunchconf, October 2015

Having lots of alerts does not make you data-driven.

Page 10: Creating a Data-Driven Organization, Crunchconf, October 2015

Figure from http://www.bwfhosting.com/we-got- your-back/

Page 11: Creating a Data-Driven Organization, Crunchconf, October 2015

Data-driven: you must have analytics

Not necessarily data-driven !

Reporting Analysis

Descriptive Prescriptive

What? Why?

Backward-looking Forward-looking

Raise questions Answer questions

Data → Information Data + Information → insightsReports, dashboards, alerts Findings, RecommendationNo context story telling

Page 12: Creating a Data-Driven Organization, Crunchconf, October 2015

Figure from https://www.sas.com/news/sascom/analytics_levels.pdf

Levels of Analytics

Page 13: Creating a Data-Driven Organization, Crunchconf, October 2015

Analytics Value Chain

Figure from http://adobe.ly/1HLJKGk

Page 14: Creating a Data-Driven Organization, Crunchconf, October 2015

“Analytics is about impact…In our company [Zynga], if you have brilliant insight and you did great research and no one changes, you get zero credit.”

Ken RudinFacebook

Page 15: Creating a Data-Driven Organization, Crunchconf, October 2015

Train analysts to be business savvy

2013 Strata+Hadoop talk: https://www.youtube.com/watch?v=RJFwsZwTBgg

Page 16: Creating a Data-Driven Organization, Crunchconf, October 2015

Having a hadoop cluster does not make you data-driven.

Page 17: Creating a Data-Driven Organization, Crunchconf, October 2015
Page 18: Creating a Data-Driven Organization, Crunchconf, October 2015

Leverage data as a strategic asset.

Page 19: Creating a Data-Driven Organization, Crunchconf, October 2015

Data-driven requires a data culture

Page 20: Creating a Data-Driven Organization, Crunchconf, October 2015

Culture

Testing

Iterative, learning

Open, sharing

Self service

Data leadership

Broad data literacy

Inquisitive,Questioning

Goals first

Data Driven Culture

Page 21: Creating a Data-Driven Organization, Crunchconf, October 2015

a strong testing culture

Being data-driven means having…

Innovate through online and offline experimentation. Encourage hypothesis generation broadly across org.

Page 22: Creating a Data-Driven Organization, Crunchconf, October 2015

“you get surprises more often, and surprises are a key source of innovation. You only get a surprise when you are trying something and the result is different than you expected, so the sooner you run the experiment, the sooner you are likely to find a surprise, and the surprise is the market speaking to you, telling you something you didn’t know.”

Scott CookIntuit

Baer, D. 2013. Why Intuit founder Scott Cook want you to stop listening to your boss. Fast Company

Page 23: Creating a Data-Driven Organization, Crunchconf, October 2015

Optimize for Right Thing

Page 24: Creating a Data-Driven Organization, Crunchconf, October 2015

Iterate

Page 25: Creating a Data-Driven Organization, Crunchconf, October 2015
Page 26: Creating a Data-Driven Organization, Crunchconf, October 2015

an open, sharing culture

Being data-driven means having…

No data hoarding or silos. Bring data together to create rich contexts. Connect the dots.

Page 27: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Belinda Smith

Context is King

Page 28: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Belinda Smith

Context is King

Page 29: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Belinda Smith

Context is King

Page 30: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Belinda Smith

Context is King

Page 31: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Address

Belinda Smith

Context is King

Page 32: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Address

Belinda Smith

Context is King

Page 33: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Address

Belinda Smith

Context is King

Page 34: Creating a Data-Driven Organization, Crunchconf, October 2015

Order #16478645

Address

Refer a friend

Belinda Smith

Context is King

Page 35: Creating a Data-Driven Organization, Crunchconf, October 2015

1 / 3business leaders frequently make decisions

with data that they cannot trust

Business Analytics and Optimization for the Intelligent Enterprise. IBM. http://ibm.co/1LR2pCr

Invest in data quality

Page 36: Creating a Data-Driven Organization, Crunchconf, October 2015

a self service culture

Being data-driven means having…

Business units have necessary data access as well as within-team analytical skills to drive insights, actions, and impact.

Page 37: Creating a Data-Driven Organization, Crunchconf, October 2015

Traits of great analysts

• Numerate • Detail-oriented • Skeptical • Confident • Curious • Communicators • Data lovers • Business savvy

Few, S. 2009. Now You See It. Analytics Press, Oakland has a good discussion of this topic, pp. 19–24.

Page 38: Creating a Data-Driven Organization, Crunchconf, October 2015

Hiring not just as individuals but to complement team

Nordstrom data lab (as of Strata 2013)

Page 39: Creating a Data-Driven Organization, Crunchconf, October 2015

a broad data literacy

Being data-driven means having…

All decision-makers have appropriate skills to use and interpret data.

Page 40: Creating a Data-Driven Organization, Crunchconf, October 2015

Analysts must sell, sell, sell their product

Page 41: Creating a Data-Driven Organization, Crunchconf, October 2015

Figure from http://www.uglyresearch.com/UglyResearch_DataEasy_DecidingHard.pdf

Tie actions to outcomes

Page 42: Creating a Data-Driven Organization, Crunchconf, October 2015

a goals first approach.

Being data-driven means having…

Set out metrics before experiment. What does success mean? Have an analysis plan. Prevent gaming the system.

Page 43: Creating a Data-Driven Organization, Crunchconf, October 2015

an objective, inquisitive culture

Being data-driven means having…

‘“Do you have data to back that up?” should be a question that no one is afraid to ask and everyone is prepared to answer’—Julie Arsenault.

Page 44: Creating a Data-Driven Organization, Crunchconf, October 2015

a visible, clearly-articulated strategy

Being data-driven means having…

Commonly understood vision. Suite of well-designed, accessible KPIs. All staff understand how their work ties back to these metrics.

Page 45: Creating a Data-Driven Organization, Crunchconf, October 2015

strong data leadership

Being data-driven means having…

A head of data to evangelize data as strategic asset with budget, team, and influence to drive cultural change.

Page 46: Creating a Data-Driven Organization, Crunchconf, October 2015

Which strategies have proved successful in promoting a data-driven culture in your organization?

Strategy % of respondents

Top-down guidance and / or mandates from execs 49

Promotion of data-sharing practices 48

Increased availability of training in data analytics 40

Communication of the benefits of data-driven decision-making 40

Recruitment of additional data analysts 17

2013. Fostering a data-driven culture. Economist Intelligence Unit. http://bit.ly/1MeGoN8

Page 47: Creating a Data-Driven Organization, Crunchconf, October 2015

but bottom up too

Change should not just be top-down

Everyone in org has role and responsibility through “leveling up” their data skills, mutual mentoring, and embedding data into their processes.

Page 48: Creating a Data-Driven Organization, Crunchconf, October 2015

2014 O’Reilly Data Science Salary Survey

Learn and you shall receive

Page 49: Creating a Data-Driven Organization, Crunchconf, October 2015

blindly following data.

Being data-driven doesn’t mean

Augment decision makers with objective, trustworthy, and relevant data.

Page 50: Creating a Data-Driven Organization, Crunchconf, October 2015
Page 51: Creating a Data-Driven Organization, Crunchconf, October 2015
Page 52: Creating a Data-Driven Organization, Crunchconf, October 2015

using data to effect impact and results

Ultimately, data-driven means

Push data through “analytics value chain” from collection, analysis, decisions, action, and finally to impact. Partway along chain doesn’t count.

Page 53: Creating a Data-Driven Organization, Crunchconf, October 2015

Example actions• Analyst competency matrix

• Raise bar for new analyst hires

• Vision statement: data culture

• Stats for managers class

• Mentor / train analysts to improve skills such as stats, SQL

• Mentoring staff in experimental design

• Democratizing data access through BI tools

• Push on ROI, tie back to strategic objectives

Page 54: Creating a Data-Driven Organization, Crunchconf, October 2015

Don’t get complacent!

“With the exception of, say, an Amazon, no global store chain was thought to have demonstrably keener data-driven insight into customer loyalty and behavior”

Page 55: Creating a Data-Driven Organization, Crunchconf, October 2015

Tesco Today

• Tesco stock rated as junk

• Shedding 9000 jobs

• Closing 43 stores

• $9.6B loss for 2014 fiscal year ($33Bn debt)

• Tried and failed to sell Dunhumby, their analytics gem

• Warren Buffett: “I made a mistake on Tesco”

Page 56: Creating a Data-Driven Organization, Crunchconf, October 2015

Data

OrganizationDecision Making

People

Data LeadershipCulture

Analytics org: composition, skills, training

Data quality, data management

Embedded, federated analytics

Testing mindset, fact-based, anti-HiPPO

Chief Data Officer / Chief Analytics Officer

Collaborative, inclusive, open, inquisitive

Summary

Page 57: Creating a Data-Driven Organization, Crunchconf, October 2015

Bake in data-driven culture early!

Page 58: Creating a Data-Driven Organization, Crunchconf, October 2015

Available now

1. What is Data-Driven? 2. Data Quality 3. Data Collection 4. Analyst Org 5. Data Analysis 6. Metric Design 7. Story Telling 8. A/B Testing 9. Decision Making 10. Data-Driven Culture 11. Data-Driven C-suite 12. Privacy, Ethics 13. Conclusions

Copyright © 2015 Carl Anderson

Page 59: Creating a Data-Driven Organization, Crunchconf, October 2015

Questions?

@leapingllamas

http://p-value.info

[email protected]