Top Banner
Reaktor Mannerheimintie 2 00100, Helsinki Finland tel: +358 9 4152 0200 www.reaktor.com [email protected] Confidential ©2015 Reaktor All rights reserved garbage in, garbage out Data quality in a TMS world Simo Ahava Senior Data Advocate
74

SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Apr 21, 2017

Download

Internet

Simo Ahava
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Reaktor Mannerheimintie 2 00100, Helsinki Finland

tel: +358 9 4152 0200 www.reaktor.com [email protected]

Confidential ©2015 Reaktor All rights reserved

garbage in, garbage out Data quality in a TMS world

Simo Ahava Senior Data Advocate

Page 2: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Simo AhavaSenior Data Advocate, Reaktor

Google Developer Expert, Google Analytics

Blogger, developer, www.simoahava.com

Twitter-er, @SimoAhava

Google+:er, +SimoAhava

Page 3: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Data quality isn’t fixed. Depending on the

hypothesis, a single data set can shift from

useless to incredibly insightful without a

single datum changing shape, size, form, or

function.

#1 Data is subjective

Page 4: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Plug-and-play Analytics

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 5: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Plug-and-play AnalyticsData quality isn’t acquired — it’s earned.

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 6: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

from online-behavior.com

Page 7: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

from online-behavior.com

Page 8: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Claim 1: Data quality is destroyed

by laziness and lack of ambition.

Page 9: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Claim 2: A TMS empowers

developers more than others.

Page 10: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

The root of all evil

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 11: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

The root of all evilThe "project"

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 12: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Your organization is creating absurd

amounts of data with every passing second,

and it’s very difficult to adapt to the fluctuations

without an agile, process-driven mindset.

#2 Data is a process

Page 13: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

The project is often a series of handovers,

breeding non-involvement.

Page 14: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Specification Implementation Analysis Results

Page 15: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Specification Implementation Analysis Results

Businessowner

Page 16: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Specification Implementation Analysis Results

Businessowner

Marketing

Page 17: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Specification Implementation Analysis Results

Businessowner

Marketing

Developer

Page 18: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

This leads necessarily to silos, which have entry

and exit conditions.

Page 19: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Implementation Analysis Results

Businessowner

Marketing

Developer

Specification

Page 20: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Implementation Analysis Results

Businessowner

Marketing

Developer

Specification

Page 21: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Implementation Analysis Results

Businessowner

Marketing

Developer

Specification

Page 22: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Implementation Analysis Results

Businessowner

Marketing

Developer

Specification

Page 23: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Implementation Analysis Results

Businessowner

Marketing

Developer

Specification

Page 24: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Implementation Analysis Results

Businessowner

Marketing

Developer

Specification

Page 25: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Silos, so what?

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 26: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Silos, so what?As long as the work gets done, right?

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 27: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Data is the lifeblood of the organization. It flows

through all departments, across job titles,

permeating the very fabric of the organization,

reinforcing its foundations for growth.

#3 Data abhors silos

Page 28: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Do these sound familiar:

Page 29: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Monthly reports which lack relevance, are rife with generic suggestions that lack research in the context of your business, reiteration of previous month’s points, even if there are

solid reasons why they weren’t addressed.

Page 30: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Ridiculously ugly and ineffective JavaScript hacks for measurement points which should be tackled in the Data Layer.

Page 31: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Hiding behind data, and passing blame to other silos.

Could someone fix the Bounce Rate metric on our

site?

Page 32: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Analytics feature requests are deprioritized, and deployed extremely infrequently.

Fix transactionRevenue to show revenue, not

customer weight.

Page 33: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Communication is difficult due to the overhead of meeting face-to-face, project plans are set in stone during sales, and it’s difficult to change existing project goals or set new ones

due to consultants being hired as "extra pairs of hands" rather than advisors.

Page 34: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

These are symptoms of data being treated as a

project outcome.

Page 35: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Cure I: The Data Layer

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 36: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Cure I: The Data LayerUsing technology to solve communication problems

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 37: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Typically, there are three definitions

of Data Layer that we use in the digital world.

Page 38: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World
Page 39: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

1. Set of business requirementsfor tracking digital assets,visits, and visitors.

Page 40: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

1. Set of business requirementsfor tracking digital assets,visits, and visitors.

2. Encoded, global data structure, accessed and modified by connected platforms.

Page 41: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

1. Set of business requirementsfor tracking digital assets,visits, and visitors.

2. Encoded, global data structure, accessed and modified by connected platforms.

2. Data model of a connected platform, which copies or digests information in the global structure.

Page 42: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

1. Set of business requirementsfor tracking digital assets,visits, and visitors.

2. Encoded, global data structure, accessed and modified by connected platforms.

2. Data model of a connected platform, which copies or digests information in the global structure.

dataLayer.push({ 'pageType' : 'home' });

google_tag_manager['GTM-123'] .dataLayer .set('pageType', 'home');

Page 43: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Across all three definitions, the purpose of a Data Layer

is simple:

Page 44: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

DMP / DWH / TMS / etc.

X X

Actions Presentation

Data Layer

Page 45: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

DMP / DWH / TMS / etc.

X X

Actions Presentation

Data Layer

The purpose of a Data Layer is to provide a bilateral layer on the digital asset, which decouples, normalises, and uniformly encodes semantic

information passed through and stored within.

Page 46: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

The Data Layer is a joint venture, where people and

systems communicate across silos.

Page 47: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

DMP / DWH / TMS / etc.

let tracker = GANTracker.sharedTracker() tracker.trackEvent("revenue", action:"Q1", value:"15678000") tracker.trackEvent("revenue", action:"Q2", value:"16888000") tracker.trackEvent("revenue", action:"Q3", value:"15991000") tracker.trackEvent("revenue", action:"Q4", value:"19133000")

rq12014,rq22014,rq32014,rq42015 15677998,16887988,15990988,19133400

analytics.collect({ ' revenueQ1' : ' 15677998.00', ' revenueQ2' : ' 16887988.00', ' revenueQ3' : ' 15990988.00', ' revenueQ4' : ' 19133400.00' })

Page 48: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

DMP / DWH / TMS / etc.

let dataLayer = new Array()dataLayer.push({ "revenue_Q1_2014" : "15677998.00", "revenue_Q2_2014" : "16887988.00", "revenue_Q3_2014" : "15990988.00", "revenue_Q4_2014" : "19133400.00"})

Page 49: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Cure II: The Process

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 50: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Cure II: The ProcessInvolve, involve, involve

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 51: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

An iterative, agile process is necessary for

optimal utilization of a TMS.

Page 52: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Definition of Done

Page 53: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Definition of DoneDeveloped features do not impede measurement. Developed features are trackable.

Sprint

Page 54: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Definition of DoneDeveloped features do not impede measurement. Developed features are trackable.

Sprint

If necessary, feature is encoded with tracking attributes.

If necessary, feature is linked to a Data Layer object.

Feature

Page 55: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Definition of DoneDeveloped features do not impede measurement. Developed features are trackable.

Sprint

If necessary, feature is encoded with tracking attributes.

If necessary, feature is linked to a Data Layer object.

Feature

Attribute syntax is correct for tracking.

Data Layer object syntax is correct.

Task

Page 56: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World
Page 57: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Constant participation

Page 58: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Constant participationTransparency

Page 59: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Cure III: Empowerment

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 60: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Cure III: EmpowermentWe are all hybrid beings

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 61: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

The entire life cycle of a single data point, from collection to reports,

requires knowledge and expertise to manage.

#4 Data is difficult

Page 62: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Developer facilitation is crucial to data quality

and optimized data collection.

Page 63: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

1: Education

Page 64: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

1. JavaScript: www.codecademy.com, www.codeschool.com, Professional JavaScript for Web Developers, DOM Enlightenment…

2. Digital analytics: www.kaushik.net, www.simoahava.com, Successful Analytics, Practical Google Analytics and Google Tag Manager for Developers…

3. Training, courses, certifications: Digital Analytics Association, Digital Analytics Fundamentals (Google), Market Motive…

4. Conferences: MeasureCamp, SMX, eMetrics, Digital Analytics Hub, ConversionXL, Superweek, All Things Data…

Page 65: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

treat content as a product2: hybrid skills

Page 66: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

"Business owner"- No operational skills

+ Strategic

"Developer"- Uncooperative

+ Methodical

"Marketer"- Bully

+ Consultative

Page 67: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

+ Passionate, actively interested+ Understands ever-changing requirements+ Good grasp of digital tech+ Statistical mindset+ Knows the product / service inside and out+ Critical about the present, curious about the future

Page 68: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

treat content as a product3: Passionate interest

Page 69: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

+ Dedicated sandbox

+ Website or blog to test new ideas on

+ Test and debug setups in Google Analytics and Google Tag Manager

+ Utilization of GTM environments

Page 70: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Hire to educate, not to delegate

PO

Developer Analyst

Page 71: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Hire to educate, not to delegate

PO

Developer Analyst

Page 72: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Data is difficult

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 73: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Data is difficultData quality is earned, not acquired

@SimoAhava from @ReaktorNow | #SPWK | 5 Feb 2016

Page 74: SuperWeek 2016 - Garbage In Garbage Out: Data Quality in a TMS World

Thank [email protected]

www.simoahava.com

Twitter: @SimoAhava

Google+: +SimoAhava

Data is difficult - http://goo.gl/53aFUU

The Schema Conspiracy - http://goo.gl/o2Pwys

Further reading:

10 Truths About Data - http://goo.gl/EpesEj