Top Banner
Data Stack Considerations: Build vs. Buy at Tout July 14, 2016
36

Data Stack Considerations: Build vs. Buy at Tout

Jan 07, 2017

Download

Technology

Looker
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Data Stack Considerations: Build vs. Buy at Tout

Data Stack Considerations:Build vs. Buy at Tout

July 14, 2016

Page 2: Data Stack Considerations: Build vs. Buy at Tout

Housekeeping

• We will do Q&A at the end.

• You should see a box on the right

side of your screen.

• There is a button marked “Q&A” on

the bottom menu.

• We will be recording this

• We will send you the recording

tomorrow.

• We will also send you the slides

tomorrow.

RecordingQ&A

Page 3: Data Stack Considerations: Build vs. Buy at Tout

Jad DeFantiVP, Technical Operations

John HamminkDeveloper Evangelist

Ming LiuSr. Software Architect

Erin FranzAlliances Analyst

2

Meet Our Presenters

David BankerDirector, Product

Management

Page 4: Data Stack Considerations: Build vs. Buy at Tout

4

AGENDA

1.2.3.4.

Quick intro to Treasure Data

Quick intro to Looker

Build vs. Buy at Tout

Q & A

Page 5: Data Stack Considerations: Build vs. Buy at Tout

Treasure Data makes ….

Page 6: Data Stack Considerations: Build vs. Buy at Tout

WHO WE ARE

Page 7: Data Stack Considerations: Build vs. Buy at Tout

WHO WE ARE

Page 8: Data Stack Considerations: Build vs. Buy at Tout

BEFORE

• Data loss• Inflexible• Silos• Complex Integrations• High Costs• High Time-To-Market

ETL Team

EDW Team

BITeam

End UserSystem

Page 9: Data Stack Considerations: Build vs. Buy at Tout

AFTEROPTION

1

Page 10: Data Stack Considerations: Build vs. Buy at Tout

OPTION 2

AFTER

Page 11: Data Stack Considerations: Build vs. Buy at Tout

Make it easy for everyone to find, explore and

understandthe data that drives your

business.

2

Page 12: Data Stack Considerations: Build vs. Buy at Tout

A DATA PLATFORM THAT DOES BOTHFind, explore and understand all the data

Explore EverythingFind, explore and

understand all the data

Create StandardsDefine your data and

business metrics

Any SQL DatabaseAnalyze all of your data

where it is stored

Build a Data Culture

Anyone can ask and answer questions

How is pipeline for Q4?

Will we meet our revenue

targets?

Which campaigns

convert best?

Which rep is converting

best?

Which customer is at risk?

Can we speed up our

operations?

Page 13: Data Stack Considerations: Build vs. Buy at Tout

THE TECHNICAL PILLARS THAT MAKE IT POSSIBLE

100% In Database

Leverage all your dataAvoid summarizing or moving it

Modern Web Architecture

Access from anywhereShare and collaborate

Extend to anyone

LookML Intelligent Modeling Layer

Describe the dataCreate reusable and shareable

business logic

Page 14: Data Stack Considerations: Build vs. Buy at Tout

Leverage a Looker Block or App or quickly implement a custom deployment for a complete analytics solution

Looker makes TD data accessible and interactive for anyone from Finance to Marketing to Customer Service

Leverage the TD platform in real time with Looker to get actionable insights to anyone

Full flexibility over defining data at query time with LookML w/o modeling ahead of time.

Best of Breed

Fast Time to Value

Analytic Flexibility

Data for Everyone

Simplified Analytics, Powerful Data Discovery.

Page 15: Data Stack Considerations: Build vs. Buy at Tout

15

How Treasure Data & Looker saved us from our Analytics stack and vendor

15

Page 16: Data Stack Considerations: Build vs. Buy at Tout
Page 17: Data Stack Considerations: Build vs. Buy at Tout
Page 18: Data Stack Considerations: Build vs. Buy at Tout
Page 19: Data Stack Considerations: Build vs. Buy at Tout
Page 20: Data Stack Considerations: Build vs. Buy at Tout

20

Analytics & Tout Platform usage growth

• Tout utilized both a turnkey analytics solution and an internal home-grown service

• Analytics events and costs skyrocketed in Q4 2015

Page 21: Data Stack Considerations: Build vs. Buy at Tout

21

Legacy systems issues• Single source vendor

• Home grown solution not reliable and difficult to support

Page 22: Data Stack Considerations: Build vs. Buy at Tout

22

What problems were we trying to solve with analytics?

22

repetitive, long term

unpredictive, short term

customers' predefined

dashboards

customers' ad-hoc reports

requests

internal routine reports

internal ad-hoc reports

external, direct impact

internal, indirect impact

foundation

foundation

Page 23: Data Stack Considerations: Build vs. Buy at Tout

23

What were our demands and costs?

23

customer demand internal demand

direct & indirectEngineering / OPEX cost vendor cost

our options

Page 24: Data Stack Considerations: Build vs. Buy at Tout

24

What to build?

buy one-stop solution

(blackbox)

build custom solution

(whitebox)

rent and integrate specialized components (greybox)

less flexibleless time / effortmore expensive

more flexiblemore time / effort

less expensive

Blackbox, Whitebox or something in between?

Page 25: Data Stack Considerations: Build vs. Buy at Tout

25

What were the attributes of analytics reports required?

Charts&

Reports

Aggregated Data

Raw Data

smaller, faster, comprehensible

bigger, slower, incomprehensibl

e

flexible, detailed

rigid, brief

Page 26: Data Stack Considerations: Build vs. Buy at Tout

26

How we fixed the problem• Completely re-think data analytics

Best of breed over single vendor and home-grown solutions

• Outsource as much as possibleScale-Out over Scale-Up

Page 27: Data Stack Considerations: Build vs. Buy at Tout

27

What does our solution look like?Data Collection & Storage

Reporting Database Data Analytics/Visualization

Primary Owner Treasure Data MySQL / Redshift LookerInfrastructure Vendor & Customer Customer Vendor

Page 28: Data Stack Considerations: Build vs. Buy at Tout

28

How does it work? Amazon S3

backup data

aggregated dataAmazonRedshift

Looker

Treasure Data

coordinator

events

scaleable

receiver

SinatraPumaRack

TD logger

Fluentd

Tout’s logic

TD outputTout’s config

Tout’s logic

Page 29: Data Stack Considerations: Build vs. Buy at Tout

29

Keeping up with the businessCustomers will adopt our services if we provide better

• Daily Reports• Monthly Reports• Better insights into Tout platform usage data

Page 30: Data Stack Considerations: Build vs. Buy at Tout

30

Deliver Insight Quickly

Page 31: Data Stack Considerations: Build vs. Buy at Tout

31

Deliver Customized Insights Quickly

Page 32: Data Stack Considerations: Build vs. Buy at Tout

32

Room to EvolveWhere do we go from here?

• Customized and generic platform usage reports• Predictive revenue analytics• Analytics now open to all stakeholders• Upsell Additional Analytics Reporting

Page 33: Data Stack Considerations: Build vs. Buy at Tout

33

Summary• Tout now meets its customers’ and internal stakeholders’

reporting needs

• Tout analytics OPEX has been reduced by 50%

• Tout Engineering & Operations can now focus on applications & infrastructure most relevant to our value to customers

Page 34: Data Stack Considerations: Build vs. Buy at Tout

Q&A

12

Page 35: Data Stack Considerations: Build vs. Buy at Tout

THANK YOU FOR JOINING

Recording and slides will be posted.

We will email you the links tomorrow.

See you next time!

Next from Looker Webinars: Winning with Data on July 28

See how Treasure Data and Looker work on

your data.

Visit treasuredata.com and looker.com/free-trial or email

[email protected].

Page 36: Data Stack Considerations: Build vs. Buy at Tout

THANK YOU!