MT32 How relational (SQL) and unstructured data (Hadoop) learned to get along

MT32How relational (SQL) and unstructured data (Hadoop) learned to get along

David Leibowitz, Dell EMC

Stephen Kyriakos, North Texas Tollway Authority

Larry Levy, Microsoft

“The computer isn’t the thing. The computer’s the thing that gets us to the thing”- Joe MacMillan

3

Big Data

4

What Can I Do About It?

When Will it Happen?

Why Did it Happen?

What Happened?

Questions asked of Big Data

Innovation

Complex implementations

Spreadmarts

Siloed data

Transactional systems

Valu

e

Enterprise data warehouse

OLAPETL

Operational Reporting

Machine learning

Any dataIn-memory

Internet of Things

Optimization &

StimulationHadoop

DashboardsAd hoc analysis

Predictive Analytics

Data mining

Example of the Harmony of Structured & Unstructured Data:

Healthcare

Case Study:

Fullerton Health

Example of the Harmony of Structured & Unstructured Data:

Public

Case Study:

North Texas TollwayAuthority

9

BI System – 0 to 70 MPH

10

Theirs Theirs

11

Ours

12

Everyone drives on toll roads

$9.5 Billion in new projects

13

First to use transponder as

a method for toll collection

First to convert

entire system to ETC

Paving the way

14

• Public entity / Private bonds

• Multiple / diverse audiences

• Blind to 20% of customers

• Capture data at 70 MPH

It’s complicated

15

BI solves the complicated

7.4 million customers

2.1 million daily transactions

97% customer satisfaction

One of the fastest growing regions in the U.S.

16

It’s complicated. How we did it

Evaluated resources

Talked to the business

Reviewed infrastructure

Made a plan

17

Why BI? Inventoried data

VarietyVelocity

Venue

Volume

18

Define the “to be” state

Manage hybrid workloads

Integrate with business partners

Self-Service and Full-Service Analytics

Extend the solution

19

Delivered CARS

20

Become Your

Own Architect

We can purchase this photo if you like it.

It speaks to finding a solution that works – cutting through

layers in order to get what you need.

Defined our “To Be” stateExtend the BI team

Empower usersBe your own architect

21

Our Next Steps

Example of the Harmony of Structured & Unstructured Data:

Education

23

Demo:

Student Analytics with Education Data Management

24

Getting Started

25

Stakeholders

Procurement

PMO

It takes a village

Lessons Learned

Data Modernization & Becoming Future Ready

27

Key takeaways

Complicated is doable

Serve the business

Build a flexible, scalable solution

Plan your work, work your plan