Pivotal Data Warehouse in the Age of Digital Transformation

background image: 960x540 pixels - send to back of slide and set to 80% transparency

The Data Warehouse in the Age of Digital Transformation Guest Presenter: Neil Raden, Founder, Hired Brains Research Overview and Comments: Jeff Kelly, Product Marketing, Pivotal

What is Digital Transformation?

“Digital transformation involves making fast and profound change in business activities,

processes, competencies, and models to strategically leverage digital technologies

and their wide-reaching impacts.”

Software is CHANGING

6

Continuous Delivery

Data Warehousing What is the role of …

… In the Age of Digital Transformation?

Founder, Hired Brains Research Today’s Speaker: Neil Raden

-  Founder & Principal Analyst at Hired Brains

Research

-  Co-author of Smart (Enough) Systems

(Pearson Education, 2007)

-  Advisory Board Member of the Boulder

Business Intelligence Brain Trust

Our Topics Today

1.  Data warehouse and data warehousing are not the same thing

2.  Data warehouses still relevant, provide needed capabilities not found elsewhere

3.  Carefully curated and reliable data, optimizers, load balancers and massive scale

4.  But data warehouses based in traditional relational databases have not performed well

5.  Big data technology has actually solved these drawbacks in scale

Copyright 2017 Neil Raden and Hired Brains Research LLC

Data Warehousing Then


Convergence is Here

1950 1960 1970 1980 1990 2000

Batch Reporting

CICS/OLTP

C/S OLTP

Y2K/ERP

4GL/PC/SS DW/BI

Convergence

2010

Operational BI

Composite Apps

BPM

Semantics

Decision Automation

History of the Rift Between Operational and Analytical Processing


Different Way to Visualize It


No More Managing from Scarcity


Digital Transformation & “Instatology”

• More work happens in computers and networks

• How to stop for second to see what’s going on

•  The rise of Instatology. Analytical solutions, cant keep up with the speed and volume of data generated by digital transformation.


Datawarehouseshavetypicallybeencomposedofwhatwemightcall“opera'onalexhaust,”wellorganizedandstructured

Precision,accuracyandconsistency

Hadoopwasfor“digitalexhaust,”informa<oncreatedbyinternetandthebyproductofonlineac<vi<es

Alsomachine-generateddata,documentsandstreamsofsensorsinreal-<me,inamul<tudeofformsnothighlystructured


Operational Exhaust vs. Digital Exhaust

To Simplify the Difference

Hadoop Data Warehouse

How queried Batch Interactive Database Schema Evolving Advanced Query Optimizer None Powerful Maximum data Petabytes Petabytes Maximum processors Unlimited Unlimited Cost Increasing Decreasing


Virtual Data Warehouse •  Deployment agnostic including on premises, private and public cloud

•  Open source

•  Support any data locality (local disk, Hadoop, private and public cloud data.)

•  Run new analytical workloads in-database including machine learning, geospatial, graph, text analytics, etc

•  Ability to handle native data types such as spatial, time-series and/or text

•  Query optimization for big data

•  Complex query formation

•  Massively parallel processing based on the model, not just sharding

•  Workload management

•  Load balancing

•  Full ANSI SQL and beyond.


“Evolved” Analytics: Demand Better Data Prep

• Abstraction of the end-to-end process • Restful API’s • Extreme performance • Limitless types of data sources • Extreme Agility • Robust business modeling capabilities • Statistical/quantitative modeling

“We think too small, like the frog at the bottom of the well. He

thinks the sky is only as big as the top of the well. If he

surfaced, he would have an entirely different view.”

Anonymous


Eero Saarinen

“Always design a thing by considering it in its next larger context – a chair in a room, a room in a house, a house in an environment, an environment in a city plan.”


Semantics


In Conclusion


What is Pivotal Greenplum?

•  Open source data warehouse

•  Massively parallel processing (MPP) architecture

•  Built for diverse analytical use cases

•  Available anywhere you need it – bare metal,

private cloud, public cloud, appliance

Resources and next steps

Download the companion white paper

Visit https://pivotal.io/pivotal-greenplum

Contact Pivotal at https://pivotal.io/contact

Founder, Hired Brains Research Contact Neil Raden

•  Twitter: @NeilRaden

•  Blog: http://hiredbrains.wordpress.com

•  Website: http://www.hiredbrains.com

•  Mail: [email protected]

background image: 960x540 pixels - send to back of slide and set to 80% transparency

Questions

Pivotal Data Warehouse in the Age of Digital Transformation

Technology