Top Banner
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. David de Santiago, Digital Transformation EMEA, Amazon Web Services April 2016 Big Data for Disruptive Models
20

Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Sep 27, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

David de Santiago, Digital Transformation EMEA, Amazon Web Services

April 2016

Big Data for

Disruptive Models

Page 2: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

SOFTWARE IS EATING THE WORLD

DATA IS FUELING

SOFTWARE

Page 3: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

What to Expect from the Session

Page 4: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

“We use Amazon Machine

Learning to analyze customer

feedback on packaging and

create predictions to identify

products that are suited for our

Frustration Free and

eCommerce ready packaging

standards”

Page 5: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Few Examples at Amazon…

It is what allows us to unload an

entire truck full of products and

make them available for purchase in

as little as 30 minutes

Page 6: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

It is what makes Amazon Echo able

to respond to your voice

Page 7: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

50 Billions

Predictions

Per Week

Page 8: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

What does it take to be data driven?

Applications

DevOps

Agile

All Data

Lakes

For ALL

Analytics

Prevent

Predict

Prescript

Page 9: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Gartner: User Survey Analysis: Key Trends Shaping the Future of Data Center Infrastructure Through 2011

IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares

Available for analysis

Generated data

Data volume - Gap

1990 2000 2010 2020

A Growing Gap

Volume

Velocity

Variety

Veracity

Value

Page 10: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Extracting the value of the data

µs ms s min hour day month Year +

Value $

Time

Predict Prevent Prescript

Streams Operational Traditional Scientific

Comfort Zone

Page 11: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Big Data is Breaking the Old Tools

Page 12: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Lower cost,

higher throughput

Highly constrained

Generation Collection &

Storage

Analytics &

Computation

Collaboration &

Sharing

Page 13: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Elastic and highly scalable

No upfront capital expense

Only pay for what you use+

+

Available on-demand+

=Remove constraints

Page 14: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

AnalyzeStore

Glacier

S3

DynamoDB

RDS, Aurora

AWS Big Data Portfolio

Data Pipeline

CloudSearch

EMR (Hadoop)

Redshift

(DWH)

Machine

Learning

ElasticSearchDatabase

Migration QuickSight SQL over

Streams

Kinesis

Firehose

Import Export

(SnowBall)

Direct Connect

Collect

Kinesis (Streams)

Page 15: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

TRANSFORMATIONis treating Data as a

Production Assetas Capital

Page 16: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Many Thousands of Companies Use AWS for Big Data

Page 17: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

“ • Wanted a platform to provide greater speed and

scalability for analyzing petabyte-scale data

• Migrating mission-critical operations to AWS

• Can provide analysts with real-time access to 75

billion records collected daily

• Can move faster, more efficiently in serving core

business processes

FINRA Performs Daily Petabyte-Scale Analysis on Trading Data Using AWS

The Financial Industry Regulatory Authority (FINRA) is

the largest independent regulatory authority in the

United States. It is based in Washington, D.C.

We chose AWS to deliver

innovation at a much larger

scale and much faster to our

core business.

Saman Michael Far

Sr. Vice President of Technology

Page 18: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

World’s leading online travel company, with a portfolio that

includes more than 150 travel sites in 70 countries.

Page 19: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

Migrated off legacy DW to Redshift (start to finish) in 7 man-months

Redshift costs 43% of legacy DW for the same data set (legacy DW cost $1.2M/ year)

Tuned queries now running faster in Redshift than on legacy system

Page 20: Big Data for Disruptive Models - Connekt · DevOps Agile All Data Lakes For ALL Analytics Prevent Predict Prescript. Gartner: User Survey Analysis: Key Trends Shaping the Future of

TRANSFORMATION

underpinned by Big Data

Join me on next session for the disruption recipe