Top Banner
GLOBAL SPONSORS Architecture Overview for Data Analytics Deployments Mahmoud Ghanem Sr. Systems Engineer
26

Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

Feb 18, 2019

Download

Documents

dangdan
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

GLOBAL SPONSORS

Architecture Overview for Data Analytics Deployments

Mahmoud Ghanem

Sr. Systems Engineer

Page 2: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 2

Agenda

• The Big Picture

• Top Use Cases for Data Analytics

• Modern Architecture Concepts for Data Analytics

• Dell EMC Solutions to Simplify Data Analytics

© Copyright 2017 Dell Inc. 2

Page 3: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 3

The Big Picture…

+

DATA

ANALYTICS DEVOPS CLOUD

+ =

INDUSTRY

LEADER

KNOW

SOONER

ACT

FASTER

SCALE

IT

DIGITAL

DISRUPTION

Page 4: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 4

DATA ANALYTICS SPECTRUM

DESCRIPTIVE

STATISTICS

PREDICTIVE

MODELING

PRESCRIPTIVE

RECOMMENDATIONS

GENERAL

INTELLIGENCE

DATA MINING

MACHINE LEARNING

GENERAL AI

Page 5: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 5

Top Use Cases for Data Analytics

EDW Optimization

360 View of Customer

Security, Risk & Compliance

IOT

Predictive Analytics

Operations Intelligence

ML

Page 6: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

DATA ANALYTICS PLATFORM

Dashboards Visualization

Platform As A Service

Data Marketplace Application Marketplace

Collaboration Real time Control

ENABLE DATA FOR CONSUMPTION – ANALYTICS / DATA APIS

OPEN STANDARDS DATA INGESTION, STORE, CLEANSE & GOVERNANCE

Data Ingestion (IoT, Social, City, Personal)

Data Stores (Structured, Unstructured, Object, In-Memory,

Key Value)

Data Wrangling (Transformation, Cleansing)

Data Governance (Audit, Workflow, Encryption)

INFRASTRUCTURE FOUNDATION

SECU

RIT

Y

Cloud M&O (Private,

Public)

Business Continuity (Backup & Recovery, DR)

Compute (Converged, Scale-up, Scale-out)

Network (SDN,SAN, WAN, Wireless)

Storage (SDS, Block, File, Object)

DATA LAYER

APPLICATION LAYER

Data Discovery

Search

Analytics (Graph, Machine Learning, Spatial,

Sentiment)

API Management (Data API, Micro-Services)

Catalog

INFRASTRUCTURE LAYER

Page 7: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 7

A strategic comparison of modern architecture concepts

for Data Analytics.

Page 8: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 8

BUY

BUILD

Page 9: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 9

BUY

Page 10: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 10

BUY • Time to value

• Commodity use case

• Simplicity at a cost

• Incumbent evolution/expansion

• Existing talent

• Use/source diversity is low

Page 11: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 11

BUILD

Page 12: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 12

BUILD

• Unique value stream

• Snowflake use case

• Cheap = Complex

• Lower cost of incumbents

• Talent and DevOps culture

• Massive scale and variety

• Lower cost of incumbents

• Talent and DevOps culture

• Massive scale and variety

Page 13: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 13

BATCH

STREAMING

Page 14: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 14

BATCH

Page 15: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 15

BATCH

• Descriptive

• Fidelity matters

• Large volumes

• Data Science playground

• Time is relative

• Scheduled

Page 16: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 16

STREAMING

Page 17: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 17

STREAMING

• Potentially Predictive

• Speed trumps fidelity

• Parallel for streams

• Data Science outcomes

• Talent and DevOps culture

• Massive scale and variety

Page 18: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 18

PUBLIC

PRIVATE

Page 19: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 19

VIRTUAL

PHYSICAL

Page 20: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 20

DAS

NAS

Page 21: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 21

Page 22: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 22

Biz Apps

Priorities

Services

Deploy

Compute

Dell EMC

portfolio

Knowledge

Ready Nodes

Ready Bundles

Ready Systems

The Ready Solutions formula

Page 23: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 23

Dell EMC Ready Bundles for Hadoop

End-to-end data

management,

processing and

analytics with

‘no-code-needed’

deployment plus

high double-digit

performance gains

Dell EMC Ready Bundle for Cloudera Hadoop

Capacity optimized

and efficient data

processing and

data lake platform

leveraging Isilon

for shared storage

for Hadoop with

HDFS as a

protocol.

Dell EMC Ready Bundle for Hortonworks with

Isilon

Open Source data

management,

processing and

analytics solution

that efficiently

process multi-

structured data

volumes using

existing tools and

resources

Dell EMC Ready Bundle for

Hortonworks Hadoop

Page 24: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 24

Big Data Technology Advisory Service • Develop an architecture and plan to implement big data capabilities

Analytics Application development

Statistical Modeling/Natural

Language Processing/

Machine Learning

Data Exploration/ Visualization

Enterprise Search/Index

Business Intelligence

Data Warehousing

Data Transformation

Data Discovery

Data Tagging / Metadata

Management

Hadoop / SQL on Hadoop

Enterprise Log Analysis

Data Ingestion

Key Steps:

1. Determine Target

Capabilities and Outcomes

2. Assess Current State

3. Determine Future State

Architecture

4. Perform Gap Analysis

5. Recommend Architecture

Roadmap and plan

Page 25: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration

© Copyright 2017 Dell Inc. 25

The journey is worth it

Page 26: Architecture Overview for Data Analytics Deployments · DATA ANALYTICS PLATFORM Dashboards Visualization Platform As A Service Data Marketplace Application Marketplace Collaboration