Top Banner
62

Practical Cloud

Jan 21, 2018

Download

Technology

Lynn Langit
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Practical Cloud
Page 2: Practical Cloud

• 5 – 15x market share of all others (US market)AWS Dominates

• AWS cloud bills are for ‘old services’ (EC2, RDS)80% EC2++

• First-time cloud projects outcome rate*50% FAIL

Page 3: Practical Cloud

Definitions

Vendors

Patterns

Lessons

1

2

3

4

Page 4: Practical Cloud
Page 5: Practical Cloud
Page 6: Practical Cloud

10 Million Executions = ~ $ 500 USD

Page 7: Practical Cloud

FilesAWSS3

RDBMSAWSRDS

VMsAWSEC2

Page 8: Practical Cloud
Page 9: Practical Cloud
Page 10: Practical Cloud
Page 11: Practical Cloud

Use imageFiles -> “BIG”

Application PLUS OS

Coordinate with Load Balancers

Mature Technology

Use Dockerfiles ->

“small”

Application

Coordinate with Container

Managers

New Technology

Page 12: Practical Cloud
Page 13: Practical Cloud

Just write code –> “tiny”

Function / Method

Auto-scales

Very New Technology

Use Dockerfiles –> “small”

Application

Coordinate via Container Mgr.

New Technology

Page 14: Practical Cloud

100

101

VM Container Lambda

Drive to Lambda – Save MoneyCost

Page 15: Practical Cloud

5

50

95

Lambda Container VM

Use VMs – Keep ControlControl

Page 16: Practical Cloud
Page 17: Practical Cloud
Page 18: Practical Cloud

“But why areCompute AND File Storage commoditieson Azure, AWS AND GCP?”

Page 19: Practical Cloud
Page 20: Practical Cloud

Compute

EC2

Containers

Lambda

Files

S3

Glacier

Data

RDS

DynamoDB

Other

Machine Learning

Kinesis

Serverless

Page 21: Practical Cloud

Alpha

Some parts may work

Service may be changed

Service may be discontinued

Beta

Many parts shouldwork

Service may be changed

Year One

Most parts shouldwork

Can include some service integrations

Year Two

All parts shouldwork

Patterns and scripts emerge

Year Three

Service is stable

Tools and partners emerge

Page 22: Practical Cloud
Page 23: Practical Cloud

$$ $ $$$

Page 24: Practical Cloud

Functions• Logic Apps• No Code • Generates JSON

Which Vendor?

Page 25: Practical Cloud
Page 26: Practical Cloud
Page 27: Practical Cloud

Server-based Solutions

Page 28: Practical Cloud

Server-based Solutions

High AvailabilityCore Security

Page 29: Practical Cloud

Server-based Solutions

High AvailabilitySecurity

Page 30: Practical Cloud

Server-based Solutions

High AvailabilitySecurityScalabilityCost Control

Page 31: Practical Cloud

Google Compute

Engine

Very fast to start

…globally

Automatically discounted

for sustained use

Easier to size via the ’slider’

Page 32: Practical Cloud
Page 33: Practical Cloud
Page 34: Practical Cloud
Page 35: Practical Cloud
Page 36: Practical Cloud
Page 37: Practical Cloud

Hadoop/Spark Transform

Visualization Client

Data Lake

ANSI SQLExploratory

ANSI SQL Warehouse

Page 38: Practical Cloud

Kappa Architecture on the Cloud – Servers?

Page 39: Practical Cloud

PySpark ETLGlue

Visualization Client - QuickSight

Data Lake – S3

Explore SQLAthena

MPP SQL Spectrum

Page 40: Practical Cloud

AWS

Page 41: Practical Cloud

AWS

Page 42: Practical Cloud

Beam ETLDataflow

Visualization Client - DataStudio

Data Lake – GCS

Explore SQLBigQuery

MPP SQL BigQuery

Page 43: Practical Cloud
Page 44: Practical Cloud
Page 45: Practical Cloud
Page 46: Practical Cloud
Page 47: Practical Cloud
Page 48: Practical Cloud

Servers / IaaS?

PaaS?

Serverless?

Integration testing?

Orchestration?

Deployment?

Page 49: Practical Cloud

“My” Programming

Language ?

Debugging?

Unit testing?

Integration testing?

Orchestration?

Deployment?

Page 50: Practical Cloud
Page 51: Practical Cloud

AWS X-Ray

Page 52: Practical Cloud
Page 53: Practical Cloud
Page 54: Practical Cloud
Page 55: Practical Cloud
Page 56: Practical Cloud

Reduce Attack

Surface

Test external

connections

Minimal permissions

Granular policies

Unique credentials

Page 57: Practical Cloud
Page 58: Practical Cloud
Page 59: Practical Cloud

Service Costs

Training Costs

Tooling Costs

Migration Costs

Learning Costs

Page 60: Practical Cloud

Service Type Servers (or Containers) Serverless

Compute EC2 Lambda

Files File Services on EC2 S3

SQL on Relational Data RDBMS on EC2 or RDS Athena / Redshift Spectrum

Data Pipeline Kafka cluster on EC2 Kinesis

Machine Learning EMR with Spark ML orHadoop on EC2

Machine Learning API

IoT MQTT Message Broker RabbitMQ on EC2 IoT Broker

NoSQL MongoDB… on EC2 DynamoDB

Page 61: Practical Cloud
Page 62: Practical Cloud