Top Banner
Cloud Data at Epic Scale with DataStax Enterprise and Pivotal Cloud Foundry Gilbert Lau, Partner Architect, DataStax [email protected] Pieter Humphrey, Principal PMM, Pivotal @pieterhumphrey
28

Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Apr 13, 2017

Download

Technology

Pivotal
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

PCF Metrics – App Dev

Providing App Developers insight into app performance

Cloud Data at Epic Scale with DataStax Enterprise and Pivotal Cloud Foundry

Gilbert Lau, Partner Architect, DataStax [email protected] Pieter Humphrey, Principal PMM, Pivotal @pieterhumphrey

Page 2: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

DataStax offers proven technology

500+ #1 Customers 30+

Percent

Ranked #1 in multiple operational database

categories

Page 3: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Building on the shoulders of giants at DataStax

•  Cluster Architecture

•  Partitioning •  Replication •  Gossip •  Anti-Entropy •  Hints

Schema Memtables Compaction SStables Commit Log

Page 4: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

You’re already using DataStax Enterprise!

Filling a prescription Watching movies online

Browsing news sites

Shopping Online

Depositing a check electronically

Playing popular video games

powered by

Page 5: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

A Multi-Model Platform for a Variety of Use Cases

Page 6: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Apache Cassandra Software

Extensions Data Models Cassandra

We start with Cassandra, that gives you a high-performance, distributed, always-on database that remains operationally simple when scaled in a single datacenter or across multiple datacenters and clouds.

Page 7: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Data Models Software

Extensions Cassandra Data Models

We then provide multiple, flexible data models that allow you to service your applications’ need for different data storage and access requirements in a single platform.

Page 8: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Software Extensions Cassandra Data Models

Finally, we wrap around that commercial software extensions that are purpose built to deliver everything you need to confidently run and manage web, mobile, and IoT applications throughout your enterprise.

Software Extensions

Page 9: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Delivering Value Across Core Use Cases

Customer Experience Internet of Things Machine Learning

Customer 360

Personalization

Time Series

Messaging

Fraud Detection

Predictive

Page 10: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Powering Cloud Applications with DSE

Responsive Intelligent Distributed

+ +

Masterless Architecture

Private, Public & Hybrid

Continuous Availability

Active Everywhere

Local Low Latency

Linear Scale

Multi-Model

Mixed Workloads

Operations Automation

Page 11: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

What is for DataStax for PCF?

Unmanaged Service Broker for your

existing DSE

We are looking for feedback & understanding of real world

DataStax Enterprise in PCF use cases

PCF-Managed (on-demand)

Service Broker for DSE

Page 12: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Hold on. ... a what? a Service Broker?

Page 13: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Application state on Pivotal Cloud Foundry

Application State

File system not shared across

container instances

Short lived, ephemeral

local file system

State is managed externally to the platform

Page 14: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

What is DataStax Enterprise for PCF?

•  We have partnered with Pivotal to explore options for supporting DataStax Enterprise as a service offering on Pivotal Cloud Foundry (PCF)

•  Requires a Bring Your Own License (BYOL) for DataStax Enterprise

•  Multiple service options under consideration:

•  Unmanaged Service Broker – supports automatic integration of applications with externally managed DSE cluster

•  Managed Service Broker – supports on-demand BOSH managed creation of DSE Enterprise service instances

Page 15: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Service Brokers and Pivotal Cloud Foundry

What types of services does PCF offer? •  Managed - Fully integrated, with

full lifecycle management •  User-Provided – Created and

managed external to the platform (unmanaged)

What is a service? •  Allows resources to be easily

provisioned on-demand •  Often middleware and other

“components” necessary for applications

•  Can be a persistent, stateful layer

USER PROVIDED

(UNMANAGED)

FULLY PCF MANAGED

Page 16: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Service Brokers and Applications

1.  Upload app bits and metadata

push app

Router2.  Create and bind services

3.  Stage application

4.  Deploy application

5.  Manage application health

Blobstore DB

Cloud Controller Service Broker Node(s)

DEA DEA

DEA Cell

+ app MD

+ =

Service credentials

Container Management - DIEGO

Brain

Page 17: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Service Brokers and Applications

Router

Pla+ormRun.me

DB Service credentials

reserve resources create service (HTTP) create service (HTTP)

bind service (HTTP) bind service (HTTP) obtain connection data

CLI Cloud Controller

Service Broker

Data Service

Page 18: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

DataStax Enterprise Service Brokers

•  Unmanaged Service Broker – supports automatic integration of applications with externally managed DSE Enterprise cluster

•  Managed Service Broker – supports on-demand BOSH managed creation of DSE Enterprise service instances

Page 19: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Unmanaged Service Broker Overview

Pivotal Cloud Foundry Elastic Runtime

Page 20: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Unmanaged Service Broker Benefits

•  For use with externally managed DSE clusters •  Automatic integration of applications with externally managed DSE cluster •  Allows applications on Pivotal Cloud Foundry to discover external DSE cluster IP

addresses •  Creation & delivery of unique database user credentials based on DSE roles

through service plans Use cases: •  On-board existing production and non-production DSE cluster(s)

Page 21: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Managed Service Broker Overview

Pivotal Cloud Foundry Elastic Runtime

Page 22: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Managed Service Broker Benefits

App Developers:

•  Self service marketplace empowers

application developers to create and scale

out their own dedicated DSE clusters

when required.

•  Automatic integration of applications with

databases; creation and delivery of

database user credentials to applications

via environment variables.

For IT Operators:

•  Multiple resources based

service plans to fit different

application requirements

•  Service plan quota limits govern

resource exposure

Page 23: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Some Managed Service Broker Use Cases

TEST / DEV

Dedicated Cluster

CI

Page 24: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Managed Service Broker Sample Service Plans

Plan Description Sample Bronze Plan Deploy a dedicated DSE 5.x service instance suitable for development or light workloads

demanding moderate networking performance. Defaults: Cluster Size: 3 (configurable up to 40) Instance Type: m3.large

Sample Silver Plan Deploy a dedicated DSE 5.x service instance suitable for moderate workloads demanding high networking performance. Defaults: Cluster Size: 5 (configurable up to 40) Instance Type: m3.xlarge

Sample Gold Plan Deploy a dedicated DSE 5.0 C* service instance suitable for heavy workloads demanding high networking performance. Defaults: Cluster Size: 5 (configurable up to 40) Instance Type: m3.2xlarge

* Instance types can be changed by Operator

Page 25: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

Demo

Page 26: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

DataStax for PCF Summary

Unmanaged & managed (on-demand)

Service Broker options

Supports DataStax Enterprise 5.x

(incl. OpsCenter 6.x)

PoT available for demonstration and

evaluation

We are looking for feedback & understanding of real world

DataStax Enterprise in PCF use cases

Page 27: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry

© Copyright 2016 Pivotal Software Inc. All rights reserved. © Copyright 2016 Pivotal Software Inc. All rights reserved. © Copyright 2016 Pivotal Software Inc. All rights reserved.

•  Share the demos with your colleagues

•  Unmanaged Service Broker - https://www.youtube.com/watch?v=-qOcrTsws7g •  Managed Service Broker - https://www.youtube.com/watch?v=k13rIia6qqo

•  The Unmanaged Service Broker tile for DSE will be available soon at http://network.pivotal.io

•  If you are interested in test-driving our Managed Service Broker integration, please contact me by [email protected] or your sales representatives from either Pivotal or DataStax

Next Steps

Page 28: Cloud Data at epic scale with DataStax Enterprise and Pivotal Cloud Foundry