Pivotal CenturyLink Cloud Platform Seminar Presentations: Architecture & Operations

© Copyright 2014 Pivotal. All rights reserved.

Pivotal Cloud Platform Deep DivePart 2: Architecture and The Operator Experience

Andrew Ripka [email protected] @rippmn

1

Keith Resar [email protected] @keithresar

mailto:[email protected]

mailto:[email protected]?subject=


Architecture and the Operator Experience• Pivotal Cloud Foundry Architecture

• Structured Platform for Cloud Native Apps

• One Click CenturyLink Ops Manager and CenturyLink Dashboard

• The Operator Experience

© Copyright 2014 Pivotal. All rights reserved. 3

This…. (not cool).


And this…(also not cool)


Loggregator

DEA Pool

Router Cloud Controller

BOSH Director BOSH Agent

UAA/Login Servers Health Manager

Service Broker Node(s)

Messaging (NATS)

!

IaaS

Cloud Foundry Architecture Stack


Rou

ter

Cloud Controller Service Broker Node(s)

DEA DEA

DEA DEA

Blobstore DB

Runtime

1. Upload bits/metadata

2. Create/bind services

3. Stage app

4. Deploy app

push app+ app MD

SC

+ =

Pushing an application


Rou

ter

Cloud Controller

DEA

Blobstore DB

Runtime

Detect Compile UploadNo

System Buildpacks

+ =

Yes

`

Runtime


Blobstore

R

oute

r Cloud Controller

DEA

Messaging (NATS)

DEA DEA

Runtime

Access App

Application containers and scaling


DB

Rou

ter

Service credentials

reserve resources

obtain connection data

CLI Cloud Controller

Service Broker

Data Service

Runtime

create service (HTTP)

bind service (HTTP)

create service (HTTP)

bind service (HTTP)

Service create and bind


2 Key Components to Pivotal Cloud Foundry•Ops Manager/ Operations Manager: A web application that

you use to deploy and manage a Pivotal Cloud Foundry PaaS

•Elastic Runtime: A web application that you install through the Ops Manager and use to deploy and manage your applications deployed on Pivotal Cloud Foundry PaaS


Demo


Pivotal CF deployment on CenturyLink Cloud














© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.

What’s on Pivotal Cloud Foundry for an operator?

26


Pivotal Cloud Foundry operations

Developer Operator


Install runtime and container

Deploy to dev



Install services (db, messaging, hadoop, …)

Deploy to dev




Setup load-balancing, SSL termination and dynamic routing

Deploy to dev




Setup / config High Availability

Deploy to dev






Setup APM

Deploy to dev






Setup APM

Setup log streaming

Deploy to dev






Setup APM

Setup log streaming

Deploy to dev

App Deployed





Setup load-balancing and dynamic routing


Setup APM

Setup log streaming

Deploy to dev

Deploy to Test

Deploy to QA

Promote to production

Scale up

Update app

Scale down

Redeploy

Unbind service

Bind service

Restart server

Change route

Scale Platform

Create service

Delete App

Blue-green deployment

Check logsscale memory

Update app server

Change JDK

Upgrade app




Setup load-balancing and dynamic routing


Setup APM

Setup log streaming

Deploy to dev

Deploy to Test

Deploy to QA

Promote to production

Scale up

Update app

Scale down

Redeploy

Unbind service

Bind service

Restart server

Change route

Scale Platform

Create service

Delete App

Blue-green deployment

Check logsEscale memory

Update app server

Change JDK

Upgrade app


Deploy to dev

The Pivotal CF way


Deploy to dev

> cf pushCloud

ControllerHealth

Manager

NATS (message bus)

RouterApp Deployed

The Pivotal CF way


The operator in the PaaS era

Developer Operator


The operator in the PaaS era


Operator Concerns

Monitor the platform

Handle upgrades and updates

Plan capacity

Manage users and quotas

Install the platform

Setup High Availability


IaaS

Pivotal CF



Handle live upgrades and updates

Scale and plan capacity

Install and manage servicesTarget multiple

clouds


IaaS

BOSH Director BOSH Agent

Mobile Services for Pivotal CF

ElasticSearch for Pivotal CF

CloudBees Jenkins Enterprise

Cassandra for Pivotal CF

Click to install

No downtime updates

Explore install logs

Click to scale the platform

Built-in High Availability

Built-in Platform Monitoring

Integrated services


BOSH


Provision services, not machines

Enables continuous delivery

Cloud-agnostic view of Platform Ops

Holistic Toolchain for “rule them all"

Eliminate bespoke automation on top of config management

Why BOSH


Ops Manager + BOSH

Blobstore

BOSH

Health Monitor

DBDeploy my Services

Worker VMs

Messaging

Health Manager

Cloud Controller

BOSH Director

NATS

IaaS


Operator Concerns



Plan capacity





Orgs, Spaces, Users and Quotas


Organizations

Logical division within a Pivotal CF install / Foundation.

Each organization has its own users and assigned quota

User permissions / roles are specified per space within an organization

Sub-divided into Spaces


Quotas and Plans

Different quota limits (e.g. “small”, “enterprise”, “default”, “runaway”) can be assigned per Organization

Quota defines

• Total Memory • Total # of Services • Total # of Routes


Spaces

Logical sub-division within an organization

Services and Applications are created / specified per Space

Users authorized at an organization level can have different roles per space

Same Service can have different meanings per space



Operator Concerns



Plan capacity





Platform Monitoring

How do I know when to scale DEAs?

How many requests each Router is servicing?

What is the current load of my Cloud Controllers?


Platform Monitoring

Pivotal Ops Metrics provides a single JMX interface to access metrics for each Pivotal CF component

• DEAs

• Cloud Controllers

• Routers

• Health Managers

• NATS, UAA, Login Server, …


Platform Monitoring

Collector

JMX Provider

JMX Monitoring Tool


Platform Monitoring

Collector

JMX Provider

JMX Monitoring Tool


Operator Concerns



Plan capacity





4 Layers of built-in High Availability

Application Instance

Platform Processes

Platform VMs

Availability Zones




Platform Processes

Platform VMs

Availability Zones


App Instance HA

Blobstore

Rou

ter

Cloud Controller

DEA

Messaging (NATS)

DEA DEA

Runtime

Health ManagerActual State

Cloud Foundry




Platform Processes

Platform VMs

Availability Zones


63

Platform Processes HA

Blobstore

BOSH

Health Monitor

DB

Messaging

Health Manager

Target Cloud Controller

BOSH Director

NATS

Agent

Agent

Agent

Process

Process

Process

Pivotal CFDEA

Agent Process


Platform Processes HA

Target Cloud Controller

Agent ProcessRestart




Platform Processes

Platform VMs

Availability Zones


66

Platform VMs HA

Blobstore

BOSH

Health Monitor

DB

Messaging

Health Manager BOSH Director

NATS Agent

Agent

Cloud Controller

Agent Process

Process

Process

Pivotal CFCloud Controller

Agent Process

Ressurector

Re-create VM

VM is missing…




Platform Processes

Platform VMs

Availability Zones


Availability Zone #2

68

Availability Zones

DEA

DEA

DEA

Rou

ter Blobstore

Cloud Controller

Health Manager

Messaging (NATS)

Push app

Availability Zone #1

DEA

DEA


Operator Concerns



Plan capacity





Pivotal CF: Enterprise Grade SW Delivery Simple & Comprehensive •  End to end platform to iterate quickly and build

highly scalable cloud apps •  IT Ops automation with no scripts, no templates,

no config headaches •  Easy to use management dashboard

Extensible •  Independent of the IaaS provider, the runtime

languages supported & the brokered services •  Simple APIs ensure easy extension and

customization

Governed & Secure •  Individual and team-based roles and permissions •  Easy integration w/ 3rd party tools and agents

Highly Available •  Built in health monitoring and management of

applications and the platform •  Zero downtime deploys/updates of the platform

and applications

Scalable & Efficient •  Elastic scale of PaaS capacity and applications

through simple interfaces or scripting •  Higher application instance density on the

same IaaS footprint through advanced containerization


The Platform for a New Era of Software Innovation Pivotal CF:

•  Instant Dynamic Routing • Streaming Logging Agg •  ID/team/RBAC/Policy • APM, Auto-scaling • Ready integration • Four layers of built-in Availability

• Auto-detect runtimes, frameworks

•  “Push and it works” model

• CF Push [.WAR] • CF Push [Docker] • CF Push [.ASP]

• Elastic Pivotal HD • HAWQ Analytics • Mobile Push • Mobile Sync • Mobile API

• MySQL HA • Redis • Rabbit MQ • Elastic Search • Cassandra • Jenkins (Partner)

….and more

DEPLOY, OPERATE, UPDATE, SCALE ON ANY INFRASTRUCTURE

INTEGRATED OPERATOR FUNCTIONS READY MIDDLEWARE SERVICES AUTO DEPLOY

AND SCALE


Bonus Demo Time - Diego

72


• Support for multiple backend implementations without warden rewrite

• Remove dependency between components

• Might as well be in Go

Diego?

DEA Pool

Cloud Controller

Health Manager


So What?

74


One Polyglot Cluster


THANK YOU!See you after the break!

76

Pivotal CenturyLink Cloud Platform Seminar Presentations: Architecture & Operations

Technology

pivotal cf deployment

centurylink cloud

cloud native apps

centurylink ops manager

app push app app md

web application

stage app

centurylink dashboard