Pivotal CenturyLink Cloud Platform Seminar Presentations: Architecture & Operations
Post on 21-Aug-2015
98 Views
Preview:
Transcript
© Copyright 2014 Pivotal. All rights reserved.
Pivotal Cloud Platform Deep DivePart 2: Architecture and The Operator Experience
Andrew Ripka aripka@pivotal.io @rippmn
1
Keith Resar keith.resar@ctl.com @keithresar
© Copyright 2015 Pivotal. All rights reserved.
Architecture and the Operator Experience• Pivotal Cloud Foundry Architecture
• Structured Platform for Cloud Native Apps
• One Click CenturyLink Ops Manager and CenturyLink Dashboard
• The Operator Experience
© Copyright 2014 Pivotal. All rights reserved. 5
Loggregator
DEA Pool
Router Cloud Controller
BOSH Director BOSH Agent
UAA/Login Servers Health Manager
Service Broker Node(s)
Messaging (NATS)
!
IaaS
Cloud Foundry Architecture Stack
© Copyright 2014 Pivotal. All rights reserved. 6
Rou
ter
Cloud Controller Service Broker Node(s)
DEA DEA
DEA DEA
Blobstore DB
Runtime
1. Upload bits/metadata
2. Create/bind services
3. Stage app
4. Deploy app
push app+ app MD
SC
+ =
Pushing an application
© Copyright 2014 Pivotal. All rights reserved. 7
Rou
ter
Cloud Controller
DEA
Blobstore DB
Runtime
Detect Compile UploadNo
System Buildpacks
+ =
Yes
`
Runtime
© Copyright 2014 Pivotal. All rights reserved. 8
Blobstore
R
oute
r Cloud Controller
DEA
Messaging (NATS)
DEA DEA
Runtime
Access App
Application containers and scaling
© Copyright 2014 Pivotal. All rights reserved. 9
DB
Rou
ter
Service credentials
reserve resources
obtain connection data
CLI Cloud Controller
Service Broker
Data Service
Runtime
create service (HTTP)
bind service (HTTP)
create service (HTTP)
bind service (HTTP)
Service create and bind
© Copyright 2014 Pivotal. All rights reserved. 10
2 Key Components to Pivotal Cloud Foundry•Ops Manager/ Operations Manager: A web application that
you use to deploy and manage a Pivotal Cloud Foundry PaaS
•Elastic Runtime: A web application that you install through the Ops Manager and use to deploy and manage your applications deployed on Pivotal Cloud Foundry PaaS
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.
What’s on Pivotal Cloud Foundry for an operator?
26
© Copyright 2014 Pivotal. All rights reserved. 29
Install runtime and container
Install services (db, messaging, hadoop, …)
Deploy to dev
© Copyright 2014 Pivotal. All rights reserved. 30
Install runtime and container
Install services (db, messaging, hadoop, …)
Setup load-balancing, SSL termination and dynamic routing
Deploy to dev
© Copyright 2014 Pivotal. All rights reserved. 31
Install runtime and container
Setup load-balancing, SSL termination and dynamic routing
Setup / config High Availability
Deploy to dev
Install services (db, messaging, hadoop, …)
© Copyright 2014 Pivotal. All rights reserved. 32
Install runtime and container
Setup load-balancing, SSL termination and dynamic routing
Setup / config High Availability
Setup APM
Deploy to dev
Install services (db, messaging, hadoop, …)
© Copyright 2014 Pivotal. All rights reserved. 33
Install runtime and container
Setup load-balancing, SSL termination and dynamic routing
Setup / config High Availability
Setup APM
Setup log streaming
Deploy to dev
Install services (db, messaging, hadoop, …)
© Copyright 2014 Pivotal. All rights reserved. 34
Install runtime and container
Setup load-balancing, SSL termination and dynamic routing
Setup / config High Availability
Setup APM
Setup log streaming
Deploy to dev
App Deployed
Install services (db, messaging, hadoop, …)
© Copyright 2014 Pivotal. All rights reserved. 35
Install runtime and container
Install services (db, messaging, hadoop, …)
Setup load-balancing and dynamic routing
Setup / config High Availability
Setup APM
Setup log streaming
Deploy to dev
Deploy to Test
Deploy to QA
Promote to production
Scale up
Update app
Scale down
Redeploy
Unbind service
Bind service
Restart server
Change route
Scale Platform
Create service
Delete App
Blue-green deployment
Check logsscale memory
Update app server
Change JDK
Upgrade app
© Copyright 2014 Pivotal. All rights reserved. 36
Install runtime and container
Install services (db, messaging, hadoop, …)
Setup load-balancing and dynamic routing
Setup / config High Availability
Setup APM
Setup log streaming
Deploy to dev
Deploy to Test
Deploy to QA
Promote to production
Scale up
Update app
Scale down
Redeploy
Unbind service
Bind service
Restart server
Change route
Scale Platform
Create service
Delete App
Blue-green deployment
Check logsEscale memory
Update app server
Change JDK
Upgrade app
© Copyright 2014 Pivotal. All rights reserved.
Deploy to dev
> cf pushCloud
ControllerHealth
Manager
NATS (message bus)
RouterApp Deployed
The Pivotal CF way
© Copyright 2014 Pivotal. All rights reserved. 41
Operator Concerns
Monitor the platform
Handle upgrades and updates
Plan capacity
Manage users and quotas
Install the platform
Setup High Availability
© Copyright 2014 Pivotal. All rights reserved. 42
IaaS
Pivotal CF
Install the platform
Setup High Availability
Handle live upgrades and updates
Scale and plan capacity
Install and manage servicesTarget multiple
clouds
© Copyright 2014 Pivotal. All rights reserved. 43
IaaS
BOSH Director BOSH Agent
Mobile Services for Pivotal CF
ElasticSearch for Pivotal CF
CloudBees Jenkins Enterprise
Cassandra for Pivotal CF
Click to install
No downtime updates
Explore install logs
Click to scale the platform
Built-in High Availability
Built-in Platform Monitoring
Integrated services
© Copyright 2014 Pivotal. All rights reserved. 45
Provision services, not machines
Enables continuous delivery
Cloud-agnostic view of Platform Ops
Holistic Toolchain for “rule them all"
Eliminate bespoke automation on top of config management
Why BOSH
© Copyright 2014 Pivotal. All rights reserved. 46
Ops Manager + BOSH
Blobstore
BOSH
Health Monitor
DBDeploy my Services
Worker VMs
Messaging
Health Manager
Cloud Controller
BOSH Director
NATS
IaaS
© Copyright 2014 Pivotal. All rights reserved. 47
Operator Concerns
Monitor the platform
Handle upgrades and updates
Plan capacity
Manage users and quotas
Install the platform
Setup High Availability
© Copyright 2014 Pivotal. All rights reserved. 49
Organizations
Logical division within a Pivotal CF install / Foundation.
Each organization has its own users and assigned quota
User permissions / roles are specified per space within an organization
Sub-divided into Spaces
© Copyright 2014 Pivotal. All rights reserved. 50
Quotas and Plans
Different quota limits (e.g. “small”, “enterprise”, “default”, “runaway”) can be assigned per Organization
Quota defines
• Total Memory • Total # of Services • Total # of Routes
© Copyright 2014 Pivotal. All rights reserved. 51
Spaces
Logical sub-division within an organization
Services and Applications are created / specified per Space
Users authorized at an organization level can have different roles per space
Same Service can have different meanings per space
© Copyright 2014 Pivotal. All rights reserved. 53
Operator Concerns
Monitor the platform
Handle upgrades and updates
Plan capacity
Manage users and quotas
Install the platform
Setup High Availability
© Copyright 2014 Pivotal. All rights reserved. 54
Platform Monitoring
How do I know when to scale DEAs?
How many requests each Router is servicing?
What is the current load of my Cloud Controllers?
© Copyright 2014 Pivotal. All rights reserved. 55
Platform Monitoring
Pivotal Ops Metrics provides a single JMX interface to access metrics for each Pivotal CF component
• DEAs
• Cloud Controllers
• Routers
• Health Managers
• NATS, UAA, Login Server, …
© Copyright 2014 Pivotal. All rights reserved. 56
Platform Monitoring
Collector
JMX Provider
JMX Monitoring Tool
© Copyright 2014 Pivotal. All rights reserved. 57
Platform Monitoring
Collector
JMX Provider
JMX Monitoring Tool
© Copyright 2014 Pivotal. All rights reserved. 58
Operator Concerns
Monitor the platform
Handle upgrades and updates
Plan capacity
Manage users and quotas
Install the platform
Setup High Availability
© Copyright 2014 Pivotal. All rights reserved. 59
4 Layers of built-in High Availability
Application Instance
Platform Processes
Platform VMs
Availability Zones
© Copyright 2014 Pivotal. All rights reserved. 60
4 Layers of built-in High Availability
Application Instance
Platform Processes
Platform VMs
Availability Zones
© Copyright 2014 Pivotal. All rights reserved. 61
App Instance HA
Blobstore
Rou
ter
Cloud Controller
DEA
Messaging (NATS)
DEA DEA
Runtime
Health ManagerActual State
Cloud Foundry
© Copyright 2014 Pivotal. All rights reserved. 62
4 Layers of built-in High Availability
Application Instance
Platform Processes
Platform VMs
Availability Zones
© Copyright 2014 Pivotal. All rights reserved.
63
Platform Processes HA
Blobstore
BOSH
Health Monitor
DB
Messaging
Health Manager
Target Cloud Controller
BOSH Director
NATS
Agent
Agent
Agent
Process
Process
Process
Pivotal CFDEA
Agent Process
© Copyright 2014 Pivotal. All rights reserved. 64
Platform Processes HA
Target Cloud Controller
Agent ProcessRestart
© Copyright 2014 Pivotal. All rights reserved. 65
4 Layers of built-in High Availability
Application Instance
Platform Processes
Platform VMs
Availability Zones
© Copyright 2014 Pivotal. All rights reserved.
66
Platform VMs HA
Blobstore
BOSH
Health Monitor
DB
Messaging
Health Manager BOSH Director
NATS Agent
Agent
Cloud Controller
Agent Process
Process
Process
Pivotal CFCloud Controller
Agent Process
Ressurector
Re-create VM
VM is missing…
© Copyright 2014 Pivotal. All rights reserved. 67
4 Layers of built-in High Availability
Application Instance
Platform Processes
Platform VMs
Availability Zones
© Copyright 2014 Pivotal. All rights reserved.
Availability Zone #2
68
Availability Zones
DEA
DEA
DEA
Rou
ter Blobstore
Cloud Controller
Health Manager
Messaging (NATS)
Push app
Availability Zone #1
DEA
DEA
© Copyright 2014 Pivotal. All rights reserved. 69
Operator Concerns
Monitor the platform
Handle upgrades and updates
Plan capacity
Manage users and quotas
Install the platform
Setup High Availability
© Copyright 2014 Pivotal. All rights reserved. 70
Pivotal CF: Enterprise Grade SW Delivery Simple & Comprehensive • End to end platform to iterate quickly and build
highly scalable cloud apps • IT Ops automation with no scripts, no templates,
no config headaches • Easy to use management dashboard
Extensible • Independent of the IaaS provider, the runtime
languages supported & the brokered services • Simple APIs ensure easy extension and
customization
Governed & Secure • Individual and team-based roles and permissions • Easy integration w/ 3rd party tools and agents
Highly Available • Built in health monitoring and management of
applications and the platform • Zero downtime deploys/updates of the platform
and applications
Scalable & Efficient • Elastic scale of PaaS capacity and applications
through simple interfaces or scripting • Higher application instance density on the
same IaaS footprint through advanced containerization
© Copyright 2014 Pivotal. All rights reserved. 71
The Platform for a New Era of Software Innovation Pivotal CF:
• Instant Dynamic Routing • Streaming Logging Agg • ID/team/RBAC/Policy • APM, Auto-scaling • Ready integration • Four layers of built-in Availability
• Auto-detect runtimes, frameworks
• “Push and it works” model
• CF Push [.WAR] • CF Push [Docker] • CF Push [.ASP]
• Elastic Pivotal HD • HAWQ Analytics • Mobile Push • Mobile Sync • Mobile API
• MySQL HA • Redis • Rabbit MQ • Elastic Search • Cassandra • Jenkins (Partner)
….and more
DEPLOY, OPERATE, UPDATE, SCALE ON ANY INFRASTRUCTURE
INTEGRATED OPERATOR FUNCTIONS READY MIDDLEWARE SERVICES AUTO DEPLOY
AND SCALE
© Copyright 2014 Pivotal. All rights reserved. 73
• Support for multiple backend implementations without warden rewrite
• Remove dependency between components
• Might as well be in Go
Diego?
DEA Pool
Cloud Controller
Health Manager
top related