Kevin Kluge Vice President, Cloud Platforms Group, Citrix Systems Inc. Build your own Infrastructure Cloud with Apache CloudStack Kevin is an expert in Large Scale Systems and Infrastructure Clouds and manages the Cloud Platforms product group at Citrix. Previously Vice President, Engineering at Cloud.com, acquired by Citrix in 2011. Held engineering leadership positions at Yahoo!, Zimbra, Corvigo, Openwave Systems, and Onebox.com. Kevin has a MS and BS in Computer Science
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Kevin KlugeVice President, Cloud Platforms Group, Citrix Systems Inc.
Build your own Infrastructure Cloud with Apache CloudStack
Kevin is an expert in Large Scale Systems and Infrastructure Clouds and manages the Cloud Platforms product group at Citrix.
Previously Vice President, Engineering at Cloud.com, acquired by Citrix in 2011.
Held engineering leadership positions at Yahoo!, Zimbra, Corvigo, Openwave Systems, and Onebox.com.
Kevin has a MS and BS in Computer Science from Stanford University.
Apache CloudStack (Incubating)An Introduction
Kevin Kluge
Apache CloudStack Committer
• Create VMs, disks networks, network services
• Self service• Meter usage
Use CloudStack to build IaaS clouds (like EC2)
• Java based• Scalable• Many vendor integrations• Native and EC2 API
How did Amazon build EC2?
Commodity Servers
Commodity Storage
Networking
Open Source Xen Hypervisor
Amazon Orchestration Software
AWS API (EC2, S3, …)
Amazon eCommerce Platform
How can you build your cloud?
Servers StorageNetworking
Open Source Xen Hypervisor
Amazon Orchestration Software
AWS API (EC2, S3, …)
Amazon eCommerce Platform
ESXi, KVM, XenServer/XCP, OVM
CloudStack Orchestration Software
Your Portal (Optional)
CloudStack or AWS API
Project history
• 2008/2009: closed-source development• First deployments in late 2009
• May 2010: ~98% open source as GPLv3 (open core) • August 2011: 100% open source GPLv3
• April 2012: Switch to Apache License v2• Submit code to Apache Software Foundation
Project current state
• In incubation within Apache Software Foundation
• Imminent first release!
• Bugs and wiki mostly moved to ASF infra
• Mailing list traffic moved to ASF infra
• Many non-Citrix contributors, committers, and PPMC members
Yes, the ASF is great
Enter ASF
IaaS Cloud Concepts
Cloud
Built for traditional enterprise apps & client-server compute
•Scale-up (pool-based resourcing)•IT management-centric •1 administrator for 100’s of servers•Proprietary vendor stack
Designed around big data, massive scale & next-gen apps• Scale-out (horizontal resourcing)• Autonomic management • 1 administrator for 1,000’s of servers• Open, value-added stack
Virtualization alone does not make a cloud
Server Virtualization
Design for failure
Self-service recovery
Multi-site redundancy
Ephemeral resources
Cloud Workload
Think Amazon Web Services
Expect reliability
Back-up everything
HA, Fault tolerance
Admin control recovery
Traditional Workload
Think Server Virtualization
Clouds must reliably run all types of workloads
Object Storage
vSphere
ESXi Cluster
ESXi Cluster
ESXi Cluster
Enterprise Networking (e.g., VLAN)
Enterprise Storage (e.g., SAN)
Cloud-era Availability
Zone
Cloud-era Availability
Zone
Cloud-era Availability
Zone
Traditional ZoneCloudStack Mgmt
Server
Cloud-era Workloads Traditional Workloads
Embrace traditional and extend to Cloud-era
Cloud-era Availability
Zone
Cloud-era Availability
Zone
Traditional Availability
Zone
Apache CloudStackManagement Server
Traditional Availability
Zone
Traditional Availability
Zone
Availability Zone
Availability Zone
Availability Zone
Amazon-Style Cloud
Object store is critical for Cloud-era workloads
CloudStack Mgmt. Server • Workloads are distributed across
availability zones
• No guarantee on zone reliability
• DBs and Templates snapped to object store.
• For small failures, recreate instance in same zone
• For DR, recreate instance in different zone
• Dramatically less expensive
Object Store
Deployment and Software Architecture
Management Server managing multiple zones
Zone1
Data Center 1
Data Center 2
Zone 3
Zone 2
Data Center 2
Zone 3
Zone 2
Data Center 2
Zone 3
Zone 2
Data Center 2
Zone 3
Zone 2
Data Center 2
Zone 3
Zone 2
Data Center 3
Zone 4
Management Servers
• Single Management Server can manage multiple zones
• Zones can be geographically distributed but low latency links are expected for better performance
• Single MS node can manage up to 10K hosts.
• Multiple MS nodes can be deployed as cluster for scale or redundancy
Site-to-Site VPN
Router
L3 Core Switch
Top of Rack Switch
………… …Availability Zone 1
Servers
Primary Mgmt Server Cluster
Object Store
Pod 1 Pod 2 Pod 3 Pod N
Primary MySQL
Load Balancer
Admin Internet
Availability Zone 2
Backup MySQL
Standby Mgmt Server Cluster
DB Replication
Cloud-era zone deployment
10Gbps Storage & Mgmt
1Gbps Guest
10Gbps Storage & Mgmt
1Gbps Guest
10Gbps Storage & Mgmt
1Gbps Guest
…
Load Balancer
Core Switch
Aggregation Switch
TOR Switch
Compute Nodes
NFS Primary Storage
Object Store
Pod 1
Pod 2
Pod 200
InternetTraditional zone deployment
Management Server internals and service VMs
Management Server interaction with hypervisors
Management Server
XenServer
ESX
vCenter
KVM
Agent
OVM
Agent
XAPI HTTP
• XS 5.6, 5.6FP1, 5.6 SP2, 6.0.2, XCP 1.1
• Incremental Snapshots• VHD• NFS, iSCSI, FC & Local
disk• Storage over-
provisioning: NFS
• ESX 4.1, 5.0 • Full Snapshots• VMDK• NFS, iSCSI, FC & Local disk• Storage over-provisioning: