Jan 26, 2015
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 2
A Vendor and End-User Perspective
• What is Fabric Compute?
• What is the use case for Cloud?
• Our experience from deploying OpenStack on a Fabric
• Bare Metal Provisioning
• Speed of Deployment
• Power and Space
OpenStack on the Fabric A use case study into deploying OpenStack on a Fabric Compute Architecture
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 3
OpenStack Interest WHAT CLOUD SOLUTIONS ARE IT ORGANIZATIONS LOOKING AT?
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 4
What is Fabric Computing?
• Severs with with Laser Beams?
No. At least not yet….
• Is it a new proprietary architecture?
No. Runs the same off the shelf OS and software. No special drivers needed.
• Do they cost a Million dollars?
No. Similar economics to rackmounts, but saves you a lot in TCO.
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 5
What is Fabric Computing?
Traditional Rackmount Server
CPU
SeaMicro Fabric Compute System
Fabric Interconnect
Compute and Memory
Storage Networking
Disaggregate CPU/Memory, Storage,
and Networking into pools of shared resources!
Captive Resources!
Top of Rack Switches
CPU
CPU CPU
CPU CPU
CPU CPU
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 6
What is Fabric Computing?
Rethinking the Server…
Traditional Rackmount Server
Core Components CPU & Memory, Networking, Storage
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 7
What is Fabric Computing?
Bare Metal Server
CPU
How servers are provisioned…
Provision specific resources needed for the application
Example of provisioning a server using SeaMicro Restful API
Curl –X PUT https//chassis-ip/v0.2/storage/volume/1/myPool/Volume-1?’action=create&size=200 Curl –X PUT https//chassis-ip/v0.2/storage/volume/1/myPool/Volume-1?’action=assign&server=1/0&vdisk=2&read-only=false Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=assign&nic=0&tagged-vlan=true&vlan-range=1-1 Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=assign&nic=1&tagged-vlan=true&vlan-range=1000-1999 Curl –X PUT https//chassis-ip/v0.2/servers/1/0?’action=power-on&using-pxe=true
SeaMicro Fabric Compute System
Fabric Interconnect
Compute and Memory
Storage Networking
CPU CPU
CPU CPU
CPU CPU
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 8
What does a Fabric Compute System look like?
Power Efficient Servers (64 to 256) • Up to 512 CPU cores per system • Up to 4 TB of memory. • Choice of CPUs:
• 64 AMD Opterons • 64 Intel Xeons – Ivy Bridge or Haswell • 256 Intel Atoms
Network Uplinks Cards (up to x8) • Up to 160 Gbps Uplink capacity • Choice of 10Gb and 1GB interfaces • Integrate 100Gb NPU
5.4 Petabyte of External Storage Expansion • Connect up to 16 Fabric Storage Enclosures. • 1344 external 3.5” disks.
Storage Controllers (up to x8) • Provides storage to any server • Up to 64 internal 2.5” disks per system.
Fabric Interconnect • 1.28 Tbps high performance fabric • Integrated L2 switching
10
RU
SM15000 Fabric Compute Server
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 9
The Fabric Computing Use Case
Compute Throughput
Memory Capacity
Network Bandwidth
Storage IOPS
Storage Capacity
Storage Bandwidth
Web Applications Medium/High Medium Low Medium Low Low
Hadoop Low/Medium/High Medium Medium Low Medium/High High
Object Storage Medium/Low Low High Medium High Medium
VDI Medium High Medium High Medium Medium
CDN Low Medium High Medium High High
Memcache High High Medium High Low Medium
Database High High Medium High Medium Medium
Cold Storage Low Low Low Low High Low
“Maintain a minimal set of server configs”
“Provide the right server for the workload”
Today’s Workloads have Heterogeneous Requirements
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 10
The Fabric Computing Use Case
Provide customers with the service they need….
VM Hosts Bare Metal Hosts
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 11
Nova Node Nova Node
The Fabric Computing Use Case
Let’s apply this to OpenStack
Controller Nodes
CPU
1TB HDD Mgt NIC
Block Storage Node (Cinder)
CPU
20 TB SSD Data+Mgt NIC
Object Storage Node (Swift)
CPU
40TB HDD Data+Mgt NIC
Nova Node
CPU
500GB SSD Data+Mgt NIC
SeaMicro Fabric Compute System
Fabric Interconnect
CPU CPU
CPU CPU
CPU CPU
Compute and Memory
Storage Networking
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 12
OpenStack and Fabric Computing
Why OpenStack is great for the Fabric Compute Architectures
Why Fabric Architectures are great for OpenStack…?
more importantly…
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 13
Bare Metal Provisioning
Isn’t it going to be complicated?
Ironic?
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 14
Bare Metal Provisioning
SeaMicro Fabric Compute System
Fabric Interconnect
CPU CPU
CPU CPU
CPU CPU
Compute and Memory 512 Cores 4TB RAM
128TB Internal 5PB External
Storage
160Gbps Uplinks Networking Switching
Flexible – Bare Metal Server
CPU
How servers are provisioned?
What is OpenStack? “OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.”
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 15
Bare Metal Provisioning
Nova Bare Metal:
• The genesis of Bare Metal in Open Stack.
• Available starting in Grizzly release.
• Provides the ability to enroll machines in Nova, and deploy images on them using PXE/IPMI.
• Overloaded libvert driver model to manage bare metal machines.
Ironic Bare Metal :
• Splits Bare Metal from Nova into it’s own project.
• Available starting in Havana release. (basic capabilities)
• Bare Metal servers are now first class citizens.
• Designed to support capabilities that are unique to hardware (not VMs)
• Database/API – HW oriented (i.e. firmware, RAID config, etc)
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 16
Bare Metal Provisioning The Difference Between Standard Servers and Fabric Servers
Traditional Rackmount Server
CPU
Flexible - Bare Metal Server
CPU
Traditional Servers – Rackmounts
• Storage and Network are fixed resources.
• You get whatever is in the box
Fabric Servers
• Provision only the storage and networking resources needed for the application
• Right sized for workloads
Supporting this with OpenStack….
• Basic Bare Metal is available today with Nova Bare Metal
• Work with Ironic Bare Metal project to enable flexible provisioning
• Eager to work with other Hardware Vendors with similar needs
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 17
How quickly, and correctly, can I deploy this?
Deploying OpenStack – Speed, Efficiency, Repeatability
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 18
What goes into deploying OpenStack?
• How many Controller, Swift, Cinder, instances do I need?
• What kind of Disks, NICs, etc should I use?
• Design Network (and possibly storage network)
• Rack, Plug, and Power up many servers and switches.
• Update system firmware and drivers.
• Learn about OpenStack
• Select and installer or build your own workflow.
(repeat when more capacity needed)
At least not at production scale… yet
Deploying OpenStack – Speed, Efficiency, Repeatability
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 19
Nova Compute Cinder Volume
OpenStack Controller
Neutron Network
Swift Object Legend:
Storage
Storage
Storage
Storage
Storage
Storage
Storage
Storage
Uplink
Uplink
SM15000
External
Storage
Expansion
External
Storage
Expansion
Rack and Plug Chassis • 64-256 servers, switch (TOR), shared storage
Zero Touch Provisioning • Fetches config via DHCP/TFTP • Automatically configures servers, network, and storage for
OpenStack use case
Install OpenStack components • Use an OpenStack installation tool to provision OpenStack • Today we use Mirantis Fuel – Made it easy to get started.
20 min
~40 min
~3 hrs
Total Time: ~ 4 hrs
Provisioning Process Today:
- For SeaMicro’s OpenStack Reference Architecture
Deploying OpenStack – Speed, Efficiency, Repeatability
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 20
Deploying OpenStack – Speed, Efficiency, Repeatability
~15 min to unbox, rack, and plug Couple Hours
(Automated Provisioning)
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 21
Deploying OpenStack – Speed, Efficiency, Repeatability
Rack and Plug Chassis • 64-256 servers, switch (TOR), shared storage
Triple“0” - Provision the Under Cloud • Undercloud Heat template
Triple”O” – Provision the OpenStack Cluster • Overcloud Heat template
Triple”O” – OpenStack-On-OpenStack
Under Cloud (Bare Metal Infrastructure)
Infrastructure
Over Cloud OpenStack Deployments
Over Cloud OpenStack Deployments
VM VM VM VM VM BM
Let’s get the industry behind one way of provisioning things. The Distro-SW and Hardware Vendors must collaborate
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 22
Power and Space – Reducing TCO
How much of a reduction can be realized with a Fabric Architecture ????
How Fabric Architectures reduce Space and Power
• Disaggregate storage from servers
• Only provision the needed storage.
• Share disks amongst servers.
• Integrated Switching (Eliminate the TOR)
• Enable energy efficient processors (Atom, ARM)
How OpenStack can help reduce Space and Power
• Automate Powering On/Off of resources when needed.
• BareMetal makes this possible.
• Need some from of DRS to move and consolidate workloads when demand decreases.
Approximate Power Savings?
We’ve measured
20-50% Savings
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 23
Power and Space How Dense Can it be?
OpenStack IaaS Rack
256 Opteron/Xeon Servers
or
1024 Atom Servers
16 TB Memory
~13KW Average
40 RU Total
OpenStack Swift Rack
5.4 Petabytes Raw
~20 KW Average
(less for cold storage)
2x 46 RU Racks
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 24
SeaMicro OpenStack Blueprint RELEASE 1.0
Included Services:
OpenStack Grizzly based
Nova Compute – virtual machines
Nova Network – VLAN based
Cinder Volume – shared block storage
Swift Storage –Object storage for images and snapshots
Other: Keystone (authentication), Glance (image mgt)
To A
cces
s Sw
itch
Capabilities - What can I do with it?
Cloud-in-a-Box: Fully integrated solution in a single SM15K
Rapid Deployment: Install and ready to deploy VMs in a few hours
Up to 3500 VMs per SM15K system
Multi Tenant Support
High Availability of OpenStack Management and Networking
Storage (Cinder/Swift) Capacity scalable to over 1 PB (Pay as you grow)
VM Size Description VMs per SM15000
tiny 1vCPU, 1GB mem, 15GB disk 3600VMs
small 1vCPU, 2GB mem, 30GB disk 1800 VMs
medium 2vCPU, 4GB mem, 60GB disk 900 VMs
large 4vCPU, 8GB mem, 120GB disk 450 VMs
xtra-large 8vCPU, 16GB mem, 240GB disk 225 VMs
• Flavors can be adjusted to meet your specific use case. Defaults are shown.
| OPENSTACK KOREA COMMUNITY – OPENSTACK ON THE FABRIC| JANUARY 14, 2014 25
OpenStack Blueprint Roadmap
2014 – Q1
2014 – Q2 2014 – Q3
Blueprint
Major Releases Key Features
1.0 - Oct 2013
OpenStack Grizzly Release
IaaS Compute (Nova), Block Store (Cinder), Swift
Single Chassis Design
2.0 - Feb 2014
OpenStack Havana Release
+ Bare Metal Provisioning
+ Neutron
+ Multi-Chassis Design
+ Improved HA and Load Balancing
+ Improved installation automation
3.0 – Q2 2014 OpenStack Icehouse Release
Additional SeaMicro value added capabilities
Need a customized design? SeaMicro and its partners can work with you to design an OpenStack architecture that meets your business needs.
Minor release will be delivered to add incremental features.
Dates are approximate
Disclaimer: Roadmap is forward looking and subject to change.