Architecting Openstack For The Enterprise · 3 OpenStack Architecture for the Enterprise Services Design Goals •Design an OpenStack architecture to run both enterprise and cloud
Post on 07-Aug-2020
16 Views
Preview:
Transcript
OpenStack Architecture for the Enterprise
Keith Tobin Cloud Architect
Greg Jacobs Network Architect
2 Services OpenStack Architecture for the Enterprise
Speaker Profiles
• Dell Cloud Architect
• Located in the Dell Cloud Center of Excellence in Dublin, Ireland
• Over two decades of software, platform and cloud development
• Organizer for OpenStack Ireland
• Loves all things OpenStack and Cloud
Keith Tobin
• Dell Network Architect
• 20 years working as a network architecture and solutions specialist
• Network evangelist and packet head
Greg Jacobs
3 Services OpenStack Architecture for the Enterprise
Design Goals
• Design an OpenStack architecture to run both enterprise and cloud applications
• Meet enterprise performance expectations for VM’s, networking and storage
• Zero downtime on the control layer
• No data loss in the event of a single node failure
• Must be durable, reliable and highly available
• Must automatically recover after a fault situation has been fixed
• Minimize management tasks
4 Services OpenStack Architecture for the Enterprise
Solution Stack
Deployment
Storage
Networking Physical Layer
Servers R620 R720 C6100
Crowbar
SUSE Linux SUSE Linux
Security SecureWorks
Managed Cloud Services
OpenStack OpenStack Titanium
Force10 SonicWall
CEPH on R720
Tested Qualified Solution
Dell Multi-Cloud Manager Enstratius
Dell Private Managed Cloud Solution
5 Services OpenStack Architecture for the Enterprise
Deployment With Crowbar
6 Services OpenStack Architecture for the Enterprise
Deploying OpenStack with Crowbar Is Easy
• Crowbar boots and installs from ISO on a management node (server)
• Provides user with web UI for configuration and operations management
• Discovers all potential targets (servers) automatically
• Performs hardware configuration – BIOS configuration
– Performs updates to BIOS and firmware
• Installs OS on targets
• Deploys OpenStack from a set of configuration modules called barclamps
7 Services OpenStack Architecture for the Enterprise
Crowbar Deployment
Chef Server
Crowbar PXE
DHCP
Identity
Barclamp
Database
Barclamp
Image
Barclamp
Networking
Barclamp
Block storage
Barclamp
Nova
Barclamp
Horizon
Barclamp
Controller
Node 01
Controller
Node 02
Controller
Node 03
Compute
Node 01
Compute
Node 02
Compute
Node 03
OpenStack
8 Services OpenStack Architecture for the Enterprise
Crowbar 2 Status
9 Services OpenStack Architecture for the Enterprise
Load Balancer
10 Services OpenStack Architecture for the Enterprise
Active/Passive (Normal)
Load Balancer 01
(Active)
Load Balancer 02
(Passive)
Keystone etc…
Keystone etc…
Keystone etc…
KeepaliveD KeepaliveD
VIP Controller
01
Controller
02
Load Balancer 01
(Inactive)
Load Balancer 02
(Active)
Incoming API
Requests
11 Services OpenStack Architecture for the Enterprise
Load Balancer 01
(Active)
Load Balancer 02
(Passive)
Keystone etc…
Keystone etc…
Keystone etc…
KeepaliveD KeepaliveD
Controller
01
Controller
02 VIP
Load Balancer 01
(Inactive)
Load Balancer 02
(Active)
Incoming API
Requests
Active/Passive (Fault)
12 Services OpenStack Architecture for the Enterprise
Single HAProxy Bottleneck
HAProxy
Horizon
Glance-API
Nova-scheduler
Nova-API
Keystone-API
Neutron-API
Cinder-API
Neutron L2
Neutron L3
Neutron DHCP
Glance-registry
RabbitMQ
MySQL
iVIP eVIP
HAProxy
Horizon
Glance-API
Nova-scheduler
Nova-API
Keystone-API
Neutron-API
Cinder-API
Neutron L2
Neutron L3
Neutron DHCP
Glance-registry
RabbitMQ
MySQL
Controller 01
(Active LB)
Controller
02
Inactive LB
13 Services OpenStack Architecture for the Enterprise
Dynamic Load Balancing
HAProxy HAProxy
Keystone
etc…
Keystone
etc…
Keystone
etc…
Quagga Quagga
Controller 01
Controller
02
HAProxy
Quagga
Controller
03
Network
Switch
Network
Switch
OSPF
ECMP
Incoming API Traffic
14 Services OpenStack Architecture for the Enterprise
Neutron
15 Services OpenStack Architecture for the Enterprise
Neutron (Single Networking Node)
Keystone
Glance
MySQL
etc…
Controller 01
Keystone
Glance
MySQL
etc…
Controller 02
Nova
Compute 01
Nova
Compute 03
Network 01
OVS Agent
L3 Agent
DHCP Agent
Neutron API
Internet
Nova
Compute 02
Nova
Compute 04
16 Services OpenStack Architecture for the Enterprise
Neutron (Separate Networking Nodes)
Controller 01 Compute 01
OVS Agent
L3 Agent
DHCP Agent
Neutron API
Internet
Controller 02
Neutron API
Ect….
Controller 03
Neutron API
Neutron Scheduler
Neutron Scheduler
Neutron Scheduler
Compute 02
OVS Agent
L3 Agent
DHCP Agent
Compute 03
OVS Agent
L3 Agent
DHCP Agent
Compute 04
OVS Agent
L3 Agent
DHCP Agent
Other OpenStack
Services
Other OpenStack
Services
Other OpenStack
Services
HAProxy HAProxy HAProxy
Quagga Quagga Quagga
17 Services OpenStack Architecture for the Enterprise
RabbitMQ
18 Services OpenStack Architecture for the Enterprise
RabbitMQ Cluster (With Mirrored Queues)
Controller 01
RabbitMQ
Controller 02
RabbitMQ
Ect….
Controller 03
RabbitMQ
Other OpenStack
Services
Other OpenStack
Services
Other OpenStack
Services
HAProxy HAProxy HAProxy
Quagga Quagga Quagga
Dynamic Load Balancer
Physical View Logical View
End Point
RabbitMQ 01 RabbitMQ 02 RabbitMQ 03
19 Services OpenStack Architecture for the Enterprise
MySQL Database
20 Services Openstack Architecture for the Enterprise
MySQL Single Server (Normal Operation)
DB Server
Data
Application
21 Services Openstack Architecture for the Enterprise
MySQL Single Server (Failed)
DB Server 1
(Active)
Data
Application
22 Services Openstack Architecture for the Enterprise
MySQL Single Server (Failed)
DB Server 1
(Active)
Data
Application • Disadvantage
• Single point of failure
23 Services Openstack Architecture for the Enterprise
MySQL Active/Passive Failover
24 Services Openstack Architecture for the Enterprise
MySQL Active/Passive Failover (Normal Operation)
DB Server 1
(Active)
Data
DB Server 2
(Passive)
Data
Application
Async Replication
DB Server 1
(Failed)
Data
DB Server 2
(Active)
Data
MySQL Active/Passive Failover (Failed Node)
Disadvantages
• Inactive Server
• Limits scale
• Reduces the potential workload processing ability of the solution by half
• Async replication has potential for data inconsistencies across server nodes in fault situations
25 Services Openstack Architecture for the Enterprise
MySQL With DRDB
26 Services Openstack Architecture for the Enterprise
MySQL With DRDB (Normal Operation)
DB Server 1
Data
DB Server 2
Data
Application
Event
Event Confirmed
Server Not Available !
Disadvantages
• Inactive server
• Limits scale
• Reduces the potential workload processing ability of the solution by half
(Failed)
27 Services Openstack Architecture for the Enterprise
MySQL Multi-Master
28 Services Openstack Architecture for the Enterprise
MySQL Multi-Master Cluster
DB Server 1
Data
Application 01
DB Server 2
Data
DB Server 3
Data
Load balancer
Application 02
29 Services Openstack Architecture for the Enterprise
MySQL Multi-Master Cluster (Failed Node)
DB Server 1
Data
Application 01
DB Server 2
Data
DB Server 3
Data
Load balancer
Application 02
30 Services Openstack Architecture for the Enterprise
MySQL Async Replication
Server 1
Data
Server N
Data
• No guarantee that data will be consistent across all nodes at any point in time
31 Services Openstack Architecture for the Enterprise
MySQL Single Thread replication
C1 C2 C3 C4
C5 C6 C7 C8
Processor
32 Services Openstack Architecture for the Enterprise
MySQL Multi-Master Cluster
DB Server 1
Data
Application 01
DB Server 2
Data
DB Server 3
Data
Load balancer
Application 02
Disadvantages
• At any point in time there is no guarantee that data is in a consistent state within the cluster
• One thread allocated for replication tasks
33 Services Openstack Architecture for the Enterprise
Percona MySQL Cluster
34 Services Openstack Architecture for the Enterprise
Percona MySQL Cluster
Capability
Synchronous Replication
Data Consistency
Parallel Applying on All Nodes
Automatic Node Provisioning
Multi-Master
35 Services Openstack Architecture for the Enterprise
Synchronous Replication
Capability
Synchronous Replication
Data Consistency
Parallel Applying on All Nodes
Automatic Node Provisioning
Multi-Master
Controller
DB 1
Data
Controller
DB 2
Event
Event Confirmed
Application 01
Data
36 Services Openstack Architecture for the Enterprise
Data Consistency
Controller
DB 1
Data
Controller
DB 2
Data
Server
DB 3
Data
Capability
Synchronous Replication
Data Consistency
Parallel Applying on All Nodes
Automatic Node Provisioning
Multi-Master
At any point in time data is always consistent across all nodes in the cluster
37 Services Openstack Architecture for the Enterprise
Parallel Applying on All Nodes
C1 C2 C3 C4
C5 C6 C7 C8
Processor
Capability
Synchronous Replication
Data Consistency
Parallel Applying on All Nodes
Automatic Node Provisioning
Multi-Master
38 Services Openstack Architecture for the Enterprise
Automatic Node Provisioning
Controller DB 4
Data
Join Cluster
Join Cluster
Controller DB 1
Data
Controller DB 3
Data
Controller DB 2
Data
New Node
Cluster
Capability
Synchronous Replication
Data Consistency
Parallel Applying on All Nodes
Automatic Node Provisioning
Multi-Master
39 Services Openstack Architecture for the Enterprise
Multi-Master Cluster
Controller DB 1
Data
Application 01
Controller DB 2
Data
Controller DB 3
Data
Dynamic Load balancer
Application 02
Capability
Synchronous Replication
Data Consistency
Parallel Applying on All Nodes
Automatic Node Provisioning
Multi-Master
40 Services OpenStack Architecture for the Enterprise
Block Storage
41 Services OpenStack Architecture for the Enterprise
Block Storage
CEPH on R720
42 Services OpenStack Architecture for the Enterprise
Logical Architecture
43 Services OpenStack Architecture for the Enterprise
Thank you
Chat with Keith and Greg @ the Dell booth
Keith Tobin Cloud Architect
Greg Jacobs Network Architect
top related