Workload Domain Infrastructure VMs Cloud Foundation Infrastructure VMs vSphere Cluster + Virtual SAN 1 st Three Nodes (manually expand to 4+ nodes) Virtual Infrastructure Virtual Desktop vCenter NSX Manager vCenter NSX Manager App- Volumes View Connect App- Volumes View Connect View Compose SQL AD vCenter NSX Manager vRack-ResourcePool-Mgmt Log Insight VROPS NSX Manager LCM Repository LCM Backup VRM vCenter PSC PSC ISVM (1) ISVM (2) ISVM (3) NSX Ctrl (1) NSX Ctrl (2) NSX Ctrl (3) Virtual Distributed Switch ESXi01 ESXi02 ESXi03 vSAN Datastore VMware SDDC Manager configures the first three servers in each rack into a management domain. It is recommended that you expand the management domain to four servers to provide added redundancy and to facilitate vSAN maintenance. The management domain hosts all the VMware Cloud Foundation infrastructure components. Management Domain NSX Transport Zone Virtual Distributed Switch vSphere Cluster Virtual Infrastructure Workload Domain vCenter & NSX Manager Runs in Management Domain NSX Logical Switch Management Corporate vMotion vSAN VXLAN NSX CTL 01 NSX CTL 02 NSX CTL 03 VM VM VM VM VM VM NSX Edge vSAN External Network vCenter NSX Manager ESXi-01 ESXi-02 ESXi-03 VTEP VTEP VTEP Virtual Infrastructure Workload Domain Management Domain A VMware Cloud Foundation Virtual Infrastructure (VI) Workload Domain is a logical partition within the private cloud representing a subset of CPU, memory and storage capacity, allocated to an individual business unit or tenant that is used to deliver virtual infrastructure. Each VI workload domain implements a separate instance of the VMware SDDC software stack to include vCenter Server, ESXi, vSAN, and NSX. NSX Transport Zone Virtual Distributed Switch vSphere Cluster Virtual Desktop Infrastructure Workload Domain vCenter Server, NSX Manager, and Horizon View infrastructure components run in the management domain NSX Logical Switch Management Corporate vMotion vSAN VXLAN NSX CTL 01 NSX CTL 02 NSX CTL 03 VDI VDI VDI VDI VDI VDI NSX Edge vSAN External Network Management Domain ESXi-01 ESXi-02 ESXi-03 VTEP VTEP VTEP Virtual Desktop Infrastructure Domain App- Volumes View Connect App- Volumes View Connect View Compose SQL AD vCenter NSX Manager A VMware Cloud Foundation Virtual Desktop Infrastructure (VDI) Workload Domain is a logical partition within the private cloud representing a subset of CPU, memory and storage capacity allocated to a business unit or tenant that is used to deliver virtual desktops. Each VDI workload domain implements a separate instance of the VMware SDDC software stack to include vCenter Server, ESXi, vSAN, and NSX together with Horizon View. vSAN Ready Nodes VMware Cloud Foundation use rack mount vSAN Ready Nodes to ensure seamless compatibility and support. The configuration and assembly for each node is standardized with all components installed the same manner to eliminate system variability. vSAN enables both hybrid and all-flash architectures. SSD Read and Write Cache Capacity Caching Tier Data Persistence Tier vSAN Ready Nodes SSD SSD VMware Cloud Foundation is VMware's unified SDDC platform for the private and public clouds. VMware Cloud Foundation brings together VMware’s compute, storage, and network virtualization into a natively integrated stack, delivering enterprise-ready cloud infrastructure with unique automation and management capabilities for simplified operations that is consistent across private and public clouds. Overview Horizon vRealize VMware Cloud Foundation vSphere vSAN NSX SDDC Manager Cloud management platform Software-defined infrastructure Private cloud Public cloud Extend to virtual desktops VMware Cloud Foundation is an integrated suite of software components. These components include the unified SDDC platform, which includes VMware vSphere, vSAN and NSX, together with the VMware SDDC Manager. Optional components, such as vRealize Suite and Horizon Suite, can also be included. Software Components Horizon Suite (optional) App Volumes Horizon View Workload Domain Management Lifecycle Management Infrastructure Services VMware NSX VMware vSAN VMware vSphere Hardware Management Services vRealize Suite (optional) vRealize Automation vRealize Business vRealize Operations vRealize Log Insight VMware Cloud Foundation Add-On Components SDDC Manager A VMware Cloud Foundation private cloud deployment is comprised of between one to eight physical racks. Each rack contains between 8 to 32 vSAN Ready Nodes, one management switch, and two Top-of-Rack (ToR) switches. In multi-rack configurations, a pair of redundant spine switches are added to the second rack to provide for inter-rack connectivity. Physical Hardware Overview Top-of-Rack Switches Management Switch Virtual Infrastructure Domain Available Capacity Expand Full Rack/ Up to 32 Servers Half Rack/ 16 Servers Minimum/ 8 Servers Expand Virtual Desktop Domain Management Domain Expandable to 8 racks Add spine switches to interconnect racks Homogenous nodes within the rack May be heterogeneous across racks SDDC Manager SDDC Manager is a virtual appliance running in the management domain that provides a single point-of-control for the management and administration of Cloud Foundation. SDDC Manager interfaces with the Hardware Management Service and vCenter server to provide centralized access along with an integrated view of both the physical and virtual infrastructure. SDDC Manager is used to configure the physical servers and switches as well as create and manage workload domains, monitor the status of the Cloud Foundation environment, and perform lifecycle management tasks such as patching and upgrades. SDDC Manager (Virtual Appliance) Workflow Services Engine Logical Resource Manager vSphere vRealize Suite Horizon Suite Physical Resource Manager Hardware Management Service References • Web Page: vmware.com/go/cloudfoundation • Documentation: vmware.com/go/cloudfoundation-docs Hardware Management Services The Hardware Management Services (HMS) provides the necessary functions required for discovering, bootstrapping, and monitoring the hardware components in each physical rack. The HMS is accessed through the VMware SDDC Manager using available APIs. Hardware Management Services (HMS) vRealize Log Insight (Syslog Forwarding) vRealize Operations (Health Dashboards) VMware SDDC Manager (Rest API) HMS Device Plugin Server Hardware HMS Device Plugin Switch Hardware (Mgmt/ToR/Spine) HMS Device Plugin PDU Hardware Workload Performance General Workload Network Review Choose how much performance and availability you need for your workload Availability Development Development • Stripe Width 1 • Flash Reserve 0% • Object Space Reservation 40% Standard • Stripe Width 1 • Flash Reserve 0% • Object Space Reservation 70% High • Stripe Width 3 • Flash Reserve 0% • Object Space Reservation 100% Standard High Low Normal High FTT=0 FTT=1 FTT=2 Back Next Low Availability FTT=0, three hosts minimum No No Cluster Maximum Normal Availability FTT=1, three hosts minimum No Enabled, % based Admission Control Cluster Maximum High Availability FTT=2, five hosts minimum No Enabled, % based Admission Control Max hosts available in one rack Option vSAN FTT vSAN FD vSphere HA Max Size Storage Policy Cloud Foundation storage policies are set independently for each Workload Domain. Performance settings determine stripe width and thick vs. thin provisioning. Availability settings determine how many copies are stored and thus how many host failures can be tolerated in a workload domain. VMware Cloud Foundation leverages VMware vSAN to provide storage for workloads running in the private cloud. vSAN aggregates the local storage (both hybrid and all-flash configurations) from each host in the workload domain into storage pool that is shared across the cluster. Storage performance and availability characteristics are set when the workload domain is created. vSAN requires that each workload domain contains a minimum of three hosts, however four hosts are recommended to facilitate host maintenance. IP attached storage (i.e. NFS / iSCSI) Option 1: Hybrid Traditional IP Attached Storage Hyper-converged vSAN Storage with SSD and HDD Hyper-converged vSAN Storage with all SSD Option 2: All-Flash vSAN vSAN Storage Physical Network The VMware Cloud Foundation physical network design is based on a leaf-and-spine network architecture. Each rack contains a redundant pair of Top-of-Rack (ToR) switches. Each ToR switch is connected to a pair of high capacity spine switches using 40GbE uplink ports. Servers are dual-connected to each ToR switching with separate 10GbE interfaces. The ToRs in the first rack provide access to the external data center network. 40GE Links MLAG/Channel Capable Aggregate over 160GE 1GE Out-of-band 4 x 40GE Ports 48 x 10GE Ports Inter ToR connectivity For control traffic & redundancy Spine Switch ToR Switch A Data Center Network Management Switch Server 32 Server 1 ToR Switch B Other Physical Racks Spine Switch 40GE 10GE 10GE 40GE 4 5 ToR ports 1 to 32 to connect hosts ToR port 48 for Management switch ToR ports 39,40,41,42 for Interconnect 4 ToR ports 43,44,45,46 for uplink connectivity 5 ToR ports 49 and 50 spine switches ESXi Host ESXi Host ESXi Host nic0 nic0 nic0 nic0 nic0 nic0 Virtual Distributed Switch Non-routable Mgmt VLAN Public Mgmt VLAN vSAN VXLAN vMotion Data Center Services • AD / DNS / NTP Core Modules • SDDC Manager • vCenter Server & PSC Optional Modules • vRealize Log Insight • vRealize Operations • vRealize Automation • Horizon View Core Modules • NSX Manager • NSX Controllers NSX Edge(s) Logical Switch VMs syslog Corporate (External) VLAN Logical Network VMware Cloud Foundation implements a virtual network overlay that runs on top of the physical leaf-and-spine network. Physical servers are logically grouped into vSphere clusters (represented as workload domains) where a Virtual Distributed Switch is configured and port groups created. VMware NSX is also installed and a single transport zone is created. Logical switches and application virtual networks are manually created based on workload needs. vmware.com Copyright © 2016 VMware, Inc. All rights reserved. VMware Cloud Foundation 2.0 - Private Cloud Architecture