©2019 VMware, Inc. Lai Kian Wah Senior Consultant, VMware 2xVCIX, CKA, CKAD, 3xCCIE #14929 (Emeritus) Five steps to run VMware Enterprise PKS Confidential │ ©2019 VMware, Inc.
©2019 VMware, Inc.
Lai Kian WahSenior Consultant, VMware2xVCIX, CKA, CKAD, 3xCCIE #14929 (Emeritus)
Five steps to run VMware Enterprise PKS
Confidential │ ©2019 VMware, Inc.
©2019 VMware, Inc.
Disclaimer
This presentation may contain product features or functionality that are currently under development.
This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.
Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.
Technical feasibility and market demand will affect final delivery.
Pricing and packaging for any new features/functionality/technology discussed or presented, have not been determined.
This information is confidential.
2
The information in this presentation is for informational purposes only and may not be incorporated into any contract. There is no commitment or obligation to deliver any items presented herein.
©2019 VMware, Inc. 3
Five steps to run Enterprise PKS
©2019 VMware, Inc.
©2019 VMware, Inc. 4
1 – Planning
©2019 VMware, Inc.
©2019 VMware, Inc. 5
Planning the platform
Image Registry
Framework Lifecycle Management
Security and Networking
Storage Persistence
Virtual Infrastructure
Physical Infrastructure
Mo
nit
ori
ng
, L
og
gin
g,
An
aly
tics
Cluster Health Monitoring, Healing and Lifecycle Management
Scheduling, Orchestration, Service Creation
vSphere Cloud Provider
vSphere | NSX | VSAN
Physical Infrastructure
NSX
BOSH (K8s LCM)
BOSH (cluster LCM)
Upstream Kubernetes
Harbor
vR
ealiz
e S
uit
e
ENTERPRISE
PKS
6©2019 VMware, Inc.
2 – Building on Existing Knowledge
©2019 VMware, Inc. 7
Because after All
Kubernetes Cluster
VM
Master Node
Pods
VM
Worker Node
Pods
vCenter
ESXi ESXi ESXi
NSX-T
vSAN
VM
Worker Node
Pods
vRealize Suite
ESXi ESXi ESXi ESXi
VMVM
Exchange Cluster
VMVMVM
SQL Cluster
VMVMVM
Other Apps
VM
Kubernetes run on VMs
ESXi
©2019 VMware, Inc. 8
Optimize the evolution of compute
Compute Is Provided by vSphere
VMware Enterprise PKS deploys control plane elements as well as Kubernetes nodes as Virtual Machines
DRS, HA and vMotion make Kubernetes more resilient to hardware failures and/or changes/upgrades
vSphere Scheduler and NUMA optimization for max performance
Intuitive, familiar and feature rich interface for day-1 and day-2 operations
Run more Kubernetes clusters with less hardware resources
vSphere Cluster pools servers for better resource utilization and simplified scaling
PKSControlPlane
Kubernetes Cluster
VM VM
Node
Pods
VM
Node
Pods
vSphere Cluster
ESXi ESXi ESXi
©2019 VMware, Inc. 9
Storage Is Provided by vSAN and VMFS Datastores
Physical Disks
vSAN/VMFS Datastores
VMDK Filesystem
Persistent Volumes
PKSControlPlane
Kubernetes Cluster
VM VM
Node
Pods
VM
Node
Pods
vCenter VSAN/VMFS
vSAN/VMFS Datastore
RAID
• No external storage system needed
• Raid configs provide data redundancy
• A single vSAN/VMFS datastore can be used for both Virtual Machines as well as provide persistent volumes for Containers
©2019 VMware, Inc. 10
Networking, Load Balancing and Security Are Provided by NSX-T
Node/Host
Pods
Eth0
VM
Distributed Logical vSwitch
ESXi
Node/Host
Pods
Eth0
VM
ESXi
Pod Networks
Distributed Logical Switch
Node Network
Ingress/Load balancing
1Build logical Switching (L2)
2Build Routing between networks(L3)
4Create Load Balancers for apps (L4)
3Apply & Enforce Network Policy
©2019 VMware, Inc. 11
PlatformOps
Infrastructure
Compute Network Monitoring
Security Storage
The SDDC Fulfills Kubernetes Infrastructure Needs
Kubernetes Cluster
vSphere NSX Wavefront
NSX Datastores
Platform Operator
Focus on mappingKubernetes constructs to
Load Balancer
Persistent Volumes
Resources / Availability Zone
Security Policy
Application Metrics
ELK Kafka Nth App
K8s API
Developerarchitects with native
Kubernetes constructs
the SDDC
Developer
Mapping Kubernetes to SDDChttps://youtu.be/ex8jY7HNnUY
©2019 VMware, Inc. 12
3 – Deploying
©2019 VMware, Inc.
©2019 VMware, Inc. 13
How Will You Deploy Kubernetes?
©2019 VMware, Inc. 14
How Will You Deploy Kubernetes?
©2019 VMware, Inc. 15
How Will You Deploy Kubernetes?
Enterprise PKS
ControlPlane
Kubernetes Cluster
VM VM
Master
Pods
ESXi ESXi ESXi
vSAN
ESXi
vRealizeAutomation
vRealizeLog Insight
vRealizeOperations
vRealizeNetwork Insight
Wavefrontby VMware
ESXi ESXi
VM
Worker
Pods
VM
Worker
Pods
vCenter NSX-TvRealize Suite
#pks create-cluster Cluster-1
©2019 VMware, Inc. 16
How Will You Deploy Kubernetes?
Enterprise PKS
ControlPlane
Kubernetes Cluster
VM VM
Master
Pods
ESXi ESXi ESXi
vSAN
ESXi
vRealizeAutomation
vRealizeLog Insight
vRealizeOperations
vRealizeNetwork Insight
Wavefrontby VMware
ESXi ESXi
VM
Worker
Pods
VM
Worker
Pods
Kubernetes Cluster
VM
Master
Pods
VM
Worker
Pods
VM
Worker
Pods
Kubernetes Cluster
VM
Master
Pods
VM
Worker
Pods
VM
Worker
Pods
vCenter NSX-TvRealize Suite
©2019 VMware, Inc. 17
4 – Monitoring & Scaling
©2019 VMware, Inc.
©2019 VMware, Inc. 18
- On-demand scaling of worker nodes
- pks resize C01 --num-nodes 5
- Automatically detect VM failure and redeploy new VM
- Traceflow for troubleshooting network flow
- Port mirroring for troubleshooting or compliance
- vRealize Network Insight for monitoring network flow and proposing firewall rules
- vRealize Operations Manager has a container management pack
Enterprise PKS: Monitoring and Scaling PKS Technical Overview
https://youtu.be/2g1KE5zdbRs
©2019 VMware, Inc. 19
5 – Upgrading & Patching
©2019 VMware, Inc.
©2019 VMware, Inc. 20
Upgrading Enterprise PKS
©2019 VMware, Inc. 21
Patching Enterprise PKS
©2019 VMware, Inc. 22
Demo
23©2019 VMware, Inc.
1. Planning
2. Building on Existing Knowledge
3. Deploying
4. Monitoring & Scaling
5. Upgrading & Patching
5 steps to run VMware Enterprise PKS
©2019 VMware, Inc.
Thank You!
Confidential │ ©2019 VMware, Inc.
©2019 VMware, Inc. 25