NAVIGATING DATA CENTER ARCHITECTURES Eric Ji SR. ARCHITECT CLOUD MARKETING
NAVIGATINGDATA CENTER ARCHITECTURES
Eric JiSR. ARCHITECT
CLOUD MARKETING
AGENDA
DC Trends
Juniper Offerings
Architecture Positioning
Use cases
PROBLEM AND SOLUTION“With three data center options (EX Series, QFabric System and Contrail), Juniper may present a somewhat
confusing set of alternatives. ” - Magic Quadrant for Data Center Networking
CHALLENGE
MC-LAG vs. VC
QFabric vs. VCF
Overlay?
MC-LAG, CLOS…
OPPORTUNITY
Network Requirements Consistent Design
Output
Describe the four key DC architectures to your customer
Engage them in a conversation about the pros and cons of each
Properly position difference choices, based on customer profile characteristics
INDUSTRY TRENDSEnterprise DC and Cloud
Public Cloud
XaaS
Iaas
Private Cloud
Business
Critical IT
Cloud-enable Campus
ITaas
Vanilla Enterprise
L3 CLOS
Overlay
L3L3 CLOS
With
Overlay
L2/L3
• Scale out IP fabric
• Small Blast Radius
• Hyper scale multi-tenancy
• Overlay virtual network
• Virtualized IT
• Low scale multi-tenancy
• Consolidated IT
• Converged storage
• Simplified operation
• Simplified network & ops
• Virtualized network services
JUNIPER OFFERINGS
THREE GUIDING PRINCIPLES
Self-healing
Proactive
Event Correlation
Security intelligence
Smart
Easy to buy
Easy to deploy
Easy to operate
Easy to secure
Simple
Embrace standards
Enable choice
Alleviate lock-in
Standard APIs and Signatures
Open
40G OpticsMulti-Silicon Strategy Innovative Systems Innovative Software
QFX Series Switching Q-FABRIC SRX Series SecurityEX & MX Series
Universal SDN Gateway
Virtual Chassis
Fabric
MH
Service Insertion and Chaining
(Security, Caching, NAT, NFV Partners)DDoS
SecureFirefly
Perimeter
WebAppSecure
NetworkDirector
------------- ORCHESTRATION ------------- ---------- ITSM & APPLICATIONS ---------
FOUNDATION
TECHNOLOGIES
METAFABRIC ARCHITECTURE
UNDERLAY
ARCHITECTURE
OVERLAY
ARCHITECTURE
SERVICE
VIRTUALIZATION
INTEGRATED
MANAGEMENT
VERTICALLY
INTEGRATED
WITH OPEN
TECHNOLOGIES
METAFABRIC ARCHITECTURE PORTFOLIO
Flexible building blocks; simple switching fabricsSwitching
Universal data center gateways and VM MobilityRouting
Smart automation, analytics and orchestration toolsManagement
Simple and flexible SDN capabilitiesNetwork Virtualization
Adaptive security to counter DC threatsData center security
Reference architectures and professional servicesSolutions and Services
METAFABRIC ARCHITECTURE PORTFOLIO
Flexible building blocks; simple switching fabricsSwitching
Universal data center gateways and VM MobilityRouting
Smart automation, analytics and orchestration toolsManagement
Simple and flexible SDN capabilitiesNetwork Virtualization
Adaptive security to counter DC threatsData center security
Reference architectures and professional servicesSolutions and Services
QFX5100 SERIES
QFX5100 Family10GbE / 40GbE Access Switches
Rich L2/L3, MPLS │ Low latency │ FCoE │ SDN protocols
Any architecture
Hitless operations and user application support
Insight Technology
QFX5100 SERIES
ENVIRONMENTAL
• Data Center Airflow
• Reversible Airflow Options
• Redundant Power Supplies
COMMON CHARACTERISTICS
CONTROL+DATA PLANE
• X86 1.5GHz dual-core
• 8GB DRAM + dual 16GB SSD
• Broadcom Trident II ASIC
SOFTWARE
• JunOS Single binary image
• CentOS KVM base system
• Guest VM for 3rd party apps
QFX5100-96S
• 2RU form factor
• 96 ports 1/10Gb SFP+
• 8 ports 40Gb QSFP
QFX5100-24Q
• 1RU form factor
• 24 ports 40Gb QSFP (fixed)
• 8 ports 40Gb QSFP (upgrade)
QFX5100-48S
• 1RU form factor
• 48 ports 1/10Gb SFP+
• 6 ports 40Gb QSFP
Challenge
Downtime not acceptable during software
upgrades. Legacy/competitive solutions need the
support of adjacent devices during software
upgrade.
Solution
Topology-independent ISSU – Made possible by
QFX5100’s unique software architecture.
Benefits
No traffic loss during upgrades
No port flap during upgrades
Works in any switching architecture
TOPOLOGY INDEPENDENT ISSU
HOST OS
OTHER HARDWAREPFE hardware
Partition for PFE
warm boot
PFE
Control
Master/
Backup
Electio
n
Other
JUNOS
process
MASTER VM
Software Bridge
PFE
Control
Other
JUNOS
process
Master/
Backup
Electio
n
BACKUP VM
Time
Qu
eu
e D
ep
th o
r Q
ue
ue
La
ten
cy
Real-time Buffer Utilization
Monitoring And Reporting
High Threshold
Low Threshold
Microburst
Challenge
Traditional analytics sample at very low frequency
~1-5 seconds. It misses critical events that may
disappear within this time interval. Network is
exposed to hotspots due to events like microbursts.
Solution
Insight Technology – Samples every 8ms
Benefits
Provides real time visibility of network hotspots
(microburst levels)
Enables correlation of historical events and
creates file in multiple formats
Enables admin to circumvent hotspots and
proactive move workloads smartly
INSIGHT TECHNOLOGY
JUNIPER ARCHITECTURES
Juniper
Architectures
Open
Architectures
MC-LAG
…
QFX5100
Virtual Chassis
Up to 10 members
QFabric
Up to 128 members
IP Fabric
L3 Fabric
Virtual Chassis
Fabric Up to 20 members
Benefits Single point of
management and
control
Purpose-built and
turnkey
Benefits Flexible deployment
scenarios
Open choice of
technologies and
protocols
One Architecture Does Not Fit All,
QFX5100 enables Choices!
VIRTUAL CHASSIS FABRICWhat and Why
switching building blocks
EX4300
QFX3500
QFX3600
QFX5100
Network Director
APIs
Single Point of Management
Full Layer 2 and Layer 3
ECMP
Transit FCoE
Topology Independent ISSU
Plug and Play Provisioning
4 spines and 16 leaves
VXLAN L2 Gateway
Virtual Chassis Fabric
SERVER AND STORAGE CONNECTIVITYMANY OPTIONS
Any Ethernet Media, High Resiliency,
Flexible deployment 10/100/1000M Copper
10/100/1000M Fiber
10G Copper
10G Fiber
10G or 40G Fabric
Any-port connectivity
In-Service Software Upgrade
n-Way multi-homing
Active-Active paths
Single Point of Management
FCoE Transit
iSCSI / NFS / CIFS
Lossless Ethernet / DCB
Hardware SDN supportServer Storage
QFX5100 QFX5100 QFX5100 QFX5100
10GbE POD 1/10/40GbE POD 1GbE POD
Spine QFX5100-24Q QFX5100-24Q QFX5100-48S
Leaf
QFX5100-48S
QFX5100-24Q
QFX5100-96S
QFX3500 & QFX3600
QFX5100-48S
QFX5100-24Q
QFX5100-96S
QFX3500 & QFX3600
EX4300
EX4300
10/40GbE spine and 1/10/40GbE leaf nodes
1,10,40 GE – ALL IN ONE FABRIC
10GbE 1/10/40GbE 1GbE40G
10G
2 spine nodes
10G 10G10G
QFX5100-24Q
1 2 18
10G 10G
3 4
QFX5100-48S
1 2
2 X uplinks
• 18 x 10GbE racks
• 936 x 10GbE ports 6:1 OS
10G 10G10G
QFX5100-24Q
1 2 16
10G 10G
3 4
1 2 3 4
QFX5100-24Q
QFX5100-96S8 X uplinks
• 16 x 10GbE racks
• 1,536 x 10GbE ports 3:1 OS
4 spine nodes
2 OR 4 SPINE NODE DEPLOYMENTS
40G 40G
SMART TRUNKS
L1
T1
T2
T12
L2
L3
S
1
S
2
• Automatic fabric trunks
• Fabric trunk types
• Next Hop (NH)-trunks
• Remote Destination (RD)-trunks
• Weights-based multi-path (instead of NH link) bandwidth ratio to avoid fabric congestion
30G
10G
20G15G
25G
30G
BROADCAST, UNKNOWN UNICAST, AND MULTICAST
Bidirectional Multicast Distribution Trees
SW 4SW 1 SW 2 SW 3
1 RU, 48 SFP+ & 1 QIC
SW 5 SW 16
…
L1 L2 L3 L4
• Multicast Distribution Trees (MDT)• One minimal cost tree rooted at
each node
• Total of N trees
• Shared among all members to carry traffic in both directions
• Benefits:• Predictable latency and replication
points
• Automatic load rebalance on topology change
RE RE
Load balancing among N trees
• BUM traffic : VLAN-ID (hw-token) mapped to tree-id
• Known multicast: multicast next-hop (IPMC) assigned to tree-id
• Bidirectional MDT tree
• Shared by all members
• Breadth-First Searchalgorithm (BFS)
Multicast
• Same MDT tree
Unknown Unicast
& Broadcast
VCF - DATA FORWARDINGSummary
• Smart Trunk
• Weighted multi-path algorithm
• 4-way ECMP
Unicast
POSITIONING
DECISION TREE4 Questions to ask
VCF MC-LAG IP FabricQFabric
YES* YES* NO YES*
1G-T (EX4300)
1G-F (Ex4300)
10G-F
10G-T
1G-T
1G-F
10G-F
10G-T
1G-T
1G-F
10G-F
10G-T
1GT (EX4300)
1G-F(EX4300)
10G-F
10G-T
<1,536 <4,260 <6,144 6144+
Do you have E2E Storage convergence?
NSX or Contrail Integration?
Interface Types
Port Density
1
2
3
4
* RELEASE 14.1X53D10 – SEP, 2014Scale
JUNIPER ARCHITECTURE SCENARIOS
Juniper
Architectures
Core
Distribution
Access
QFabric Virtual Chassis Fabric
DEPLOYMENT SCENARIO DETAILS
Attribute
Control Plane
Latency
Storage Convergence
1G Copper
1G Fiber
10G Copper
10G Fiber
MAC Addresses
ARP Entries
VLANs
Technology
VXLAN L2 Gateway
QFX3000-M/G
Centralized
3 μs /5μs
Yes
768/6,144
768/6,144
768/6,144
768/6,144
1,536,000
20,000
4K
QFabric
No
VCF
Centralized
1.5μs
Yes
1,536
1,536
1,536
288,000
48,000
4K
Virtual Chassis Fabric
Yes
1,536
Juniper Architectures
CUSTOMER PROFILE
Control Plane: VCF (in-band) vs. QFabric (out-of-band)
Position VCF as much as possible
QFabric for large scale only
ISSU on VCF*
Comparison
* RELEASE 14.1X53D10 – SEP, 2014
OPEN ARCHITECTURE SCENARIOS
Juniper
Architectures
Open
Architectures
Core
Distribution
Access
QFX5100
or
EX9214
EX4300-VC
QFX5100
or
EX9214
QFX5100
EX9214
VCF
or
QFX3000-M
QFX5100
or
EX9214
QFX5100
*Lead with QFX5100 when possible, otherwise use EX9214 if required for scale
DEPLOYMENT SCENARIO DETAILS
Attribute
Control Plane
Latency
Storage Convergence
1G Copper
1G Fiber
10G Copper
10G Fiber
MAC Addresses
ARP Entries
VLANs
Technology
QFX5100-96S
+
EX4300-VC
Distributed
2μs
No
4,608
3,072
No
No
288,000
48,000
4K
MC-LAG
Open Architectures with the QFX5100 Spine
QFX5100-96S
+
QFX5100-48
Distributed
2μs
No
4,608
4,608
No
No
288,000
48,000
4K
MC-LAG
QFX5100-24Q
+
QFX5100-48
Distributed
2μs
No
No
No
896
896
288,000
48,000
4K
MC-LAG
QFX5100-24Q
+
QFX5100-24Q
Distributed
2μs
No
No
No
No
1,536
288,000
48,000
4K
MC-LAG Low latency overall
Port Density varies (<4,608)
QFX5100-96S + EX4300-VC for 1G deployment
Comparison
DEPLOYMENT SCENARIO DETAILS
Attribute
Control Plane
Latency
Storage Convergence
1G Copper
1G Fiber
10G Copper
10G Fiber
MAC Addresses
ARP Entries
VLANs
Technology
EX9214
+
QFX5100-48
Distributed
19μs
No
15,360
15,360
3,840
3,840
1,000,000
256,000
24K
MC-LAG
EX9200
QFX3000-M
Distributed
19μs
Yes
4,032
4,032
4,032
4,032
1,000,000
256,000
24K
MC-LAG
Open Architectures with EX9214 Spine
EX9214
+
EX4300-VC
Distributed
19μs
No
15,360
No
No
No
1,000,000
256,000
24K
MC-LAG High Port Density
Higher logical scale
Higher latency overall
QFX9214 + EX4300-VC for 1G deployment
EX9200 + QFX3000-M for storage convergence
EX9214: 240 10G ports at line rate
Comparison
USE CASES
NG DATA CENTER WITH OVERLAY
S S S S
L L L L L L L L L L L L L L L L
Virtual Chassis Fabric
POD
E1 E2
Single POD – 768 Ports
Small
Data CenterS S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF S S S S
L L L L L L L L L L L L L L L L
VCF
S2 S3 S4 S1 S6 S7 S8 S5
E1 E2 E3 E4
32 PODs – 24,576 Ports
Large
Data Center
16 PODs – 12,288 Ports
Medium
Data Center
S S S S
L L L L L L L L L L L L L L L L
VC F S S S S
L L L L L L L L L L L L L L L L
VC F S S S S
L L L L L L L L L L L L L L L L
VC F S S S S
L L L L L L L L L L L L L L L L
VC F
S S S S
L L L L L L L L L L L L L L L L
VC FS S S S
L L L L L L L L L L L L L L L L
VC FS S S S
L L L L L L L L L L L L L L L L
VC FS S S S
L L L L L L L L L L L L L L L L
VC F
S S S S
L L L L L L L L L L L L L L L L
VC FS S S S
L L L L L L L L L L L L L L L L
VC FS S S S
L L L L L L L L L L L L L L L L
VC FS S S S
L L L L L L L L L L L L L L L L
VC F
S S S S
L L L L L L L L L L L L L L L L
VC F S S S S
L L L L L L L L L L L L L L L L
VC F S S S S
L L L L L L L L L L L L L L L L
VC F S S S S
L L L L L L L L L L L L L L L L
VC F
S1 S2 S4S3
E1 E2
TELCO VIRTUAL HOSTING
KVM ESXiXen NAS KVM ESXiXen NAS
S S SS
L L L L
A A A A A A A A
Super Spine
VMware
NSX
Juniper
Contrail
MPLS Backbone
POD1 POD2
VXLAN FABRIC ARCHITECTUREFull Mesh of VXLAN Tunnels
S S S S
BMS BMS BMS BMS
L L L L L L L L L L L LL L L L
BMS NAS
MSDC AND OVER THE TOP (OTT)IP Fabric
S S S S
L L L L L L L L L L L L L L L L
S S S S S S S S
L L L L L L L L L L L L L L L L
A A A A A A A A
L L L L L L L L
A A A A A A A A A A A A A A A A
S S S S
3-Stage Clos
Spine and Leaf
5-Stage Clos
PODs
5-Stage Clos
Performance
NG DATA CENTER ARCHITECTURE
VCF
POD
1
VCF
POD
2
VCF
POD
3
VCF
POD
4
VCF
POD
5
VCF
POD
6
VCF
POD
7
VCF
POD
8
VCF
POD
9
VCF
POD
10
VCF
POD
11
VCF
POD
12
VCF
POD
13
VCF
POD
14
VCF
POD
15
VCF
POD
16
Internet MPLS
768
ports
1536
ports
2304
ports
3072
ports3840
ports
4608
ports
5376
ports
6144
ports
6912
ports
7680
ports
8448
ports9216
ports
9984
ports
10752
ports
11520
ports
12288
ports
Scale
Network Director
Scale Out – Point of Delivery (PODs)
Core Switches
Edge Routers