BRKDCN-2219.pdf - Cisco Live

Ammar Latif, Principal Systems Engineer, SalesRahul Parameswaran, Technical Marketing Engineer

BRKDCN-2219

Data Center Design for Media and Entertainment Networks

Questions? Use Cisco Webex Teams to chat with the speaker after the session

Find this session in the Cisco Events Mobile AppClick “Join the Discussion”Install Webex Teams or go directly to the team spaceEnter messages/questions in the team space

How1234

© 2020 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Webex Teams

BRKDCN-2219 3


Who Are the Presenters?

4BRKDCN-2219

Ammar LatifPrincipal Engineer – Media

Rahul Parameswaran Technical Marketing Engineer – INSBU


• Digital Disruption In Media

• SMPTE 2110 and Move from SDI to IP

• Cisco’s IP Fabric for Media

• Time Synchronization with PTP

• Post Production workflows

• Architectures and Customer Deployments

5

Agenda

BRKDCN-2219


Media Workflows Reimagined

6BRKDCN-2219


Capturing New Transitions

7BRKDCN-2219

Transition to IP from SDI

10110101 1001010110101010101010

• Ready for today’s new formats and data rates

• Increased bandwidth with Ethernet• Deterministic networking

x86 Workloads

• Move away from specialized, dedicated, expensive HW

• Towards general purpose, low cost compute and storage

Cloud Architectures

• Software Defined Networking (SDN), not manual

• Application Policy Driven Infrastructure • Composable pools of resources


PRODUCTION POST-PROD PLAYOUTGRAPHICS

fxDISTRIBUTION

Reimagine Your Broadcast Workflow

8BRKDCN-2219


GV Convergent

Imagine SDNO

REST REST REST

Cisco IP Fabric for Media

REST

Nevion Video IPathLawo VSM

REST

REST EVS S-Core Master

Evertz Magnum

• Open Scalable SMPTE 2110 Network• SDI-to-IP Network Infrastructure • Fully Non-Blocking Multicast Architecture• Open APIs• Multicast Flow Visibility • Realtime Telemetry & Analytics

Live Studio Production Infrastructure

9BRKDCN-2219



versio SNP100Selenio

• ST-2110 and ST-2022-6/7 Network• AES 67 Audio• DANTE Audio• Mixed workflows (Streaming + File Based)• Compressed (MPEG, ABR, J2K)

Production Control Room

10BRKDCN-2219



versio SNP100Selenio

• Master Control Facility Operations• Compressed / Uncompressed Workflows• AES67 / DANTE Audio• Disaster Recovery• Playout• Program Replacement / Insertion

Master Control Infrastructure

11BRKDCN-2219

Professional Media Network


Objective: Replace SDI Router with IP Fabric

Cameras and Microphones

Graphic Systems

Remote Source

Playout

Video Switcher

Audio Mixer

Monitoring Systems

Multiviewer

Video Router

Video ServerRelay and Clips

Control Systems with Control Panel

REST API

Network Controller

IP Fabric


Industry Challenges and Requirements

14BRKDCN-2219

Unchanged Operator Workflow

Zero Packet LossReservation of network resources across redundant paths for zero congestion loss

Video/ Audio End Point Sync Precision Timing and Synchronization

Fast SwitchingSwitching streams with minimal delay

System AvailabilitySame or better than SDI-based system

Network SecurityProtect network operations from any malicious attacks


Relevant Standards and Industry Specifications

• SMPTE ST 2022-6 : SDI Over IP. Composite Media

• SMPTE ST 2110 suite: SDI to IP Essence-based media

• SMPTE ST 2059-2: Timing. Based on IEEE1588

• SMPTE ST 2022-7 : Redundancy

• AMWA NMOS: • IS-04: Device Registration and Discovery• IS-05: Connection Management: Connection mgmt between sender and receiver• IS-06 Network Control API (Work-in-progress): SDN API for Network Services

15BRKDCN-2219


SMPTE ST 2110

16BRKDCN-2219

• Composite to Essence + Timing

VideoHANCAudio

VANCAncillary Data

VANCAncillary Data

Video

SMPTE ST 2022-6 (SDI over IP)

SMPTE ST 2110

Straight encapsulation of SDI frames into 1428 byte IP packet

2110-20

2110-40

2110-30

HANC Audio2110-30

PTP


Rich Ecosystem of Broadcast Vendors

17BRKDCN-2219

and more …..

Building Reliable Network for Multicast Transport


Routing in SDI world

19BRKDCN-2219

Video Router

SRC DST

Broadcast Controller

-SDI router sets up path


SMPTE 2110 End Points

20BRKDCN-2219

• Native IP Support• Cameras• Playout Systems

• Connect directly to the fabric

• SDI endpoints

• Legacy

• Requires IPGs

• IPGs can become SDI aggregation point

Connectivity Per flow 1.5, 3 or 12Gbps Per Port 10, 25, 40, 50 or 100Gbps

IPGSDI IPA

B

IPGIPG


Destination Timed Switching

21

Src Dst


-BC instructs destination to switch using IS-05 or other control means-End Point requests path setup using IGMP-Network Fabric protocols sets up path

IGMP

IP Fabric

Dst


-BC instructs destination to switch using IS-05 or other control means and instructs the destination network switch to route new flow using API (in parallel)-Network Fabric protocols sets up path

IP Fabric

Dst


-BC instructs destination to switch using IS-05 or other control means and instructs the source, spine and destination network switch to route new flow using API (in parallel)-BC sets up the end to end path (no network fabric protocols involved)

IP Fabric

SrcSrc


Deployment Options for IP Fabric

22BRKDCN-2219

Single Modular Chassis Flexible Spine and Leaf Fabric


Hybrid Spine and Leaf

23BRKDCN-2219

Endpoints on Spine

1.5G HD 3G HD 12G UHD


1.5G HD 3G HD 12G UHD

Layer 3 IP Fabric – Building Blocks

24BRKDCN-2219

PIM for Multicast Routing

IGMP

Layer 3 Uplinks

IGP

ip pim rp-address 10.237.1.1 group-list 224.0.0.0/4


interface Ethernet1/1ip pim sparse-mode

interface Ethernet1/1ip igmp version 3ip igmp immediate-leaveip igmp suppress v3-gsq

interface Ethernet1/1ip router ospf 1 area 0.0.0.0

QoS

policy-map type queuing PRIORITY

class type queuing c-out-8q-q7

priority level 1

<snip>

class type queuing c-out-8q-q5

bandwidth remaining percent 10


What Defines the Topology?

• Unlike how SDI routers were defined (example:1024x1024), IP Fabrics are defined based on type of end points and their port requirements

• Consider the following example• Gateways ; Ports Required 36x40G• IP Camera’s ; Ports Required 150x10G• Audio, Intercomm ; Ports Required 50x1G Copper ports

26BRKDCN-2219


Design : Bandwidth Consideration

Bandwidth from Leaf to each Spine > Bandwidth of senders on that leaf

Bandwidth from Leaf to all Spines (aggregate) > Bandwidth of receivers on that leaf

Non Blocking CLOS Architecture

27BRKDCN-2219


Design

• 9336FX2 can be used as a Leaf for 40G Gateways• Each supports up to 25x40G end point and requires 10x100G uplink

• 93180YC-EX/FX can be used as a Leaf for 10G Camera’s• Each supports up to 48x10G end points and requires 6x100G uplinks

• 9348FXP can be used as a Leaf for 1G Audio/Intercomm• Each supports up to 48x1/10G T end points with 2x100G uplinks

28BRKDCN-2219

End Points Platform/Quantity Number of Uplinks

Gateways-36x40G 9336FX2/2 20x100G

Camers-160x10G 93180-EX/4 24x100G

Audio and InterComm-

70x1G9348FXP 2x100G


Network Topology

29BRKDCN-2219

9336Leaf 1

9336Leaf 2

93180Leaf 3

93180Leaf 4

93180Leaf 5

93180Leaf 6

9348Leaf 7

9348Leaf 8

9508Spine

10x100G Uplinks from each 9336 Leaf




• Protocol Independent Multicast(PIM) enables multicast routing across subnets/networks.

• When multiple path exist between Source and Receivers , traffic is load balanced (ECMP)

• ECMP uses hashing to determine which path is used for a flow

Multicast Routing – PIM and ECMP

30BRKDCN-2219


PIM ECMP and Load Balancing

31BRKDCN-2219

S1 S2 S3 S4 R1(S1) R2(S2) R3(S3) R4(S4)

ECMP hashing could result in traffic loss as it is not bandwidth aware!

There is a need for Intelligent Multicast Transport

UHD Video 12GAudio 1MbpsCC 100kbps

SMPTE 2110

40G Link


Cisco’s Non Blocking Multicast (NBM)

• NBM brings bandwidth awareness to PIM

• Traffic load balanced using flow bandwidth as a parameter

• Prevents link oversubscription by ensuring flows more than link capacity is not sent

32BRKDCN-2219


PIM ECMP with NBM

33BRKDCN-2219

S1 S2 S3 S4 R1(S1) R2(S2) R3(S3) R4(S4)

NBM Brings Bandwidth Awareness to PIM ECMP

UHD Video 12GAudio 1MbpsCC 100kbps

SMPTE 2110

40G Link


• NBM active mode (default)

• NBM orchestrates flows in the fabric

• NBM finds and programs a optimized non-blocking path from source to destination

• Destination either use IGMP or Broadcast controller uses API to request for traffic

NBM modes

• NBM passive mode (shipping starting 9.3(2))

• NBM exposes API using which external controller can program end to end flow path from source to destination

PIM+NBM signaling between switches


API

BRKDCN-2219 34


NBM for Endpoint Bandwidth Protection

• NBM tracks flows a receiver is subscribed to

• If operator accidently routes more sources to receiver than interface capacity – NBM gracefully denies the request

35BRKDCN-2219

3x3G flow on 10G lane Join request for 4th source

NBM denies the request


Configuration Snippet – PIM and NBM

36BRKDCN-2219

feature pimfeature msdpfeature ospf


router ospf 1

interface Ethernet1/33ip address 192.168.1.1/31ip router ospf 1 area 0.0.0.0ip pim sparse-modeno shutdown

feature pimip pim rp-address 192.168.100.1 group-list 224.0.0.0/4

interface Ethernet1/49ip address 192.168.1.0/31ip router ospf 1 area 0.0.0.0ip pim sparse-modeno shutdown

nbm flow-policypolicy Anc_1bandwidth 10000 kbpsip group 239.100.160.221

policy Audio_1bandwidth 40000 kbpsip group-range 239.30.11.1 to 239.30.11.10

policy Video_1bandwidth 1500000 kbpsip group-range 239.20.11.1 to 239.20.11.10

Cisco’s IP Fabric for Media


IP Fabric for Media – Solution Components

38BRKDCN-2219

Cisco Nexus

9300-EX/FX/FX2 Series

9500 -R Series

+Cisco DCNM software

(Optional)

9200 Series

Cisco Nexus 9000 Series

From Cisco’s Data Center Portfolio

NX-OS : NBM Process


DCNM Media Controller

• Fabric Bootstrap : Day 0 Provisioning

• Topology and Endpoint Visibility

• End to End Flow Visualization

• Policy Manager

• API Gateway for Broadcast Controller

• Network Health Monitoring

39BRKDCN-2219


DCNM and NBM

40BRKDCN-2219

NBM Process streams state information to DCNM using Streaming Telemetry

DCNM uses NXAPI REST to push policies/configuration to switch


Topology Discovery

41BRKDCN-2219


Endpoint Discovery

42BRKDCN-2219

NBM Streams Endpoint Information to DCNM


Flow Visualization

43BRKDCN-2219


Security

44BRKDCN-2219

Define flow sizeSender policing & shapingMonitor packet drops

Permit/Deny end pointsWhite list policyBlack list policy

Monitor flow statsNotify packet drops

Notify security events

Sender to mcast groupReceiver to mcast groupFlow

AuthorizationAdmission

Control

Analytics &NotificationsFlow Policing


Flow Policy

• Flow Policy defines bandwidth and QoSparameters for flow

• NBM programs a policer that ensures traffic from an endpoint does not exceed what is allowed in the policy

• NBM uses bandwidth parameter in flow policy to determine bandwidth reservation in the fabric

For Bandwidth Reservation and Securing Network Bandwidth

45BRKDCN-2219

3Gbps

12Gbps

policy Videobandwidth 3000000 kbpsip group-range 239.1.1.0 to 239.1.1.255


Host Policy

• With SDI security was not an issue

• With IP anyone with an IP device can send and IGMP join and subscribe to a feed or spoof a source

• Host Policy provides ability to restrict a sender to send to certain flow(s) or a receiver to subscribe to a certain flow(s)

Authorizing Endpoint to Send or Receive Traffic

46BRKDCN-2219

Join request239.1.1.1

Join request239.1.1.2

nbm host-policyreceiverdefault deny5 host 100.1.18.2 group 239.1.1.1/32 permit


Flow Statistics

48BRKDCN-2219


Cisco IP Fabric for MediaResponse to Industry’s Challenges and Requirement

49BRKDCN-2219

Non-Blocking FabricLow Latency

1/10/25/40/100 Gbps

Plug-n-PlayDay 0 Deployment

Image and Configuration Updates

Visibility and AnalyticsInformation Rich TopologyFlow VisibilityFlow Statistics

HA & ScaleSpine-Leaf TopologyFlow MigrationMulticast and PTP Scaling

SecurityEndpoint Admission Control

Flow AuthorizationFlow Policing

Open StandardsSMPTE 2022-6SMPTE 2110PTP – SMPTE 2059-2, AES67AMWA Network Control REST API


Spine

Leaf Leaf Leaf

XP UCIP

GV Node

IPFM

Legacy SDI Layer

VLINK

DCNMMedia Controller

Spine

Control PlaneMedia APIs/NXAPI/Netconf

Broadcast Controllers

54

Video IPATH

Deployment Architectures


IP Fabric with Redundant Networks

56BRKDCN-2219

Fabric A Fabric B

End Points

• Two Independent Fabric• Two Independent Network Controller• Single Broadcast Controller• End point connected to both fabrics


IP Fabric for Media – Distributed Studios

57BRKDCN-2219


Network Controller

IP Fabric

• Studios spread across buildings/locations • Have Leaf Switches at Each Studio• Aggregate it to Centrally Located Spine

Master Control Room

Studio A Studio B Studio C


Multi Site – Remote Leaf

58BRKDCN-2219

Main Site

End Points

• Remote Leaf Suitable when number of end point in Remote Site Small• Most Traffic is sent to Main Site

End Points

Remote Leaf

Challenges:• Latency in Control Network between Network Controller and Remote Leaf• How will Broadcast Controller control end points in Remote Site• Needs dark fiber (No Service provided or router in between remote leaf and Spine)• PTP distribution : GM in main site


Multi-Site and PIM Border

59BRKDCN-2219

• Multi-Site and PIM Border is a feature with which the IPFM fabric can interconnect with another site / external PIM Router

• Uses border-leaf to interconnect with an external site/router

• The sites that are interconnected work independently.

Full Mesh MSDP


PIM Border

60BRKDCN-2219

Site A

Layer 3 ports

External PIM Network

ExS ExR

Full Mesh MSDP

PTPTimeSynchronization


Timing in SDI world

63BRKDCN-2219


IEEE 1588-2008 Precision Time Protocol

• Two Way Time Transfer protocol (TWTT)

• Accuracy in a well designed E2E model in the nanosecond range

• Boundary Clocks (BC) and Transparent Clocks (TC) aim correcting delay variations, in both directions (asymmetry)

64BRKDCN-2219

Ordinary Clock Leaf Slave

OrdinaryClock

grandmasterTransparent

ClockBoundary

Clock

RecoveredClock

PTPPTP

PTP

ReferenceClock


PTP Considerations

65BRKDCN-2219

GM

Leaf

Spine

Leaf

Transparent ClockGM

Leaf

Spine

Leaf

Boundary Clock

Better Scale Lower Load on the GM

SyncDelay RequestDelay Response


PTP profiles for media & broadcast

• AES67 (Audio driven)• Based on IEEE 1588-2008 default profile /w specific message rates

• Announce: 1 {0,4}• Sync: -3 {-4,1}• DelayReq: 0 {-3,Sync +5}*

• Allow all devices to be either Master or Slave• Multicast messages only• Default PTP domain: 0 {0-255}

66BRKDCN-2219


PTP profiles for media & broadcast

• SMPTE 2059 (Video driven)• Based on a 5 sec fast locking requirement for endpoints /w spec rates

• Announce: -2 {-3,1}• Sync: -3 {-7,-1}• DelayReq: 0 {Sync +0, Sync +5}

• Default Slave mode unless can operate as Master• Additional PTP TLV with media specific information

• Daily Jam Time, Default Frame rate, …

• Supports Multicast, Mixed (Mcast/Ucast) and Unicast modes• Default PTP domain: 127 {0-127}

67BRKDCN-2219


Providing Multiple PTP Profiles

68BRKDCN-2219

GM

Leaf

Spine

Leaf

Boundary Clock

SyncDelay RequestDelay Response

1588v2ST2059 AES67

1588v2


PTP for Redundant Fabrics

70BRKDCN-2219

With PTP Feeder Switches


PTP for Redundant Fabrics

71BRKDCN-2219

Without PTP Feeder Switches


PTP and Multi Site

72BRKDCN-2219

• Keep PTP separated between sites• Ensure the GMs at all sites are synced to GPS• Signal going from one site to another may need to be re-clocked

No PTP Extension

GPS GPSGPS GPS


Checking PTP at the Switch

73BRKDCN-2219

• show ptp brief

• show ptp clock

• show ptp parent


Checking PTP Messages at the Switch Port

74BRKDCN-2219

• sh ptp port interface ethernet 1/x counters

• sh ptp corrections


DCNM PTP Monitoring

75BRKDCN-2219


Answering Industry Challenges

76BRKDCN-2219

Precision Time for Synchronization

Deterministic Network(Zero Packet Loss, Ultra Low Latency and Minimal Jitter)

Network Security

Unchanged Operator Workflow

System Availability

SDI-basedVideo Router

IP Network

SMPTE 2059-2, AES67 profile

Non Blocking Network Design with Bandwidth Aware Flow

Setup

Flow and Host Policies

Integration with Broadcast Controllers

Redundant Network (-7)

Advance Media Flow Analytics


WAN Router

Media DC Remote Production

Border Leaf

WAN link

Media Controller

PacketLoss

Video Troubleshooting (Today)

78BRKDCN-2219

MPLS


RTP Flow Monitoring

• Detect gaps in RTP flows• uncompressed flows like SMPTE 2110-20• compressed flows MPEG-4,H.264 etc.

• Leveraging Cisco’s Nexus 9000 Cloud Scale ASIC capability• ASIC can inspect every packet of every flow (up

to 24k per switch)• Parses up to 128B of packet header to detect

gaps in RTP flow

79BRKDCN-2219


IP UDP RTP SMPTE 2110 Payload

RTP headers include a sequence number which can be used to track loss

80BRKDCN-2219


WAN Router

Media DC Remote Production

Border Leaf

WAN link

Media Controller

PacketLoss

No RTP drops

Reports

Report RTP

Drops

Media Network Insights

81BRKDCN-2219

Best of Show

MPLS

RTP Flow


RTP Flow Monitor

82BRKDCN-2219

!Configurationfeature netflowip flow rtp

show flow rtp details -- Displays all active flows detected by the ASIC

RTP Flow timeout is 1440 minutesIPV4 EntriesSIP DIP BD ID S-Port D-Port Intf/Vlan Name Packet Count BytesPerSec FlowStart192.168.21.2 239.20.13.1 4139 5500 20000 Ethernet1/34 181699102492 157943157 22:25:08 UTC May 22 2019192.168.100.164 239.101.160.22 4138 50000 20000 Ethernet1/33 41719636319 76983505 06:21:29 UTC May 30 2019192.168.21.2 239.30.21.1 4141 5500 20000 Ethernet1/36 1388462946 299999 22:25:10 UTC May 22 2019192.168.21.2 239.40.21.1 4141 5500 20000 Ethernet1/36 84118756 30686 22:25:11 UTC May 22 2019

show flow rtp errors active – Displays flows currently impacted

RTP Flow timeout is 1440 minutesIPV4 EntriesSIP DIP BD ID S-Port D-Port Intf/Vlan Name Packet Count BytesPerSec FlowStart Packet Loss Loss Start Loss End192.168.21.2 239.20.13.1 4150 5500 20000 Ethernet1/50 99709154952 157932128 06:21:22 UTC May 30 2019 56853 04:18:34 UTC Jun 08 2019 N/A

Leaf1# show flow rtp errors history –- Displays historic information of flows that where impacted and the time of impact (24hr on box history)

RTP Flow timeout is 1440 minutesIPV4 EntriesSIP DIP BD ID S-Port D-Port Intf/Vlan Name Packet Count BytesPerSec FlowStart Packet Loss Loss Start Loss End192.168.21.2 239.20.13.1 4150 5500 20000 Ethernet1/50 99713271686 157931882 06:21:22 UTC May 30 2019 307773 04:18:34 UTC Jun 08 2019 04:19:02 UTC Jun 08 2019192.168.21.2 239.20.13.1 4150 5500 20000 Ethernet1/50 97761927229 157931915 06:21:22 UTC May 30 2019 27295 00:07:48 UTC Jun 08 2019 00:07:48 UTC Jun 08 2019


DCNM – RTP Flow Monitoring

83BRKDCN-2219

• DCNM overlays end to end path of flow and the point in the network where loss is detected

• Time spent on troubleshooting flow loss goes from several hours to seconds!

Leveraging Telemetry – Nexus9k notifies DCNM when a loss is detected

Customer Deployment and Use Case


Major US Broadcaster

85BRKDCN-2219

News Rooms, Converged Infrastructure


OB Van / Production Truck

86BRKDCN-2219

• Live UHD broadcast from IP-enabled truck• Grass Valley IP Camera and GV Node• World’s first live 4K UHD broadcast• Platform: N9508

• UK Premier League broadcast with BT Sport


Master Control Room – Major US Broadcaster

87BRKDCN-2219


Event Live Production and Playout

91BRKDCN-2219

• Cisco on Cisco Story• Internal customer for

IPFM• All IP Studio

Production• Platform: N9300


Playout

92BRKDCN-2219

• Another common use case

• Platform: N9300 and N9508 - Spine and Leaf

Multi-Site

• Connect multiple locations via dark fiber

• Platform: N9300 and N9508

Post Production



fxDISTRIBUTION


94BRKDCN-2219


Graphic Intensive Workflows


Cisco Hyperflex

• Graphics Production • VFX • Compositing / Overlays• Rendering• Real-time GFX Processing

BRKDCN-2219 95


Network control

Graphics Storage

ST2110

Graphics and

EditingST

2110

LinkLLQ

ControlFiles / Editing

SMPTE 2110

QueuesService Classes

Best Effort

96BRKDCN-2219


Prioritizing LIVE (Multicast) over File(Unicast/TCP)

• The solution allows LIVE workflow to co-exist with file based workflows

• NBM places the flows in priority queue

• User defined QOS policies are used to classify and place unicast or file based traffic in low priority queues

• Allows a certain percentage of bandwidth to be reserved for unicast

97BRKDCN-2219

Distribution:Multicast NAT



fxDISTRIBUTION


100BRKDCN-2219


Multicast Challenges

• No RIRs / DNS• No address ownership

• Multi-Tenancy

• Administrative domains• Overlap of addresses

• Security

• IGMP support

101BRKDCN-2219

Service Providers

ProductionDC


Multicast Address Translation

102BRKDCN-2219

S2,G2S1,G1

Multicast NAT

Service Providers

ProductionDC

Translate Source, Group , and L4 portProgramable through APIs


Egress Multicast Address Translation

103BRKDCN-2219

S1,G1

S2,G2

S3,G3

S4,G4

Service Providers

ProductionDC

Translate Source, Group , and L4 portProgramable through APIsScales to 1000s of entries


NAT for Destination Control

104BRKDCN-2219

S2,G2S1,G1 S3,G3

Switch changes Multicast mappingS1,G1 > S3,G3S2,G2 > S3,G3

Destination static join to S3,G3

Conclusion


Summary and Call to Action

• IP Fabric is the Next Gen Digital Glue for Media DC

• Spine Leaf Distributed Architecture • IP Fabric for Media• Multicast rich

• SDN Controller for Deterministic and Secure Media Fabric

• Automation and Streaming Telemetry

106BRKDCN-2219


Useful Resource

• Cisco Media page @ http://www.cisco.com/go/media

• IP Fabric for Media on Cisco.com• Cisco IP Fabric for Media Design Guide • Precision Time Protocol for Timing in IP Fabric for Media Guide

• DCNM Page

107BRKDCN-2219

http://www.cisco.com/go/media

https://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/white-paper-c11-738605.html

https://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/guide-c07-742142.html

http://www.cisco.com/c/en/us/products/cloud-systems-management/prime-data-center-network-manager/index.html

Complete your online session survey • Please complete your session survey

after each session. Your feedback is very important.

• Complete a minimum of 4 session surveys and the Overall Conference survey (starting on Thursday) to receive your Cisco Live t-shirt.

• All surveys can be taken in the Cisco Events Mobile App or by logging in to the Content Catalog on ciscolive.com/emea.

Cisco Live sessions will be available for viewing on demand after the event at ciscolive.com.

© 2020 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCN-2219 108

https://www.ciscolive.com/emea.html

http://ciscolive.com/


Continue your education

109BRKDCN-2219

Related sessions

Walk-in labsDemos in the Cisco campus

Meet the engineer 1:1 meetings

Thank youThank you

BRKDCN-2219.pdf - Cisco Live

Documents