Top Banner
BRKEVT-2804 Cisco TelePresence: Monitoring and Troubleshooting Video Deployments Follow us on Twitter for real time updates of the event: @ciscoliveeurope, #CLEUR
98
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: BRKEVT 2804 Monitor Tshoot

BRKEVT-2804

Cisco TelePresence: Monitoring and Troubleshooting Video Deployments

Follow us on Twitter for real time updates of the event:

@ciscoliveeurope, #CLEUR

Page 2: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 2

Housekeeping

We value your feedback- don't forget to complete your online session evaluations after each session & the Overall Conference Evaluation which will be available online from Thursday

Visit the World of Solutions and Meet the Engineer

Visit the Cisco Store to purchase your recommended readings

Please switch off your mobile phones

After the event don’t forget to visit Cisco Live Virtual: www.ciscolivevirtual.com

Follow us on Twitter for real time updates of the event: @ciscoliveeurope, #CLEUR

Page 3: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 4

Keeping Focused: What This Session is Not About

This session is about monitoring and troubleshooting video conferencing.

To provide context for the above, we will cover some video conferencing features that are relevant

This session is NOT about

- Video conferencing deployments

- CUCM features

- VCS features

- Interworking CUCM- VCS- CTS, etc.

There are sessions for the above:

- Remaining at Cisco Live:

BRKEVT-2803 Cisco TelePresence: designing and deploying multipoint video solutions BRKEVT-2319 Cisco TelePresence: ad-hoc business to business video

- Already occurred, but slides are available!

BRKEVT-2800 Architectural overview for Cisco TelePresence deployments BRKEVT-2801 Cisco TelePresence: best practices for call control integration BRKEVT-2802 Cisco TelePresence: deploying and provisioning video endpoints

Page 4: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 5

Agenda

Defining TelePresence Applications

Application Traffic Patterns and Demands

Monitoring and Troubleshooting Lifecycle

- Registration

- Endpoint health

- Call Routing

- Media Generation, Transport and Termination

- Utilization

Page 5: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 6

What is Video Collaboration?

Video IP Telephony

CP-9971

IP Video Phone E20

EX90

MXP1700

Telepresence

1xxx,3xxx Series

T Series

Soft Clients

CUPC

MOVI

Desktop/ Room Video

Conferencing

Web Conferencing

WebEx

Page 6: BRKEVT 2804 Monitor Tshoot

Video Application Media Traffic Patterns

Page 7: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 8

But Video Is Not Voice

Traffic profile is very different

Variable Bit Rate

More data on the wire

32 to 209

times

the

bandwidth

Page 8: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 9

Video Application Bandwidth Video requirements continue to grow

• VoIP: 30-40 kbps, Desktop Share: 40 kbps, Video: 220 Kbps1

• HQ Video (360p 1.5Mbps, 180p 0.5 Mbps) Min 300k WebEx

• E20 128 kbps – 1152 kbps

• CP-99xx 256 kbps – 1024 kbps Video IP Telephony

• CUVA 460 kbps

• MOVI 384 kbps – 2 Mbps Soft Clients

• 384 kbps – 6 Mbps Desktop Video Conferencing

• 1.5 Mbps – 24+ Mbps TelePresence

1: NOTE: average is much lower

all: burst bitrate could be 7-20% higher

Page 9: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 10

One way

latency Jitter Loss

< 1000ms < 100ms < .05%

< 150ms < 30ms < .1%

< 150ms < 10ms < .05%

Network Requirements of Video Collaboration Apps

< 150ms < 30ms < .1%

< 150ms < 30ms < .1%

Media Synchronization

audio + discrete info (slide show): < 1000 ms

audio + pointed objects w/ narration: < 200 ms

Lip Sync: audio advance over video: < 30 ms

Lip Sync: audio delay following video: < 100 ms

Page 10: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 11

Cisco 9971

Cisco 8945

VCS Cluster CUCM Cluster

EX90

SIP

Dual Profile 52

SIP SIP and H.323 Media

CSF

Call Signaling may traverse multiple servers

No Signaling Protocol Interworking Required

Media Flows Directly between Terminating Endpoints

Movi

Point to Point Video Conferencing Intra-Company, SIP to SIP

Many VCS based endpoints

support both H.323 and SIP.

SIP & H.323 Dual Homing

should be explored:

• Migration

• Keeping signaling in

native format

Page 11: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 12

H.323 registered

SIP H.323 SIP and H.323 Media

Point to Point Video Conferencing Intra-Company, SIP/H.323 interworking

Cisco 9971

Cisco 8945

VCS Cluster CUCM Cluster

H.323 registered

SIP

CSF

Call Signaling may traverse multiple servers

Media Flows through the VCS (which performs media translation)

Because of media anchoring, geographical location of the VCS

is Important

Movi

VCS performs

presentation share

interworking on

media.

Page 12: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 13

Multipoint Video Conferencing

Multiple solutions to enable multipoint conferencing.

Participants send their audio/video stream to centralized device (MCU/CTMS)

Device selects, possibly re-encodes, and retransmits audio/video to participants

Cascading a possibility for some

MCUs (better BW optimization but some loss of functionality)

Device Usage

Cisco TelePresence Multipoint Switch (CTMS) Immersive Cisco TelePresence multi-party

TelePresence Server Active-Presence & Transcoded TelePresence

TelePresence MCU Multipoint Transcoded Video Conferencing

Multi-site on certain endpoints Adhoc multipoint conferencing

Page 13: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 15

Cisco TelePresence Multi-Point Meetings Multipoint latency considerations

For small deployments centrally locate multipoint resources

Target a one way end-to-end network latency of < 150ms

Calculate worst case latency by adding the longest two legs

-+ latency of multipoint bridge/switch

Sites with relatively low latency point-to-point may have much higher latency with multipoint

For Large deployments regionalize multipoint resources and manage meeting with CTS-Manager

31ms

75ms

54ms

75ms

54ms

10ms

139ms

London to Tokyo

37ms

London – New York

Point-to-point 37ms

Multipoint 116ms

Page 14: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 16

Traditional Video Conferencing MCU

Endpoints send audio and video towards central MCU

MCU

- Receives, blends/selects media and transmits

Mixes audio

Transcodes video to match receiving endpoint capabilities

- Performs interop between devices

- May operate in screen switching or composite modes

MCUs are placed at:

- High WAN bandwidth connected sites

- Balancing end to end latency

MCU

SIP, H.323 or H.320 Videoconferencing

Single Screen HD

Mobile Clients

Phone and Desktop

Page 15: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 17

WAN

Endpoint Integrated Video Bridges

Specific VCS based models (MultiSite on EX, MXP, etc.) may offer option of MCU like functionality for ad-hoc conferencing.

- Low cost multiparty option that provides limited number of participants

Lead unit receives and retransmits media streams

Can create dynamic stress points within network, lead unit is poorly chosen.

Features can generally be disabled to force use of well connected MCUs

Page 16: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 18

Traffic Details IP Telephony and Video Conferencing

IP Telephony and video conferencing almost always use RTP

- RTP (RFC3550) over UDP

RTP header provides

- Sequencing Timestamp Payload types Multiplexing of different media

RTCP (RTP UDP port + 1) provides

- Reporting Control channel

RTP header

IP UDP RTP media

20B 8B 12B

Signaling

Media (RTP)

Page 17: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 19

RTP and Media types

Each media stream (audio, video, desktop share, etc.) is a unique SSRC

Implementation specific: multiple SSRCs of same media type might be multiplexed together (same IPsrc, IPdst, UDP protocols)

CTS:

- 1 Audio UDP flow (multiple audio channels) 1 Video UDP Flow (multiple channels)

RTP Video

RTP Audio

Same

IPSrc,

IPDst, UDP

ports,

different

SSRC

Page 18: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 20

RTP Payload Types

RTP Payload Type (PT) field designates type of media

Divided into static (mostly legacy audio) and dynamic.

- http://www.iana.org/assignments/rtp-parameters

Dynamic range (96-127) PT communicated via signaling (SIP, H.323)

- Identifying video can become a challenge.

RTP header

Page 19: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 21

Why Monitor Video Services?

Video service delivery validation & troubleshooting

End users associate poor video quality with poor network service

Validation via monitoring will lead to earlier identification of issues and greater confidence in network

Video is sensitive: early detection of network issues that may affect all traffic

Contractual SLAs need to be validated

Violations may incur punitive costs

Page 20: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 22

Detection & Troubleshooting

Methodology for troubleshooting: The 4 A’s

This session will focus on tools and methodologies for

- Assess and Acquire

Assess

• Your Senses

• User Reports

• Automated Alerts

Acquire

• What is the issue?

• What is NOT the issue?

• Identify place in call lifecycle

Analyze

• Narrow possible causes

• Most likely cause?

Act

• Test Theory

• Confirm Root Cause

• How to prevent?

• How to detect better?

Page 21: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 23

Call Life Cycle

Identify where in the Call Life Cycle did the call Fail

- Did the calling party receive ring back?

- Did the called party phone ring?

- Did the call fail before or after it was picked up?

- Did two way audio or video establish and then drop?

- Did the users experience one-way audio/video?

- Did audio/video drop after a few seconds?

Establish Control

Communications

Media

Negotiation

Open

Channels

Stream

Media

Call Control

Call Control Media Endpoint Health

IP configuration

Registration

Page 22: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 24

Assess & Acquire Proactive Steps

Be prepared and have data collection systems enabled

- Enable passive monitoring

Call signaling and endpoint logging systems: CDR, Syslog, SNMP Traps etc.

Session monitoring on endpoints, application infrastructure and network

- Enable active tests

Periodic endpoint to endpoint calls

Network performance probes

Helpdesk

- Interview Script

- Access to tools, logs, etc.

Page 23: BRKEVT 2804 Monitor Tshoot

Endpoint Centric Monitoring

Page 24: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 26

Demo of Endpoint Monitoring Management

Cisco Prime Collaboration Manager (CPCM)

Page 25: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 27

The Simple Stuff: Endpoint Registration

Video endpoints register to signaling system

- Allows signaling system to ‘find’ endpoint in the event of an incoming call

- Allows endpoint entry into signaling system for outgoing calls

- Allows discovery of endpoint by some management systems (eg. CPCM)

Endpoints may register to management system (eg. TMS)

- Endpoint health, configuration, software image

GK

VCS Cluster

H.323 Gatekeeper SIP Registrar

CUCM Cluster VCS Cluster

Management

TMS / MSI-Registrar

Page 26: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 28

TCP/IP

Medianet

Auto-Registration

Configuration

Media Monitoring

Service Discovery

Host Monitoring

Resource Management

Middleware/API

Neighbor Discovery

Ma

na

gem

en

t – P

olic

y

Media Services Interface (resides at the

video endpoint):

API

Middleware

Host Stacks / Protocols

Media Services Interface Deliverables

MSI Reference implementation API SDK Simulation - Test environment Support - Documentation

Platform Portability Layer: Win, Mac, embedded Linux, mobile OS

Introducing Media Services Interface (MSI)

Page 27: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 29

Registration Validation (VCS)

GUI: Status-> Registration-> (By Device, By Alias, History)

CLI: xstatus registrations & xhistory registrations

xstatus registrations

Registration 14:

Protocol: SIP

Node: "DefaultSubZone"

SerialNumber: "e67b0418-3983-11e1-9cf1-0010f31e2888"

Authenticated: True

CreationTime: "2012-01-07 18:04:06"

Duration: 10909

SecondsSinceLastRefresh: "9"

SecondsToExpiry: "51"

VendorInfo: "TANDBERG/771 (MCX 4.2.0.10318 (multistream))"

SIP:

AOR: "[email protected]"

Contact: "sip:[email protected]:63278;transport=tls"

Instance: ""<urn:uuid:478f691f-c2fb-5718-b8fd-df0f8c033c9b>""

Registration:

ID: ""

Page 28: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 30

Registration Validation (CUCM)

GUI: Device-> Phone

SNMP: CISCO-CCM-MIB (To use CCM MIB, SNMP service on CUCM needs to started)

>snmpwalk -v2c -m +CISCO-CCM-MIB -m +SYSAPPL-MIB -c Public -Osq 10.81.74.41 CISCO-CCM-MIB::ccmPhoneInfo

ccmPhonePhysicalAddress.1 0:1d:a2:38:a2:f6

ccmPhoneDescription.1 994-4481 CTS3K Room 303

ccmPhoneUserName.1

ccmPhoneIpAddress.1 10.1.160.19

ccmPhoneStatus.1 registered

ccmPhoneTimeLastRegistered.1 2012-1-6,11:16:55.0,-5:0

ccmPhoneLoadID.1 CTS.1-7-1-4864R-K9.P1.sbn

ccmPhoneDevicePoolIndex.1 0

ccmPhoneInetAddressType.1 ipv4

ccmPhoneStatusReason.1 noError

ccmPhoneTimeLastStatusUpdt.1 2012-1-6,11:16:55.0,-5:0

ccmPhoneProductTypeIndex.1 115

ccmPhoneProtocol.1 sip

ccmPhoneUnregReason.1 noError

ccmPhoneRegFailReason.1 noError

ccmPhoneExtn.1.1 9944481

Page 29: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 31

Endpoint POV of Registration

Endpoints have their own view of registration– useful for verification

CTS examples:

- GUI: Monitoring->Call Statistics

- SNMP: (CISCO-TELEPRESENCE-CALL-MIB)

$ snmpwalk -v2c -c public 10.1.3.5 -m +CISCO-TELEPRESENCE-CALL-MIB ctpcMgmtSysConnStatus

CISCO-TELEPRESENCE-CALL-MIB::ctpcMgmtSysConnStatus.1 = INTEGER: registered(5)

Page 30: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 32

Endpoints Peripheral Status

TelePresence units are systems composed of cameras, displays, projectors and microphones etc.

Monitoring Peripheral status is key

CTS: HTTP GUI, CLI and CISCO-TELEPRESENCE-MIB

- Troubleshooting->Hardware Setup peripheral testing wizard

C-series/EX90/EX60: xstatus camera|audio

$ snmpwalk -v2c -c public 10.1.3.5 -m +CISCO-TELEPRESENCE-MIB ctpPeripheralStatusTable

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.1 = STRING: UP_LINK

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.2 = STRING: IP_PHONE --

MACAddress=00070E5705FA,HostName=SEP00070E5705FA,PhoneDN=10029,AppLoadID=jar

70sip.8-3-1- 22.sbn,BootLoadID=7970_020706_cert.bin,Version=SIP70.8-3-

2S,HardwareRevision=1.3,SerialNumber=FCH11299F9X,ModelNumber=CP-7970G

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.3 = STRING: MAIN_CAM -- PID=CTS-CAM-

GEN1,Hardware_ver=3,Firmware=346:788,Hardware=1.0,BuildTime=Fri Apr 20 15:05:42 EDT 2007

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.4 = STRING: MAIN_DISPLAY --

Serial=4178411420257,Hardware_ver=1.3,Model=Unknown,Manufacturer=Unknown,BootCode_

Ver=(unsupported), AppCode_Ver=(unsupported)

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.7 = STRING: AUX_CAM --

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.8 = STRING: AUX_DISPLAY --

CISCO-TELEPRESENCE-MIB::ctpPeripheralDescription.13 = STRING: MIC -- front_center

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.1 = INTEGER: noError(0)

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.2 = INTEGER: noError(0)

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.3 = INTEGER: noError(0)

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.4 = INTEGER: noError(0)

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.7 = INTEGER: cableError(2)

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.8 = INTEGER: cableError(2)

CISCO-TELEPRESENCE-MIB::ctpPeripheralStatus.13 = INTEGER: other(1)

Page 31: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 33

CTS Log Files

Sysop, detailed logs, and SIP Messages

Detailed SIP transactions available for analysis.

Detailed logs available via CLI (utils logs) and HTTP (Troubleshooting -> Log

Files)

Page 32: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 34

CTS Troubleshooting Utilities

Variety of network side diagnostic utilities available via CLI

- Usual ping, traceroute, DNS resolution

- utils network sip|TCP <remote> tests SIP or TCP connectivity to remote

- utils network rtr <remote> realtime per-node based latency reports

- utils network capture … captures packets seen on Ethernet interface

- IPSLA responder built into CTS codecs

Host - tos=0x00 count=60 Last Avg Min Max

0 10.1.3.1 1.5 1.2 1.0 3.2

1 10.1.3.129 1.8 1.9 1.5 3.1

2 10.1.162.1 5.5 4.4 2.9 7.2

3 172.16.2.2 128.8 128.7 126.2 133.2

4 10.1.1.6 127.1 128.9 126.0 139.1

Page 33: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 35

CTS Endpoint Media Statistics

Monitoring->Call Statistics

- Lost packets

- Latency

- Jitter

- Duplicate

- Late packets

Available per media channel and media type

Also available via CLI and SNMP

- CISCO-TELEPRESENCE-CALL-MIB

Page 34: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 37

EX, C-Series and VCS Network Utilities

Endpoints: ping and traceroute available via CLI systemtools network ping|traceroute

VCS (via root CLI) :

- THIS REALLY IS A UNIX ROOT You’ve been warned. Create a non-root user if possible.

- Ping, ping6, traceroute, traceroute6, traceproto, nslookup, arp

- netstat lists listening and established ports

- tcpdump filter, capture and analyze network packets

- nstat aggregate TCP, UDP, ICMP, IP statistics

Page 35: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 38

Signaling Issues

Network connectivity available but

- call not establishing: call routing, interop

- connects-disconnects: codec mismatch, endpoint compatibility

- one-way video: codec mismatch, firewall on media

Important to understand processing of call signaling on each signaling controller.

Logs available at endpoints, VCS and CUCM to help analysis

Page 36: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 39

CUCM Call Tracing

Can be useful to determine call routing issues.

CUCM Serviceability-> Trace-> Configuration

- Enable detailed trace level

2011/06/01

15:52:34.148|SIPL|0|TCP|IN|10.81.74.99|5060|SEPC471FEE64473|10.81.74.100|39550|1,100,57,1.3209^10.81.74.100^*|8214|c471fee6-

[email protected]|INVITE

2011/06/01 15:52:34.152|CC|SETUP|26582520|26582521|9944482|9944471|9944471

2011/06/01

15:52:34.154|SIPL|0|TCP|OUT|10.81.74.99|5060|SEPC471FEE64473|10.81.74.100|39550|1,100,57,1.3209^10.81.74.100^*|8215|c471fee6

[email protected]|100 Trying

2011/06/01

15:52:34.158|SIPT|26582521|TCP|OUT|10.81.74.99|5060|TRUNK_ALPHA_CLUSTER|172.18.106.59|5060|1,100,57,1.3209^10.81.74.100^SEPC

471FEE64473|8218|[email protected]|INVITE

2011/06/01

15:52:34.161|SIPT|26582521|TCP|IN|10.81.74.99|5060|TRUNK_ALPHA_CLUSTER|172.18.106.59|5060|1,100,57,1.3210^172.18.106.59^*|82

19|[email protected]|100 Trying

2011/06/01

15:52:34.162|SIPT|26582521|TCP|IN|10.81.74.99|5060|TRUNK_ALPHA_CLUSTER|172.18.106.59|5060|1,100,57,1.3211^172.18.106.59^*|82

20|[email protected]|503 Service Unavailable

Page 37: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 40

VCS Tracing

Logs available for:

- Historical Calls: Status-> Calls History Able to understand call interop, processing, and routing

- Call Search processing: Status -> Search History Follow call forking, FindMe, transforms etc.

Call Search Testing: Maintenance->Tools-> Locate

- Protocol Messages (SIP, H.323): Status-> Event Log ->

Jan 8 21:42:36 tvcs: Event="Response Received" Service="SIP" Src-ip="10.35.174.118" Src-port="5060" Dst-ip="10.81.74.115" Dst-port="5060" Call-

serial-number="9444a21a-3a6b-11e1-9ad9-0010f31e2888" Tag="9444a300-3a6b-11e1-bd8b-0010f31e2888" Protocol="TCP" Method="INVITE"

To="sip:[email protected]" Response-code="487" Level="2" UTCTime="2012-01-09 02:42:36,371"

Jan 8 21:42:36 tvcs: Event="Response Received" Service="SIP" Src-ip="10.35.174.118" Src-port="5060" Dst-ip="10.81.74.115" Dst-port="25257"

Protocol="TCP" Method="INVITE" To="sip:[email protected]" Response-code="487" Level="3" UTCTime="2012-01-09 02:42:36,371"

Jan 8 21:42:36 tvcs: Event="Response Received" Service="SIP" Src-ip="10.35.174.118" Src-port="5060" Dst-ip="10.81.74.115" Dst-port="5060" Call-

serial-number="9444a21a-3a6b-11e1-9ad9-0010f31e2888" Tag="9444a300-3a6b-11e1-bd8b-0010f31e2888" Protocol="TCP" Method="INVITE"

To="sip:[email protected]" Response-code="487" Level="2" UTCTime="2012-01-09 02:42:36,091"

Jan 8 21:42:36 tvcs: Event="Response Received" Service="SIP" Src-ip="10.35.174.118" Src-port="5060" Dst-ip="10.81.74.115" Dst-port="25257"

Protocol="TCP" Method="INVITE" To="sip:[email protected]" Response-code="487" Level="3" UTCTime="2012-01-09 02:42:36,090"

Page 38: BRKEVT 2804 Monitor Tshoot

Network Based Monitoring & Troubleshooting

Page 39: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 42

Demo of Endpoint Monitoring Management

Cisco Prime Performance Assurance Manager

Page 40: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 43

Cisco IOS NetFlow—What Is It?

Developed and patented at Cisco Systems in 1996

NetFlow is the de facto standard for acquiring IP operational data

Standardized in IETF via IPFIX

Provides network and security monitoring, network planning, traffic analysis, and IP accounting

Packet capture is like a wire tap

NetFlow is like a phone bill

Network World Article—NetFlow Adoption on the Rise http://www.networkworld.com/newsletters/nsm/2005/0314nsm1.html

Page 41: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 44

Page 42: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 45

Where to Apply NetFlow Monitoring

NetFlow allows

- Application discovery Traffic pattern analysis Application profiling Capacity Planning

MPLS-

VPN

DMVPN

campus

Branch A

Branch B

MPLS-VPN

• access interface(s) toward SP

• + NetFlow Egress on LAN with GETVPN deployment

DMVPN

• access interface(s) toward ISP (bandwidth planning)

• DMVPN Tunnel interface (traffic matrix)

Page 43: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 46

ToS Source IP Addr

Dest IP Addr

Src Port Sub-Port/Deep Inspection

Dst Port

Protocol

TCP/UDP Packet Data Area IP Packet

NBAR: Full-Packet Inspection

Used for intelligent policy (QoS, filtering, etc.) or reporting

Identifies over 400 applications and protocols TCP and UDP port numbers

-Statically assigned

-Dynamically assigned during connection establishment

-RTP and RTP payload type identification

-Cisco TelePresence media and signaling supported in IOS 15.1(3)T

Non-TCP and non-UDP IP protocols

Data packet inspection for matching values

Stateful and Dynamic Inspection

Page 44: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 47

Flexible NetFlow & NBAR Integration

show flow mon <app_mon> cache

IPV4 SRC ADDR IPV4 DST ADDR APP NAME …

=============== =============== ===============

10.0.1.1 10.0.1.2 nbar rtcp

10.0.1.1 10.0.1.2 nbar ssh

10.0.1.1 10.0.1.2 nbar telnet

10.0.1.1 10.0.1.2 NBAR lunar_light

nbar = Static Applications

NBAR = Custom Applications

router(config)# flow record app_record

router(config-flow-record)# match ipv4 source address

router(config-flow-record)# match ipv4 destination address

router(config-flow-record)# match application name

IOS 15.0

Reporting Example (Cisco Prime Assurance)

NBAR application name inclusion in

Flexible NetFlow record creates

association of application name with

flow reporting.

Page 45: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 48

Latency Network

Jitter Dist. of Stats

Connectivity Packet Loss

FTP DNS DHCP TCP Jitter ICMP UDP DLSW HTTP

Network Performance Monitoring

Service Level Agreement

(SLA) Monitoring

Network Assessment

Multiprotocol Label

Switching (MPLS)

Monitoring

VoIP Monitoring

Availability Trouble

Shooting

Operations

Measurement Metrics

Uses

MIB Data Active Generated Traffic to Measure the Network

Destination Source

Defined Packet Size,

Spacing COS and Protocol

Responder

LDP H.323 SIP RTP

IP SLA

IP SLA: Measuring Network Paths

RADIUS Video

IP SLA

Cisco IOS

Software

IP SLA

Cisco IOS

Software Cisco IOS

Software

IP SLA Jitter responder supported on CTS

Page 46: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 49

IPSLA Video Operation Embedded Traffic Simulator

IPSLA known in industry for jitter, ICMP, etc. probes

Most probes measure experience without affecting user traffic (hopefully)

Need traffic to stress test network

IPSLA VO provides

Realistic representation of arbitrary video (RTP) traffic

Packet sizes, burstiness, traffic rate, etc.

pre-packaged profiles:

IPTV, Video Surv, CTS

Extensible via data file

Custom profile generation from packet capture

March 2011

ActionPacked

Page 47: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 50

CBQoS MIB

IOS QoS collects vital information regarding health of QoS classes

Pre and Post bytes, drops, etc

Same class names from different routers can be compared

‘snmp mib persist CBQoS’

Page 48: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 51

Advanced Video Performance Analytics With Network Analysis Module (NAM)

Troubleshoot application performance problems

Analyze application behavior and trends for capacity planning

Perform pre- and post-deployment monitoring of app optimization and acceleration services

Identify application consolidation opportunities

Define and assure services levels

Reclassify and Redirect Traffic

to NAM Based on RTP Payload

Type for Performance Analytics

Poor Quality

Video

Enterprise

Network

NME-NAM-*

Page 49: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 52

IP Traffic Export, Capture & Analyze

Capture packets locally to buffer on router

Store to flash, USB, FTP, TFTP for analysis in protocol analyzer

-IOS XE Cat 4k Sup 7E & Sup 7L-E (XE 3.3.0 SG) include built in Wireshark decode capabiltiy

Capture does not add traffic to network

LY-2851-8(config)#ip traffic-export profile test mode capture

LY-2851-8(config)#int fast 2/0

LY-2851-8(config-if)#ip traffic-export apply test

LY-2851-8#traffic-export interface fast2/0 start

LY-2851-8#traffic-export interface fast2/0 stop

LY-2851-8#traffic-export interface fast2/0 copy ftp://10.17.0.252/images/test.cap

Fast2/0

Page 50: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 53

IOS Performance Monitor

Network nodes are able to discover & validate RTP, TCP and IP-CBR traffic on hop by hop basis

À la carte metric (loss, latency, jitter etc.) selections, applied on operator selected sets of traffic

Allows for fault isolation and network span validation

Cross-network synchronized time windows for measurement

- same 30 second (default) intervals measured

Per-application threshold and altering.

NetFlow and MIB interfaces

Router/Switch native RTP and TCP analysis

Released Nov 2010 15.1(3)T

Page 51: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 54

Perf-mon: Wide Applicability

Tested with:

- Cisco EX90, MXP1700, Polycom, Cisco TelePresence (1xxx, 3xxx), CUVA, CP-9971, CP-7985, CP-7960 (audio only),

- Cisco Video Surveillance Cameras, WebEx (HTTPS), IPTV (VLC)

- Just plain web transactions (wget)

Page 52: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 55

Thresholds & Alerts

Metrics can be tested against thresholds to trigger actions

- Multi-level Alarm Raise/Clear, SNMP Traps, Syslog, embedded scripts, automatic mediatrace, path adaptation (PfR)

SyslogWatcher

Page 53: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 56

Solution Details: Third Party Components and Software

Performance Monitor - Cisco Prime Assurance (includes configuration)

Cisco Prime Collaboration Manager ActionPacked LiveAction (configuration also planned) Plixer Scrutinizer SevOne SevOneNMS CA/NetQoS UCM ManageEngine NetFlow Analyzer1

14+ NMS application vendors engaged!

1: Has support but has not completed CDN IVT testing

plixer

ActionPacked

More info: CDN Partners Page:

http://developer.cisco.com/web/mnets/partners

Page 54: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 57

Metrics Available via Performance Monitor

Variety of network centric metrics added.

Metric/Data Value Protocol

transport rtp ssrc RTP

application media packets counter (long) All

application media bytes counter (long) All

application media bytes rate All

application media packet rate All

transport packets lost counter RTP

transport packets expected counter RTP

transport packets lost rate RTP

counter bytes rate All

transport event packet-loss counter TCP, RTP

transport round-trip-time TCP

transport rtp jitter maximum RTP

transport rtp jitter minimum RTP

transport rtp jitter mean RTP

application media packets rate variation IP-CBR

application media event -

counter packets dropped All

for reference

Page 55: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 58

Metrics in Performance Monitor 2.0 IOS 15.2(2)T

Additional audio/video metrics

More emphasis on TCP metrics

Metric/Data Value Protocol

RTP payload type RTP

IPv6 support

(all new and existing metrics)

Flexible NetFlow (FNF) field imports all

TCP Max Segment Size TCP

TCP min/max/avg Window Size TCP

Out of order bytes RTP

Out of order packets RTP

for reference

Page 56: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 59

Solution Details: performance monitor P

RIC

E

SCALABILITY

c890

c1861

cat3750E

c3945

c2900

ASR1k

c3945e

Cat6k-Sup2T

Cat4k-K5/K10 (Q2CY2012)

20mbps 70mbps 250 mbps 600 mbps

to 8.3gbps

Page 57: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 60

Dynamic Monitoring with Mediatrace

Mediatrace discovers and queries L2 and L3 nodes along a flow’s path

Gathers system resource, interface and flow specific (perf-mon) stats

- For performance monitor: dynamically configures monitoring policy (if needed) 5-tuple + intervals etc. match static policy).

Consolidates information into a single screen

Allows for easy comparisons of device behavior

- Which interface dropping packets?

- Where is DSCP getting reset?

Can be requested by remote device

Automatically (based on thresholds) via EEM script

Let mediatrace do the walking for you!

Released Nov 2010 15.1(3)T

Page 58: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 61

Quick Mediatrace

Available via:

- Cisco IOS Exec CLI

- Periodic configuration via IOS configuration

- Launch from endpoints

Modes:

- Hop Poll: performs only path discovery

- System Poll: in addition to performing node and interface discovery, statistics from the interfaces are collected

- Perf-Mon Poll: collects flow specific statistics. If additional

- information, such as the IP protocol and Layer 4 ports, is specified, the query will be as detailed as possible

Learn More

• Quick Start Guide - http://www.cisco.com/en/US/solutions/collateral/ns340/ns856/ns156/ns1094/whitepaper_c11-653899.pdf

• Deployment Guide - http://www.cisco.com/web/solutions/medianet/docs/guide_c07-684466_v2.pdf

• Configuration Guide - http://www.cisco.com/en/US/docs/ios/media_monitoring/configuration/guide/mm_mediatrace.html

Page 59: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 62

VXR-AA0310#mediatrace poll path-specifier source 10.1.160.3

destination 10.1.3.3 perf-monitor

Started the data fetch operation.

Waiting for data from hops.

This may take several seconds to complete...

Data received for hop 0

Data received for hop 1

Data received for hop 2

Data fetch complete.

Results:

Mediatrace Hop Number: 0 (host=VXR-AA0310, ttl=255)

Mediatrace Hop Number: 1 (host=3845-AA0216, ttl=250)

Metrics Collection Status: Success

Reachability Address: 10.1.162.2

Ingress Interface: Fa0/0/0

Egress Interface: Fa0/0/1

Metrics Collected:

Flow Sampling Start Timestamp: 01:30:42

Loss of measurement confidence: FALSE

Media Stop Event Occurred: FALSE

IP Packet Drop Count (pkts): 0

IP Byte Count (Bytes): 207398

IP Packet Count (pkts): 898

IP Byte Rate (Bps): 6913

Packet Drop Reason: 0

IP DSCP: 34

IP TTL: 57

IP Protocol: 17

Media Byte Rate Average (Bps): 6314

Media Byte Count (Bytes): 189438

Media Packet Count (pkts): 898

RTP Interarrival Jitter Average (usec): 6677

RTP Packets Lost (pkts): 0

RTP Packets Expected (pkts): 893

RTP Packet Lost Event Count: 0

RTP Loss Percent (%): 0.00

Mediatrace perf-mon poll

- Flow specific statistics

Performance-monitor policy automatically configured (if needed) along path, then flow data collected

Fixed field-sets for RTP and TCP flow analysis

Mediatrace 2.0 removes requirement of Layer-4 ports in mediatrace request.

Mediatrace Perf-Mon Poll

Page 60: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 63

Comparing Monitoring Technologies IPSLA NetFlow

metering

Performance

Monitor

Mediatrace

Synthetic

Traffic User Traffic

Accounting User traffic

Performance

Measurement

point (MP) Responder

Single

Node/interface

Single

Node/interface

Multiple

Nodes along

path

Measurement

scope

Between

Generator and

responder

Source and MP Source and MP Source and each

MP

Endpoint Late 2012*

Late 2012

2011

2011

Network 2010

2010

Mediatrace

is not about

monitoring

but

troubleshoot

ing!

* IPSLA Responder avl on CTS 1.5+ already

Page 61: BRKEVT 2804 Monitor Tshoot

Management Options

Page 62: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 65

Enterprise Medianet Network & System Management

Medianet Network & System Management Suite

VoIP

Network, Video & Voice Infrastructure/Applications

webex

Ne

two

rk

Perf

orm

ance M

gt

Traffic

Analysis

Troubleshoot/

Readiness

Assessment

Passive/Active

Performance

Metrics

Device

Ne

twork

De

vic

e M

an

ag

er

& C

onfigu

ration

Mgt

Configuration

Management

Device

Readiness

Assessment

Device

Monitoring

Device

Ap

plic

atio

n

Ma

na

ge

r

Voice/Video

Troubleshoot

Voice/Video

QoE

Mediatrace

IPSLA VO

MSI

SDR

IOS Perf Monitor

NetFlow (PfR, NBAR)

FNF (IOS Perf

Monitor)

MSI (VDI, etc.)

MIB

IPSLA VO

Mediatrace

MIB

IPSLA VO

CLI

Voice/Video

Infra

Cisco Prime

Collaboration

Manager

Cisco Prime

Assurance Cisco Prime LMS

& NCS

Page 63: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 66

Cisco Prime Collaboration Manager Simplifies Operations for Video Collaboration Services

Collaboration Manager helps deliver a

first-rate end user experience:

• Visualize and monitor video

collaboration sessions in real-time-

provide timely support to end users

when issues arise

• Quickly isolate areas of service

degradation with detailed video flow

path analyses - significantly reduce

operational costs

• Effectively manage key assets

through exportable diagnostic and

utilization reports– increase ROI and

improve allocation of resources

Page 64: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 67

Collaboration Manager Features Comprehensive Video Collaboration Service Assurance

• End to End Service Monitoring: Significantly

reduce operational costs by speeding time required

to pinpoint service-impacting issues

• Real Time Service Troubleshooting &

Diagnostics: Dramatically reduce time to detect and

resolve problems

• Service Readiness Assessment with Cisco

Medianet: Ease validation of network readiness

prior to new video endpoint deployments

• Executive Summaries: Instantly view service

degradation and ensure higher system uptime.

Quickly view utilization trends and ensure optimal

resource allocation

• Simplified Reports: Easily view ROI and quickly

analyze utilization/problem trends through

comprehensive reports

• Centralized Inventory of Video Infrastructure:

Fast and easy access to comprehensive inventory

details

Need to

diagnose

faster!

Need to

reduce

costs!

Page 65: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 68

Collaboration Manager 1.1 • End-to-end visibility, real time

troubleshooting and inventory support for

EX and C series(1.0 included CTS)

• Support for scheduled meetings from TMS

(1.0 included CTS-MAN)

• At-a-glance executive summaries and out-

of-the box, simplified usage and

diagnostic reports

• Deeper visibility on medianet enabled

networks into flow-related statistics at hot

spots (1.0 introduced mediatrace and

IPSLA VO)

• Integration with other Prime management

systems (LMS, NAM) offering critical

diagnostic information about the network

along the video path

Page 66: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 69

Collaboration Manager 1.1 Device Support

Category Models Software Version

CTS series CTS 32xx/3xxx, CTS 500,

CTS 1300, CTS 1100

1.7.4, 1.8

C/EX series Profile Dual 65 & Profile 65,

Profile Dual 52, Profile 52,

Profile 42

EX90 & EX60

C20 Quickset & C40 series,

C60 series & C90 series

TC 4.1, 5.0

Call Processors VCS & VCS Expressway

CUCM

x6.0, x6.1, x7.0

8.6 and later

Conferencing 4500 MCU series

TS Server 7010

MSE 8000

CTMS

4.1, 4.2

2.1, 2.2

Ibid

1.7, 1.8

Application Management TMS

CTS-MAN

13.1 and later

1.7 and 1.8

Page 67: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 70

Cisco TelePresence Management Suite Simple, Comprehensive TelePresence Solution Management

TMS simplifies TelePresence solution

management and maximizes ROI:

• Plan, Create and Schedule Conferences

from a Centralized Control Centre –

simple, effective conference management

• Determine where to invest, using detailed

management reporting information.

Customize reports, charts and dashboards

to support informed decision making

• Manage and integrate Directory

information. Ensure that all contact

information is easily accessible, accurate

and consistent.

Page 68: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 71

Cisco TMS + Collaboration Manager

Cisco TMS 13.1

• Real-time Conference Control

• Scheduling of sessions and

phonebook/directory services

• Centralized meeting management and

control for scheduled/ad-hoc meetings

• Powerful, customizable reports

• Provisioning of endpoints and

management of infrastructure

Cisco Prime CM 1.1

• Real-time visualization and

troubleshooting of live sessions

• End-to-end visibility down to media packet

level

• Advanced alarming, diagnostics and

trouble isolation

• Executive summaries and easy to use

reports

Page 69: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 72

Introducing Prime Assurance

Branch Data Center

Collaboration Network

Infrastructure

Data Center

Collaboration Network

Infrastructure

Data Center

ASSURANCE

End-User Exp

Infra Mgmt

App Visibility

Analysis &

Troubleshooting

Page 70: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 73

Collaboration

Data Center Network

Infrastructure

Assurance

PA SNMP (IF, CBQoS)

Events Packets Medianet Performance

Monitor

NetFlow & NBAR

Interactive &

Customizable

Dashboards

End-

User/Application/Network

views

Monitoring,Config,

Threshold templates

FNF Coll &

Reporting

Multi-NAM

Management

WAN Optimization Views

OOB Reports & APIs

ART/Traffic/RTP Analysis

End-point

management

Alarms/Events Browser

Page 71: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 74

Prime Assurance: Voice/Video Dashboard

DSCP Classification

RTP Conversations Details

Top N RTP Streams

Voice Call Statistics

Worst N RTP Streams by Jitter

Worst N RTP Streams by Packet Loss

Worst N RTP Streams by MOS

Worst N Sites by MOS

Worst N Site to Site Connection KPI

Page 72: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 75

Cisco Remote Management Services (RMS)

Cisco Remote

Management Services

Increases • Ability to quickly

adopt and deploy

advanced

technologies

Enables • Customers to avoid

cumulative costs of

hiring & training

mgmt team

• IT to maintain focus

on enabling core

bus strategies

Delivers • High availability

and performance

for full benefits of

AT/ET

Guarantees • Customer

retains control

of their

network, gains

network

visibility

• Remote Monitoring

•24x7 NOC / Service Desk

• Incident Management

• Problem Management

• Change Management

• Configuration Management

• Release Management

• Security Administration

People

Process Tools

Page 73: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 76

Connect with Your Peers and Cisco

Discuss business, IT, architecture, adoption and product topics with peers

-Unified communications, collaboration applications, customer care, telepresence

Interact with Cisco Product Managers, Technical Marketing Engineers and Services Consultants

Learn about new product announcements

Join the Collaboration User Group

-Influence product direction

-Access to Beta trials

-Exclusive programs, advisory groups and briefings

-Membership is free!

Visit the Collaboration Community and join the Collaboration User Group at:

www.cisco.com/go/joinconversation

Cisco Collaboration Community and User Group

Page 74: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 77

Resources

Cisco Remote Management Services (RMS) www.cisco.com/go/rms

Nagios http://www.nagios.org/

Cisco Prime™ Collaboration Manager http://www.cisco.com/go/cpcm

Cisco TelePresence Management Suite http://www.cisco.com/en/US/products/ps11338/

Page 75: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 78

Additional Medianet Resources

• Medianet on Cisco.com http://www.cisco.com/go/medianet

Autoconfiguration http://www.cisco.com/go/autoconfiguration

Media Monitoring http://www.cisco.com/go/mediamonitoring

MSI http://www.cisco.com/en/US/solutions/ns340/ns857/ns156/ns1094/media_services_interface.html

• Medianet Knowledge Base http://www.cisco.com/web/solutions/medianet/knowledgebase/index.html

• Medianet Support Forum https://supportforums.cisco.com/community/etc/medianet

• Medianet Blogs http://blogs.cisco.com/tag/medianet/

• Cisco Developer Network for Medianet http://developer.cisco.com/web/mnets

-

Page 76: BRKEVT 2804 Monitor Tshoot

BRKEVT- 2804

Recommended Reading

Page 77: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 80

Please complete your Session Survey

Don't forget to complete your online session evaluations after each session.

Complete 4 session evaluations & the Overall Conference Evaluation

(available from Thursday) to receive your Cisco Live T-shirt

Surveys can be found on the Attendee Website at www.ciscolivelondon.com/onsite

which can also be accessed through the screens at the Communication Stations

Or use the Cisco Live Mobile App to complete the

surveys from your phone, download the app at

www.ciscolivelondon.com/connect/mobile/app.html

We value your feedback

http://m.cisco.com/mat/cleu12/

1. Scan the QR code

(Go to http://tinyurl.com/qrmelist for QR code reader

software, alternatively type in the access URL above)

2. Download the app or access the mobile site

3. Log in to complete and submit the evaluations

Page 78: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 81

Page 79: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 82

Thank you.

Page 80: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 83

CTMS Bandwidth Optimization Inbound flow control

London

Dallas

Paris

Video and Audio

Video and Audio

Active Site

Active Site

With Flow Control:

5.5Mbps per table segment (avg.)

6 – Table segments (video & audio)

3 – Audio channels

33.2 Mbps total bandwidth

Audio Only

No Flow Control (non-CTMScases):

5.5Mbps per table segment (avg.)

9 – Table segments

49.5 Mbps total bandwidth

Audio used to

identify active sites.

Only active sites

send video.

Page 81: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 88

TelePresence Remote Managed Services Summary

Services Assisted

Management

Enhanced

Management

Comprehensive

Management *

Monitoring &

Management

24x7 Monitoring and Ticketing

Incident, Change & Problem

(Reactive)

Proactive Problem

Software Upgrades Execution of Endpoint and

Infrastructure Upgrades

Customer Service

24x 7 Help Desk

Customer Relationship Manager

Advanced CRM

Ancillary Services

TelePresence Room Service

VIP Event Monitoring

Dedicated Technical Engineer

Training and Reporting

Service Training – How to use service

Enhanced Reporting

Standard Reporting

Conference

Scheduling Scheduling requests via phone/e-mail

optional

optional

optional

optional

optional

optional

optional

optional

optional

optional

optional

optional

*Customer must purchase either Assisted Management or Enhanced Management service level SKUs for each TelePresence endpoint. This is a pre-requisite to

ordering Comprehensive Management service level which is added at the customer level.

optional

optional

Page 82: BRKEVT 2804 Monitor Tshoot

Cisco Confidential © 2011 Cisco and/or its affiliates. All rights reserved. 89

Tier 1

Service Desk

Tier 2

Incident Management

Tier 3

Problem

Management

•Service Desk support around-the-clock

•Assists with general room information

•How do I…?

•Multipoint call initiation

•Notification on impacting incidents

•Verification of scheduling

•Around-the-clock incident management support

•Monitor proactive alarms

•Prioritize incidents per severity and urgency of impact

•Resolve the incident or engage TAC or BU

•Provide technical leadership, collaboration on incident with

vendors on behalf of customer

•Analyze incident trends to identify patterns or systemic

conditions (Proactive problem management – Enhanced )

•Create incidents and refer to tier 2

•Provide root cause analysis

•Perform lab re-creates

Page 83: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 90

Cisco Remote Management Services (RMS)

Cisco Remote

Management Services

Increases • Ability to quickly

adopt and deploy

advanced

technologies

Enables • Customers to avoid

cumulative costs of

hiring & training

mgmt team

• IT to maintain focus

on enabling core

bus strategies

Delivers • High availability

and performance

for full benefits of

AT/ET

Guarantees • Customer

retains control

of their

network, gains

network

visibility

• Remote Monitoring

•24x7 NOC / Service Desk

• Incident Management

• Problem Management

• Change Management

• Configuration Management

• Release Management

• Security Administration

People

Process Tools

Page 84: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 91

Cisco RMS Web Portal

TelePresence RMS platform for all customers

– Comprehensive tool set for monitoring, alarming enhancements

Interactive web portal for TelePresence

– Access to all business reporting

– Active site maps for detailed insight

– Log service requests, track progress of open tickets

Page 85: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 92

Intra-company Media Flow Multipoint with TelePresence Server

VCS Cluster CUCM Cluster

CUCM CTS Cluster

SIP

CTS 1300

CTS 3010

SIP H.323 SIP and H.323 Media

Telepresence Server

T3

EX90 Movi

CSF

Cisco 9971

Triple Screen to Triple Screen Capability

Large Footprint of Supported Video Conferencing Systems

BFCP/H.239 and CTS Auto Collaborate Content Sharing

Does-it-All Platform

Page 86: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 94

Intercompany and external calls Models

Three conceptual models for business-to business (B2B) collaboration:

Extranet

Two or more enterprises interested in B2B communication establish direct

network connectivity through an IP or MPLS VPN.

Cisco deployments rely on the Cisco Unified Border Element (CUBE) or Session

Border Controller (SBC) to provide security and firewall/network address

translation (NAT) traversal.

Exchange

Alternative business-to-business architecture where session and access control is centralized in the form of video service exchanges.

Over the Internet

VCS Expressway used as gateway towards the Internet.

WebEx based desktop, voice and video collaboration.

Page 87: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 95

Company B Company A

B2B with Arranged Extranets

Direct peer to peer relationships arranged between SBC/CUBE or VCS-E of various companies.

Media and signaling flows through firewalls at established points of intercompany communications.

VCS

Cluster

CUCM

Cluster

VCS

Cluster

CUCM

Cluster

Extranet

(s)

Media

SIP

Page 88: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 96

Company B

Company A

Company A

Exchange

Provider Y

SBC

CUCM

Exchange

SW-A ES-A

CE-A

PE-A PE-B

CE-B SW-B

CE-C SW-C

B2B with Exchanges

Exchange Service Providers interconnect different companies (and VC systems)

Exchange provider may also be network provider

May provide additional services: scheduling, transcoding, attendant, recording etc.

Page 89: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 97

Home Office

Internet

Over the Internet (VCS Expressway )

Main Office to Home Workers

Home office endpoints register to VCS Expressway across Internet.

Media travels thru Internet & firewalls

VCS Control

VCS Expressway

Main Office

DMZ

CUCM

SIP H.323 SIP and H.323 Media

Systems registering directly

to the VCS Expressway

EX90

[email protected]

CSF IP Phones

60124

Dual Profile

Campus

Page 90: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 98

Over the Internet (VCS Expressway )

Direct B2B communication

VCS Control

Enterprise A

VCS Expressway

VCS Control

Enterprise B

VCS Expressway Enterprise A

DMZ

Enterprise B

DMZ

Internet

CUCM

SIP H.323 SIP and H.323 Media

Peering

CUCM

IP Phones IP Phones CSF CSF

DNS

Page 91: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 99

Product Demo

Page 92: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 100

• Centralized administration and orchestration of conferences, simplifies administration and dramatically reduces resource costs, ensuring optimal payback from infrastructure investment.

• Plan conferences quickly and easily, with integration to third party applications. Simple, straightforward conference creation.

• Easily manage contacts, integrate phonebooks, increase speed of conference creation.

• Maximize Return on Investment with a comprehensive view of TelePresence Infrastructure

• Increase TelePresence infrastructure availability, ensuring devices have the latest software installed, and are configured to the highest quality.

• Comprehensive customizable data accessibility, enabling informed Executive decision making

Cisco TMS Value Proposition

Conference Control Center:

Booking and Scheduling:

Directories and Phonebooks:

Infrastructure Management:

Provisioning and Configuration Management:.

Customizable Reporting, Trending, Analysis:

Page 93: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 101

TMS

Page 94: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 102

It depends

~70 mbps monitoring bandwidth

CPU impacted by:

- Number of flows

- Complexity of filter

- NBAR, ACLs, DSCP

- Number of classes

- minimal impact until ~80 classes

Memory impacted by:

- Number of flows

- minimal

- Number of classes

Performance Results: performance-monitor Cisco c3945

0

2

4

6

8

10

12

14

16

0 200 400 600 800 1000

CP

U U

til (%

)

Num of Flows

CPU Impact with Scaling on Num of Flows

CPU Delta

VM CPU %

Baseline CPU %

0

5

10

15

20

25

30

35

40

45

50

0 500 1000

Pro

cesso

r M

em

ory

(M

byte

s)

Millio

ns

Num of Flows

Memory Impact with Scaling on Num of Flows

Delta of Proc Mem (Mbytes)

VM Proc Mem (Mbytes)

Baseline Proc Mem (Mbytes)

Page 95: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 103

Performance Monitor: Deployment

Enable pervasively (if possible)

- More monitoring points, the better the data

Applications:

- VoIP, WebEx, TelePresence, Desktop Video Conferencing (Cisco EX/MXP , Polycom, etc), Skype, Microsoft MOC/Lync

- Any TCP traffic: Oracle, SAP, HTTP(s)

Scenarios:

- Remote sites without local IT staff

- Telecommuter / cisco virtual office

- WAN edge

- DMVPN – tunnel interface

- GETVPN – LAN interface

- Mutation (NAT, SBC, etc.) – will require correlation

DMVPN

Apply policy

in/out on tunnel

interface or LAN

GETVPN

Apply policy

in/out on LAN

MPLS-

VPN

CE

Apply policy

in/out on WAN

NA

T

Page 96: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 104

CUCM Tools

CDR/CMR Records

Make sure Load CDR only is unchecked

CUCM ServiceabilityToolsCDRSystemSchedulerCDR Load

• Enable via service parameters:

• CDR –

• CMR –

• Can be exported to a .csv or scheduled to archive to an FTP/SFTP Server for 3rd party billing applications

Page 97: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 105

CDR/CMR Sample Output

CDR Analysis & Reporting

Packet and

Path statistics

K Factor Stats as reported by

device SEP001D705FB47F

Packet and

Path statistics

K Factor Stats as reported by

device SEP001D705FB47F

Page 98: BRKEVT 2804 Monitor Tshoot

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Public BRKEVT-2804 106