Catalyst 6500 and 4500 IP Multicast Architecture and Troubleshooting

• 1. Catalyst 6500 & 4500/4900 IP Multicast Architecture Session ID: BRKARC-3322

2. Cisco Live & Networkers VirtualSpecial Offer Save $100Cisco Live has a well deserved reputation as one the industrysbest educational values. With hundreds of sessions spanning foureducational programs Networkers, Developer Networker,Service Provider, IT Management, you can build a customcurriculum that can make you a more valuable asset to yourworkplace and advance your career goals. Cisco Live and Networkers Virtual immerses you in all facets ofCisco Live, from participating in live keynotes and Super Sessionsevents to accessing session content to networking with your peers. Visit www.ciscolivevirtual.com and register for Cisco Live andNetworkers Virtual. To get $100 USD off the Premier pass, whichprovides access to hundreds of technical sessions, enterslideshareFY11.Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 2 3. Session GoalsTo provide you with a thorough understanding of the Catalyst 6500 IP Multicast architecture and packet flow To provide you with a thorough understanding of the Catalyst 4500 & 4900 IP Multicast architecture and packet flowPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 3 4. Session AssumptionsWorking understanding of General (platform-independent) IPv4 & IPv6 Multicast Working understanding of Catalyst 6500 & 4500/4900 (platform-dependent) architecture and operation General IP Multicast architecture covered in: General Catalyst 6500 architecture covered in: IPM-1261: Introduction to IP MulticastRST-3465: Cisco Catalyst 6500 Switch Architecture Advanced IP Multicast architecture covered in:General Catalyst 4500/4900 architecture covered in: IPM-2008: Advanced Topics in IP Multicast DeploymentRST-3445: Cisco Catalyst 4500 Switch Architecture Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 4 5. IP Multicast - Agenda 1/3Multicast Overview (15-20m) PIM Distribution Modes (~5m) IGMP/MLD & Snooping (~2m) Multicast VPN & Extranet (~2m) Multicast High-Availability (~2m) Multicast Management (~2m) IP Multicast on Catalyst 6500 (~2m) IP Multicast on Catalyst 4500/4900 (~2m) Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 5 6. Catalyst 6500 - Agenda 2/3Catalyst 6500 (60-70m) Multicast Hardware Architecture (~15m) Multicast Hardware Forwarding (~10m) Multicast Hardware Replication (~5m) Multicast Packet Flows (~15m) IGMP / MLD & PIM Snooping (~5m) Multicast Forwarding on VSS (~10m) Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 6 7. Catalyst 4500/4900 - Agenda 3/3Catalyst 4500/4900 (30-40m) Multicast Hardware Architecture (~10m) Multicast Hardware Forwarding (~10m) Multicast Hardware Replication (~5m) Multicast Packet Flows (~15m) Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 7 8. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview PIM Distribution Modes Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public8 9. PIM Dense Mode (PIM-DM) Source Tree Source Tree 1st Gen. Flood & Prune (S,G based)Rooted at Rooted atSource2 multicast distribution protocolSource112 Source1 Source2 Designed with the assumption that receivers are Densely populated in the network... Uses only Source-based Trees Distribution trees are unidirectional (RPF-based)Does NOT use Rendezvous Points (RPs), which makes it simpler to implement & deploy Data-driven Multicast state Requires Periodic Flooding & Pruning on all PIM routers, and DR Election / Asserts on each subnetGroup membership tracked via IGMP v1 or v2 Catalyst Switches provide support for: IPv4 PIM-DM (S,G) forwarding IGMPv1 & v2 and Snooping ReceiversPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 9 10. PIM Sparse Mode (PIM-SM)2nd Gen. All-Purpose (S,G and / or *,G) Source Tree SourceShared TreeRPT: Rooted multicast distribution protocolSPT: Rootedat the Sourceat theRendezvous PointDesigned with the assumption that receivers RP are Sparsely populated in the network... Uses both Shared (RP) & Source based Trees Distribution trees are unidirectional (RPF-based)Data-driven Multicast state Requires Source Registration, RP group-mapping, DR Election & Asserts, and SPT switch-overAutomatic Source discovery (via Registers) Group membership tracked via IGMP v1, v2, or v3 (IPv4) or MLD v1 or v2 (IPv6) Catalyst Switches provide support for: IPv4 and IPv6 (*,G) forwarding Receivers IPv4 and IPv6 (S,G) forwarding IGMP v1/2/3 & MLDv1/2 and Snooping Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public10 11. PIM Source-Specific Multicast (PIM-SSM)Source Tree Source Tree 3rd Gen. Shortest Path (S,G based) Rooted at Source1Rooted at Source2 multicast distribution protocol 2 1 Source1 Source2 Low-Latency variation of PIM-SM, which assumes the one-to-many model Internet, Inter-Domain and Voice / Video distribution Data-driven Multicast state Requires only SSM Range, and DR Election / Asserts Hosts are responsible for source discovery Typically via some out-of-band mechanism (web page,etc.) Eliminates need for RP (Shared trees) & MSDP Group membership tracked via IGMP v3 (IPv4) or MLD v2 (IPv6) Catalyst Switches provide support for: IPv4 and IPv6 (S,G) forwarding IGMPv3 & MLDv2 and Snooping SSM mapping (for IGMPv2 & MLDv1) S1,G1S1,G1 S1,G1 S2,G1 S2,G1Receivers Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 11 12. Bidirectional PIM (PIM-BiDir)3rd Gen. Shared Path (*,G based)Source Shared TreeBidirectional tree multicast distribution protocolrooted at theRendezvous PointHighly Scalable variation of PIM-SM, which assumes LOTS of Sources & Receivers RP Intra-Domain multicast & Database distribution Data-Flow Independent Pre-built (RP/DF-based) distribution trees = NO sourceregisters, DR Asserts, or non-RPF issues Drastically reduces network mroute state Eliminates ALL (S,G) mroute state in the PIM network Permits virtually UNLIMITED Sources Multicast traffic can flow Up & Down (Bidirectional) on theShared (RP-based) tree Group membership tracked via IGMP v1 or v2 Catalyst Switches provide support for: Sources/Receivers IPv4 PIM-Bidir (*,G) forwarding IGMP v1/2 & SnoopingPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public12 13. The Evolution of PIM...SSMSparse Mode BiDir(S,G) One to Many(S,G) & (*,G) (*,G) Many to Many LookupLookup arrives arrives Acceptarrives arrives Accept Lookup Lookuparrives arrivesDirect Direct (S,G)?(S,G)?(*,G)? (*,G)?Connect? Connect?(S,G)? (S,G)? DiscardDiscardRPF or RPF orDF DFDiscard Discard OIFOIFPIM PIM RPF? RPF?List? List? Process ProcessDF DFOIF OIFPIMPIMRPF?RPF? Forwarding // ForwardingList?List? ProcessProcess ReplicationReplicationro v eS w S P Titc hOIF OIF Discard Discard!NULL? !NULL?Forward/ Forward/ sentForward // sent rewriterewrite sentForward rewrite sentsent rewriterewritesent Replicate ReplicateReplicaterewriteReplicate Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public13 14. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview IGMP/MLD & Snooping Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 14 15. IGMP / MLD & SnoopingInternet Group Management Protocol (IGMP) Source Source Host membership reporting for IPv4 Multicast Listener Discovery (MLD) Host membership reporting for IPv6 IGMP / MLD operates on L3 PIM Interfaces IGMP v1/v2/v3 MLD v1/v2 SSM mapping IGMP / MLD Snooping constrains multicast flooding on L2 switchports Based on received Join / Leave reportsHost Snooping process uses both L2 & L3Join Reports Hardware & Software information Receivers Snooping support for IGMPv1/2/3 and MLDv1/v2 PFC/DFC performs hardware protocol redirection of IGMP & MLD packets to SP CPU for processing Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 15 16. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview Multicast VPN & Extranet Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 16 17. Multicast Over MPLS VPNMVPNCEReceiverData MDTCE Used forhigh-bandwidthdata stream JoinPEEnterpriseMPLS Core ReceiverDefault MDTJoin Default MDTReceiver Traffic Used forlow-bandwidth& control-traffic only High-RateSourceMVPN Source Tree Shared / Source TreeRooted at Source PE:Rooted at CE RP or Source: controls multicast distribution controls multicast distributionwithin MPLS VPN core within individual VPN/VRF Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 17 18. MVPN ExtranetJoin ReceiverMPLS Core Join TrafficReceiver Source Allows IP Multicast content which originated in one MVPN, to be distributed to other MVPNs Two configuration requirements: On Source PE or Receiver PE (or both) configure all relevant MVRFs Configure fallback static mroute (for Source VRF IP subnets: Source and / or RP address) to allow RPF check between MVRFs. Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public18 19. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview Multicast High-Availability Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 19 20. Multicast HA - MMLS NSF/SSOMulticast MLS Non-Stop Forwarding Multicast Data (NSF) & Stateful Switch-Over (SSO) StructuresActive Offers single-node Multicast HA on Catalyst 6500 with Supervisor 720 Synchronizes critical Multicast forwarding entries from the Active supervisor to Standby Multicast (MLS/CEF) Forwarding Entries GlobalGlobalSync Periodic Syncs Sync Multicast Expansion Table (MET)Standby IGMP / MLD Snooping stateBenefit: Minimizes multicast traffic disruption during supervisor switchover Works with PIM Triggered JoinsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public20 21. Multicast HA -Triggered PIM JoinsDesigned for SSO/NSF-capable Highly RP Available IP Multicast deployment Benefit: Rebuilds the PIM multicast state GenID 1 GenID 2 very quickly after switchover On switchover, new Active supervisorStandby changes Generation ID field in PIM Hellos Active Failure PIM neighbors use the new GenID as an indication that the neighbor on that Interface has no / old multicast stateGenID 1 GenID 2Neighbor then sends triggered PIM Join messages for all (*,G) & (S,G) mroutes, which have that Interface as the RPF Interface Assumption is that PIM neighbors know Periodic PIM Helloshow to interpret GenID field in PIM hello Periodic PIM Joins Hello with new GenID Triggered PIM Joins Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public21 22. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview Multicast Management Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 22 23. Multicast Management - NDE with NetFlow v9 NetFlow Provides wire-rate statistics Collector collection for IP Multicast data flows Support for Ingress & Egress multicast statistics Ingress NetFlow tracks multicast traffic received (input) on an InterfaceS1,G1NetFlow v9 Export Egress NetFlow tracks multicast S2,G1 traffic replicated (output) on an S1,G2Egress InterfaceS3,G1 Netflow Sampling support, Voice to reduce export loadIngress vlan100 Important for PIM-BiDir Video vlan200 networks, where (S,G) g1/1 entries NOT in mroute table Data Catalyst 6500 vlan300Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public23 24. Multicast Management - SNMP MIBs & Traps Several Multicast-specificSNMP SNMP MIBsServer PIM, MROUTE, MSDP, MVPN &IGMP/MLD Several Multicast-specific SNMP Traps pimNeighborLoss ciscoPimRPMappingChange SNMP Traps ciscoPimInvalidReFaster S1,G1 ciscoPimInvalidJoinPrune SNMP MIBsS2,G1 ciscoPimInterfaceUp ciscoPimInterfaceDown S1,G2 Egress msdpEstablished1S3,G1 msdpBackwardTransitionVoice vlan100 ciscoMvpnMvrfChangeIngress Special Trap called Multicast Heartbeat can be used to track Video vlan200 availability of a Multicast groupg1/1ciscoIpMRouteMissingHeartBeatsvlan300Data Catalyst 6500 Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public24 25. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview Multicast on Catalyst 6500 Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 25 26. Catalyst 6500 - Ciscos Premiere Multicast Hardware-Switching PlatformLeverages Cisco IOSs 10+ years of IPv4 & IPv6 Multicast expertise & innovation Delivers Un-Matched Price & Performance 200+Mpps IPv4 multicast forwarding demonstrated in EANTC tests Up to 80G multicast replication per-slot with WS-6708-10GE module 720Gbps throughput & 1.44Tbps throughput with VSS Already widely deployed in many of the Worlds most business-critical networks Global Financials - Exchanges, Brokerages and FSPs Video Providers - Domestic / Foreign IPTV and Triple-Play ISPs Retail Enterprise - Inventory & Data-Base Distribution Government and Department of DefensePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 26 27. IP Multicast on Catalyst 6500Centralized & Distributed IPv4 & IPv6 Multicast hardware-switching Off-loads the majority of multicast forwarding load (data-plane) from the switch control-planeIPv4 & IPv6 PIM-SM & PIM-SSM (S,G) mroute forwarding in hardware IPv4 & IPv6 PIM-SM & PIM-Bidir (*,G) WS-SUP720-3B/XLWS-SUP720-3B/XL mroute forwarding in hardware IPv4 MVPN forwarding in hardware IPv4 IGMP v1/v2/v3 Snooping in hardware IPv6 MLD v1/v2 Snooping in hardware IPv4 PIM Snooping in hardware Switch Fabric provides greater throughput over traditional Bus-based designs VS-S720-10GE-3C/XLVS-S720-10GE-3C/XL Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 27 28. Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping Multicast VPN & Extranet Multicast High-Availability Multicast Management IP Multicast on Catalyst 6500 IP Multicast on Catalyst 4500/4900IP Multicast Overview Multicast on Catalyst 4500/4900 Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 28 29. Classic and E-Series PlatformsClassicE-Series Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 29 30. Catalyst 4500/4900 IP MulticastImplements Centralized & Distributed IPv4 and IPv6 Multicast hardware-switchingOff-loads the majority of (data-plane) forwarding tasks from theswitch control-planeSupports IPv4 & IPv6 PIM-SM and PIM-SSM (S,G) mroute forwarding in hardware Supports IPv4 PIM-SM and PIM-Bidir (*,G) mroute forwarding in hardware Supports IPv4 MVPN forwarding in hardware Supports IGMPv1/v2/v3 snooping in hardware Supports MLDv1/v2 snooping in hardware Supports PIM snooping in hardware Supervisor720 supports Centralized & Distributed multicast packet-replication Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 30 31. Multicast Features (Hardware)FeaturesClassic E-Series IGMP (Internet Group Management Protocol) v1, v2, v3 YesYesIGMP Snooping (v1, v2, v3) YesYesMLD (Multicast Listener Discovery) v1, v2 NoYesMLD snooping (v1, v2) NoYesPIM (Protocol Independent Multicast) SM (Sparse Mode)YesYesPIM DM (Dense Mode)YesYesPIM SSM (Source Specific Mode) YesYesPIM Bi-Dir (Bi-Directional) NoYesPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public31 32. Catalyst 6500 (60-70m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS Catalyst 6500 IP Multicast Hardware Architecture Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public32 33. Supervisor Engine Multicast ComponentsSwitch Fabric &PFC Daughter Card Multicast Replication EngineRoute Processor (RP)Switch Processor (SP) Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 33 34. Supervisor 720 Multicast ArchitecturePFC provides L2 - L3/L4RP & SP CPUs control Software Hardware data-plane, usingcontrol-plane and user-interface TCAMs & ASICsBidir RP table for DFInterface check SP CPU programs RP CPU FIB containsADJ contains hardware &maintains mroutes (S,G) & (*,G) entries rewrite info &performs IGMP/MLD& state, and and RPF VLAN MET index& PIM snooping downloads tablesSupervisor 720 Baseboard1GE Uplinks Counter QoSFIB ADJ RP (MSFC3) FPGATCAM TCAM1 GbpsCPU DRAMPort ASICBidir RP1 GbpsSP (NMP)DRAM ACLL3/4CPUTCAMNetFlow Engine CPU Daughter Card MET Protocol L2 Engine PFC3IntegratedRedirectionDaughter Fabric20 GbpsLogic L2 CAM720 Gbps Card Interface &Switch Fabric ReplicationEngine 18 x 20Gbps Fabric Channels Protocol Redirection32 Gbps DBUS Central replication-engine captures IGMP Bus 16 GbpsL2 CAM containsRBUS/ MLD & PIMMET contains OILs for Bus-based modules packetsmulticast MAC entries Bus for replicationand uplink portsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 34 35. Supervisor 720-10GE Multicast Architecture PFC3C serves sameRP & SP CPUsbasic functions asperform all CLI andPFC3A/B control-plane functions Supervisor 720-10GE Baseboard 1GE & 10GE UplinksCounter QoSFIBADJ RP (MSFC3C)FPGATCAM TCAM 1 Gbps CPUDRAMPort PortASIC ASICBidir RP1 GbpsSP (NMP)DRAMACL L3/4CPU TCAM Engine NetFlowMETCPU Daughter Card ProtocolL2 Engine PFC3C Integrated Redirection Daughter Fabric 20 Gbps LogicL2 CAM720 Gbps CardInterface & Switch Fabric ReplicationEngine 20 x 20GbpsFabric Channels32 GbpsDBUS Central Replication engineBusRBUSfor Bus-based cards anduplink ports Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 35 36. Supervisor 32 Multicast ArchitecturePFC3B is the same as RP & SP CPUsused on Supervisor perform all CLI and 720 control-plane functions Supervisor Engine 32 Baseboard10GE UplinksCounterQoSFIB ADJFPGA TCAM TCAM1 GbpsSP CPUDRAM Port Port ASIC ASIC Bidir RP 1 GbpsACL L3/4RP CPUDRAM TCAMEngineNetFlowFPGA MSFC2a Daughter CardMUXProtocol L2 Engine PFC3B Redirection DaughterBus Interface & Logic L2 CAMCardReplication Engine METWS-SUP32-10GE-3B32 Gbps DBUS Central replication engine BusRBUS performs replication forENTIRE systemPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public36 37. Classic Module ArchitectureDBUS Example: WS-X6416-GBIC RBUSClassic Module PortPortPort PortASICASICASIC ASIC4xGE 4xGE 4xGE 4xGEExample: WS-X6148A-RJ-45Port ASIC for Physical DBUS Connectivity, Buffering, RBUSand QueuingClassic ModulePortASIC 48x10/100No multicast-specific components on these modules...Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 37 38. CEF256 Module ArchitectureExample: WS-X6516-GBIC DBUS8 Gbps Fabric RBUSChannel CEF256 Module Fabric / BusInterfaceFabric InterfaceLC-DBUSConnects toLC-RBUS Fabric and BusReplication MET Engine PortPortPort PortASICASICASIC ASICMET 4xGE4xGE4xGE 4xGEContainsMulticast ReplicationOILs forPort ASIC for PhysicalEngineReplicates ReplicationConnectivity, Buffering,Packets to OILs and QueuingPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public38 39. CEF256 Module Architecture + DFC Example: WS-X6516-GBIC with WS-F6K-DFCLayer 2 Engine forMAC learning, Security / QoS ACLLookups, and Protocol Redirection8 Gbps Fabric Layer 3 Channel Engine for CEF256 FIB/ADJ and Layer 2L3/L4 ModuleNetFlow Fabric / Buswith DFC Lookups EngineEngineInterface DFC LC-DBUS LC-RBUS ReplicationMET Engine PortPortPortPortASICASICASICASIC4xGE4xGE 4xGE 4xGEPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public39 40. CEF720 Module ArchitectureExample: WS-X6748-SFPDBUS20 Gbps FabricRBUS 20 Gbps FabricChannelChannelComplex A Complex BCEF720 ModuleFabric BusBus Fabric Interface &InterfaceInterfaceInterface &METReplicationReplication MET Engine Engine PortPortCFCPortPortASICASIC ASICASIC12xGE 12xGE12xGE 12xGEPort ASIC forMET Fabric Interface &PhysicalContains Replication Engine - Connectivity,OILs for Connects to Fabric & Bus Buffering, and Replication(CFC), and Replicates Queuing Packets to OILsBus Interface for Control Data Only!!Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public40 41. CEF720 Module Architecture + DFC3Example: WS-X6748-SFP with WS-F6700-DFC3BLayer 2 Engine for L2 Lookupsand ProtocolLayer3/4 Engine for FIB/ADJ, Redirection ACL, QoS, and NetFlow Lookups 20 Gbps Fabric 20 Gbps FabricChannelChannelComplex AComplex B CEF720 ModuleFabric Layer 2 Layer 2 Fabric w/DFC3 Interface & EngineEngine Interface & MET ReplicationReplicationMET Engine L3/4Engine Engine Port PortDFC3 PortPort ASIC ASIC ASICASIC12xGE 12xGE12xGE 12xGE Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public41 42. Catalyst 6500 (60-70m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS Catalyst 6500 IP Multicast Hardware Forwarding Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 42 43. Multicast Control PlaneRP CPU (L3) IP Multicast SP CPU (L2) IP Multicast control- control-plane functions: plane functions: Multicast protocols: PIM, IGMP / MLD, Managing PFC / DFC hardware tables AutoRP / BSR, MSDP, MVPN, etc. IGMP / MLD Snooping packet processing Calculating RPF interfaces PIM Snooping / RGMP packet processing Managing software IP mroute table IGMP / MLD Querier functions Downloading IP mroute table entries Statistics Collection & Reporting to SP (for installation in the PFC / DFC hardware)IP MrouteTableRP (MSFC3)Group1 GbpsCPUMembershipInbandMSDPChannels 1 Gbps SP (NMP)IGMP / MLDSnooping CPUPIMSnoopingPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 43 44. Hardware Multicast Switching RP CPU derives 3 important data RP (MSFC)PIM, IGMP,structures from the IP MulticastMLD & routing table... MMLS-RPMDSSIP Mrouting Multicast FIB: Contains (S,G) & (*,G) entries, RPF VLAN, and BiDir RP indexSCP / ICC Adjacency Table: Contains L2 rewrite MAC information and MET index SP (Supervisor)MET Manager, Multicast Expansion Table (MET): Contains Output Interface Lists (OILs) IGMP & PIM MMLS-SP Snooping RP CPU downloads tables to SP...SP CPU installs the tables into theSCP appropriate hardware... MET installed in replication engines LC (Linecard) LC (Linecard) Multicast FIB and Adjacency tablesMETFIB/ADJMETinstalled in PFC/DFC hardwareMMLS-LCSP CPU also maintains L2 tablesMMLS-LCfor IGMP/MLD & PIM snooping Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public44 45. Multicast FIB TCAM Lookup Compare3 Generate Lookup10.1.1.10, 239.1.1.1 Key 10.1.1.10, 239.1.1.11 Lookup Key 2 10.1.1.10, 239.1.1.12 FFFFFFFF FFFFFFFF10.1.1.10, 239.1.1.13(S,G) 1 10.1.1.10, 239.1.1.110.1.1.10, 239.1.1.14 Result Multicast 10.1.1.10, 239.1.1.154 RPF VLANPacketHIT! 10.1.1.10, 239.1.1.16Adj Index 10.1.1.10, 239.1.1.17 S,G compares10.1.1.10, 239.1.1.18 all bits inFIB TCAM MasksPatterns Source IP and Group IPReplication Engine(s)MAC, MET Index OIL #1 OIL #2 MAC, MET Index6 5 OIL #3 MAC, MET Index OIL #4MAC, MET Index METAdjacency Table Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public45 46. BiDir FIB TCAM LookupCompare 3 Bidir RP Table Generate5 Lookup 10.1.1.10, 239.1.1.1XXXXXX,RP #1 DF Set Keyxxxxxxxx, 239.1.1.99 1Lookup Key 2 RP #2DF Setxxxxxxxx, 239.1.16.1 2 RP #3DF Set 00000000 FFFFFFFFxxxxxxxx, 239.2.1.13S,GRP #4DF Set1 10.1.1.10, 239.1.1.1 xxxxxxxx, 239.14.14.1 4 Multicast xxxxxxxx, 239.44.12.1 54Packet HIT! xxxxxxxx, 239.1.1.16 Bidir RP Index Adj Indexxxxxxxxx, 239.1.11.1 7 Resultxxxxxxxx, 239.50.1.1 8*,G comparesall bits in MasksFIB TCAM Patterns Group IP Replication Engine(s)MAC, MET IndexOIL #1OIL #2MAC, MET Index 76OIL #3MAC, MET IndexOIL #4MAC, MET IndexMETAdjacency TablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 46 47. BiDir RP-to-DF Mapping TableRP IndexDF Interface Set 0 1 2 3 4 5 64093 4094 1 1 2 3 4 5 64093 4094 2 1 2 3 4 5 64093 4094 3 1 2 3 4 5 64093 40944K VLAN IDs RPRP IP DFIndexAddressInterfaces RP #1DF Set 0 10.1.1.1 VLAN 1 2 3 RP #2DF Set 1 10.2.2.2VLAN 3 4 5 6 RP #3DF Set 2 10.3.3.3VLAN 3 4093 RP #4DF Set 3 10.4.4.4 VLAN 200 201Bidir RP Table(PFC/DFC) Mapping Table (Software Data Structure) Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 47 48. Multicast Expansion Table (MET) Index OIF VLANPort List Index A from ADJA 100 Gi4/12,Gi4/19101 Gi9/1 MET Block 102 Gi9/25,Gi9/29 Index B from ADJB 100Gi4/12,Gi4/22,Gi4/301019Te1/1 Index C from ADJC 700 Gi4/1,Gi4/2,Gi4/34030Te8/1 Replication 4031Te8/3MET Engine 4032Te2/1,Te2/2,Te2/9Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 48 49. Catalyst 6500 (60-70m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS Catalyst 6500 IP Multicast Hardware Replication Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 49 50. Multicast ReplicationProcess of creating copies of multicast packets on each Layer 3 OIF Example: A PIM-SM (S,G) with 3 OIFs - multicast replication creates three copies of every packet received from source (S) & destined to group (G) Catalyst 6500 supports 3 types of replicationLayer 3 multicast replication For Layer 3 Forwarding between (1 or many) interfaces Replication Engine does the replicationLayer 2 multicast replication For Layer 2 Forwarding between ports in same LC Port ASIC does the replicationFabric multicast replication For Egress Forwarding between ports on different Modules Fabric ASIC does the replication Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 50 51. Multicast Replication ModesReplication Mode refers to exactly where in the system that multicast replication occurs Replication occurs in one or more replication engine ASICs In a Classic (bus) system, replication occurs centrally on the Supervisor replication engine In a Fabric-enabled system, there are two possible replication modes: Ingress replication Egress replicationPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 51 52. Centralized Replication - Classic SystemsThe Supervisor replication-engine MUST perform multicast packetSupervisor replication for all modules Linecard Linecard All input packets must pass on theFIB/ADJMETshared Data switching Bus (DBUS) All replicated copies must also pass DBUS -- Data Bus: on the switching busDBUS Data Bus:Path over which actual Path over which actualframe Data (and // or Header) frame Data (and or Header)PFC performs forwarding lookups,is transferred between is transferred betweenModules and the Supervisor Modules and the Supervisorand then replicates all packetsLinecard LinecardRBUS -- ResultRBUS ResultBus: Path over whichBus: Path over which Only one MET within the system Results of L2-L3/L4 Results of L2-L3/L4forwarding-engine lookups forwarding-engine lookups (i.e. the MET on the Supervisorby the Supervisor (PFC) are by the Supervisor (PFC) arepassed back to Modules passed back to Modules replication-engine) Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 52 53. Ingress Replication-ModeSupported on Supervisor 720s & Supervisor 2 + SFM Three Packets Cross Switch Fabric Requires Switch Fabric, and multiple Fabric & Replication-capable modules B Replication load is Distributed:RE Supervisor and / or Switching modules can perform replication AC Replication engine on the ingress Switch module performs replication for all RE Fabric RE OIFs D Input and replicated packets get lookup on PFC or ingress DFC RE All replicated copies pass over Fabric to egress modules Multiple MET tables, but MET on all RE = Replication Engine replication-engines synchronized Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public53 54. Egress Replication-ModeSupported on Supervisor 720s with certain modulesOne Packet Crosses Switch Fabric e.g. CEF720, 6516A, 6548A-GETX, SIPsRequires ALL egress-capable modules Input packets get one lookup on ingress B PFC/DFC, replicated packets get lookup ARE on egress PFC/DFC CSwitch For OIFs on ingress module, the localRE REFabric RE performs the replicationD For OIFs on other (egress) modules,RE the ingress RE only sends a single copy of packet over Switch Fabric The replication-engine on the egress= Replication Engine module then replicate for local OIFs MET on different egress-capable RE = Replication Engine modules can be different / asymmetric Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 54 55. Egress Replication - Same ModuleMET Contents With Egress Replication OIF entries are symmetricalEntryOIF Dest Indexamong replication-engines on the same module... Index12/1 2/1Hence replication bandwidth usage is not optimized 22/2 2/2Module BRE 2/1Receiver Green 2/2 Module ADROP Switch FabricRE 2/3 RE2/4Source EntryOIFDest Index MET entry for Non-Local port12/12/1RE = Replication Engine= Replication Engine 22/32/3Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public MET Contents55 56. Egress Local Replication MET ContentsEgress local replication optimizes the replication EntryOIF Dest Indexbandwidth within the same module, by including Indexonly the local ports of each replication engine12/1 2/1Cat6500(config)# mls ip multicast egress local 22/2 2/2Module BRE 2/1 Receiver Green 2/2 Module ASwitchFabric 2/3RE RE2/4SourceEntryOIFDest Index12/32/3 RE = Replication Engine= Replication EngineMET ContentsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public56 57. Catalyst 6500 (60-70m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS Catalyst 6500 IP Multicast Packet Flows Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 57 58. Centralized Replication (1)NOTE: Packet-Flow Stepsare kept in the Slide Notes Supervisor Engine 32 L3/4 EngineOrange Green Red PurpleMETR R RRL2 EnginePort ASIC Port ASIC 2 3Replication A BEngineClassic PFC3 Module B DBUS RBUSSourceS Classic ReceiverRPort ASIC Port ASIC Module A A B4 Blue VLAN1Orange VLANBlue S Blue RGreen VLAN Red VLAN Purple VLANEntire Packet Packet Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 58 59. Centralized Replication (2)NOTE: Packet-Flow Stepsare kept in the Slide Notes Supervisor Engine 32 L3/4 EngineOrange Green Red PurpleMETR R RR888 8 L2 EnginePort ASIC Port ASIC 6Replication A B 7EngineClassic PFC35Module B DBUS RBUS SourceS ClassicReceiverRPort ASIC Port ASIC Module A A BBlue VLANOrange VLANBlue S Blue R Green VLANRed VLANPurple VLAN Entire PacketPacket Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 59 60. Ingress Replication (1)NOTE: Packet-Flow Stepsare kept in the Slide Notes Orange Green Red PurpleR RR RSupervisorEngine 720Port ASIC Port ASIC L3/4 EngineA B LC-RBUSLC-DBUS L2 Engine 720 GbpsSwitch FabricReplication CEF25638 Gbps METPFC3 FabricInterface Engine Module BDBUSRBUS2Fabric CEF256 SourceS 8 GbpsModule AInterface 4 ReceiverR Blue VLAN LC-DBUS Orange VLANLC-RBUS Green VLANReplicationRed VLAN METEngine Port ASIC Port ASIC Purple VLAN A B 1Blue S Blue REntire Packet Packet Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public60 61. Ingress Replication (2) NOTE: Packet-Flow Steps are kept in the Slide NotesOrange Green Red Purple R RR R Supervisor Engine 720Port ASIC Port ASIC L3/4 Engine A BLC-RBUS LC-DBUS L2 Engine720 Gbps 7 Switch Fabric9 Replication CEF256 8 Gbps METPFC3FabricInterface Engine Module B DBUS RBUS 6 FabricCEF256 SourceS8 GbpsModule AInterface8ReceiverRBlue VLAN LC-DBUSOrange VLANLC-RBUSGreen VLANReplication5Red VLAN METEnginePort ASIC Port ASIC Purple VLANA BBlue S Blue REntire PacketPacket Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public61 62. Egress Replication (1) NOTE: Packet-Flow Stepsare kept in the Slide Notes Orange Green Red PurpleR RR RPort ASICPort ASIC CEF720DFC3 Module B Supervisor Engine 720 L3/4 Enginew/DFC3 MET720 GbpsFabric Interface &PFC3 Switch Replication EngineL2 Engine20 GbpsFabric20 Gbps SourceSCEF720 ReceiverR 2 Module ABlue VLANFabric Interface &L2 Engine w/DFC3 Orange VLANMET3Replication Engine Green VLAN 4 Red VLAN L3/4 Engine Purple VLANPort ASIC Port ASIC DFC3 Internal VLAN1 Entire Packet Blue S R Blue Packet Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 62 63. Egress Replication (2)NOTE: Packet-Flow Steps are kept in the Slide Notes Orange Green Red PurpleR RR RPort ASICPort ASIC CEF720DFC3 Module B Supervisor Engine 720 L3/4 Enginew/DFC3 MET720 GbpsFabric Interface & 9 PFC3Switch Replication EngineL2 Engine20 GbpsFabric 820 Gbps SourceSCEF720 ReceiverR7 5 Module ABlue VLANFabric Interface & L2 Enginew/DFC3 Orange VLANMET6Replication Engine Green VLAN Red VLAN L3/4 Engine Purple VLANPort ASIC Port ASIC DFC3 Internal VLANEntire Packet Blue S R Blue Packet Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public63 64. Egress Replication (3)NOTE: Packet-Flow Steps are kept in the Slide NotesOrange Green Red Purple R RR R Port ASICPort ASICCEF720DFC3 Module BSupervisor Engine 720L3/4 Enginew/DFC3MET12 12720 Gbps Fabric Interface & 11 PFC3SwitchReplication EngineL2 Engine 20 GbpsFabric 1020 Gbps SourceS CEF720ReceiverRModule A Blue VLANFabric Interface &L2 Enginew/DFC3Orange VLANMETReplication Engine Green VLAN Red VLANL3/4 EnginePurple VLANPort ASICPort ASIC DFC3 Internal VLANEntire Packet Blue SR BluePacket Header Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 64 65. Catalyst 6500 (60-70m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS Catalyst 6500 IP Multicast IGMP/MLD & PIM Snooping Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 65 66. IGMP / MLDPurpose: Signal & Refresh group membership on receiver subnets IGMP (IPv4) & MLD (IPv6) supported IGMP v1, v2 & v3 protocol support for PIM-SM & PIM-BiDir IGMP v3 protocol support for PIM-SSM Option for SSM Mapping to translate IGMPv2 (*,G) joins into PIM-SSM (S,G) joinsMLD v1 & v2 protocol support for PIM-SM MLD v2 protocol support for PIM-SSM Option for SSM Mapping to translate MLDv1 (*,G) joins into PIM-SSM (S,G) joinOperates on Layer 3 PIM interfacesPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 66 67. IGMP / MLD SnoopingPurpose: Constrain unnecessary multicast flooding on Layer 2 host ports IGMP/MLD Snooping code leverages both Hardware and Software: Switch snoops Layer 3 contents of IGMP / MLD packets PFC/DFC ASICs recognize IGMP / MLD packets and redirects them to SP CPU (protocol redirection logic) Switch installs static Layer 2 forwarding entries for each multicast group MAC address Multicast data traffic forwarded to appropriate Interfaces according to MAC address table entries (per VLAN)Snooping does NOT affect the performance of multicast data traffic Redirection logic ONLY redirects IGMP/MLD packets, not UDP (multicast data) packetsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 67 68. PIM SnoopingPurpose: Constrain unnecessary multicast flooding on Layer 2 mrouter ports Mainly used in PIM-connected Layer 2 Core PIM Snooping code also leverages both Hardware and Software: Switch snoops Layer 3 contents of PIM packets PFC/DFC ASICs recognize PIM packets and redirects them to SP CPU (protocol redirection logic) Switch installs / removes Layer 2 forwarding entries for interfaces which send PIM Joins / Prunes Multicast data traffic only forwarded to appropriate Interfaces according to PIM Snooping mroute table entries (per VLAN)Protocol redirection ONLY redirects PIM packets, not UDP (multicast data) packets Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 68 69. L2 Snooping Packet FlowNOTE: Packet-Flow Stepsare kept in the Slide NotesSupervisor Engine 720 Baseboard CPU Daughter Card RP (MSFC3) Port ASICCPU 5SP (NMP) SNOOPING4CPU PROCESSMET Fabric Interface Integrated& Replication 720 Gbps EngineSwitch Fabric CEF720 3ModuleDFC3 L2 Engine Fabric Interface & w/DFC3 2 Replication EngineProtocol L3/4 EngineRedirectionLogic Port ASICPort ASIC 1 Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 69 70. Catalyst 6500 (60-70m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS Catalyst 6500 IP Multicast Forwarding on VSS Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 70 71. Virtual Switching System - Overview Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 71 72. Benefits of Multicast with VSSStand-AloneVirtual SwitchDRNon-DRSwitch-1: Active Switch-2:-Standby DR STP/HSRP VSLBenefits of VSSBetter multicast traffic load-distribution using MEC Inter chassis SSO (*,G) & (S,G) and L2 snooping entries synced across chassis, faster convergence Simplified multicast topology eliminates PIM DR election process & Non-RPF traffic across inter-switch links Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public72 73. Multicast with VSS - Load-SharingVSS provides Multicast Load-sharing across multiple links with MECStand-Alone VSS RPRPL3 MEC ECMPDR Non-DRDRSTP/HSRPVSL L2 STPL2 MECReceiversReceiversReceivers ReceiversPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public73 74. Multicast with VSS - Inter-chassis SSO VSS Supervisor failure re-convergence is faster with MMLS SSO Multicast forwarding entries (State) is synchronized, so that the new Active Supervisor can forward traffic immediately after Switch-OverRP SSOPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 74 75. Multicast with VSS - Simplified TopologyVSS Simplifies Multicast Topologies Stand-Alone VSS Logical View DRNon-DR DR Non-RPF flows In Stand-Alone (multi-home) topologies, inter-switch link bandwidth is wasted due to non-RPF traffic between DR & non-DR VSS is a single DR, so there is no non-RPF traffic Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public75 76. Multicast Re-convergence Scenarios 1. Uplinks Failure 3. Switch Interlink FailureRP1L3 DR L3 L2/L32 3L2/L342. Supervisor Failure4. Downlinks Failure ReceiversReceivers Multicast State: 500 PIM groups @ 10 sources per-group = 5000 mroute entriesWith MMLS Egress Replication-Mode =10,000 shortcuts in hardware Time is in Seconds Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 76 77. Multicast with VSS - Deployment Guidelines VSS Multicast Guidelines: Connected devices should ALWAYS be dual-homed (MEC or ECMP), for optimal replication performance L3L3 MEC MEC MEC is recommended in BOTH L2 & L3 environments, to provide deterministic VSS data-plane convergence MEC eliminates RPF re-calculation & DR re-election during Link Failures PIM DRUse Egress replication-mode (and egress-local) for higher multicast L2 L2 replication throughput MECMEC Egress replication-mode requires DFCs for optimized replication performance Traffic flow #1 Size the total number of VSL member Traffic flow #2 links to meet traffic requirementsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public77 78. Multicast Control Plane Details Control Plane operates ONLY on the VSS Active Supervisor Multicast Control Plane traffic ( IGMP / MLD, PIM hellos, PIM Joins / Prunes, etc... ) received by VSS Standby are redirected to VSS Active via VSLControl traffic is redirected to Active VSS SP/RPCatalyst 6500-A Catalyst 6500-B (VS Active)(VS Standby)VSLSupervisorSupervisorSP RPRP SP PIM Hellos MEC MECPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public78 79. VSS Multicast: FIB Programming VS ACTIVEVS STANDBY The VS Standby SP is MET67XXtreated as a DFC moduleDFC FIB/ADJfrom a FIB / ADJMETforwarding perspective.FIB/ADJDFCMET The VS Active SP installs forwarding shortcuts ontoMETC2+C2+MET the Active PFC, Standby PFC and all other DFCsFIB/ADJ in the VS System.ActiveStandby FIB/ADJMET SPSP MET VSLHA FIB-CAPABLEICC MCAST GROUPPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 79 80. VSS Multicast: MET programming VS ACTIVEVS STANDBY The VS Standby SP isC2+MET treated as a Supervisor module from a METDFCMETprogramming perspectiveDFC MET The SP on each Chassis manages & programs itsC2+ MET C2+METown MET, and the METs of all local C2+ modules DFC modules manage andActiveStandbySPMET SP METprogram their own METsVSL ACTIVE SCP MET STANDBY SCP METMCAST GROUP MCAST GROUP Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 80 81. Multicast Ingress Forwarding Model All forwarding-lookups & replication occur on the Ingress modules Subsequent modules only perform L2 egress lookup. Multiplereplications cross the Ingress Cores Switch Fabric and / or VSLIngress Core Egress Core M0R RM0 R3 E E1 M1R RM1MET2 LC2 LC 1LC 3 S 2MET33M0R RM0ER4 R16 7E VSL E LC1 (Ingress) R5 M1R RM1 8 49LC3LC2 LC 4Switch 1 Switch 2 MECI-E-E-E (Ingress-VSL-VSL-Egress) Access SwitchNOTE: Packet-Flow Steps 5 Multicast packets may cross up to 4 DFCs are kept in the Slide Notes Ingress DFC performs L2-L4 forwarding lookup R2 Up to 3 DFCs (VSL) perform L2 egress lookup Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public81 82. Multicast Egress Forwarding ModelIngress modules replicate locally & one copy to Egress modulesEgress modules (on Ingress Core) then replicate locally, and also for all receivers on the Egress Core. Multiple replications cross the VSL Ingress CoreEgress Core M0 RR M0R3 EE 1 M1 RR M1MET3LC 3 S2LC2 (Egress)LC 1MET2 M0 RR M0R4E R16 7 8EVSL ELC1 (Ingress)R5 3 M1 RR M1 9LC3 (Egress) 4LC 4 10 LC2Switch 1Switch 2 MEC MET2MET3Access Switch I-E-E-E (Ingress-VSL-VSL-Egress) NOTE: Packet-Flow Steps Multicast packets may cross up to 4 DFCs 5 are kept in the Slide Notes Ingress DFC performs L2-L4 forwarding lookup R2Up to 3 DFCs (VSL) perform L2 egress lookup Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public82 83. Catalyst 4500/4900 (30-40m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows Catalyst 4500/4900 IP Multicast Hardware Architecture Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public83 84. Cat4K Architecture Packet Processor: receive, extract, reconstruct, and send. Forwarding Engine: lookup, rewire, replication, and QosPacket Memory Packet Memory Packet Lookup Descriptor (PLD)Layer2 module InputServices FWDReplication Forwarding EngineReplication Forwarding Engine module Packet Processor Packet ProcessorQueueQueueOutputServicesPacket TransmitReplicationReplication Descriptor(PTD)ModuleModuleCPU CPUPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public84 85. Cat4K Multicast Architecture Single copy of multicast packet in Packet Memory => Excellent buffer capability Same path as unicast => deterministic and low latency/jitter Packet MemoryPacket MemoryPacket LookupDescriptor (PLD)Layer2moduleInput ServicesFWD Replication Forwarding Engine modulePacket ProcessorPacket Processor Forwarding Engine QueueOutput Services Packet TransmitReplicationDescriptor(PTD)ModuleReplicationCPUCPUTable Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public85 86. Catalyst 4500/4900 (30-40m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows Catalyst 4500/4900 IP Multicast Hardware Forwarding Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 86 87. Multicast Forwarding OverviewForwarding TCAM RET tableRPFindex Set of {vlan switchport} S,G RP ID RET indexinterface 0S1, G1 Vlan301219 ..S2, G2 Vlan701279 1279 {vlan3, Fa3/1} {vlan5, Fa3/2} *, G421356 1356 {vlan101, te1/1} {vlan1007, te1/8} Hardware FIB Table Hardware RET TableInstall mroute table except OIL Install OIL information of mroute (Outgoing Interface List) These two tables constitute the MFIB entry Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public87 88. Multicast PIM BiDir Forwarding Overview Forwarding TCAM RET tableRPFindex Set of {vlan switchport} S,G RP ID RET indexinterface 0S1, G1 Vlan301219 ..S2, G2 Vlan701279 1279 {vlan3, Fa3/1} {vlan5, Fa3/2} *, G421356 1356 {vlan101, te1/1} {vlan1007, te1/8}VLAN DF Table VLAN 127 100 0 00 0 10101 0 4094 00 0Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public88 89. Catalyst 4500/4900 (30-40m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows Catalyst 4500/4900 IP Multicast Hardware Replication Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 89 90. Replication Module Packet MemoryPacket Memory PLD Layer2 module InputServices FWDReplication Forwarding EngineReplication Forwarding Engine module Packet Processor Packet ProcessorQueueQueueOutputServices Replication PTDModule ReplicationReplication CPU CPUTable TablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public90 91. Replication ModuleReplicated packetspackets that need to go to two or more ports and/or VLANs Packet which require replication areCPU copy for Unicast packetSPANUnknown Unicast FloodingIP multicast packetReplicationBroadcast packetsModuleWith Classic Supervisors, this module is called Multicast Replication Module (MRM) With E-Series Supervisors, this module is called Replication Management Module (RMM)Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 91 92. Replication Table Packet MemoryPacket Memory PLD Layer2 module InputServices FWDReplication Forwarding EngineReplication Forwarding Engine module Packet Processor Packet ProcessorQueueQueueOutputServices ReplicationReplication PTDModuleModuleReplication CPU CPUTablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public92 93. Replication TableStores replication vlan/portsets information for L2 multicast/broadcast/flooding and IP multicast forwarding With Classic Supervisors, this module is called Multicast Expansion Table (MET). The MET size is 64K [it is 32K for SupII+, SupII+TS and SupII+10GE] Replication TableWith E-Series Supervisors, this module is called Replication Expansion Table (RET). The RET size is 102KPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 93 94. Replication Queues Packet MemoryPacket MemoryPLDLayer2 module InputServices FWDReplication Forwarding Engine module Packet Processor Packet Processor Forwarding EngineQueueOutputServices ReplicationReplicationPTDModuleModuleReplicationReplication CPU CPUTable TablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public94 95. Replication QueuesReplication queues prevents the congestion in Forwarding Engines pipeline With Classic Supervisors, this module is called Multicast Replication Queue (MRQ). Queue depth is 2048. It stores [pkt id, header, MET index] Replication With E-Series Supervisors, this module is Queue called Replica Request Queue (RRQ). Queue depth is 4096. It stores [pkt id, header, RET index]Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 95 96. Catalyst 4500/4900 (30-40m) Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows Catalyst 4500/4900 IP Multicast Packet Flows Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 96 97. IP Multicast ForwardingPacket Memory Packet MemoryHost AVLAN 1PLD Multicast SourceLayer2 moduleInput ServicesHost BVLAN 2PacketFWD Multicast Receiver Modules Packet Replication Forwarding EngineModulesProcessor Forwarding Engine module Processor QueueOutput ServicesReplicationPTDModuleHost CVLAN 3 Multicast Receiver CPU CPUReplicationTablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 97 98. IP Multicast ForwardingPacket Memory Packet MemoryHost AVLAN 1PLD Multicast SourceLayer2 module123 4 InputServicesHost BVLAN 2Packet FWD Multicast Receiver Modules Packet Replication Forwarding EngineModulesProcessor Forwarding Enginemodule Processor Queue OutputServicesReplicationPTD 6 Module5Host CVLAN 3 Multicast Receiver CPU CPUReplicationTablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public98 99. IP Multicast ForwardingPacket Memory Packet MemoryHost AVLAN 1 Multicast SourcePLD 7Layer2 module8Input ServicesHost BVLAN 2PacketFWD Multicast Receiver Modules Packet Replication Forwarding EngineModulesProcessor Forwarding Engine module Processor QueueOutput ServicesReplicationPTDModule 9Host CVLAN 3 Multicast Receiver CPU CPUReplicationTablePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 99 100. Session Take-AwaysCatalyst Switches leverage proven IP Multicast IOS code Hardware Switching provides Higher Throughput Software-based Multicast forwarding is limited by CPU & Memory (vs. bandwidth) MLS & CEF offloads a significant portion of Multicast routing (packet rewrite) to hardware WS-SUP720-3B & VS-S720-10G provide 720Gbps Fabric-based throughput (VSS @ 1.44Tbps) WS-SUP32-3B provides 32Gbps Bus-based throughput DFCs + Egress Replication capable of 30/48Mpps of throughput Supervisor 6E & Catalyst 4900M capable of 250Mpps of replication. Supervisor 6L-E capable of 225Mpps of replication.Hardware Switching provides Less Latency / Jitter Software-based forwarding incurs high latency / jitter during routing & replication Hardware-based forwarding is only limited by ASIC replication timesHigh-Availability (SSO/NSF) Minimizes Traffic Loss Loss of an adjacency will cause RPF re-calculation, DR/DF election, before convergence Forwarding entries are synchronized & adjacencies will not drop, resulting in near-zero loss Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public100 101. Recommended ReadingContinue your Networkers @ Cisco Live learning experience with further reading from Cisco Press Check the Recommended Reading flyer for suggested books Available Onsite @ the Cisco Company StorePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 101 102. Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 102 103. APPENDIX: IP Multicast Troubleshooting Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 103 104. Some Definitions...ACL: Access Control ListBIDIR: Bi-Directional (PIM)ACE: Access Control Entry DR: Designated Router (DM,SM & SSM)ADJ: Adjacency Table / Rewrite Info DF: Designated Forwarder (BIDIR) DM: Dense-Mode (PIM) CEF: Cisco Express Forwarding IGMP: Internet Group Management Protocol FIB: Forwarding Information Base MET: Multicast Expansion Table HA: High Availability MLD: Multicast Listener Discovery MLS: Multi-Layer Switching MVPN: Multicast VPN NSF: Non-Stop Forwarding OIF: Out-going InterFace RPF: Reverse-Path Forwarding OIL: Out-going Interface List SSO: Stateful Switch-Over PIM: Protocol Independent Multicast VPN: Virtual Private NetworkRP: Rendez-vous Point (SM & BIDIR) VRF: Virtual Routing & Forwarding SM: Sparse-Mode (PIM) VSS: Virtual Switching System SSM: Source-Specific Multicast (PIM)Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 104 105. Catalyst 6500 IP Multicast Troubleshooting Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 105 106. Multicast Troubleshooting OverviewKey Problem Areas ConfigurationSoftware and hardware multicast forwarding stateSoftware and hardware scalability limits Most of the troubleshooting is applicable toCatalyst 4500/4900 as well.There is note on the slide if that is specific toCatalyst 6500.Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 106 107. Verify the Multicast ConfigurationVerify that ip multicast-routing is enabled! If MVPN, verify ip multicast-routing is enabled per-VRF PIM enabled on all of the Interfaces (including Loopbacks) If PIM-SM and / or PIM-BiDir, verify the RP configuration (AutoRP, BSR, Anycast, Phantom RP, Static) Hardware MMLS/CEF and IGMP Snooping enabled (enabled by Default, but can be disabled) Watch out for TTL thresholds, multicast boundary, security ACLs, VACLs, policers, etc. Watch for proper SSM or BiDir address-range configuration (SSM & Bidir require coordination between Network and Application groups) Unicast Routing is enabled & RPF information is correct Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 107 108. Troubleshooting Forwarding StateVerify RP and DR/DF stateVerify software IP mroute stateVerify hardware multicast forwarding tables Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 108 109. Verifying RP and DR/DF StateCheck RP IP addresses and group-to-RP mappingsVerify RP RPF/upstream informationVerify DR or DF Interface state Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 109 110. Verifying Group-to-RP MappingsCatalyst-6506E#show ip pim rp mappingPIM Group-to-RP MappingsGroup(s): 224.0.0.0/4, StaticRP: 10.255.255.3 (tstevens-6509.cisco.com)Catalyst-6506E#show ip pim rpGroup: 239.1.1.10, RP: 10.255.255.3, v2, uptime 00:01:10, expires neverGroup: 239.1.1.11, RP: 10.255.255.3, v2, uptime 00:01:10, expires neverGroup: 239.1.1.12, RP: 10.255.255.3, v2, uptime 00:01:10, expires neverGroup: 239.1.1.13, RP: 10.255.255.3, v2, uptime 00:01:10, expires neverGroup: 224.0.1.40, RP: 10.255.255.3, v2, uptime 00:01:10, expires neverCatalyst-6506E# Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 110 111. Verifying IP RPF InformationCatalyst-6506E#show ip rpf 10.255.255.3RPF information for tstevens-6509.cisco.com (10.255.255.3)RPF Interface: GigabitEthernet1/5RPF neighbor: tstevens-6513 (10.20.1.2)RPF route/mask: 10.255.255.3/32RPF type: unicast (ospf 10)RPF recursion count: 0Doing distance-preferred lookups across tablesCatalyst-6506E#Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 111 112. Identifying the DR for a Segment show ip pim Interface identifies DR for each Interface Catalyst-6506E#show ip pim Interface Address InterfaceVer/Nbr Query DRDRModeCount Intvl Prior 10.255.255.2Loopback0v2/S0 301 10.255.255.2 10.255.254.1Loopback1v2/S0 301 10.255.254.1 10.10.1.2 GigabitEthernet4/3 v2/S1 301 10.10.1.2 10.30.1.1 GigabitEthernet4/16v2/S1 301 10.30.1.2 10.100.1.1Vlan100v2/S1 301 10.100.1.2 10.101.1.1Vlan101v2/S1 301 10.101.1.2 10.200.1.1Vlan200v2/S1 301 10.200.1.2 10.201.1.1Vlan201v2/S1 301 10.201.1.2This routers Interface Catalyst-6506E#Compare with DRaddresses address Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public112 113. Identifying Bidir DF InterfacesCatalyst-6506E#show ip pim Interface dfInterface RP DF Winner MetricUptimeLoopback0 10.255.255.3 10.255.255.12 02:21:07GigabitEthernet1/510.255.255.3 10.20.1.2 0 02:21:08GigabitEthernet1/13 10.255.255.3 10.13.1.1 2 02:21:07GigabitEthernet2/13 10.255.255.3 10.13.2.1 2 02:21:07GigabitEthernet2/14 10.255.255.3 10.14.2.1 2 02:21:07GigabitEthernet2/24 10.255.255.3 10.2.24.1 2 00:35:15Vlan100 10.255.255.3 10.100.1.22 00:03:39Vlan101 10.255.255.3 10.101.1.22 00:01:13Vlan200 10.255.255.3 10.200.1.22 00:01:10Vlan201 10.255.255.3 10.201.1.22 00:01:07Catalyst-6506E#Winners routing metric to RPPIM enabled Interfaces IP address of current Bidir RP DF winner address Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public113 114. Bidir RP-to-DF Interface Mapping Table* Catalyst 6500 OnlyCatalyst-6506E#show mls ip multicast rp-mapping df-cache State: H - Hardware Switched, I - Install Pending, D - Delete Pending,Z - Zombie All DF Interfacesshould be in H stateRP AddressStateDFState 10.255.255.3HGi2/13 H 10.255.255.3HGi1/13 H 10.255.255.3HGi2/14 H 10.255.255.3HGi2/24 H 10.255.255.3HVl100H 10.255.255.3HVl101H 10.255.255.3HVl200H 10.255.255.3HVl201H Catalyst-6506E# DF Interfaces forspecified Bidir RPPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public114 115. Verifying Software IP Mroute State Ensure IP mroute exists in software... show ip mrouteDoes (*,G) and/or (S,G) exist in software mroute table?Does Hardware state information in show ip mroute outputappear correct?Ensure RPF Interface is known and correctMake sure show ip mroute and show ip rpf show correctRPF Interface for (*,G) or (S,G)PIM reliance on unicast routing means multicast issues oftencaused by unicast routing issues Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 115 116. Verifying Software IP Mroute State (2)OIFs are Known and Correct OIF Inclusion driven by PIM or IGMPEnsure PIM neighbors active and stable(show ip pim neighbor)IGMP dictates connected receiver membershipensure joins/leaves sent by receivers and receivedby RP CPUMight need to verify PIM and IGMP packet exchangeusing SPAN/sniffer and/or debugs Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 116 117. Displaying Hardware Forwarding Entries * Catalyst 6500 Only show mls ip multicastCatalyst-6506E#show mls ip multicast group 239.1.1.1 source 10.1.1.100 Multicast hardware switched flows: (10.1.1.100, 239.1.1.1) Incoming Interface: Gi1/5, Packets switched: 293919 Hardware switched outgoing Interfaces:Vlan100 Vlan101 Gi1/13 Gi2/13 Gi2/14 Vlan200 RPF-MFD installed Total hardware switched flows : 1 Catalyst-6506E#Applies to PIM-SM, PIM-SSM, and Bidir (*,G) hardware entriesPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public117 118. Bidir-PIM (*,G/m) Entries Source-only traffic must reach RP (could be receivers on other branches) For efficiency, system installs (*,G/m) hardware forwarding entry/entries to transport this trafficEntries based on Bidir-PIM RP ACL configuration At RP, assuming no receivers on other branches, packets dropped in hardware NOTE: (*,G/m) entries not shown in software mroute table today Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 118 119. Viewing Bidir (*,G/m) Forwarding Entries * Catalyst 6500 Only Catalyst-6506E#show mls ip multicast rp-mapping gm-cacheState: H - Hardware Switched, I - Install Pending, D - Delete Pending, Z - ZombieRP AddressState Group MaskState Packet/Byte-count10.255.255.3H 224.0.0.0 240.0.0.0 H 1183799/1754389822Catalyst-6506E# Statistics Group IP and Mask (224/4)Bidir RP IP AddressPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 119 120. Troubleshooting Group Membership Verify IGMP / MLD & IGMP / MLD Snooping configuration status Make sure IGMP snooping requirements are met Make sure the Layer 3 and Layer 2 entries exist and Interface/port membership is correct Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 120 121. Verifying IGMP / MLD & Snooping Configuration StatusCatalyst-6506E#show ip igmp Interface vlan 100 Vlan100 is up, line protocol is up Internet address is 10.100.1.2/24 IGMP is enabled on Interface Current IGMP host version is 2 Current IGMP router version is 2 IGMP query interval is 60 secondsIGMPConfiguration IGMP querier timeout is 120 secondsState IGMP max query response time is 10 seconds Last member query count is 2 Last member query response interval is 1000 ms Inbound IGMP access group is not setIGMP Packet IGMP activity: 3 joins, 2 leavesStatistics Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 121 122. Verifying IGMP / MLD & Snooping Configuration Status (2) Multicast routing is enabled on InterfaceMulticast TTL threshold is 0Multicast designated router (DR) is 10.100.1.3 DR & Querier InformationIGMP querying router is 10.100.1.2 (this system)No multicast groups joined by this systemIGMP snooping is globally enabledIGMP snooping is enabled on this InterfaceIGMP snooping Gist-leave is disabled and querier is disabledIGMP snooping explicit-tracking is enabledIGMP snooping last member query response interval is 1000 msIGMP snooping report-suppression is disabled Catalyst-6506E#IGMP Snooping Configuration StatePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 122 123. Verifying IGMP Snooping RequirementsIGMP querier must be present in the VLAN Could be multicast router or switch configured as querier Make sure all multicast router ports known Switch tracks location of all multicast routers on per-VLAN basis Detection based on IGMP queries and PIM hellos Snooping switch uses list of mrouter ports to flood certain traffice.g., proxied joins/leaves Loss of multicast router port will impact traffic flow Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 123 124. Viewing Multicast Routers Catalyst-6506E#show ip igmp snooping mrouter vlanports -----+---------------------------------------- 100 Gi3/7,Gi3/16 101 Gi3/7,Gi3/16 List of Multicast Router Ports for VLAN 200 Gi3/7,Gi3/16 201 Gi3/7,Gi3/16 Catalyst-6506E#VLAN for Which Specified Ports AreMulticast Router Ports Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public124 125. Verifying IGMP MembershipIGMP enabled when PIM configured on an Interface For receiver segments, IGMP drives OIF presence in mroute tableUse show ip igmp groups to see IGMP join status on mrouterUse debug ip igmp to monitor IGMP packet reception at routerBe aware of effect of IGMP snooping on Layer 3 IGMP behavior(e.g. not all joins/leaves seen by router)Verify IGMP querier consistency and group membership for routers on shared segments Watch for IGMP access groups, multicast boundary Verify IGMP snooping entriesMake sure entry exists and port membership correctPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 125 126. Verifying IGMP Entries Catalyst-6506E#show ip igmp groups IGMP Connected Group Membership Group Address InterfaceUptime Expires Last Reporter 239.1.2.0 Vlan20000:00:12 00:00:0010.200.1.101 239.1.2.1 Vlan20000:00:12 00:00:0010.200.1.101 239.1.2.2 Vlan20000:00:12 00:00:0010.200.1.101 239.1.2.3 Vlan20000:00:12 00:00:0010.200.1.101 239.1.1.10Vlan201Interface with 00:00:1300:00:0010.201.1.101Connected Receiver 224.0.1.40Loopback0 1w4d00:02:1810.255.255.1 Catalyst-6506E# IP Address of LastMulticast Group JoinedReceiver to Report forthe Group on theInterfacePresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public126 127. Verifying IGMP Snooping Entries Catalyst-6506E#show mac-address-table multicast igmp vlan mac address type learn qos ports -----+---------------+--------+-----+---+--------------------------------200 0100.5e01.0101 static Yes - Gi3/1,Gi3/7,Gi3/16100 0100.5e01.0101 static Yes - Gi3/5,Gi3/7,Gi3/16101 0100.5e01.0101 static Yes - Gi3/6,Gi3/7,Gi3/16Catalyst-6506E# List of Receiver Ports(Also Includes Any Multicast Router Portsin VLAN)Group Destination MAC VLAN Where GroupMAC Is LearnedPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public 127 128. Scalability LimitsEnsure Layer 3 and Layer 2 entry capacity notexceededMonitor MET utilizationMonitor RP and SP CPU utilizationMonitor Fabric and bus utilization Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 128 129. Checking Layer 3 Entry Capacity * Catalyst 6500 Only Multicast entries share FIB TCAM entries and hardware adjacency entries with other protocols (unicast, IPv6, MPLS) Syslogs printed when hardware capacity exceeded (total FIB exhaustion, or exceeded max-routes configuration) Check current entry status:show mls ip multicast summaryshow mls cef maximum-routes (PFC3)Maximum capacity by forwarding engine documented earlier in your handoutsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public129 130. show mls ip multicast summary * Catalyst 6500 Onlyshow mls ip multicast summaryCatalyst-6506E#show mls ip multicast summary 21210 MMLS entries using 3394656 bytes of memory Number of partial hardware-switched flows: 0 Number of complete hardware-switched flows: 21210 Directly connected subnet entry install is enabled Hardware shortcuts for mvpn mroutes supported Current mode of replication is Ingress Auto-detection of replication mode is enabled Consistency checker is enabled Bidir gm-scan-interval: 10 Catalyst-6506E#Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public130 131. Monitoring MET UtilizationRecall that MET in replication engines contains OIFs for mroutes MET is limited hardware resource (64K entries total)Allocated in fixed size blocksCatOS always allocates in four-entry blocksCisco IOS allocates in variable block sizes based on need (one, two, four, eight,or 16 entries)Monitor current MET utilizationInexact sciencesome internal overhead (pointers, etc.) and wasted spaceSyslog generated if MET capacity reached%MMLS-SP-6-MET_LIMIT_EXCEEDED: Failed to allocate METentry, exceeded system limit of (65536) entries. Number oftimes MET limit is exceeded in the last 1 min : 7 Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 131 132. Monitoring MET UtilizationCatalyst-6506E-sp#show mmls met met free entries: 61462 Total Free Entries met total entries: 65526 64K Total MET EntriesCatalyst-6506E-sp#Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 132 133. Layer 2 Entry Capacity Limit is 15,488 Layer 2 multicast groups Limit is configurable using ip igmp snooping l2-entry-limit command Syslog posted when limit exceeded or hash collision occurred%MCAST-SP-6-GC_LIMIT_EXCEEDED: IGMP snooping was trying to allocatemore Layer 2 entries than what allowed (15488)%MCAST-SP-6-L2_HASH_BUCKET_COLLISION: Failure installing (G,C)->index: (0100.5e01.1465,1017)->0x82CWhen limit exceeded, flooding occurs for additional group MACsPresentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 133 134. Monitoring Layer 2 Entry Capacity show mac-address-table multicast igmp count Catalyst-6506E#show mac-address-table multicast igmp countMulticast MAC Entries for all vlans:455Catalyst-6506E#Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 134 135. Catalyst 4500/4900 IP Multicast Troubleshooting Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 135 136. Multicast Related EntriesProtocolsEIGRP/OSPFPIM/IGMP IGMP snooping Unicast RoutingMulticast Routing Layer 2 Forwarding Table TableTable Software TablesCEFMFIB CEF MFIB Subsystem S/W adjacencyS/W FIB Table TableHardware H/W adjacencyH/W FIBReplication TablesTable TableTable Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.Cisco Public136 137. Multicast Related EntriesProtocols EIGRP/OSPF PIM/IGMP IGMP snooping show ip igmp snooping groupshow ip mroute show ip igmp group Unicast Routing Multicast Routing Layer 2 ForwardingTableTable Table Softwareshow ip mfibTables CEF MFIB CEF MFIB Subsystem show platform software ip route multicastS/W adjacencyS/W FIB TableTableshow platform hardware ip route multicastHardware H/W adjacencyH/W FIBReplicationTablesTable TableTable show platform hardware met entry < >Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Show platform hardware ret chain index Cisco Public137 138. IGMP Troubleshooting Check List Make sure igmp entry is correctly programmed to mroute tableshow ip igmp snooping groupshow ip igmp snooing mroutershow platform hardware mac-address-table address < >show platform hardware met entry < > [Classic]show platform hardware ret chain index < > [E-Series]show ip igmp groupshow ip igmp Interface < >show ip pim neighborshow ip mroute Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public 138 139. PIM troubleshooting check list PIM and mroute debuggingshow ip mrouteshow platform hardware ip route multicastshow platform hardware met entry < > [Classic]show platform hardware met chain < > [Classic]show platform hardware ret chain < > [E-Series]show ip rpf < >show ip pim neighborshow ip mroute < > countshow ip mroute activeShow ip pim rp mapping in-use Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public139