You are on page 1of 111

BRKARC-3322

Shawn Wargo Technical Marketing Engineer


You already have an understanding of
standards-based (platform-independent)
IP Multicast technologies
You already have an understanding of
hardware-based (platform-dependent)
Catalyst 6500 architecture
General IP Multicast technologies covered in:
IPM-1261: Introduction to IP Multicast
Advanced IP Multicast technologies covered in:
IPM-2008: Advanced Topics in IP Multicast Deployment
General Catalyst 6500 architecture covered in:
RST-3465: Cisco Catalyst 6500 Switch Architecture
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
To provide you with a deeper understanding
of Catalyst 6500 hardware-based IP Multicast
architecture, packet flow & monitoring

To introduce several IPv4 / IPv6 Multicast


improvements & innovations that are only
available on the Catalyst 6500 platform

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Multicast Overview (~5-10m)
Multicast Architecture (~15-20m)
Multicast Forwarding (~10-15m)
Multicast Replication (~10-15m)
Remember, this is YOUR session:
Multicast Packet Walks (~20-30m) Please Ask
Multicast on VSS (~15-20m) Questions!
Multicast Debugging (~10-15m)

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PIM Distribution Modes
IGMP / MLD & Snooping
Multicast VPN & Extranet
Multicast High-Availability
Multicast Management
Catalyst 6500 & IP Multicast
Source Tree Source Tree
Flood & Prune (S,G based) multicast Rooted at
Source1
Rooted at
Source2
distribution protocol
Source1 Source2
Designed with assumption that receivers
are densely populated in the network...
Uses only Source-based Trees
Distribution trees are unidirectional (RPF-based)

Does NOT use Rendezvous Points (RPs)


Data-driven Multicast state
Requires Periodic Flooding & Pruning on all PIM
routers, DR Election / Asserts on each subnet

Inefficient Flood style packet delivery


Group members tracked via IGMPv1 / v2
NOTE: PIM-SM Auto-RP mapping info is
distributed densely
Receivers
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Source Tree Shared Tree
General Purpose (S,G and *,G based) SPT: Rooted
Source RPT: Rooted
at the
multicast distribution protocol at the Source
Rendezvous Point

Designed with assumption that receivers


are sparsely populated in the network... RP

Uses both Shared (RP) & Source Trees


Distribution trees are unidirectional (RPF-based)

Data-driven Multicast state


Requires Source Registration, RP mapping, DR Election
& Asserts, and SPT switch-over

Automatic Source discovery (via Registers)


More efficient on-demand packet delivery
Supports an arbitrary (non-symmetrical)
source and receiver distribution model
Group members tracked via IGMPv1, Receivers
v2, or v3 (IPv4) or MLD v1 or v2 (IPv6)
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Shortest Path (S,G based) distribution, Source Tree Source Tree
Rooted at Rooted at
simplifies one-to-many delivery Source1 Source2
Source1 Source2
Low-Latency variation of PIM-SM, which
assumes the one-to-many model
Internet / inter-domain distribution
Voice & Video distribution

Uses only & Source-specific (SPT) Trees


Data-driven Multicast state
Requires only SSM Range, and DR Election / Asserts

Hosts are responsible for source discovery


Typically via some out-of-band mechanism
(web page, content server, etc.)
Eliminates need for RP and Shared trees
Eliminates need for MSDP

Group members tracked via IGMPv3 (IPv4)


or MLDv2 (IPv6) S1,G1 S1,G1 S2,G1 S1,G1
S2,G1 Receivers
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Shared Path (*,G) based distribution, ideal Shared Tree
Bidirectional tree
for many-to-many applications Source rooted at the
Rendezvous Point
Highly Scalable variation of PIM-SM, which
assumes LOTS of Sources & Receivers
Intra-Domain multicast RP
Database distribution
Uses only Shared (RP-based) Trees
Data-Flow Independent
Pre-built (RP/DF-based) distribution trees, so there are NO
source registers, DR asserts, or non-RPF issues
Drastically reduces network mroute state
Eliminates ALL (S,G) mroute state in the PIM network
Permits virtually UNLIMITED Sources
Source multicast traffic can flow both Up & Down
(Bidirectional) on the Shared (RP-based) tree
Group members tracked via IGMPv1 or v2
Sources/Receivers

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PIM Distribution Modes
IGMP / MLD & Snooping
Multicast VPN & Extranet
Multicast High-Availability
Multicast Management
Catalyst 6500 & IP Multicast
Purpose: Signal & refresh Multicast group
membership, on receiver subnets
Internet Group Management Protocol
(IGMP)
host membership reporting in IPv4
Multicast Listener Discovery (MLD)
host membership reporting in IPv6
IGMP v1 & v2 support for PIM-SM & PIM-
BiDir
IGMP v3 support for PIM-SSM
Option for SSM Mapping, which translates all IGMPv2
(*,G) joins into PIM-SSM (S,G) joins
MLD v1 & v2 support for IPv6 PIM-SM
MLD v2 protocol support for IPv6 PIM-SSM Remember: IGMP & MLD
Option for SSM Mapping to translate MLDv1 (*,G) joins actually operate @ Layer 3
into IPv6 PIM-SSM (S,G) joins

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
IGMP for IPv4 & MLD for IPv6
Source Source

Layer 3 IGMP / MLD operate on all PIM-


enabled Interfaces
IGMP v1/v2/v3
MLD v1/v2
SSM mapping

Layer 2 IGMP / MLD Snooping constrains Join / Leave


multicast flooding on L2 switchports, Reports

based on snooped membership reports

Remember: Snooping leverages both L2 &


L3 and Hardware & Software details
Support for IGMPv1/2/3 and MLDv1/v2
Receivers
PFC/DFC performs hardware redirection of all IGMP
& MLD packets to SP CPU for processing

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PIM Distribution Modes
IGMP / MLD & Snooping
Multicast VPN & Extranet
Multicast High-Availability
Multicast Management
Catalyst 6500 & IP Multicast
Receiver
CE Data MDT Provides Multicast
CE Used for
high-bandwidth distribution over an
data stream MPLS core
Join
Overlay model encapsulates
VPN multicast traffic in GRE
Enterprise tunnels, for transport over core
PE MPLS Core
Receiver MVPN tunnels connect remote
Default MDT PEs via Multicast Distribution
Trees (MDTs)
Creates fully meshed PE-PE
Default MDTs for control-plane
Join data & low-bandwidth streams
Can also create on-demand
Data MDTs to constrain high-
Default MDT bandwidth streams to only PEs
Used for Receiver with interested receivers
low-bandwidth
Traffic & control-traffic
High-Rate only Shared / Source Tree
Source Rooted at RP or Source:
MVPN Source Tree controls multicast distribution
Rooted at Source PE: within individual VPN/VRF
controls multicast distribution
within MPLS VPN core

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Join Receiver

Extranet MVPN
Same mroute,
extranet OIF

MPLS Core

Join

Traffic
Receiver
Source

Allows for Multicast content that originated in one MVPN to be


distributed to other (separate) MVPNs
Two basic configuration requirements:
Configure all relevant MVRFs on Source PE or Receiver PE (or both)
Configure Fallback static mroute (Source VRF IP subnets: Source and / or RP
address) to allow RPF check between MVRFs.
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PIM Distribution Modes
IGMP / MLD & Snooping
Multicast VPN & Extranet
Multicast High-Availability
Multicast Management
Catalyst 6500 & IP Multicast
Multicast Data
Multicast Non-Stop Forwarding Structures
(NSF) with Stateful Switch-Over Active
(SSO)
Offers single-node Multicast HA on
Catalyst 6500 with Supervisor 720
Synchronizes all critical multicast Periodic
Global
forwarding state & entries from the Sync Syncs

Active to Standby supervisor Standby


Multicast (MMLS/MFIB) Forwarding Entries
Multicast Expansion Table (MET) - for MMLS
IGMP / MLD Snooping state

Minimizes multicast traffic disruption


during supervisor switchover
Works with PIM Triggered Joins
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Use-Case: Any SSO/NSF capable highly RP
available multicast deployment
Helps rebuilds the multicast routing state
very quickly after switchover
On switchover, new Active supervisor Active
Standby
changes Generation ID in PIM Hellos Active
Failure

PIM neighbors use the new GenID as an


indication that the neighbor on that Interface
has no multicast state
Neighbor now sends triggered PIM
Join messages for all the (*,G) & (S,G)
mroutes which had that PIM Interface as
the RPF Interface Periodic PIM Hellos

Assumption is that all PIM neighbors know Periodic PIM Joins

how to interpret GenID field in PIM hellos Hello with new GenID
Triggered PIM Joins
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PIM Distribution Modes
IGMP / MLD & Snooping
Multicast VPN & Extranet
Multicast High-Availability
Multicast Management
Catalyst 6500 & IP Multicast
Provides wire-rate statistics NetFlow
Collector
collection for IPv4 Multicast
data flows
Support for both ingress &
egress multicast statistics
Ingress NetFlow tracks multicast traffic
received on the Incoming Interface (IIF) S1,G1 NetFlow v9
Egress NetFlow tracks multicast traffic S2,G1 Export
replicated on each Outgoing Interface
(OIF) S1,G2
Egress
S3,G1
Netflow Sampling support, to Voice
reduce export load Ingress
vlan100

Important for PIM-BiDir Video vlan200


networks, where (S,G) entries g1/1
NOT in mroute table vlan300
Data Catalyst 6500
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Several Multicast-specific SNMP MIBs SNMP
PIM, MROUTE, MSDP, MVPN & IGMP/MLD Server

Several Multicast-specific SNMP Traps


pimNeighborLoss
ciscoPimRPMappingChange
ciscoPimInvalidReFaster
ciscoPimInvalidJoinPrune
ciscoPimInterfaceUp SNMP Traps
S1,G1
ciscoPimInterfaceDown
SNMP MIBs S2,G1
msdpEstablished1
msdpBackwardTransition S1,G2
Egress
ciscoMvpnMvrfChange S3,G1
Special trap called Multicast Voice
Heartbeat can be used to track Ingress
vlan100
availability of a Multicast group
ciscoIpMRouteMissingHeartBeats Video vlan200
g1/1

Catalyst 6500 vlan300


Data
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PIM Distribution Modes
IGMP / MLD & Snooping
Multicast VPN & Extranet
Multicast High-Availability
Multicast Management
Catalyst 6500 & IP Multicast
Leveraging 13+ years of IPv4 & IPv6 Multicast
expertise, innovation & solutions
Delivers unmatched Multicast performance & pricing
200+Mpps IPv4 multicast forwarding demonstrated in EANTC tests
Up to 80G multicast replication per-slot, with WS-6908-10GE module

Deployed in the worlds most business-critical networks


Global Financials - Exchanges, Brokerages, FSPs
Video Providers - Domestic & Foreign IPTV and Triple-Play ISPs
Service Providers - L2 & L3VPN IP Multicast Services
Transportation - Airlines, Buses and Trains
Government - Federal and Defense Departments
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Implements both Centralized & Distributed
IPv4 & IPv6 multicast hardware-switching
Supports IPv4 / IPv6 PIM-SM & SSM (S,G)
mroute forwarding in hardware WS-SUP720-3B
Supports IPv4 PIM-SM & BIDIR (*,G)
mroute forwarding in hardware
Supports IPv4 MVPN forwarding in hardware
Supports IGMPv1/v2/v3 Snooping in hardware VS-S720-10G-3C
Supports MLDv1/v2 Snooping in hardware
Supports IPv4 PIM Snooping in hardware
Supports both Centralized & Distributed
IPv4 & IPv6 multicast packet-replication VS-SUP2T-10G

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Up to 256K Multicast Entries in the FIB-XL Provides for unparalleled Hardware
Multicast Scaling!
PIM Source Register in Hardware: all register frames Saves CPU & Memory usage & minimizes
are encapsulated & de-encapsulated by PFC Source Register time!

PIM Dual-RPF in Hardware: which allows SPT switch- Saves CPU & Memory usage & minimizes
over (RP to Source) to occur w/o software SPT Switchover time!

New MFIB & EDC (+ LTL & MET sharing) designs: which Optimized HW Infrastructure, designed
Incorporate the new LIF & BD capabilities for L2/L3 Scalability!

New Global IGMP Snooping & Optimized Multicast Flood Enhanced Layer 2 multicast processing
(OMF) designs: for L2 multicast & forwarding!

Multicast VPN (MVPN) Egress-Replication support Optimized MVPN Replication!

Store IPv6 (*,G) & (S,G) entries in FIB (vs. Netflow) Much faster forwarding of IPv6!

Hardware IGMPv3 & MLDv2 Snooping support Faster updates of L2 IPv4 & IPv6
PIM-SSM host tables!
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Multicast Control-Plane
Supervisor Components
Module Components
Route Processor - Layer 3 Switch Processor - Layer 2
control-plane functions: control-plane functions:
Multicast Protocols: PIM, IGMP / MLD, Managing PFC / DFC hardware tables
AutoRP / BSR, MSDP, MVPN, etc. IGMP / MLD Snooping packet processing
Calculating RPF interfaces PIM Snooping / RGMP packet processing
Managing software IP mroute table IGMP / MLD Querier functions
Downloads IP mroute entries to SP (for Statistics Collection & Reporting
installation into PFC / DFC hardware)
IP Mroute
Table
RP
Group
1 Gbps (Route Processor) Membership
CPU
Inband RP & Source
Advertisement
Channels
SP IGMP / MLD
1 Gbps (Switch Processor) Snooping

CPU PIM
Snooping
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
720Gbps Switch Fabric & PFC3 (XL)
Multicast Replication Engine Forwarding Engine
Route Processor
(RP)
Switch Processor
(SP)

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Route Processes - Layer 3 Switch Processes - Layer 2
control-plane functions: control-plane functions:
Multicast Protocols: PIM, IGMP / MLD, Managing PFC / DFC hardware tables
AutoRP / BSR, MSDP, MVPN, etc. IGMP / MLD Snooping packet processing
Calculating RPF interfaces
Same Basic Principle:
PIM Snooping / RGMP packet processing
ManagingSeparate
software IP Routing
mroute table & Switching IOS processes
IGMP / MLD Querier functions
Downloads IP mroute entries(with Single RP CLI) Statistics Collection & Reporting
to SP (for
installation into PFC / DFC hardware)

IP Mroute
Table
RP
Group
1 Gbps (Route
Single Process)
(Dual-Core) Membership
Functions
Inband RP & Source
Channel Control-Plane
SP
Advertisement

Processor
(Switch Process)
IGMP / MLD
Snooping
Functions PIM
Snooping
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
2Tbps Switch Fabric &
PFC4 (XL)
Multicast Replication Engine
Forwarding Engine

Combined (SP/RP)
Control-Plane
Processor
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Multicast Control-Plane
Supervisor Components
LAN Module Components
PFC3 provides Hardware 4 entry Bidir RP RP & SP CPUs are housed on
L2-L3/L4 forwarding, using TCAMs & table for DF the same Daughter Board
ASICs Interface check
SP CPU programs
FIB contains ADJ contains RP CPU maintains
hardware and performs
(S,G) & (*,G) entries, and Rewrite info & MET routes & state, and
IGMP/MLD & PIM
RPF VLAN index downloads tables
snooping
Supervisor 720 Baseboard 1GE Uplinks
Counter QoS FIB RP (MSFC3)
ADJ 1 Gbps DRAM
FPGA TCAM TCAM CPU
Port ASIC
Bidir RP 1 Gbps SP (NMP) DRAM
ACL L3/4 CPU
TCAM Engine NetFlow
MET CPU Daughter Card
Protocol PFC3
Redirection
L2 Engine Integrated
L2 CAM Daughter Fabric 20 Gbps 720 Gbps
Logic
Card Interface & Switch Fabric
Replication
Engine
18 x 20Gbps
Protocol Fabric Channels
32 Gbps Bus
Redirection DBUS Central Replication Engine for
captures 64K L2 CAM contains MET contains OILs RBUS Bus-based cards and uplink
IGMP/MLD & PIM 16 Gbps
multicast MAC entries for replication ports
BRKARC-3322 Bus 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
RP and SP CPUs
PFC3C serves same basic perform all control
functions as PFC3A/B plane functions

Supervisor 720-10GE Baseboard 1GE & 10GE Uplinks


Counter QoS FIB RP (MSFC3C)
ADJ 1 Gbps DRAM
FPGA TCAM TCAM Port Port CPU
ASIC ASIC SP (NMP)
Bidir RP 1 Gbps DRAM
ACL L3/4 CPU
TCAM Engine NetFlow
MET CPU Daughter Card
Protocol PFC3C
L2 Engine Fabric Integrated
Redirection Daughter 20 Gbps
Logic L2 CAM Interface & 720 Gbps
Card Switch Fabric
Replication
Engine 20 x 20Gbps
Fabric Channels
32 Gbps Bus
DBUS Central Replication engine for
96K L2 CAM for more RBUS Bus-based cards and uplink
multicast MAC entries ports
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
PFC4 builds upon PFC3 and RP (combined L2/L3) CPU is
8 entry Bidir RP table housed on the MSFC5 Daughter
provides new IFE/OFE processing for DF Interface check
capabilities Board
RP (L2) programs RP (L3) maintains
LDB contains ADJ / RIT contains
hardware and performs routes & state, and
Ingress & Egress Rewrite Info & MET
IGMP/MLD & PIM downloads tables
LIF/BD mapping index
snooping
Supervisor 2T Baseboard 1GE & 10GE Uplinks
QoS FIB
ADJ RIT
TCAM TCAM 1 Gbps RP DRAM
ACL Port ASIC CPU
TCAM Bidir RP
L3/4
Counter Engine NetFlow MSFC5 Daughter Card
FPGA
MET

LIF Database L2 Engine PFC4 Integrated


Fabric 20 Gbps
Protocol L2 CAM Daughter 2Tbps Gbps
Redirection Interface &
Card Switch Fabric
Replication
Engine 26 x 40Gbps
Fabric Channels
Protocol Redirection
32 Gbps Bus
DBUS Central Replication engine for
captures RBUS
128K L2 CAM for more
16 Gbps MET contains OILs for Bus-based cards and uplink
IGMP/MLD & PIM
multicast MAC entries replication ports
BRKARC-3322 Bus 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Stock Stock Stock Stock

Join
Join
Join

Join
Broker Broker Broker Broker
C D B A

t0
or
t0
or

or
t0

P
or
N

or
P

P
N

or
P
P

t
t

(Tx)
(Rx)
(Tx)
(Rx)

(Tx)
(Rx)

FE
RE

FE
RE

FE
RE
CP

CP
CP
U

U
U
Fabric ASIC Fabric ASIC Fabric ASIC

S
C
H
CPU E
Port
RE (Tx) D
Fabric ASIC

0
U
Source L
Port
N
RE (Rx) E
Stock R
Exchange
Host

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Multicast Control-Plane
Supervisor Components
LAN Module Components
DBUS Example: WS-X6416-GBIC
RBUS
Classic Module
Port Port Port Port
ASIC ASIC ASIC ASIC
12xGE 12xGE 12xGE 12xGE

Example: WS-X6148A-RJ-45
Port ASIC for Physical DBUS
Connectivity, Buffering, and RBUS
Queuing
Classic Module
Port
ASIC

48x10/100
No multicast-specific components on these modules
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Example: WS-X6516-GBIC

DBUS 8 Gbps
RBUS Fabric Channel
CEF256
Fabric / Bus Module
Interface

Fabric Interface
Connects to Fabric LC-DBUS
and Bus LC-RBUS

Replication
MET
Engine Port Port Port Port
ASIC ASIC ASIC ASIC
MET Contains 4xGE 4xGE 4xGE 4xGE
OILs for Multicast Replication Engine - Port ASIC for Physical
Replication Replicates Packets to each OIF Connectivity, Buffering, and
Queuing

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Layer 2 Engine for MAC Example: WS-X6516-GBIC with WS-F6K-DFC
learning, Security / QoS
ACL Lookups, and
Protocol Redirection 8 Gbps
Layer 3 Engine
Fabric Channel for FIB/ADJ and
CEF256 NetFlow
Layer 2 L3/L4 Module Lookups
Fabric / Bus
Engine Engine with DFC
Interface
DFC2/3
LC-DBUS
LC-RBUS

Replication
MET
Engine Port Port Port Port
ASIC ASIC ASIC ASIC
4xGE 4xGE 4xGE 4xGE

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Example: WS-X6748-SFP

DBUS
20 Gbps RBUS 20 Gbps
Fabric Channel Fabric Channel
Complex A Complex B CEF720
Fabric Fabric Module
Bus Bus
Interface & Interface Interface Interface &
MET Replication Replication MET
Engine Engine

Port Port CFC Port Port


ASIC ASIC ASIC ASIC
12xGE 12xGE 12xGE 12xGE
Port ASIC for
MET Contains Fabric Interface & Replication Physical
local OIFs for Engine - Connects to Fabric & Connectivity,
Replication Bus (CFC), and Replicates Buffering &
Packets to OILs Queuing
Bus Interface for Control Data Only!!
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Example: WS-X6748-SFP with WS-F6700-DFC3B
Layer 2 Engine for
L2 Lookups and
Protocol Layer3/4 Engine for FIB/ADJ, ACL,
Redirection QoS, and NetFlow Lookups

20 Gbps 20 Gbps
Fabric Channel Fabric Channel
Complex A Complex B CEF720
Module
Fabric Layer 2 Layer 2 Fabric
Interface & Interface & + DFC
Engine Engine
MET Replication Replication MET
Engine L3/4 Engine
Engine
Port Port DFC Port Port
ASIC ASIC ASIC ASIC
12xGE 12xGE 12xGE 12xGE

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Example: WS-X6908-10G with WS-F6K-DFC4-E
Layer 2 Engine for
L2 Lookups and
Protocol Layer3/4 Engine for FIB/ADJ, ACL,
Redirection QoS, and NetFlow Lookups
40 Gbps 40 Gbps
Fabric Channel Fabric Channel
Fabric Complex A Complex B Fabric CEF2T
MET ASIC MET MET ASIC MET
Layer 2 Module
Fabric Fabric
Engine Fabric Fabric + DFC
Interface & Interface & Interface & Interface &
Replication Replication Replication Replication
Engine Engine L3/4 Engine Engine
Engine
Port Port Port Port DFC4 Port Port Port Port
ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC
1x10G 1x10G 1x10G 1x10G 1x10G 1x10G 1x10G 1x10G

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Hardware Forwarding
Multicast FIB Processing
PIM BiDir Processing
Multicast Expansion Table
RP (MSFC) RP CPU derives 3 important data
IP Mrouting,
structures from the IP Multicast routing
PIM, IGMP table
MMLS-RP MDSS & MLD
Multicast FIB: Contains (S,G) & (*,G) entries,
RPF VLAN, and BiDir RP index
SCP / ICC Adjacency Table: Contains L2 rewrite MAC
information and MET index
Multicast Expansion Table (MET): Contains
SP (PFC) MET Manager, Output Interface Lists (OILs), i.e. Interfaces
IGMP & PIM requiring replication
MMLS-SP Snooping RP CPU downloads tables to SP
SP CPU installs tables into the
SCP appropriate hardware
MET installed in replication engines
LC (CFC) LC (DFC) Multicast FIB and Adjacency tables installed in
MET FIB/ADJ MET PFC/DFC hardware
SP CPU also maintains L2 tables for
MMLS-LC MMLS-LC IGMP/MLD & PIM snooping
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500# sho ip mroute 239.1.1.101 When the RPF Multicast Fast
IP Multicast Routing Table Drop (RPF_MFD) flag is set, no
matching traffic will be sent to RP
Flags: D - Dense, S - Sparse, B - Bidir Group, s - SSM Group, C - Connected, CPU
L - Local, P - Pruned, R - RP-bit set, F - Register flag,
The SP periodically updates
T - SPT-bit set, J - Join SPT, M - MSDP created entry, E - Extranet,
multicast statistics allowing RP to
X - Proxy Join Timer Running, A - Candidate for MSDP Advertisement, refresh activity timers
U - URD, I - Received Source Specific Host Report,
Z - Multicast Tunnel, z - MDT-data group sender,
Y - Joined MDT-data group, y - Sending to MDT-data group
V - RD & Vector, v - Vector
Outgoing interface flags: H - Hardware switched, A - Assert winner
Timers: Uptime/Expires
Interface state: Interface, Next-Hop or VCD, State/Mode

(101.1.1.1, 239.1.1.101), 00:05:22/00:02:53, flags: sTI


Incoming interface: Vlan101, RPF nbr 0.0.0.0, RPF-MFD
Outgoing interface list:
Vlan201, Forward/Sparse, 00:02:33/00:02:41, H H Flag is set to show that
OIF is switching in
6500# Hardware

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
(S,G) Packet
Statistics

6500#sho mls ip multicast group 239.1.1.101


Multicast hardware switched flows:
(101.1.1.1, 239.1.1.101) Incoming interface: Vlan101, Packets switched: 57926515914
Hardware switched outgoing interfaces:
Vlan201
RPF-MFD installed (S,G) OIFs (S,G) IIF

Total hardware switched flows : 1


6500#

6500#sho mls ip multi stat group 239.1.1.101


Group: 239.1.1.101
Source: 101.1.1.1, bytes: 75073226997168, packets: 57926872683

6500#
(S,G) Byte & Packet
Statistics

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
MSFC RP CPU derives 3 important data
IPv4 & v6 IGMP & MET MGR structures from the Multicast routing
PIM MLD
LTL MGR
table
Multicast FIB: Contains (S,G) & (*,G) entries,
RPF VLAN, and BiDir RP index
MRIB EDC Server Adjacency Table: Contains L2 rewrite MAC
information and MET index
I Multicast Expansion Table (MET): Contains
P Output Interface Lists (OILs), i.e. Interfaces
C requiring replication
EDC PFC
MFIB Client RP builds MRIB state in software
&
MFIB uses MRIB to program
I MET MGR LTL RAM forwarding information in hardware
C Multicast FIB & Adjacency tables installed in
PFC/DFC hardware
C
MET MGR LTL RAM
DFC EDC uses MRIB to program hardware
(OIF) port information
MFIB EDC Client
MET defines per-module OIFs

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho ip mroute 239.124.1.1
IP Multicast Routing Table
Flags: D - Dense, S - Sparse, B - Bidir Group, s - SSM Group, C - Connected,
L - Local, P - Pruned, R - RP-bit set, F - Register flag,
T - SPT-bit set, J - Join SPT, M - MSDP created entry, E - Extranet,
X - Proxy Join Timer Running, A - Candidate for MSDP Advertisement,
U - URD, I - Received Source Specific Host Report,
Z - Multicast Tunnel, z - MDT-data group sender,
Y - Joined MDT-data group, y - Sending to MDT-data group, NOTE: the RPF_MFD flag no
longer applies, because all flows
V - RD & Vector, v - Vector are completely hardware
Outgoing interface flags: H - Hardware switched, A - Assert winner switched
Timers: Uptime/Expires
Interface state: Interface, Next-Hop or VCD, State/Mode

(*, 239.124.1.1), 00:00:24/stopped, RP 3.3.3.3, flags: SJC


Incoming interface: Null, RPF nbr 0.0.0.0
Outgoing interface list:
Vlan148, Forward/Sparse, 00:00:11/00:02:48

(124.1.1.1, 239.124.1.1), 00:00:24/00:02:35, flags: T


Incoming interface: Vlan124, RPF nbr 0.0.0.0
Outgoing interface list:
Vlan148, Forward/Sparse, 00:00:11/00:02:48

6500#
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho ip mfib 239.124.1.1
Entry Flags: C - Directly Connected, S - Signal, IA - Inherit A flag,
ET - Data Rate Exceeds Threshold, K - Keepalive
DDE - Data Driven Event, HW - Hardware Installed
I/O Item Flags: IC - Internal Copy, NP - Not platform switched,
NS - Negate Signalling, SP - Signal Present,
A - Accept, F - Forward, RA - MRIB Accept, RF - MRIB Forward,
MA - MFIB Accept
Forwarding Counts: Pkt Count/Pkts per second/Avg Pkt Size/Kbits per second
Other counts: Total/RPF failed/Other drops
I/O Item Counts: FS Pkt Count/PS Pkt Count
Default
(*,239.124.1.1) Flags: C HW
SW Forwarding: 0/0/0/0, Other: 0/0/0
HW Forwarding: 0/0/0/0, Other: 0/0/0 Hardware Flag
Tunnel1 Flags: A (S,G) Byte & Packet
Vlan148 Flags: F NS Statistics
Pkts: 0/0
(124.1.1.1,239.124.1.1) Flags: HW
SW Forwarding: 0/0/0/0, Other: 6/0/6
HW Forwarding: 182188/1001/1318/10307, Other: 0/0/0
Vlan124 Flags: A (S,G) IIF
Vlan148 Flags: F NS denoted by the A
Pkts: 0/0 (S,G) OIFs flag
denoted by the F
& NS flags
6500#
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Hardware Forwarding
Multicast FIB Processing
PIM BiDir Processing
Multicast Expansion Table
Compare 3
Generate
Lookup 2010::1, FF05::1
Key 2000::1, FF02::1 1
Lookup Key 2 2001::1, FF02::1 2
2003::1, FF05::1 3
(S,G) FFFFFFFF FFFFFFFF
1 2010::1, FF05::1 2002::1, FF05::1 4
2003::1, FF06::1 5 Result
Multicast
Packet HIT! 46 RPF VLAN
2010::1, FF05::1 Adj Index
2010::1, FF06::1 7
2020::1, FF05::1 8
S,G compares all
bits in Source IP Masks FIB TCAM Patterns
and Group IP
Replication Engine(s)
MAC, MET Index
OIL #1
OIL #2 MAC, MET Index
6 5
OIL #3 MAC, MET Index
OIL #4
MAC, MET Index
MET
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Adjacency
Cisco Public Table
Multicast
6500-sp#sho mls cef ip multicast source 192.168.6.2 group 226.1.1.1 detail
Multicast CEF Entries for VPN#0 Source &
(192.168.6.2, 226.1.1.1) Group
Primary Input Entry Flag
IOSVPN:0 (1) PI:1 (1) CR:0 (1) Recirc:0 (1) address
Vlan:1019 AdjPtr:376832 FibRpfNf:1 FibRpfDf:1 FibAddr:0x4060
RPF rwvlans:1019 rwindex:0x7FFA adjmac:000b.45a8.1280 rdt:1 E:0 CAP1:0 MET
VLAN fmt:Mcast l3rwvld:1 DM:0 mtu:1518 rwtype:L2&L3 met2:0x4 met3:0x1746 indexes
packets:0000750657305 bytes:000000549260903076
Starting Offset: 0x0004 Adjacency index
V E C:1014 I:0x07F09 associated with the
Packets & Bytes switched
Starting Offset: 0x1746 Multicast FIB entry
on the adjacency
V C:1022 I:0x00A2D P->2C4C
V C: 11 I:0x0219F MET blocks for SP
V E C: 12 I:0x019CF replication engine

Found 1 entries. 0 are mfd entries

6500-sp#sh mls cef adjacency entry 376832 detail


Index: 376832 smac: 000b.45a8.1280, dmac: 0000.0000.0000
mtu: 1518, vlan: 1019, dindex: 0x7FFA, l3rw_vld: 1
format: MULTICAST, flags: 0x2000004608
met2: 4, met3: 5958
packets: 839836755, bytes: 555325105676
6500-sp#
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho plat hard multic rout ip source 124.1.1.1 gro 239.124.1.1 det
IPv4 Multicast CEF Entries for VPN#0
Multicast Source
(124.1.1.1, 239.124.1.1/32) & Group address
FIBAddr: 0x1BE02 IOSVPN: 0 RpfType: SglRpfChk SrcRpf: Vl124 RPF
CPx: 0 s_star_pri: 1 non-rpf drop: 0 VLAN
PIAdjPtr: 0x34334 Format: IP rdt: off elif: 0xC5408 MET
fltr_en: off idx_sel/bndl_en: 0 dec_ttl: on mtu_idx: 2(1518)
indexes
PV: 1 rwtype: MCAST_L3_RWT_L2_EXPS
met3: 0x5 met2: 0x4
Packets: 346661 Bytes: 456899198
Adjacency indexes
NPIAdjPtr: 0x34335 Format: IP rdt: on elif: 0xC5408 associated with the
fltr_en: off idx_sel/bndl_en: 0 dec_ttl: off Multicast FIB entry
PV: 0 rwtype: MCAST_L3_REWRITE
met3: 0x5 met2: 0x0 DestNdx: 0x7FF3 Packets & Bytes switched
Packets: 352132 Bytes: 464109976 on the adjacency
MET offset: 0x5
OIF AdjPtr Elif CR
+-------------+----------+-----------+--------+ MET blocks & ICROIF for
Vl148 0x8094 0x94 1T2 egress replication
MET offset: 0x4
OIF AdjPtr Elif CR
+-------------+----------+-----------+--------+
EDT-3C334 0x3C334 0x8400A 1T1/T2 5T1 7T1/T2
Found 1 entries.
6500# BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Hardware Forwarding
Multicast FIB Processing
PIM BiDir Processing
Multicast Expansion Table
Compare 3
Generate 5 Bidir RP Table
Lookup 10.1.1.10,
XXXXXX, 239.1.1.1 RP #1 DF Set
Key xxxxxxxx, 239.1.1.99 1 RP #2 DF Set
Lookup Key 2 xxxxxxxx, 239.1.16.1 2 RP #3 DF Set
S,G 00000000 FFFFFFFF xxxxxxxx, 239.2.1.1 3 RP #4 DF Set
1 10.1.1.10, 239.1.1.1 xxxxxxxx, 239.14.14.1 4
Multicast xxxxxxxx, 239.44.12.1 5 Bidir RP
Packet HIT! xxxxxxxx, 239.1.1.1 4 6 Index
xxxxxxxx, 239.1.11.1 Adj Index
7
Result
xxxxxxxx, 239.50.1.1 8
*,G compares all
bits in Group IP Masks FIB TCAM Patterns

Replication Engine(s)
MAC, MET Index
OIL #1
OIL #2 MAC, MET Index
7 6
OIL #3 MAC, MET Index
OIL #4
MAC, MET Index
MET
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Adjacency Table
Cisco Public
Hardware Forwarding
Multicast FIB Processing
PIM BiDir Processing
Multicast Expansion Table
Index OIF VLAN Port List

Index A from ADJ A 100 Gi4/12,Gi4/19


101 Gi9/1 MET Block
102 Gi9/25,Gi9/29

Index B from ADJ B 100 Gi4/12,Gi4/22,Gi4/30


1019 Te1/1

Index C from ADJ C 700 Gi4/1,Gi4/2,Gi4/3


4030 Te8/1
Replication MET 4031 Te8/3
Engine
4032 Te2/1,Te2/2,Te2/9

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500-sp#sh mls cef ip multi source 192.168.6.2 group 226.1.1.1 detail
Multicast CEF Entries for VPN#0
(192.168.6.2, 226.1.1.1)
IOSVPN:0 (1) PI:1 (1) CR:0 (1) Recirc:0 (1)
Vlan:1019 AdjPtr:376832 FibRpfNf:1 FibRpfDf:1 FibAddr:0x4060
rwvlans:1019 rwindex:0x7FFA adjmac:000b.45a8.1280 rdt:1 E:0 CAP1:0
fmt:Mcast l3rwvld:1 DM:0 mtu:1518 rwtype:L2&L3 met2:0x4 met3:0x39E
packets:0000716098029 bytes:000000632810218228
OIF VLAN Starting Offset: 0x0004
V E C:1014 I:0x07F09
Starting Offset: 0x039E
MET Indexes
V C: 11 I:0x0219F P->2C48
V E C: 12 I:0x019CF Port Indexes

6500-sp#test mcast rd-met slot 1 addr 4


Starting Offset: 0x0004
V E C:1014 I:0x07F09
6500-sp#

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Replication Overview
Ingress Replication Mode
Egress Replication Mode
Egress-Local Optimization
It is the process of creating copies of multicast
packets, one for each Layer 3 OIF
For example: An (S,G) mroute, with 3 OIFs - replication hardware creates
three egress copies of every one ingress packet received from source (S) &
destined to group (G)
There are 3 basic types of hardware replication

Layer 3 multicast replication


For Layer 3 Forwarding between (1 or many) interfaces
Multicast Replication Engine does the replication
Layer 2 multicast replication
For Layer 2 Forwarding between ports in same LC
Port ASIC does the replication
Fabric multicast replication
For Egress Forwarding between ports in different LCs
Fabric ASIC does the replication

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
The Replication mode refers to exactly
where within the system multicast
replication occurs
Replication occurs in one or more hardware
replication-engine ASICs
In a Classic (bus) system, replication
occurs centrally on the Supervisor
replication-engine ASIC
In a Fabric-enabled system, there are two
possible replication modes:
Ingress replication
Egress replication

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Replication Overview
Ingress Replication Mode
Egress Replication mode
Egress-Local Optimization
Supported on Supervisor 720s Three Packets Cross
& Supervisor 2 + SFM. Switch Fabric

Requires Fabric-enabled modules


B
Replication load is Distributed: Supervisor RE
and / or Switching modules can perform
A
replication
C
Replication engine on the ingress module Switch
performs replication for all OIFs (MET2/3) RE
Fabric RE
Input and replicated packets get lookup on D
PFC or ingress DFC
Replicated copies pass over Fabric to RE
egress modules (MET2)
Multiple MET tables, but MET on all
replication-engines are synchronized RE = Replication Engine

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho mls ip multicast capability
Current mode of replication is Ingress
Configured replication mode is Ingress
Egress Local is Disabled
Slot Multicast replication capability Egress Local
1 Egress No Three Packets Cross
2 Egress Yes Switch Fabric
3 Egress No
4 Egress Yes
6500#sho mls ip multicast summary B
15422 MMLS entries using 9869888 bytes of memory RE
Number of partial hardware-switched flows: 0
Number of complete hardware-switched flows: 15422
Directly connected subnet entry install is enabled A
Hardware shortcuts for mvpn mroutes supported C
Current mode of replication is Ingress Switch
Consistency checker is enabled RE
Bidir gm-scan-interval: 10 RE
IPv6 Multicast Hardware Uplinks: Disabled Fabric
6500-sp#sho mls cef ip multi gro 239.1.1.101 det D
Multicast CEF Entries for VPN#0
(101.1.1.1, 239.1.1.101)
IOSVPN:0 (1) PI:1 (1) CR:0 (1) Recirc:0 (1) RE
Vlan:101 AdjPtr:31 FibRpfNf:1 FibRpfDf:1 FibAddr:0x4044
rwvlans:101 rwindex:0x9D9 adjmac:0013.5f1d.cb80 rdt:1 E:0 CAP1:0
fmt:Mcast l3rwvld:1 DM:0 mtu:1518 rwtype:L3 met2:0x0 met3:0x3C RE = Replication Engine
packets:0000000000000 bytes:000000000000000000
Starting Offset: 0x003C
V E C: 201 I:0x00A1F
Found 1 entries. 1 are mfd entries
6500-sp#

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Replication Overview
Ingress Replication Mode
Egress Replication mode
Egress-Local Optimization
Supported on egress-capable One Packet Crosses
Fabric modules Switch Fabric
e.g. WS-X6900, WS-X6700 & WS-X6548A-GETX

Input packets get one lookup on ingress B


(PFC/DFC), and replicated packets get lookup
on egress (PFC/DFC) A RE
C
For OIFs on ingress module, local RE Switch
performs the replication (MET2/3) RE RE
For OIFs on other (egress) modules, ingress Fabric D
RE replicates a single copy (MET2) to Switch RE
Fabric
Uses an internal (Egress) VLAN, called Internal
Central Rewrite OIF (ICROIF), which all egress
modules are members of
RE = Replication Engine
The RE on the egress module will then
replicate only for local OIFs (MET3)

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho mls ip multicast capability
Current mode of replication is Egress
Configured replication mode is Auto
Egress Local is Enabled
Slot Multicast replication capability Egress Local
1 Egress No One Packet Crosses
2 Egress Yes Switch Fabric
3 Egress No
4 Egress Yes
6500-sp#show mls cef ip multicast group 225.10.10.10 detail B
Multicast CEF Entries for VPN#0
(172.16.25.1, 225.10.10.10) A RE
IOSVPN:0 (1) PI:1 (1) CR:0 (1) Recirc:0 (1) C
Vlan:20 AdjPtr:30 FibRpfNf:1 FibRpfDf:1 FibAddr:0x30080 Switch
rwvlans:20 rwindex:0x939 adjmac:001d.a29a.1f00 rdt:1 E:0 CAP1:0 RE RE
fmt:Mcast l3rwvld:1 DM:0 mtu:1518 rwtype:L2&L3 met2:0x8A met3:0x8B
packets:0000000000049 bytes:000000000000005782 Fabric D
Starting Offset: 0x008A RE
V E L0 C:1015 I:0x0080B
Starting Offset: 0x008B
V E C: 10 I:0x0091B
IOSVPN:0 (1) PI:0 (1) CR:1 (1) Recirc:0 (1)
Vlan:1015 AdjPtr:65536 FibRpfNf:0 FibRpfDf:1 FibAddr:0x30082 RE = Replication Engine
rwvlans:1015 rwindex:0x7FFA adjmac:001d.a29a.1f00 rdt:1 E:0 CAP1:0
fmt:Mcast l3rwvld:1 DM:0 mtu:1518 rwtype:L3 met2:0x0 met3:0x8B
packets:0000000000000 bytes:000000000000000000
Starting Offset: 0x008B
V E C: 10 I:0x0091B
Found 1 entries. 1 are mfd entries
6500-sp#

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Replication Overview
Ingress Replication Mode
Egress Replication mode
Egress-Local Optimization
Entry OIF Dest Index
Egress Local for SVI & EtherChannel extends the original
optimizations to Logical interfaces (with multiple ports), by Valid 1 2/1 2/1
including only the physical port index that should receive... Index
2 2/2 2/2
* On by DEFAULT for Sup2T Module B

RE 2/1 Receiver Green


2/2
VLAN
Module A
Switch GREEN
Fabric RE 2/3
RE 2/4

Source

Entry OIF Dest Index

1 2/3 2/3
RE = Replication Engine Post-SXI
MET Contents
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Centralized Replication
Ingress Replication
Egress Replication
IGMP/MLD/PIM Snooping
Supervisor
L3/4 Engine Engine 32
Orange Green Red Purple
MET R R R R
L2 Engine Port ASIC Port ASIC
2 Replication
3
Classic A B
PFC3 Engine
Module B

DBUS
RBUS

Source S
Classic Port ASIC Port ASIC Receiver R
Module A Blue VLAN
A B4
1 Orange VLAN
Blue S Blue R Green VLAN
Red VLAN
Purple VLAN

Entire Packet
Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Supervisor
L3/4 Engine Engine 32
Orange Green Red Purple
MET R R R R
8 8 8 8
L2 Engine Port ASIC Port ASIC
6 Replication
7 Classic A B
PFC3 Engine
5
Module B

DBUS
RBUS

Source S
Classic Port ASIC Port ASIC Receiver R
Module A Blue VLAN
A B
Orange VLAN
Blue S Blue R Green VLAN
Red VLAN
Purple VLAN

Entire Packet
Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Orange Green Red Purple
R R R R
Supervisor
Engine 720 Port ASIC Port ASIC
L3/4 Engine
A B
LC-RBUS
LC-DBUS
L2 Engine 720 Gbps
3 Switch Fabric Replication
8 Gbps MET CEF256
PFC3 Fabric Interface Engine
Module B

DBUS
RBUS
2
Fabric CEF256 Source
8 Gbps S
Interface Module A Receiver
4 R
Blue VLAN
LC-DBUS Orange VLAN
LC-RBUS
Green VLAN
Replication Red VLAN
MET
Engine Port ASIC Port ASIC Purple VLAN
A B
1
Entire Packet
Blue S Blue R
Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Orange Green Red Purple
R R R R
Supervisor
Engine 720 Port ASIC Port ASIC
L3/4 Engine
A B
LC-RBUS
720 Gbps LC-DBUS
L2 Engine
7 Switch Fabric
9 Replication
8 Gbps MET CEF256
PFC3 Fabric Interface Engine
Module B

DBUS
RBUS
6 CEF256
Fabric Source S
8 8 Gbps Module A
Interface Receiver R
Blue VLAN
LC-DBUS Orange VLAN
LC-RBUS
Green VLAN
5
Replication
MET Red VLAN
Engine Port ASIC Port ASIC Purple VLAN
A B
Entire Packet
Blue S Blue R
Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Orange Green Red Purple
R R R R

Port ASIC Port ASIC CEF720


DFC3 Module B
Supervisor Engine 720 L3/4 Engine
w/DFC3
MET
720 Gbps Fabric Interface &
20 Gbps
PFC3 Switch Replication Engine L2 Engine
20 Gbps
Fabric
20 Gbps

20 Gbps

CEF720 Source S
2 Module A Receiver R
Fabric Interface & L2 Engine w/DFC3 Blue VLAN
MET 3
Replication Engine Orange VLAN
4
Green VLAN
L3/4 Engine Red VLAN
Port ASIC Port ASIC DFC3 Purple VLAN

1 Entire Packet
Blue S R Blue Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Orange Green Red Purple
R R R R

Port ASIC Port ASIC CEF720


DFC3 Module B
Supervisor Engine 720 L3/4 Engine
w/DFC3
MET
720 Gbps Fabric Interface &
20 Gbps 9
PFC3 Switch Replication Engine L2 Engine
20 Gbps 8
Fabric
20 Gbps

20 Gbps

7
CEF720 Source S
5 Module A Receiver R
Fabric Interface & L2 Engine w/DFC3 Blue VLAN
MET 6
Replication Engine Orange VLAN
Green VLAN
L3/4 Engine Red VLAN
Port ASIC Port ASIC DFC3 Purple VLAN

Entire Packet
Blue S R Blue Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Orange Green Red Purple
R R R R

Port ASIC Port ASIC CEF720


DFC3 Module B
Supervisor Engine 720 L3/4 Engine
w/DFC3
MET 12 12
720 Gbps Fabric Interface & 11
20 Gbps
PFC3 Switch Replication Engine L2 Engine
20 Gbps 10
Fabric
20 Gbps

20 Gbps

CEF720 Source S
Module A Receiver R
Fabric Interface & L2 Engine w/DFC3 Blue VLAN
MET
Replication Engine Orange VLAN
Green VLAN
L3/4 Engine Red VLAN
Port ASIC Port ASIC DFC3 Purple VLAN

Entire Packet
Blue S R Blue Packet Header
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Centralized Replication
Ingress Replication
Egress Replication
IGMP/MLD/PIM Snooping
Purpose: Constrain unnecessary (default)
multicast flooding on Layer 2 switch-ports
IGMP/MLD Snooping code leverages both
Hardware & Software information:
Switch snoops L3 contents of IGMP / MLD packets
PFC/DFC ASICs recognize IGMP / MLD packets and redirects them
to SP CPU (protocol redirection logic)
Switch installs static Layer 2 forwarding entries for each multicast
group MAC address
Multicast data traffic forwarded to appropriate Interfaces according to
MAC address table entries (per VLAN)

NOTE: Snooping does NOT affect the


performance of multicast data traffic
Redirection logic ONLY redirects IGMP/MLD
packets, not UDP (multicast data) packets

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho ip igmp group vlan 201
IGMP Connected Group Membership
Group Address Interface Uptime Expires Last Reporter Group Accounted
239.1.1.101 Vlan201 05:09:00 stopped 201.1.1.2
6500#sho ip igmp snoop stat int vlan 201

Current number of Statistics entries : 41


Configured Statistics database limit : 32000
Configured Statistics database threshold: 25600
Configured Statistics database limit : Not exceeded
Configured Statistics database threshold: Not exceeded

Snooping statistics for Vlan201


#channels: 1
#hosts : 1

Source/Group Interface Reporter Uptime Last-Join Last-Leave


0.0.0.0/239.1.1.101 Vl201:Te4/1 201.1.1.2 05:10:36 00:00:00 -

6500#

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Purpose: Constrain unnecessary multicast
(default) flooding on Layer 2 switch-ports
Mainly used in PIM-connected Layer 2 Core
PIM Snooping code also leverages both
Hardware and Software information:
Switch snoops the L3 contents of PIM packets
PFC/DFC ASICs recognize PIM packets and redirects them to SP
CPU (protocol redirection logic)
Switch installs / removes Layer 2 forwarding entries for interfaces
which send PIM Joins / Prunes
Multicast data traffic only forwarded to appropriate Interfaces
according to PIM Snooping mroute table entries (per VLAN)

Protocol redirection ONLY redirects PIM packets,


not UDP (multicast data) packets

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#sho ip pim snoop neigh vlan 146
IP Address Mac address Port Uptime/Expires Flags
VLAN 146: 3 neighbors
1.46.1.6 000b.45b7.0900 Gi2/3/16 00:21:14/00:01:42
1.46.1.4 0005.74e2.b340 Po202 01:50:22/00:01:41
1.46.1.1 0001.6444.5fc0 Router 01:50:23/00:01:31 DR DF
6500#sho ip pim snoop mroute vlan 146
Flags: J/P - (*,G) Join/Prune, j/p - (S,G) Join/Prune
SGR-P - (S,G,R) Prune

VLAN 146: 2 mroutes


(*, 239.135.1.5), 00:32:28/00:02:31
Downstream ports:
Upstream ports:
Outgoing ports: 15/1 Gi2/3/16

(1.35.1.51, 239.135.1.5), 00:32:28/00:02:31


1.46.1.6->1.46.1.1, 00:32:28/00:02:31, j
Downstream ports: Gi2/3/16
Upstream ports: 15/1
Outgoing ports: 15/1 Gi2/3/16

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
VSS Control-Plane
VSS Benefits
VSS FIB & MET Programming
VSS Packet Walks
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
VSS Control-Plane operates ONLY on the Active Supervisor
Multicast Control-Plane traffic ( IGMP / MLD, PIM hellos, PIM Joins / Prunes, etc... ) received by VSS
Standby are redirected to VSS Active via VSL
Control traffic is redirected to Active VSS SP/RP

Catalyst 6500 #1 Catalyst 6500 #2


(VS Active) (VS Standby)
VSL

Supervisor SP RP RP SP Supervisor

PIM Hellos

MEC MEC

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
VSS Control-Plane
VSS Benefits
VSS FIB & MET Programming
VSS Packet Walks
Stand-Alone Virtual Switch
DR Non-DR Switch1: Active Switch2: Standby
DR

STP/HSRP
PIM/IGMP VSL

Better multicast traffic load-distribution using MEC


Inter chassis SSO (*,G) & (S,G) and L2 snooping entries
synced between chassis, for faster convergence
Simplified topology eliminates PIM DR election process, as well as
Non-RPF traffic across inter-switch links
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Multicast state: 500 PIM groups @ 10 sources
Uplinks Failure per-group = 5000 mroute entries Switch Interlink Failure

With Egress replication-mode = 10,000 shortcuts


in hardware
RP

L3 L3
2 3
L2/L3 L2/L3

Supervisor Failure DR Downlinks Failure


4

Receivers Receivers

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
VSS Control-Plane
VSS Benefits
VSS FIB & MET Programming
VSS Packet Walks
VS ACTIVE VS STANDBY
The VSS Standby SP is
treated the same as a DFC MET CFC
module from a FIB & ADJ DFC FIB/ADJ
programming perspective. MET
FIB/ADJ DFC
MET

The VSS Active SP installs MET CFC CFC MET


multicast shortcuts onto the
Active PFC, Standby PFC and
all other DFCs in the VSS FIB/ADJ Active
Standby FIB/ADJ
MET
System. SP
SP
MET
VSL
HA FIB-CAPABLE
ICC MCAST GROUP

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
VS ACTIVE VS STANDBY
The VSS Standby SP is treated
MET
as a Supervisor from a MET CFC

programming perspective DFC MET

DFC MET
The Local SP (on each Chassis)
CFC MET CFC MET
manages & programs its own
MET, and also the METs of all
local CFC modules Active Standby
SP MET SP MET

VSL
DFC modules manage and ACTIVE SCP MET STANDBY SCP MET
MCAST GROUP MCAST GROUP
program their own METs
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
VSS Control-Plane
VSS Benefits
VSS FIB & MET Programming
VSS Packet Walks
All forwarding lookups & replication occurs on the Ingress modules
Subsequent modules only perform L2 egress lookup.
Multiple replications cross the Ingress Cores Switch Fabric and / or VSL
Ingress Core Egress Core
M0 R R M0 R3
E E

1 M1 R R M1
S MET2 LC2 LC 1 LC 3
2
MET3
M0 R R M0
R1 E R4
6 7 8
E VSL E
LC1 (Ingress)
3 R5
M1 R R M1 9 10
LC3 4 LC 4
LC2
Switch 1 Switch 2
MEC

Access Switch I-E-E-E (Ingress-VSL-VSL-Egress)


5
Multicast packets may cross up to 4 DFCs
Ingress DFC performs L2-L4 forwarding lookup
R2 Up to 3 DFCs (Cross VSL) perform L2 egress lookup
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Ingress modules replicate locally & one copy to Egress modules
Egress modules (on Ingress Core) replicate locally, and for all receivers on Egress Core.
Multiple replications cross the VSL
Ingress Core Egress Core
M0 R R M0 R3

E E
M1 R R M1
1
S MET3 LC 3
2 LC2 (Egress) LC 1
MET2
M0 R R M0 R4
E
R1 6 7 8
E VSL E
LC1 (Ingress) R5
3 M1 R R M1 9
4 10
LC3 (Egress) LC2 LC 4
Switch 1 Switch 2
MEC
MET2 MET3

Access Switch
I-E-E-E (Ingress-VSL-VSL-Egress)
Multicast packets may cross up to 4 DFCs
5 Ingress DFC performs L2-L4 forwarding lookup
R2 Up to 3 DFCs (Cross VSL) perform L2 egress lookup
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
High-Level Flow
Verifying Multicast Routing
Verifying Group Membership
Scalability Notes
Protocols EIGRP/OSPF PIM/IGMP IGMP snooping

Unicast Routing Multicast Routing Layer 2 Forwarding


Table Table Table
Software
Tables
CEF MFIB CEF MFIB Subsystem

S/W adjacency S/W FIB


Table Table

Hardware H/W adjacency H/W FIB Replication


Tables Table Table Table
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Protocols EIGRP/OSPF PIM/IGMP IGMP snooping
show ip mroute show ip igmp snooping group
show ip mrib show ip igmp group

Unicast Routing Multicast Routing Layer 2 Forwarding


Table Table Table
Software show ip mfib
Tables
CEF MFIB CEF MFIB Subsystem

show platform software multicast routing

S/W adjacency S/W FIB


Table Table
show platform hardware multicast routing
Hardware H/W adjacency H/W FIB Replication
Tables Table Table Table
show platform software met statistics
BRKARC-3322 show platform software
2013 Cisco and/or its affiliates. All rights reserved. met module <#> detail
Cisco Public
High-Level Flow
Verifying Multicast Routing
Verifying Group Membership
Scalability Notes
Verify that ip multicast-routing is enabled!
If MVPN, verify ip multicast-routing is enabled per-VRF

Verify PIM enabled on applicable Interfaces (including Loopbacks)

If PIM-SM and / or PIM-BiDir, then verify the RP configuration (AutoRP, BSR, Phantom, Anycast, Static)

Hardware MMLS/MFIB and IGMP Snooping enabled (enabled by default, but can be disabled)

Watch out for TTL, Multicast Boundary, Router Guard, IGMP Filters, RACLs, VACLs, QoS
Policers, etc.

Watch for proper SSM / BiDir address-range configuration (Requires prior address planning & coordination)

Verify that Unicast Routing is enabled & that the RPF information is correct

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#show ip pim rp mapping
PIM Group-to-RP Mappings
Group(s): 224.0.0.0/4, Static
RP: 10.255.255.3 (6509.cisco.com)
6500#show ip pim rp
Group: 239.1.1.10, RP: 10.255.255.3, v2, uptime 00:01:10, expires never
Group: 239.1.1.11, RP: 10.255.255.3, v2, uptime 00:01:10, expires never
Group: 239.1.1.12, RP: 10.255.255.3, v2, uptime 00:01:10, expires never
Group: 239.1.1.13, RP: 10.255.255.3, v2, uptime 00:01:10, expires never
Group: 224.0.1.40, RP: 10.255.255.3, v2, uptime 00:01:10, expires never
6500#

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
show ip pim interface - identifies DR for each Interface

6500#show ip pim Interface

Address Interface Ver/ Nbr Query DR DR


Mode Count Intvl Prior
10.255.255.2 Loopback0 v2/S 0 30 1 10.255.255.2
10.255.254.1 Loopback1 v2/S 0 30 1 10.255.254.1
10.10.1.2 GigabitEthernet4/3 v2/S 1 30 1 10.10.1.2
10.30.1.1 GigabitEthernet4/16 v2/S 1 30 1 10.30.1.2
10.100.1.1 Vlan100 v2/S 1 30 1 10.100.1.2
10.101.1.1 Vlan101 v2/S 1 30 1 10.101.1.2
10.200.1.1 Vlan200 v2/S 1 30 1 10.200.1.2
10.201.1.1 Vlan201 v2/S 1 30 1 10.201.1.2
6500#

This routers PIM


Compare with DR address
interface addresses
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#show mls ip multicast rp-mapping df-cache
State: H - Hardware Switched, I - Install Pending, D - Delete Pending,
Z - Zombie All DF Interfaces should
be in H state
RP Address State DF State
10.255.255.3 H Gi2/13 H
10.255.255.3 H Gi1/13 H
10.255.255.3 H Gi2/14 H
10.255.255.3 H Gi2/24 H
10.255.255.3 H Vl100 H
10.255.255.3 H Vl101 H
10.255.255.3 H Vl200 H
10.255.255.3 H Vl201 H
6500#

DF Interfaces for specified


Bidir RP
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
High-Level Flow
Verifying Multicast Routing
Verifying Group Membership
Scalability Notes
IGMP is enabled when PIM is configured on an Interface
For all receiver segments, IGMP (or MLD) drives OIF presence
in mroute table
Use show ip igmp groups to see IGMP join status on mrouter
Use debug ip igmp <group> to monitor IGMP packet reception at router
Be aware of effect of IGMP snooping on Layer 3 IGMP behavior
(e.g. not all joins/leaves seen by router)
Verify IGMP Querier consistency, and group membership for mrouters on
shared segments
Watch for IGMP access groups, filters, and / or multicast boundary
Verify IGMP snooping entries
Make sure entry exists & port membership correct
Should include the mrouter port

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#show ip igmp interface vlan 100
Vlan100 is up, line protocol is up
Internet address is 10.100.1.2/24
IGMP is enabled on interface
Current IGMP host version is 2
Current IGMP router version is 2
IGMP query interval is 60 seconds
IGMP querier timeout is 120 seconds
IGMP L3 Interface
IGMP max query response time is 10 seconds State
Last member query count is 2
Last member query response interval is 1000 ms
Inbound IGMP access group is not set
IGMP activity: 3 joins, 2 leaves
...
IGMP Packet
Statistics

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
...
Multicast routing is enabled on Interface
Multicast TTL threshold is 0
DR & Querier
Multicast designated router (DR) is 10.100.1.3 Information
IGMP querying router is 10.100.1.2 (this system)
No multicast groups joined by this system
IGMP snooping is globally enabled
IGMP snooping is enabled on this interface
IGMP snooping fast-leave is disabled and querier is disabled
IGMP snooping explicit-tracking is enabled
IGMP snooping last member query response interval is 1000 ms
IGMP snooping report-suppression is disabled
6500#

IGMP L2 Snooping State


BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
IP Address of Last Receiver
6500#show ip igmp groups to Report, for the Group
on the Interface

IGMP Connected Group Membership


Group Address Interface Uptime Expires Last Reporter
239.1.2.0 Vlan200 00:00:12 00:00:00 10.200.1.101
239.1.2.1 Vlan200 00:00:12 00:00:00 10.200.1.101
239.1.2.2 Vlan200 00:00:12 00:00:00 10.200.1.101
239.1.2.3 Vlan200 00:00:12 00:00:00 10.200.1.101
239.1.1.10 Vlan201 00:00:13 00:00:00 10.201.1.101
224.0.1.40 Loopback0 1w4d 00:02:18 10.255.255.1
6500#

Interfaces with Connected


Receiver
Multicast Group Joined

BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
6500#show mac-address-table multicast igmp

vlan mac address type learn qos ports


-----+---------------+--------+-----+---+--------------------------------
200 0100.5e01.0101 static Yes - Gi3/1,Gi3/7,Gi3/16
100 0100.5e01.0101 static Yes - Gi3/5,Gi3/7,Gi3/16
101 0100.5e01.0101 static Yes - Gi3/6,Gi3/7,Gi3/16

6500#
List of Receiver Ports (Also
Includes Any Multicast
Router Ports in VLAN)

Group Destination MAC

VLAN Where Group MAC Is


Learned
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Catalyst 6500 has over 15 years of Multicast innovations

Specialized Hardware Architecture for IPv4 / v6 Multicast

Scale up to 32K mroutes @ ~30Mpps with Sup720 & PFC3

Scale up to 128K mroute @ ~60Mpps with Sup2T & PFC4

Optimal System Capacity & Availability w/ Virtual Switching

Catalyst 6500 Multicast Rocks!!!


BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public
Give us your feedback and you
could win fabulous prizes.
- Winners announced daily.
Receive 20 Passport points for
each Session Evaluation that you
complete.
Complete your session evaluation Dont forget to activate your Cisco
online now (open a browser through our Live Virtual account for access to all
session material,
wireless network to access our portal) or visit
communities, and on-demand & live
one of the Internet stations activities
throughout the Convention Center. throughout the year.

Activate your account at the Cisco booth in


the World of Solutions or visit
www.ciscolive.com.
BRKARC-3322 2013 Cisco and/or its affiliates. All rights reserved. Cisco Public 135

You might also like