ASR 9000 Architecture

Cisco ASR 9000 Architecture Overview
BRKARC-2003
Dennis Cai, ERBU Technical Marketing Architect
CCIE # 6621
Session Goal
Understand Cisco ASR 9000 system architecture
RSP, switch fabric, Line card
Packet flows, control plane, data plane
nV (network virtualization)
Not cover the baseline configuration of ASR 9000

Please refer to BRKSPG-2202 Deploying Carrier Ethernet Services on ASR 9000 for ASR
9000 configuration examples
Not cover any specific technology other than system architecture

Not an IOS-XR session
Please refer to TECARC-2001 (Cisco IOS-XR - Cisco Next Generation Operating System)
for IOS-XR related technical information
BRKARC-2003
2012 Cisco and/or its affiliates. All rights reserved.
Cisco Public
Related Sessions
BRKSPG-2202 Deploying Carrier Ethernet Services on ASR 9000
TECARC-2001 (Cisco IOS-XR - Cisco Next Generation Operating System
Building Carrier Ethernet Services Using Cisco Ethernet Virtual Circuit Framework BRKSPG-2204 (EVC SW Infrastructure)
Redundancy Mechanisms for Carrier Ethernet and Layer 2 VPN Services - BRKSPG-2207
(L2VPN Resiliency)
Deploying Next Generation Carrier Ethernet: Services, Architectures and Operations TECOPT-2100 (Carrier Ethernet design)
Deployment challenges with Interconnecting Data Centers - BRKDCT-3060 (Data center

interconnect)
And more
BRKARC-2003
Cisco Public
Agenda
Hardware Overview
Carrier Class, Scalable System Architecture
Fabric architecture
Line card architecture
Packet flow, control plane and data plane
Multicast packet flow and replication
Internal system Qos
nV Technology Overview
BRKARC-2003
Cisco Public
Cisco ASR 9000 Next-Gen Edge Routing Platform

SP Edge + Data Center Edge
Designed for Longevity
Full HW portfolio
Based on IOS-XR: true modular, fully
distributed OS
Full L2 and L3 feature set with high scale
Advanced Video and Mobility DNA
Data center internet and cloud gateway
Next generation broadband Router*
nV (network virtualization) for operational
saving
* Please attend this session for asr9k BNG details:
PSOSPG-4325 ASR9K BNG Update
BRKARC-2003
Cisco Public
48 Tbps
ASR 9000 Chassis Overview

Same HW&SW architecture, identical features
across different chassis type
one ASR 9000 family
7 Tbps
3.5 Tbps
240 Gbps
ASR 9001 (Ironman)
ASR 9006
ASR 9922 (Megatron)
440G/slot
8 I/O slots
1.2T/slot
20 I/O slot
Max Capacity
(bi-directional)
120Gbps
Size
2RU
10RU
21RU
44RU
Air Flow
Side to side
Side to back
Front to back
Front to back
FCS
shipping
Shipping
Shipping
August, 2012
BRKARC-2003
440G/slot
4 I/O slots
ASR 9010
Cisco Public
ASR 9010 and ASR 9006 Chassis

Front-toback airflow
Integrated cable
management
with cover
System fan trays
Side-to-back
airflow
RSP (0-1)
(switch fabric)
Line Card
(0-3)
Line Card
(0-3, 4-7)
RSP (0-1)
(switch fabric)
System fan trays

Air draw
cable
management
BRKARC-2003
V1 power shelf: 3 Modular V1 PS

V2 power shelf: 4 Modular V2 PS
Cisco Public
2 power shelves
6 or 8 PS
ASR 9001 Iron Man Chassis

Sub-slot 0 with MPA
Redundant
(AC or DC)
Power Supplies
Field Replaceable
Sub-slot 1 with MPA
GPS, 1588
BITS
Console, Aux,
Management
EOBC ports for nV
Edge (2xSFP)
Fixed 4x10G
SFP+ ports
Fan Tray
Field Replaceable
Supported MPA (Media Port Adaptor): 20xGE, 2/4x10GE, 1x40GE

BRKARC-2003
Cisco Public
ASR 9922 Megatron Chassis

48Tbps system
Front-toback airflow
8+8 ACs or
11+1 DCs
20x Line Cards
(10 top, 10 bottom)
Height : 44 RU (AC & DC)

Depth : 28.65 (800mm)
Width : 17.75 (fits 19 rack)
Fan trays 4x
(ASR-9922-FAN)
2 x RPs
2 x RPs
6+1 FCs
4+1 Fabric Cards initially
6+1 Fabric Cards in future
BRKARC-2003
Cisco Public
10
Power and Cooling
ASR-9010-FAN
ASR-9006-FAN
Fans unique to chassis

Variable speed for
ambient temperature variation
Redundant fan-tray
Low noise, NEBS and OSHA compliant
DC Supplies
A
B
2.1/1.5 kW
A
B
2.1 kW
AC Supplies
Power Supply
BRKARC-2003
3 kW
3 kW
Single power zone

All power supplies run in active mode
Power draw shared evenly
50 Amp DC Input or 16 Amp AC
for Easy CO Install
Cisco Public
11
Hidden slide
New ASR 9000 Power Infrastructure: V2
Each V2 power shelf can hold 4 V2 power supply, existing

power shelf can hold 3 existing power supply
Cant mix different version of power shelf in the same chassis
Cant mix different version of power shelf and power supply
V2 power shelves for improved
load sharing
redundancy
power efficiency
Shipping in release 4.2.0
ASR 9922 chassis ship with new V2 power shelf and power
supply
Existing ASR 9006 and 9010 chassis is field upgradable to V2
BRKARC-2003
Part number
Description
PWR-3KW-AC-V2
3kW AC Power Module Version 2

for ASR-9006 & ASR-9010
PWR-2KW-DC-V2
2kW DC Power Module Version 2

for ASR-9006 & ASR-9010
A9K-AC-PEM-V2
ASR 9000 AC Power Entry Module

(power tray) Version 2
A9K-DC-PEM-V2
ASR 9000 DC Power Entry Module

(power tray) Version 2
ASR-9006-AC-V2
ASR 9006 AC Chassis with support

for PEM Version 2
ASR-9006-DC-V2
ASR 9006 DC Chassis with support

for PEM Version 2
ASR-9010-AC-V2
ASR 9010 AC Chassis with support

for PEM Version 2
ASR-9010-DC-V2
ASR 9010 DC Chassis with support

for PEM Version 2
Cisco Public
12
ASR 9006/9010 RSP (Route/Switch Processors )

RSP
RSP440
Freescale 8641D
Intel x86 Jasper Forest
2 Core 1.5GHz
4 Core 2.27 GHz
RSP-4G: 4GB
RSP440-TR: 6GB
RSP-8G: 8GB
RSP440-SE: 12GB
nV EOBC ports
No
Yes, 2 x 1G/10G SFP+
Switch fabric
bandwidth
184G/slot
440G/slot
(with dual RSP)
(with dual RSP)
Processors
RAM
BRKARC-2003
ASR 9922 RP is based

on RSP440, but with
separated fabric cards
Cisco Public
13
RSP440 Front Ports

Note, red color is the new functional ports, which is
supported on RSP440 only
1G SFP
EOBC ports for nV Edge
LEDs
Status, Alarm
USB
Aux
IEEE 1588, GPS

BITS/J.211
SyncE, IEEE1588 master and slave

10/100M Copper Ethernet
Sync 0, Sync 1
RJ45
BRKARC-2003
Console
Management
Ethernet
Cisco Public
14
RSP Engine Architecture

BITS
Clock
Time
FPGA
Timing Domain
MEM
CF card
or USB
HDD
CPU
Mgt Eth
EOBC
Mgt Eth
Internal communication between RPs and Line Cards
Console
Aux
Punt
FPGA
4G disk
FIA
Alarm
Front Panel
BRKARC-2003
Boot Flash
Crossbar
Fabric
ASIC
CPU Complex
Arbiter
Crossbar
Fabric
ASIC
I/O FPGA
NVRAM
Arbitration
Cisco Public
Switch fabric
15
ASR 9000 Ethernet Line Card Overview

-L, -B, -E
First-generation LC
(Trident)
A9K-40G
A9K-4T
A9K-8T/4
A9K-2T20G
A9K-8T
A9K-16T/8
-TR, -SE
Second-gen LC
(Typhoon)
A9K-24x10GE
A9K-2x100GE
A9K-MOD80
A9K-MOD160
MPAs
20x1GE
2x10GE
4x10GE
1x40GE
2x40GE
A9K-36x10GE
BRKARC-2003
Cisco Public
16
New HW PID and Shipping Release

Part Number
Target
Release
Part Number
Target
Release
ASR 9001
4.2.1
A9K-RSP440-SE
4.2.0
ASR 9000v
4.2.1
A9K-RSP440-TR
4.2.0
ASR 9922
4.2.2
A9K-MOD80-SE
4.2.0
A9K-24x10GE-SE
4.2.0
A9K-MOD80-TR
4.2.0
A9K-24x10GE-TR
4.2.0
A9K-MOD160-SE
4.2.1
A9K-MOD160-TR
4.2.1
A9K-MPA-2x10GE
4.2.1
A9K-2x100GE-SE
4.2.0
A9K-2x100GE-TR
4.2.0
A9K-MPA-4x10GE
4.2.0
A9K-36x10GE-SE
4.2.2
A9K-MPA-20x1GE
4.2.0
A9K-MPA-1x40GE
4.2.2
A9K-MPA-2x40GE
4.2.1
A9K-36x10GE-TR
4.2.2
4.2.2 release target for August/2012

BRKARC-2003
Cisco Public
17
ASR 9000 Optical Interface Support
Hidden slide
Modular optics used everywhere

GE: SFP interfaces (T, SX, LX, ZX)
10GE: SFP+ and XFP modules
XFP (for line card with less than 8x10GE
ports) : SR, LR, ZR, DWDM, CWDM,
Tunable
SFP+ (for line card with more than 8X10GE
ports): SR, LR, ZR
XFP
SFP, SFP+
BRKARC-2003
Cisco Public
18
ASR 9000 40/100GE Optics Roadmap
Hidden slide
QSFP (40GE)
ASR9k 40GE: QSFP form factor

SR4
LR4 (Q3CY12)
ASR9k 100GE: CFP form factor
LR4
SR10 (Q3CY12)
DWDM support:
40GE has g.709/FEC built-in at FCS
needs Q-SFP DWDM optics (future)
100GE is gray only and no FEC/g.709
use external transponder
CFP
(100GE)
BRKARC-2003
Cisco Public
19
ASR 9000 SIP-700 and SPA

20Gbps, feature rich, high scale, low speed interfaces
SPA support list:
http://www.cisco.com/en/US/partner/prod/collateral/routers/ps9853/data_sheet_c78-573452.html
Strong QoS
128+K Queues,
128+K Policers
H-QoS
Color Policing
Scalability
Distributed control and data
plane; 20G; 4 Bays
L3 i/f, route, session,
protocol scaled up for
MSE needs
High Availability
IC-Stateful Switch Over
capability,
MR-APS
IOS-XR base for high scale
and reliability
Powerful and Flexible

QFP Processor
Flexible ucode Architecture
for Feature Richness
L2 + L3 Services: FR, PPP,
HDLC, MLPPP, LFI, L3VPN,
MPLS, Netflow, 6PE/VPE
A9K-SIP-700
BRKARC-2003
SPA Support:
ChOC-12: T1 / T3, MLPPP, LFI, IC-SSO, MR-APS
ChOC-3/STM1 + ChOC-12: DS0 / STM1 + ChOC-48:
DS3 / E3 / STM4
POS: OC3/STM1, OC-12/STM4, OC-48/STM16, OC192/STM64
Ch T1/E1, Ch T3/E3, CEoPs, ATM
Cisco Public
20
ASR 9000 ISM (Integrated Service Module)

CDS Streaming:
TV and internet streaming
Error repair
CGN (carrier grade NAT):
NAT44, DS-Lite
NAT64(future)
Feature
ASR 9000 ISM Capabilities
Applications
Ultra-Dense VoD, TV,

Internet Streaming, Error Repair, CGv6
Bandwidth
30-40 Gbps streaming capacity

~3 Gbps cache fill rate
Compatibility
Works with all CDS appliances
Concurrent Streams
Up to 8,000 SD equivalent
Content Cache
3.2 TBytes at FCS - Modular Design
Video Formats
MPEG2 & AVC/H.264
Transport
MPEG over UDP / RTP
Session Protocols
RTSP / SDP
Environmental
NEBS / ETSI compliant
CDS: Manage 8,000 streams up to 40G per second

CGv6: 20M translations,
translations/sec.,
~15Gbps
BRKARC-2003
2012 Cisco and/or1M
its affiliates.
All rights reserved.
Cisco Public throughput / ISM
21
Agenda
Hardware Overview
Fabric architecture
Internal system Qos
BRKARC-2003
Cisco Public
22
ASR 9000 System Architecture

At-a-Glance
Line Card
RSP
CPU
CPU
BITS/DTI
FIA
FIC
Switch Fabric
BRKARC-2003
Cisco Public
23
ASR 9000 Switch Fabric Overview

3-Stage Fabric
Fabric frame format: Super-frame

Fabric load balancing:
Unicast is per-packet
Multicast is per-flow
Egress Line Card
fabric
ingress Line Card
fabric
FIA
FIA
FIA
fabric
Arbiter
FIA
FIA
FIA
8x55Gbps
RSP0
fabric
Fabric bandwidth:
Arbiter
8x55Gbps =440Gbps/slot with dual RSP

4x55Gbps=220Gbps/slot with single RSP
RSP1
BRKARC-2003
Cisco Public
24
New Fabric Back-compatible with 1st Generation LC
FIA0
8x23G bi-directional
FIA1
fabric
fabric
Dual-FIA 8xNPs
1st gen Linecard
Arbiter
FIA
FIA
FIA
RSP440
FIA
2nd gen Line Card

fabric
Single-FIA 4xNPs
1st gen Linecard
Arbiter
RSP440
BRKARC-2003
Cisco Public
25
Old Fabric Forward-compatible with 2nd Gen LC

FIA0
Original RSP
FIA1
fabric
Dual-FIA 8xNPs
1st gen Linecard
fabric
Arbiter
FIA
FIA
FIA
RSP0
FIA
2nd gen Line Card

fabric
Single-FIA 4xNPs
1st gen Linecard
Arbiter
RSP1
BRKARC-2003
Cisco Public
26
ASR 9922 Fabric Architecture : 5-plane System

fabric
550Gbps/LC or
440Gbps/LC with fabric
redundancy
FIA
FIA
FIA
2nd gen Line Card
RSP 3 Switch
Fabric
FIA
FIA
FIA
fabric
FIA
FIA
FIA
fabric
2nd gen Line Card
7-plane (6+1)
2nd gen Line Card
cards
2ndFabric
stage
faic
2x55G links
110G per fabric plane
BRKARC-2003
Cisco Public
27
ASR 9000 Line Card Architecture Overview

1x10GE
Trident
1x10GE
NP1
PHY
NP2
PHY
NP3
Typhoon
3x10GE
SFP +
NP1
3x10GE
SFP +
NP2
3x10GE
SFP +
NP3
3x10GE
SFP +
NP4
3x10GE
SFP +
NP5
3x10GE
SFP +
NP6
3x10GE
SFP +
NP7
B0
4x23G
FIA0
B1
Trident LC example: A9K-4T
Switch
Fabric
RSP0
CPU
FIA0
FIA1
FIA2
Switch
Fabric ASIC
3x10GE
SFP +
CPU
8x55G
Switch
Fabric
RSP1
9010/9006
FIA3
Typhoon LC example: A9K-24x10G
BRKARC-2003
Cisco Public
28
Hidden slide
Generic LC Architecture (1) Components

Pluggable physical interfaces
PHY
speeds: GE, 10GE, 40GE, 100GE
form factors: SFP, SFP+, XFP, QSFP, CFP
media/reach: T, SR, LR, ZR, LR4, SR10
colors: gray, CWDM, DWDM, Tunable
CPU
forwarding and feature engine for the LC

NP
scales bandwidth via multiple NPs
up to 8 NPs/LC for performance vs. density options

highly integrated silicon as opposed to multiple discrete components
shorter connections, faster communication channels
higher performance, density with lower power draw
simplified software development model
BRKARC-2003
Distributed Control planes

SW switched packets
Inline Netflow
Program HW forwarding tables
interface between forwarding processor and system switch fabric

arbitration, framing, accounting in HW
provides buffering and virtual output queuing for the switch fabric
QoS awareness for Hi/Lo and ucast/mcast
total flexibility regarding relative priority of unicast vs. multicast
Cisco Public
FIA
29
LC Architecture Example 24x10G

CPU
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
3x10GE
SFP +
8x55G
FIA
FIA
NP
Switch
Fabric
RSP0
Switch
Fabric
NP
Each NP:
60Gbps bi-directional
120Gbps uni-directional
2x45Mpps
BRKARC-2003
FIA
LC Switch Fabric
ASIC
3x10GE
SFP +
FIA
RSP1
Each FIA:
60Gbps bi-directional
Cisco Public
30
LC Architecture Example 2x100G

CPU
100G
Ingress
NP
FIA
Egress
NP
FIA
8x55G
100G
100G
100GE
MAC/PHY
100G
Ingress
NP
LC Switch Fabric
ASIC
100GE
MAC/PHY
FIA
Egress
NP
Switch
Fabric
RSP0
Switch
Fabric
FIA
RSP1
MUX
FPGA
BRKARC-2003
Cisco Public
31
NP Architecture Details
-L/-B and -E, -TR and -SE
has different memory size
-L/-B and -E, -TR and -SE

has same memory size
FIB
STATS MEMORY
MAC
LOOKUP
MEMORY
Forwarding chip (micro cpu)
FRAME MEMORY
TCAM
TCAM: VLAN tag, QoS and ACL classification
Stats memory: interface statistics, forwarding statistics etc
Frame memory: buffer, Queues
Lookup Memory: forwarding tables, FIB, MAC, ADJ
-TR/-SE, -L/-B/-E
NP complex
Different TCAM/frame/stats memory size for different per-LC QoS, ACL, logical
interface scale
Same lookup memory for same system wide scale mixing different variation of
LCs doesnt impact system wide scale
BRKARC-2003
Cisco Public
32
ASR 9001 Architecture Overview
ASR 9001 System Architecture Overview
Same architecture as big chassis
FIA
NP
SFP+ 10GE
On-board
4x10 SFP+
ports
SFP+ 10GE
Internal
EOBC
SFP+ 10GE
LC
CPU
RP
CPU
SFP+ 10GE
MPAs
2,4x10GE
20xGE
1x40GE
BRKARC-2003
NP
Switch Fabric ASIC
MPAs
2,4x10GE
20xGE
1x40GE
FIA
Cisco Public
33
Agenda
Hardware Overview
Fabric architecture
Internal system Qos
BRKARC-2003
Cisco Public
34
IOS-XR 2-Stage Forwarding Overview

For high system scale
1st Stage: Ingress LC look up
2nd Stage: Egress LC look up
3x10GE
SFP +
3x10GE
SFP +
NP
3x10GE
SFP +
NP
FIA
Ingress
NP
100G
100GE
MAC/PHY
NP
3x10GE
SFP +
NP
FIA
3x10GE
SFP +
NP
3x10GE
SFP +
Switch
Fabric
Switch Fabric
ASIC
NP
FIA
Switch Fabric
ASIC
3x10GE
SFP +
3x10GE
SFP +
FIA
FIA
Egress
2
NP
FIA
Ingress
NP
100G
100G
100GE
MAC/PHY
NP
1Typhoon
2
FIA
Switch
Fabric
FIA
Egress
NP
100G
Uniform packet flow for simplicity and predictable performance

BRKARC-2003
Cisco Public
35
ASR 9000 Fully Distributed Control Plane

LPTS (local packet transport service):
control plane policing
RP
EOBC (1G internal switch)
CPU
LC2
CPU
BRKARC-2003
Switch Fabric
FIA
Switch Fabric
Typhoon
LPTS
FIA
NP
NP
NP
FIA
NP
FIA
NP
Switch Fabric
ASIC
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
LC1
Punt
FPGA
RP CPU: Routing, MPLS, Multicast,

HSRP/VRRP, etc
LC CPU: ARP, ICMP, BFD, Netflow,
OAM, etc
NP
FIA
NP
Cisco Public
36
L3 Control Plane Overview

LDP
RSVP-TE
Static
LSD
BGP
OSPF
ISIS
EIGRP
RP CPU
RIB
RP
Selective VRF download

Over internal EOBC
LC
ARP
FIB
SW FIB
Adjacency
AIB
LC NPU
LC CPU
BRKARC-2003
AIB: Adjacency Information Base

RIB: Routing Information Base
FIB: Forwarding Information Base
LSD: Label Switch Database
Cisco Public
37
L3 Forwarding Hierarchical Data Structure

for prefix independent fast convergence: BGP, TE/FRR, LAG
VRF table
PIC: Prefix independent convergence

LAG: Link aggregation group
LDI: Load information
Search Tree
OutI/F
adj
Leaf Table (FIB
table)
LDI/ADJ table
BRKARC-2003
Recursive
Prefix Leaf
Table
Recursive
LDI
LAG
NR Prefix
Leaf Table
OutI/F
adj
Protected
TE adj
NR LDI 0
NR LDI 1
NR LDI N
Backup
TE adj
Cisco Public
LAG
OutI/F
OutI/F
38
Hardware based MAC

learning: ~4Mpps/NP
MAC Learning and Sync

1 NP learn MAC address in hardware (around
4M pps)
RP
2 NP flood MAC notification (data plane)
message to all other NPs in the system to

sync up the MAC address system-wide. MAC
notification and MAC sync are all done in
hardware
Punt
FPGA
CPU
FIA
Switch Fabric
CPU
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
3x10GE
SFP +
BRKARC-2003
CPU
FIA
NP
NP
FIA
NP
NP
FIA
NP
NP
FIA
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
LC2
FIA
2
FIA
FIA
Switch
Fabric ASIC
3x10GE
SFP +
LC1
Switch
Fabric ASIC
3x10GE
SFP +
1NP
Switch Fabric
FIA
Cisco Public
39
Agenda
Hardware Overview
Fabric architecture
Internal system Qos
BRKARC-2003
Cisco Public
40
Internal Multicast Replication Overview

1
Fabric to LC Replication
LC fabric to FIA Replication
FIA to NP Replication
NP to egress port Replication
MFIB
Typhoo
4n
3x10GE
SFP +
NP
4
3x10GE
SFP +
NP
NP
3x10GE
SFP +
NP
MFIB Multicast Forwarding Information Base
MGID
FIA
FIA
FIA
MGID/
FPOE
FIA
3x10GE
SFP +
NP
3x10GE
SFP +
NP
3x10GE
SFP +
NP
FGID/
FPOE
1
Switch
Fabric
MFIB
FIA
Egress
4
NP
FIA
Ingress
NP
MGID
100GE
MAC/PHY
FIA
Switch
Fabric
FIA
Uniform packet flow

for simplicity and predictable performance
Cisco Public
BRKARC-2003
Ingress
NP
100GE
MAC/PHY
MGID/
FPOE
Switch Fabric
ASIC
3x10GE
SFP +
Efficiency: replicate if required

Line rate: for fully loaded chassis
Simple and clean architecture
Predictable performance
MGID Multicast Group ID
Switch Fabric
ASIC
3x10GE
SFP +
FGID Fabric Group ID
Egress
NP
41
Internal System QoS Overview

End-to-End priority (P1,P2, 2xBest-effort) propagation
Unicast VOQ and back pressure
Unicast and Multicast separation
Ingress side of LC
Egress side of LC
CPU
CPU
3
PHY
NP
PHY
NP1
1
Ingress Port
QoS
FIA
FIA
NP
PHY
PHY
Switch
Fabric
4 VOQ per each virtual port

in the entire system
Up to 4K VOQs per FIA
BRKARC-2003
NP
4 Egress Queues per each

virtual port, aggregated
rate per NP
Cisco Public
Egress Port
QoS
42
Agenda
Hardware Overview
Fabric architecture
Internal system Qos
BRKARC-2003
Cisco Public
43
ASR 9000 nV Technology Overview

SP Services/
Content
Before: nV Technology
Third-Party
Services/ Content
After: nV Technology
Cisco
Prime IP NGN
Individual device to
manage
Core
Edge
Complex network
protocols
Feature inconsistent,
inter-operability
nV Edge
Residentia
l
Business
Converged
Aggregation
nV
No network protocols
within virtual system,
Remote satellite is
plug-n-play, zero touch
nV Satellite
Single feature set, one

release cycle
Access
Physical port limit
BRKARC-2003
One virtual system to

manage
Scale to 10 of 1000s
physical ports
Cisco Public
44
ASR 9000 nV Satellite Overview

Plug-n-play, zero touch satellite access device
ASR9K local port
Satellite Protocol
Satellite access port
Satellite
nv fabric links
One ASR 9000 nV System
Host
Satellite and ASR 9000 Host run satellite protocol for auto-discovery, provisioning and
management
Satellite and Host could co-locate or in different location. There is no distance limit between
satellite and Host
The connection between satellite and host is called nv fabric link, which could be L1 or over L2
virtual circuit (future)
Satellite access port has the same feature parity as ASR9K local port,
it works/feels just as local port
BRKARC-2003
Cisco Public
45
Satellite Hardware: ASR 9000v Overview

Field Replaceable Fan Tray
Power Feeds
Redundant -48vDC
Power Feeds
1 RU ANSI & ETSI

Compliant
Redundant Fans
ToD/PSS Output
Single AC power feed
Bits Out
44x10/100/1000 Mbps
Pluggables
4x10G SFP+
Full Line Rate Packet Processing

and Traffic Management
Initially used as Fabric Ports ONLY

(could be used as access port in the
future)
Copper and fiber SFP optics
Copper and fiber SFP+ optics
Speed/duplex auto negotiation
Max Power 210 Watts

Nominal Power 159 Watts
Industrial Temp Rated

-40C to +65C Operational Temperature
-40C to +70C Storage Temperature

BRKARC-2003
Cisco Public
46
Satellite Operation Initial Configuration

Satellite Protocol
Satellite 101
nv fabric links
Host
nv
satellite 101 define satellite
type asr9000v
ipv4 address 10.0.0.101
interface TenGigE 0/2/0/2 configure satellite fabric port
ipv4 point-to-point
ipv4 unnumbered Loopback100
nv
satellite-fabric-link satellite 101
remote-ports satellite to fabric port mapping
GigabitEthernet 0/0/0-9
BRKARC-2003
Cisco Public
47
CLI example Configure Satellite Access Port

Satellite Protocol
Satellite
nv fabric links
Host
Satellite access port
configuration examples
Local port
configuration examples
interface GigabitEthernet 101/0/0/1

ipv4 address 1.2.2.2 255.255.255.0

ipv4 address 2.2.2.2 255.255.255.0
interface TenGig 101/0/0/1.1

encapsulation dot1q 101
rewrite ingress tag pop 1 sym
interface TenGig 0/0/0/1.1

encapsulation dot1q 101
rewrite ingress tag pop 1 sym
interface Bundle-ethernet 200

ipv4 address 1.1.1.1 255.255.255.0
interface Bundle-ethernet 100

ipv4 address 1.1.1.1 255.255.255.0

bundle-id 200

bundle-id 100
BRKARC-2003
Cisco Public
48
Satellite Host Control Plane

Satellite discovery and control protocol
CPU
MAC-DA
MAC-SA
Control VID
CPU
Payload/FCS
Satellite ASR 9000v

ASR 9000 Host
Discovery Phase
A CDP-like link-level protocol that discovers satellites and maintains a periodic heartbeat
Heartbeat sent once every second, used to detect satellite or fabric link failures. CFM based fast
failure detection plan for future release
Control Phase
Used for Inter-Process Communication between Host and Satellite
Cisco proprietary protocol over TCP socket for the time being. It could move to standard in the future
Get/ Set style messages to provision the satellites and also to retrieve notifications from the satellite
Standardization is considered for future

BRKARC-2003
Cisco Public
49
Satellite Host Data Plane Encapsulation

MAC-DA
MAC-SA
VLANs (OPT)
Payload
MAC-DA
MAC-DA
MAC-SA
nV-tag
VLANs (OPT)
MAC-SA
VLANs (OPT)
Payload
Payload/FCS
Satellite ASR 9000v

On Satellite
ASR 9000 Host
Satellite receive Ethernet frame on its access port

Satellite add special nV-tag, then local xconnect packet to its fabric port
Put packet into fabric port egress queue, transmit packet out
BRKARC-2003
On Host
Host receive the packet on its satellite fabric port
Check the nV tag, then map the frame to the corresponding satellite virtual
access port
From there, process packet just as local port, apply potential L2/L3 features,
qos, ACL, etc
Packet is forwarded out of local port, or satellite fabric port to same or
different satellite
Cisco Public
50
Satellite Operation Management

Normal operation, like show CLIs are done on the Host
directly, for example
Satellite inventory reporting, environmental monitoring
Interface counts, stats
SNMP MIB
NMS support, including ACT, ANA/ PRIME
Low level debug could still be done directly on the satellite

device
User can telnet into satellite via out-of-band management console,
or in-band from Host, and run regular show/debug CLIs
BRKARC-2003
Cisco Public
51
Satellite Operation Image Upgrade

RP/0/RSP0/CPU0:R1#sh install active
Node 0/RSP0/CPU0 [RP] [SDR: Owner]
Boot Device: disk0:
Boot Image: /disk0/asr9k-os-mbi-4.2.1.22K.CSCtz10483-0.0.4.i/0x100305/mbiasr9k-rsp3.vm
Active Packages:
disk0:asr9k-px-4.2.1.22K.CSCtz10483-0.0.4.i
disk0:asr9k-satellite-px-4.2.1.22K satellite image PIE
disk0:asr9k-mini-px-4.2.1.22K
disk0:asr9k-mpls-px-4.2.1.22K
disk0:asr9k-mcast-px-4.2.1.22K
disk0:asr9k-fpd-px-4.2.1.22K
RP/0/RSP0/CPU0:R1#install nv satellite ?
<100-65534> Satellite ID
all
All active satellites
Golden satellite image is

always there in satellite flash
card for image fall back
RP/0/RSP0/CPU0:R1#install nv satellite 100 ?

activate Install a new image on the satellite, transferring first if necessary
transfer Transfer a new image to the satellite, do not install yet
RP/0/RSP0/CPU0:R1#install nv satellite 100 active
BRKARC-2003
Cisco Public
52
Satellite Operation Rack, Plug and Go

Initial satellite
configuration (on
ASR9K Host
Rack & Plug
Go
A. Critical Error LED ON bad hardware, RMA

B. Major Error LED ON Unable to connect to ASR9K host
Missing the initial satellite configuration?
L1 issue, at least one of the uplink port light green?
Security check (optional), is the satellite SN# correct?
Status light green ready to go, satellite is fully managed by Host
BRKARC-2003
Cisco Public
53
Supported Topologies in initial release

Satellite
Single home, static pinning
Satellite
Single home, fabric link bundle
Hidden slide
ASR 9000 Edge
Satellite
Dual home to nV edge, static pinning

ASR 9000 Edge
Satellite
Dual home to nV Edge with fabric link bundle
Satellite must have direct Ethernet over Fiber/copper or Ethernet over Optical transport system
(such as Ethernet over a SONET/ SDH/ CWDM/ DWDM network: ring, mesh topology, etc)
BRKARC-2003
Cisco Public
54
ASR 9000 nV Edge Overview

Simple Network Dual-homing Resiliency & Extensiable Node Capacity
Fabric
chassis
Leverage existing IOS-XR

CRS multi-chassis SW
infrastructure
Simplified/Enhanced for ASR
9000 nV Edge
CRS Multi-Chassis
ASR 9000 nV Edge
Single control plane, single management plane, fully distributed data

plane across two physical chassis one virtual nV system
BRKARC-2003
Cisco Public
55
nV Edge Architecture Overview

RSP440 nV EOBC ports for
control plane connection
One Virtual ASR 9000 nV System

Control Plane EOBC Extension
0
Secondary
RSP
Active
RSP
LC
LC
LC
LC
1
Standby
RSP
LC
Inter-chassis data link (L1 connection)

10G bundle (up to 16 ports)
LC
Secondary
RSP
LC
Internal
EOBC
LC
Regular 10G data ports
Control plane connection: Active RSP and standby RSP are on the different chassis, they
communicate via external EOBC links
Data plane connection: bundle regular data links into special nV fabric link to simulate
switch fabric function between two physical chassis for data packet
Flexible co-located or different location deployment (upto 10msec latency)
BRKARC-2003
Cisco Public
56
nV Edge Configuration
1
Configure nv Edge globally

nv
edge-system
serial FOX1437GC1R rack 1
serial FOX1439G63M rack 0
static mapping of chassis serial# and rack#
Configure the inter-chassis fabric(data plane) links

interface TenGigE1/2/0/0
nv edge interface
interface TenGigE0/2/0/0
nv edge interface
NO need to configure the inter-chassis control plane EOBC ports. Its plug-and-play
After this configuration, rack 1 will reload and then join cluster after it boot up
Now you successfully convert two standalone ASR 9000 into one ASR 9000 nV Edge
As simple as this !!!
BRKARC-2003
Cisco Public
57
Hidden slide
Sample Show CLIs

RP/0/RSP0/CPU0:ASR4-Rack0(admin)#show dsc
Thu Apr 12 03:01:12.225 UTC
--------------------------------------------------------Node ( Seq#) Role
Serial# State
--------------------------------------------------------0/RSP0/CPU0 (
0) ACTIVE FOX1545GRM1 PRIMARY-DSC
0/RSP1/CPU0 ( 31785) STANDBY FOX1545GRM1 NON-DSC
1/RSP0/CPU0 ( 31763) STANDBY FOX1325G77H NON-DSC
1/RSP1/CPU0 ( 32001) ACTIVE FOX1325G77H BACKUP-DSC
RP/0/RSP0/CPU0:ASR4-Rack0#show platform
Thu Apr 12 03:00:32.799 UTC
Node
Type
State
Config State
----------------------------------------------------------------------------0/RSP0/CPU0 A9K-RSP440-SE(Active) IOS XR RUN
PWR,NSHUT,NMON
0/RSP1/CPU0 A9K-RSP440-SE(Standby) IOS XR RUN
PWR,NSHUT,NMON
0/0/CPU0
A9K-2x100GE-TR
IOS XR RUN
PWR,NSHUT,MON
0/1/CPU0
A9K-MOD160-TR
IOS XR RUN
PWR,NSHUT,NMON
0/1/0
A9K-MPA-2X40GE
DISABLED
PWR,SHUT,MON
0/1/1
A9K-MPA-20X1GE
OK
PWR,NSHUT,MON
0/3/CPU0
A9K-SIP-700
IOS XR RUN
PWR,NSHUT,MON
0/3/0
SPA-8XOC12-POS
OK
PWR,NSHUT,MON
0/3/1
SPA-2XCHOC12/DS0
OK
PWR,NSHUT,MON
0/3/2
SPA-2XOC48POS/RPR
OK
PWR,NSHUT,MON
1/RSP0/CPU0 A9K-RSP440-SE(Standby) IOS XR RUN
PWR,NSHUT,MON
1/RSP1/CPU0 A9K-RSP440-SE(Active) IOS XR RUN
PWR,NSHUT,MON
1/1/CPU0
A9K-MOD160-SE
IOS XR RUN
PWR,NSHUT,MON
1/1/0
A9K-MPA-2X10GE
OK
PWR,NSHUT,MON
1/1/1
A9K-MPA-20X1GE
OK
PWR,NSHUT,MON
1/3/CPU0
A9K-24x10GE-TR
IOS XR RUN
PWR,NSHUT,MON
1/4/CPU0
A9K-24x10GE-SE
IOS XR RUN
PWR,NSHUT,MON
BRKARC-2003
Interfaces on one virtual system

<interface on chassis 0>
GigabitEthernet0/1/1/0
<snip>
unassigned
unassigned
Up
Shutdown
<interface on the satellite 100>

unassigned
unassigned
<snip>
Up
Up
<interface on the chassis 1>

unassigned
GigabitEthernet1/1/1/0.1
unassigned
<snip>
Up
Down
Cisco Public
Up
Down
Up
Up
Up
Down
58
Summary
Cisco ASR 9000: Next-gen SP+DC Edge Routing
Carrier Class
Scalable
System Architecture
Full HW portfolio: chassis, LC, port
IOS-XR true modular OS

Superior Multicast replication
nV expand the system capacity and

physical ports
Fully distributed IOS-XR control plane
Advanced internal system QoS

IOS-XR 2-stage forwarding
And more
HW MAC learning, prefix independent
fast convergence, and more
59
BRKARC-2003
Cisco Public
59
Complete Your Online

Session Evaluation
Give us your feedback and you
could win fabulous prizes.
Winners announced daily.
Receive 20 Passport points for each
session evaluation you complete.
Complete your session evaluation
online now (open a browser through
our wireless network to access our Dont forget to activate your
Cisco Live Virtual account for access to
portal) or visit one of the Internet
all session material, communities, and
stations throughout the Convention
on-demand and live activities throughout
Center.
the year. Activate your account at the
Cisco booth in the World of Solutions or visit
www.ciscolive.com.
BRKARC-2003
Cisco Public
60
60
Final Thoughts
Get hands-on experience with the Walk-in Labs located in World of
Solutions, booth 1042
Come see demos of many key solutions and products in the main Cisco
booth 2924
Visit www.ciscoLive365.com after the event for updated PDFs, ondemand session videos, networking, and more!
Follow Cisco Live! using social media:
Facebook: https://www.facebook.com/ciscoliveus
Twitter: https://twitter.com/#!/CiscoLive
LinkedIn Group: http://linkd.in/CiscoLI
BRKARC-2003
Cisco Public
61
61

ASR 9000 Architecture

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

ASR 9000 Architecture

Uploaded by

Copyright:

Available Formats

Cisco ASR 9000 Architecture Overview

Not cover the baseline configuration of ASR 9000

Not cover any specific technology other than system architecture

2012 Cisco and/or its affiliates. All rights reserved.

Deployment challenges with Interconnecting Data Centers - BRKDCT-3060 (Data center

2012 Cisco and/or its affiliates. All rights reserved.

2012 Cisco and/or its affiliates. All rights reserved.

Cisco ASR 9000 Next-Gen Edge Routing Platform

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9000 Chassis Overview

ASR 9001 (Ironman)

ASR 9922 (Megatron)

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9010 and ASR 9006 Chassis

System fan trays

V1 power shelf: 3 Modular V1 PS

ASR 9001 Iron Man Chassis

Sub-slot 1 with MPA

Supported MPA (Media Port Adaptor): 20xGE, 2/4x10GE, 1x40GE

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9922 Megatron Chassis

Height : 44 RU (AC & DC)

2012 Cisco and/or its affiliates. All rights reserved.

Power and Cooling

Fans unique to chassis

Single power zone

New ASR 9000 Power Infrastructure: V2

Each V2 power shelf can hold 4 V2 power supply, existing

2012 Cisco and/or its affiliates. All rights reserved.

3kW AC Power Module Version 2

2kW DC Power Module Version 2

ASR 9000 AC Power Entry Module

ASR 9000 DC Power Entry Module

ASR 9006 AC Chassis with support

ASR 9006 DC Chassis with support

ASR 9010 AC Chassis with support

ASR 9010 DC Chassis with support

ASR 9006/9010 RSP (Route/Switch Processors )

Intel x86 Jasper Forest

4 Core 2.27 GHz

Yes, 2 x 1G/10G SFP+

(with dual RSP)

(with dual RSP)

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9922 RP is based

RSP440 Front Ports

IEEE 1588, GPS

SyncE, IEEE1588 master and slave

2012 Cisco and/or its affiliates. All rights reserved.

RSP Engine Architecture

Internal communication between RPs and Line Cards

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9000 Ethernet Line Card Overview

2012 Cisco and/or its affiliates. All rights reserved.

New HW PID and Shipping Release

4.2.2 release target for August/2012

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9000 Optical Interface Support

Modular optics used everywhere

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9000 40/100GE Optics Roadmap

ASR9k 40GE: QSFP form factor

2012 Cisco and/or its affiliates. All rights reserved.

ASR 9000 SIP-700 and SPA