LI/VN BT NGY PHT NGI

TT NGY NG TESTCASE THC HIN

THNG HIN PHT HIN

02 links SRT01 - AGG01,

1 Multicast i truyn hnh 7/12/2016 7/12/2016 Minhnh24 AGG01 - AGG02 fails (Multi
DOWNLINKs of AGG01)

Multicast DTH (Source ti

2 cc TH ti SRT ly 7/11/2016 7/11/2016 Minhnh24 Link SRT03 - SRT02 fails
ngun v PETH)
 Multicast BTV (Source ti 02 links CT01 -CT02,CT01 -
3 PETH --> STB khch 7/13/2016 7/13/2016 Minhnh24 CKV01 fails (Multi UPLINKs
hng trn SRT) of CT01)

02 links CT02 -CT01,CT02 -

4 VOD 7/14/2016 Minhnh24 CKV02 fails (Multi UPLINKs
of CT02)
5 Multicast (BTV + DTH) 7/14/2016 7/14/2016 Minhnh24 Node SRT03 fails

6 Tt c cc dch v 7/14/2016 Minhnh24 Node AGG1 fails

Scrip shutdown downlink 02 links AGG01 -

7 xung Ring SRT khi 7/13/2016 7/13/2016 Minhnh24 AGG02,AGG01 - CT01 fails
multiuplink AGG down (Multi UPLINKs of AGG01)
8 Tt c cc dch v 7/16/2016 Minhnh24 Node CT1 fails

9 Dch v BTV 7/18/2016 Minhnh24 Node AGG2 fails

10 Dch v 4G 7/19/2016 Minhnh24 Multi uplink AGG1 fail
 RNC switch traffic , i v
11 Dch v 4G, 3G 7/19/2016 Minhlv7
khc ng

12 Dch v 3G,4G 7/22/2016 7/22/2016 Minhnh24 UP Multiup link PEDD1

13
14
15
16
17
18
19
20
TESTCASE THC
HIN VI I TC

JUNIPER

JUNIPER
JUNIPER

JUNIPER
JUNIPER

JUNIPER

JUNIPER
JUNIPER

JUNIPER
JUNIPER
JUNIPER

JUNIPER
 HIN TRNG MNG KHI PHT HIN RA LI

- OSPF cost pha SRT auto theo link 10G: 10.

- OSPF cost bt cp AGG manua: 5.
- Multicast source nm SRT 4, PE thit lp PIM join.
- Multicast source c qung b thng qua BGP (khng s dng OSPF, OSPF ch
qung b a ch IP loopback).
- SRT 4 qung bo tt vi LP 2000 cho AGG2, qung b xu vi LP 1000 cho AGG1.
- Bnh thng: PIM join theo hng: CT2-AGG2-AGG1-SRT1-SRT2-SRT3-SRT4.

- OSPF cost pha SRT auto theo link 10G: 10.

- OSPF cost bt cp AGG manua: 5.
- Multicast source nm SRT 4, PE thit lp PIM join.
- Multicast source c qung b thng qua BGP (khng s dng OSPF, OSPF ch
qung b a ch IP loopback).
- SRT 4 qung bo tt vi LP 2000 cho AGG2, qung b xu vi LP 1000 cho AGG1.
- Ngun nhn lung Multicast ti PEDD2 (ni my o) . PEDD2 nhn 2 route source
multicast do 2 RR qung b , vi 2 next hop ln lt l AGG1 v AGG2, vi u tin
hn ti AGG2.
- PEDD2 xy dng cy multicast PIM JOIN ln SRT4 : PEDD2- CKV2-CT2-AGG2-
AGG1-SRT1-SRT4. Chiu lu lng multicast v theo hng ngc li.
- Multicast rource ti PEDD2, SRT4 thit lp pim join
- Route BTV c qung b qua BGP , SRT nhn c 2 route t 2 AGG vi next-
hop tng ng. u tin hn ti AGG2, SRT4 s chn next-hop ca n n AGG2.
SRT4 s gi pim join theo hng SRT4-SRT3-AGG1. Ti AGG1 nhn c 2 route
BTV vi next-hop tng ng l CT1 v CT2 vi u tin hn n CT2. AGG1 pim join
ln CT1 , CT1 pim join ln CKV1 --> PEDD1 --> PEDD2. Chiu lu lng multicast
v theo hng ngc li.

- Route VOD server ti PEDD2, STB khch hng ti SRT, dch v t PEDD2 v
SRT4.
- Cc route VOD v STB c qung b thng qua giao thc BGP , vi u tin lu
lng theo mt di. Lu lng chiu ln : SRT4 -> SRT1 --> AGG1 --> AGG2 -->
CT2 --> CKV2 --> PEDD2. Lu lng chiu v : PEDD2 --> CKV2 --> CT2 --> AGG2
--> AGG1 --> SRT1 --> SRT4
- OSPF cost pha SRT auto theo link 10G: 10.
- OSPF cost bt cp AGG manua: 5.
- Multicast source DTH nm SRT 4, PE thit lp PIM join.
- Multicast source c qung b thng qua BGP (khng s dng OSPF, OSPF ch
qung b a ch IP loopback).
- SRT 4 qung bo tt vi LP 2000 cho AGG2, qung b xu vi LP 1000 cho AGG1.
- Ngun nhn lung Multicast ti PEDD2 (ni my o) . PEDD2 nhn 2 route source
multicast do 2 RR qung b , vi 2 next hop ln lt l AGG1 v AGG2, vi u tin
hn ti AGG2.
- PEDD2 xy dng cy multicast PIM JOIN ln SRT4 : PEDD2- CKV2-CT2-AGG2-
AGG1-SRT1-SRT4. Chiu lu lng multicast v theo hng ngc li.

- Multicast rource BTV ti PEDD2, SRT4 thit lp pim join

- Route BTV c qung b qua BGP , SRT nhn c 2 route t 2 AGG vi next-
hop tng ng. u tin hn ti AGG2, SRT4 s chn next-hop ca n n AGG2.
SRT4 s gi pim join theo hng SRT4-SRT3-AGG1. Ti AGG1 nhn c 2 route
BTV vi next-hop tng ng l CT1 v CT2 vi u tin hn n CT2. AGG1 pim join
ln CT1 , CT1 pim join ln CKV1 --> PEDD1 --> PEDD2. Chiu lu lng multicast
v theo hng ngc li.

Dch v chy bnh thng

Script chy bnh thng khi down 2 uplink ca AGG1

Dch v chy bnh thng

- Multicast rource ti PEDD2, SRT4 thit lp pim join

- Route BTV c qung b qua BGP , SRT nhn c 2 route t 2 AGG vi next-
hop tng ng. u tin hn ti AGG2, SRT4 s chn next-hop ca n n AGG2.
SRT4 s gi pim join theo hng SRT4-SRT3-AGG1. Ti AGG1 nhn c 2 route
BTV vi next-hop tng ng l CT1 v CT2 vi u tin hn n CT2. AGG1 pim join
ln CT1 , CT1 pim join ln CKV1 --> PEDD1 --> PEDD2. Chiu lu lng multicast
v theo hng ngc li.
- AGG1 v AGG2 cng qung b defaul route xung SRT , nhng SRT chn AGG1
u tin hn.
- RNC cm tam gic v 2 PEDD, trn PEDD cu hnh VRRP, vi master v PEDD1.
- Traffic RNC tr v PEDD1,
- PEDD1 v PEDD2 cng qung b route RNC xung SRT qua BGP.
- SRT chn next-hop l PEDD1, lu lng ln v hng PEDD1
- TRn PEDD1 v PEDD2 cu hnh route static v RNC.

-Thc hin qung b a ch IP Node B v RNC qua BGP, vi lu lng chiu ln :

SRT4 --> SRT1 --> AGG1 --> CT1 --> CKV1 --> PEDD1 .
- Trn PEDD1 v PEDD2 cu hnh VRRP, vi VRRP master ti PEDD1, v VRRP
backup ti PEDD2. Thc hin track VRRP trn multiuplink ca PEDD1, khi vn cn 1
link up , quyn VRRP master khng i, khi mt ht cc uplink, quyn VRRP master
b mt. Time nh k gi VRRP hello = 100ms, Time preempt hold time chuyn li
t backup ln master l 60s.
- Khi thc hin down multiuplink ca PEDD1 , lu lng chuyn : SRT4 -->SRT1 -->
AGG1 --> CT1 --> CT2 --> CKV2 --> PEDD2.
 M T HIN TNG

- Khi xy ra t multilink (AGG1-SRT1, AGG1-AGG2), PIM join i theo hng:

CT2-AGG2-SRT10--SRT4 (Multicast traffic OK).
- Khi multilink (AGG1-SRT1, AGG1-AGG2) up tr li (up ng thi), OSPF hi
t trc, BPG hi t chm hn Dn n PIM join t AGG2-SRT10 chuyn
sang hng AGG2-AGG1 (do cost OSPF nh hn), nhng ti thi im ny
BGP ti AGG1 cha hi t (cha c multicast route ca SRT4) nn PIM join n
y khng c lu lng -> Mt gi, ty tng thi im, trong thi gian 3s, hoc
12s (test trong lab).

- Khi down link gia Ring SRT , dch v Multicast DTH c time hi t = 4s
- Khi down multilink CT1-CT2, CT1-CKV1 , dch v BTV c time hi t 8s

- Khi down multilink CT2-CT1 , CT2-CKV2 , dch v VOD c time hi t 8s

- Khi node SRT3 fail , dch v Multicact hi t lu : 8s

- Khi node AGG1 fail , reboot or off 2 RE ng thi th time hi t tt c cc dch

v lu : 8s. Trong cc trng hp khc, off tng RE , reboot tng RE , hay off
ngun cng thit b th khng b.

Khi dng mode configure exclusive thc hin shutdown 2 uplink ca AGG1, th
script s khng chy c.
- Khi node CT1 fail , reboot or off 2 RE ng thi th time hi t tt c cc dch
v lu : 8s. Trong cc trng hp khc, off tng RE , reboot tng RE , hay off
ngun cng thit b th khng b.

- Khi AGG2 up tr li , sau khi tt ngun , dch v BTV b thi gian hi t = 30s
- Khi Multi uplink ca AGG1 fail, dch v 4G mt.
- V 1 trng hp no , trn RNC b li , interface vn up, nhng giao din
trn RNC mt. Route static trn PEDD1 vn up. Dch v mt dch v.

- Khi thc hin UP tr li multi uplink PEDD1, dch v 3G, 4G mt time hi t =

15s
 NGUY C LP LI LI TNG
PHM VI NH HNG
T TRN MNG LI

- Thc t xy ra mt multilink do Tt c cc vendor u b tng t

cp th him. nh Juniper (Cisco, Huawei) i vi
- Do li card d , v Uplink v bt dch v multicast ly knh t cc i
cp AGG kt ni trn cng 1 card. truyn hnh

- Trong thc t , vic down 1 link

trn vng Ring SRT l xy ra Tt c cc vendor u b tng t
thng xuyn. Do nhiu nguyn nh Juniper (Cisco, Huawei )
nhn.
- Thc t xy ra mt multilink do
cp th him. Tt c cc vendor u b tng t
- Do li card d , v Uplink v bt nh Juniper (Cisco, Huawei)
cp CT kt ni trn cng 1 card.

- Thc t xy ra mt multilink do
cp th him.
Ch c trn vendor Juniper
- Do li card d , v Uplink v bt
cp CT kt ni trn cng 1 card.
- Thc t vic node SRT fail l rt Tt c cc vendor u b tng t
hay sy ra, do nhiu nguyn nhn. nh Juniper (Cisco, Huawei)

- Thc t vic down node AGG Tt c cc vendor u b tng t

trong thc t l t khi xy ra. nh Juniper (Cisco, Huawei)

Thc t t khi gp trng hp ny Vendor Juniper

- Thc t vic down node CT1 trong Tt c cc vendor u b tng t
thc t l t khi xy ra. nh Juniper (Cisco, Huawei)

- Thc t vic mt ngun AGG

Tt c cc vendor u b tng t
trong thc t khng xy ra thng
nh Juniper (Cisco, Huawei)
xuyn
Thc t mt 2 uplink AGG l Tt c cc vendor u b tng t
thng gp. nh Juniper (Cisco, Huawei)
Thc t vic RNC li l rt him Tt c cc vendor u b tng t
gp. nh Juniper (Cisco, Huawei)

Thc t vic mt multiuplink ng Tt c cc vendor u b tng t

thi ca RNC l rt him gp nh Juniper (Cisco, Huawei)
LUNG DCH V
 NGUYN NHN

- Khi multilink (AGG1-SRT1, AGG1-AGG2) up tr li (up ng thi), OSPF

hi t trc, BPG hi t chm hn Dn n PIM join t AGG2-SRT10
chuyn sang hng AGG2-AGG1 (do cost OSPF nh hn), nhng ti thi
im ny BGP ti AGG1 cha hi t (cha c multica

- Khi down link SRT3-SRT2 , PEDD2 khng bit ngay, n vn gi pim join ra
hng c, hng pim join vn bnh thng trn ng i sau : PEDD2-
CKV2- CT2- AGG2-AGG1 . Khi n AGG1 , n thy route DTH do SRT4
qung b , n s tm ng n SRT4 gi pim join. Do ang cu hnh
qung b BGP vi local address l IP Loopback Services ca SRT4 , nn
AGG1 thy SRT4 qua LSP AGG1-to-SRT4. N pim join ra SRT1. SRT1 i
tip n SRT2. Ti SRT2 , n bit link down , SRT2 pim join theo hng
ngc li v SRT1. Ti thi im IGP hi t s b loop lu lng ti y. Khi
IGP hi t , nu LSP t AGG1 - SRT4 cha i , th lu lng vn mt. Ch
sau time LSP AGG1- SRT4 i theo ng mi , AGG1 pim join theo hng
ngc li v AGG2 , dch v khi phc li bnh thng !
Tng t nh vi li trong trng hp Link SRT03 - SRT02 fails . Nhng
chiu qung b route ngc li.

Li version 13,3 trong policy Load_balace composite route L3VPN li.

- Vi trng hp BTV , SRT4 pim join sang SRT3 , sau khi up li SRT3
cha thit lp phin BGP vi AGG1 v AGG2, nn cha c route n BTV ,
nn mt gi.

- Nguyn nhn do khi thit b AGG1 fails, khi IGP hi t, mt route AGG1
trong inet,0 , nhng vn cn route trong inet,3 . Nn SRT4 vn next-hop
l n AGG1 , khng i sang AGG2, nn mt gi dch v.

- Nguyn nhn l do ngi dng cu hnh trong mode exclusive , khng cho
script thc hin commit ng thi, nn khng th chy c.
- Nguyn nhn do khi thit b CT1 fails, time hi t IGP trn min OSPF lu.

- Khi AGG2 down, dch v BTV s khng b mt dch v. Trong khong time
IGP cha hi t, SRT4 vn thy next-hop l con AGG2, gi pim join theo
hng SRT4- SRT1 - AGG1. Ti AGG1 s gi hng pim join theo hng
CT1. Sau time IGP hi t, SRT4 s i next-hop sang AGG1 , hng pim
join vn khng i. Dch v khng gin on trong time ny.
- Khi AGG2 up tr li, trong khong time IGP cha hi t, hng pim join
khng i, dch v khng mt. Sau IGP hi t, phin BGP SRT4 vi AGG2
vs AGG2 vi CT2 CT1 vn cha up, dch v vn bnh thng. Sau khi cc
phin BGP hi t li, AGG2 hc li route BTV server , v qung b li xung
SRT4, SRT4 tnh ton li v i next-hop, hng pim join vn khng i.
==> Dch v phi khng b nh hng khi AGG down , hay up.
- Khi Multi uplink ca AGG1 fail, AGG1 mt route RNC_4G , nhng route
aggregate default route vn up , AGG1 vn qung b v SRT vi LP u tin
hn (2000). Nn SRT vn chn next-hop l AGG1, dch v b mt.
- Do route static tr next-hop v interface outgoing, nn khi interface vn up,
route vn active , dch v i ln vn ln PEDD1, dch v b mt.
- Mc ch l xa route static ny trn PEDD1 lu lng ln PEDD2.

- Do khi down multiuplink ca PEDD1, phin BGP gia PEDD1 v RR mt.

Ti thi im ny, PEDD1 s mt route n Node B.
- Khi VRRP thc hin chuyn backup master , th lu lng chiu RNC v
NodeB chuyn v PEDD1, PEDD1 ti thi im ny cha c route n
NodeB , nn dch v b mt gi.
- Dch v ch khi phc tr li khi phin BGP gia RR v PEDD1 thit lp li
v PEDD1 nhn li c route v NodeB.
 PHNG N KHC PHC

Gii php 1: Tng thi gian hold time ca 1 link ln cao

- Khi link up tr li tng thi gian hold time ca link kt ni AGG1-SRT1 ln cao m bo BGP hi t xong (AGG
- Nhc im: Trong cng thi im hold time m xy ra t link t AGG2-SRT10 th ton b SRT b c lp.
Gii php 2: S dng tnh nng LDP-IGP sync
- Bt tnh nng LDP-IGP sync tng OSPF cost trong thi im sau khi multilink up tr li (Juniper thit lp ti a
bo hng AGG2-AGG1-SRT1--SRT4 c cost cao hn so vi AGG2-SRT10--SRT4 -> mc ch PIM join kh
- u im: Trong cng thi im tng OSPF cost ln 65535 ca LDP-IGP sync m xy ra t link t AGG2-SRT10
OSPF cao, link khng down nh gii php 1).
Gii php la chn: S dng nng LDP-IGP sync vi thi gian 60s (p dng cho c 3 vendor).

- Thc hin i li next-hop qung b rource DTH ti SRT v AGG t IP Loopback Service thnh IP Loopback NMS
Do IP Loopback NMS ch qung b trong OSPF, nn sau time hi t LSP s i.
- Thc hin i li next-hop qung b route BTV ti CT v AGG t IP Loopback Service thnh IP Loopback NMS.
Do IP Loopback NMS ch qung b trong OSPF, nn sau time hi t LSP s i.

- Thc hin sa li trn version 13.3 trn thit b MX

- Thc hin cu hnh set overlost bit OSPF cho SRT3 khi khi ng li, SRT3 s hiu tng metric tt c cc link ln

- Thc hin cu hnh BFD cho phin BGP gia SRT vi AGG, sau time xc nh s nh down ngay phin BGP n

- Thc hin chn mode exclusive configure hoc i mode cu hnh script t private .
- Thc hin cu hnh BFD cho phin BGP gia CT vi AGG, sau time xc nh s nh down ngay phin BGP n

- Do trn AGG2 cha cu hnh LDP-IGP sync.

- C th trong trng hp phin BGP gia SRT3, SRT2, SRT1 up trc phin vi SRT4, lc ny, ti SRT4 vn nhn
SRT1 nhn thy next-hop l AGG2, Nhng cu hnh trn AGG1 c keep OSPF metric link sang ngang AGG2 l 65k
gi n SRT3, nhng ti SRT3 s nhn thy ng i n AGG2 i vng xung di (SRT3-SRT4-SRT10-AGG2) ,
khong time ny. n khi phin BGP gia SRT4 vs AGG1 v AGG2 thit lp li , SRT4 thy li ng i tt hn l
li bnh thng .
- Trn AGG cu hnh Policy active aggregate default route VRF 4G , AGG qung b BGP xung cho SRT.
- Juniper c 2 cch active aggregate default route , cch 1 l router static vi next-hop l null0 (discasd), mc nh l
RNC_4G u xa, route default ny vn up, dch v li. Cch 2 : s dng conditribute route , tc l xt iu kin 1 ro
Route xc nh c th x dng prefix or community.
- Gii php hin ti ang x dng xt policy vi community xc nh active aggregate route .
- Thc hin cu hnh SLA (cisco ) , khi PEDD1 mt route n RNC, route static s b xa, lu lng s chuyn sang

- Cch 2 : Thc hin cu hnh li time hold time chuyn trng thi VRRP master trn thit b PEDD2, tng time ny
max= 3600s. Thc hin chy script shutdown link xung RNC khi multi uplink down, v khi up li th s up link n
 KT QU SAU KHC PHC

Time hi t xung 500ms

Time hi t xung 500ms

Time hi t xung 500ms

Time hi t gim xung 500ms

Time hi t gim xung 500ms

Time hi t gim xung 500ms

Script chy bnh thng

Time hi t gim xung 500ms

Khng mt dch v
Time hi t 50ms
 GHI CH

igp-synchronization holddown-interval 60; LDP syn IGP

cac link up down
- Anh ng s gii thch li sau
overload timeout 300; (RPD reboot, all link)

Anh Quang ang check li nguyn nhn

Anh Quang ang check li nguyn nhn
- Thc hin vit script sau
bfd-liveness-detection {
minimum-interval 150;
multiplier 3;
routing-options {
aggregate {
route 0.0.0.0/0 {
policy REQUIRED_ROUTE_PEDD;
discard;
}
}
}
juniper@AGG_960_02_RE0> show configuration policy-options policy-statement
REQUIRED_ROUTE_PEDD
/* Aggregate route 0/0 is only active if there is a least 1 bgp route from PEDD VRF_4G */
term PEDD_4G_ROUTE_EXIT {
from {
protocol bgp;
community VRF_4G_PEDD_ROUTE;
route-filter 10.200.4.0/24 exact;
}
then accept;
}
term FINAL {
then reject;
}

juniper@AGG_960_02_RE0>
 LI/VN BT NGY PHT NGY NGI TESTCASE THC
TT
THNG HIN NG PHT HIN HIN
TESTCASE THC
HIN VI I TC
Huawei
Huawei
Huawei
Huawei
Huawei
Huawei
Huawei
Huawei
Huawei
Huawei
HIN TRNG MNG KHI PHT HIN RA LI
M T HIN TNG
NGUY C LP LI LI TNG
PHM VI NH HNG
T TRN MNG LI
LUNG DCH V
NGUYN NHN
PHNG N KHC PHC
KT QU SAU KHC PHC
GHI CH
 LI/VN BT NGY PHT NGY NGI TESTCASE THC
TT
THNG HIN NG PHT HIN HIN
TESTCASE THC
HIN VI I TC
Cisco
Cisco
Cisco
Cisco
Cisco
Cisco
Cisco
Cisco
Cisco
Cisco
HIN TRNG MNG KHI PHT HIN RA LI
M T HIN TNG
NGUY C LP LI LI TNG
PHM VI NH HNG
T TRN MNG LI
LUNG DCH V
NGUYN NHN
PHNG N KHC PHC
KT QU SAU KHC PHC
GHI CH