You are on page 1of 18

MCEL IP MBH

Network Congestion February


2016
VPN Services Load-Balancing
Network Design
Benoit Roblin
20-04-2016

1 Nokia 2016
VPN Service
Configuration
Load-Balancing

2 Nokia 2016
Network Congestion
Microwave transmission ISSUE:
3 Links with major failures, see next slide.
Treated separately from this presentation , refer to microwave team.

IP/MPLS network:
Under severe Transmission conditions, the network revealed some
flaws, imperceptible under normal conditions or when the network was
less loaded :
No QoS on E// 3G access : Implemented, closed.
Load-balancing over radio channels not correctly implemented
Some design improvements can optimise traffic rerouting

3 Nokia 2016 MCEL IP MBH


10.1.16.117 10.1.16.118
BENFICA LAULANE
1/3/7 .83 10.1.17.82/31 225M .82 1/4/7
.84 <= 290M
MAPUTO OUTER RING .83 10.1.16.82/31 .82
(MW) .84 .81
1/4/7 .101 .81
10.1.17.84/31 1/3/7 1/3/7

10.1.16.84/31
.85 1.3M 1.3M
1/3/7 10.1.16.100/31
PATRICE LUMUMBA .85
10.1.16.116

1/4/7 .100
.86 1/5/7
10.1.16.112 10.1.16.113 10.1.16.80/31
.86 10.1.17.80/31
MAVALANE 10.1.16.94/31 IFT
.96 .95 .94
10.1.17.86/31
1/4/7
10.1.16.86/31
.96 1/3/710.1.17.94/311/4/7 1/3/7 .93
.95 .94 .93
10.1.16.96/31
.97 10.1.17.96/31 10.1.17.92/31 10.1.16.92/31
.196/31 .206/31 .192/31 .202/31
.87
.87 1/3/7 .92 TORRES
ALTO MAE .92 1/4/7
1/3/7 .97 IMMOVISA
10.1.16.114 MAPUTO 10.1.16.111
.98 1/4/7 INNER RING .80
(MW) 1/3/7 .91 1/4/7 .80
.98 .198 .208 .98 .198 .208 1/3/7
10.1.16.98/31 10.1.17.98/31 10.1.17.90/31 10.1.16.90/31 .79
.881/4/7 .198/31 .208/31
PARMALAT .190/31 .208/31
10.1.16.88/31 .99 .199 .209 10.1.16.78/31
.88 .90 .190 .200 EDUARDO MONDLANE
10.1.16.115 .99 2/1/4 .90
2/1/3 10.1.16.119
10.1.17.88/31 .78 .79
.89 .53 10.1.16.52/30 .54 10.1.17.78/31
.89
2/1/5 3/1/1 3/1/1 2/1/4

.78
(MW Link - future)
4 Nokia 2016 MSC1 / TDM HQ MSC2 / MCEL
10.1.16.127 10.1.16.126
210 M sent on blue links
Traffic observation (29th of Feb) 30M sent on red links
10.1.16.117 =>25M LSP to TDM-group2
10.1.16.118
BENFICA LAULANE
Group1 <= 46M
Group2
Group3
Group4
=>48M LSP to TDM
<= 60M
PATRICE LUMUMBA MAPUTO OUTER RING
=>0M
(MW)
<= 0M
LSP to TDM
LSP to MCEL

MAVALANE IFT

=>150 M
<= 114 M
Mw trans
issue not
ALTO MAE
=>33M =>113M fixed yet
<= 9M <= 117M MAPUTO TORRES
INNER RING IMMOVISA
(MW)
PARMALAT
EDUARDO MONDLANE
10.1.16.119
Note on
measurements:
Sequential , link per 10.1.17.89 10.1.17.78
link, during 1minute.
Not premanent value
MSC1 / TDM HQ MSC2 / MCEL

5 Nokia 2016
10.1.16.127
Service Inventory on Outer Ring: Load balancing verification

Reminder:
Microwave Radio Links made of 2 Radio channels (outer ring) or 4 (inner).
Load-balancing: implemented in IP/MPLS routers, with static VPN service L-B at service
creation

Service Inventory: OUTER RING NODES / VPN Services to MCEL and TDM Core sites:
PARMALAT P.LUMUMBA BENFICA LAULANE EDUARDO-MOND.
Nb of Service to MSC1/2 49 49 33 59 26
via Blue Link / Grp1: 48 98% 48 96% 31 94% 53 90% 19 73%
via Red Link / Grp2: 1 2% 1 4% 2 6% 6 10% 7 27%

No Load-balancing at service level (not equal to traffic, however many cpipe using same
bandwidth)
Almost all traffic concentrated on Blue IP link / using one single radio channel out of 2
In case of link failure on the outer ring, there is a high risk of high level of congestion.

6 Nokia 2016 MCEL IP MBH


Service Load balancing Implementation
Service Load-balancing after implementation:
PARMALAT P.LUMUMBA BENFICA LAULANE EDUARDO-MOND.
via Blue Link / Grp1: 50% 50% 50% 27% 54%
via Red Link / Grp2: 50% 50% 50% 63% 46%
50/50 load-balanced on blue and red link by default. For Cpipe and for VPRN.
Laulane case:
one 3rd of traffic could be carried via inner ring. Requires careful upper IP/MPLS design.
Pre-requisites: Microwave Link recovery Carried on blue link of outer ring meanwhile

Example: BENFICA
SvcId SdpId Type Far End Opr S* I.Label E.Label Svc Type CURRENT LSP: LSP/SDP Modification
225 126:225 Spok 10.1.16.126 Up 131031 130760 Cpipe TDM:Group1
333 127:333 Spok 10.1.16.127 Up 130830 130850 Cpipe TDM:Group1
334 1272:334 Spok 10.1.16.127 Up 130831 130829 Cpipe TDM:Group2
335 127:335 Spok 10.1.16.127 Up 130801 130795 Cpipe TDM:Group1 Move to SDP 1262
911 126:911 Spok 10.1.16.126 Up 131028 130757 Cpipe MCEL:Group1 Move to SDP 1262
1025 127:1025 Spok 10.1.16.127 Up 130790 130792 Cpipe TDM:Group1
1026 127:1026 Spok 10.1.16.127 Up 130789 130775 Cpipe TDM:Group1 Move to SDP 1262
1027 127:1027 Spok 10.1.16.127 Up 130787 130752 Cpipe TDM:Group1
1028 127:1028 Spok 10.1.16.127 Up 130786 130747 Cpipe TDM:Group1 Move to SDP 1262
1029 127:1029 Spok 10.1.16.127 Up 130785 130745 Cpipe TDM:Group1
1030 127:1030 Spok 10.1.16.127 Up 130784 130738 Cpipe TDM:Group1 Move to SDP 1262
1031 127:1031 Spok 10.1.16.127 Up 130782 130732 Cpipe TDM:Group1
1032 127:1032 Spok 10.1.16.127 Up 130780 130692 Cpipe TDM:Group1 Move to SDP 1262
1033 127:1033 Spok 10.1.16.127 Up 130777 130685 Cpipe TDM:Group1
1034 127:1034 Spok 10.1.16.127 Up 130775 130656 Cpipe TDM:Group1 Move to SDP 1262
1035 127:1035 Spok 10.1.16.127 Up 130774 130591 Cpipe TDM:Group1
1036 127:1036 Spok 10.1.16.127 Up 130773 130589 Cpipe TDM:Group1 Move to SDP 1262
1037 127:1037 Spok 10.1.16.127 Up 130772 130557 Cpipe TDM:Group1
1039 126:1039 Spok 10.1.16.126 Up 130966 130754 Cpipe MCEL:Group1
2077 127:2077 Spok 10.1.16.127 Up 130771 130527 Cpipe TDM:Group1 Move to SDP 1262
2078 127:2078 Spok 10.1.16.127 Up 130770 130493 Cpipe TDM:Group1
7 Nokia2079
2016 127:2079 Spok 10.1.16.127 Up MCEL IP MBH
130769 130492 Cpipe TDM:Group1 Move to SDP 1262
2126 126:2126 Spok 10.1.16.126 Up 130965 130746 Cpipe MCEL:Group1 Move to SDP 1262
Service Inventory on Inner Ring: Load balancing verification

Service Inventory: INNER RING NODES / VPN Services to MCEL & TDM Core sites:
ALTO MAE MAVALANE IFT TORRES IMMOVISA
Nb of Service to MSC1/2 3 L-B: 16 L-B: 35 L-B: 20 L-B:
via Blue Link / Grp1: 3 100% 13 81% 15 43% 9 45%
via Red Link / Grp2: 0 0% 0 0% 4 11% 2 10%
via Green Link / Grp3: 0 0% 2 13% 9 26% 2 10%
via Orange Link / Grp4: 0 0% 1 6% 7 20% 7 35%

Load-balancing partially implemented


Blue and Red links are reserved between MSC1 and Laulane for Outer ring traffic (inter-
rings traffic + outer ring traffic rerouted).

ALTO MAE MAVALANE IFT TORRES IMMOVISA


via Blue Link / Grp1: 0% 0% 17% 15%
via Red Link / Grp2: 0% 0% 17% 15%
via Green Link / Grp3: 33% 50% 37% 35%
via Orange Link / Grp4: 67% 50% 29% 35%

8 Nokia 2016 MCEL IP MBH


Service Inventory inside rings: Load balancing verification

Service Inventory: INTER-RING VPN all terminated on Inner nodes Mavalane & IFT

No Load-balancing

Load-balancing for all traffic:


from Outer ring (blue and red only) to Mavalane and IFT
Inside inner ring (green & orange mostly) to Mavalane and IFT

9 Nokia 2016 MCEL IP MBH


Implementation
Pre-requisites:
NOKIA: provides MOP
MCEL : share IP/MPLS infrastructure modifications
MCEL : validate MOP and propose planning

Migration:
IP verification: routing, costs/metric
MPLS verification: admin group, LSP status and paths
Service configuration modification
LSP optimization (see next section)
IP modification (see next section)
= > Service interruption (1 by 1)
= > LSP and services interruption (per node)& link)

10 Nokia 2016 MCEL IP MBH


DESIGN REVIEW
IGP / MPLS Optimizations

Design reviewed considering the Radio LAG


implementation

11 Nokia 2016
MPLS Tunnels optimization

Protection:
MPLS Fast reroute
For immediate protection on any along the path , 50 ms switch-over
One-to-one Detour LSP used on all LSPs instead of Facility
FRR does not consider TE : all traffic would be re-routed on Blue links
Primary/Secondary path:
Only primary path is configured , without any constraint (loose dyn path)
Radio LAG removes the need of admin group constraint. Secondary path benefit
disappears at the same time.
Mavalane-Laulane case:
Limited bandwidth (one radio channel only)
Needs to be protected against inter-ring traffic congesting the link > high IGP cost/metric
Needs constrained LSP to be forced to use it (both blue and red LSPs)
Primary path with loose + strict hops to use Mavalane Laulane link
Secondary path > dyn without any constraints

12 Nokia 2016 MCEL IP MBH


IGP (OSPF): Metric review [before Microwave radio LAG]
10.1.16.117 10.1.16.118
Group1 BENFICA LAULANE
200
Group2
Group3
200
Group4

200
200
PATRICE LUMUMBA MAPUTO OUTER RING
(MW)
5000
Lower capacity Link:
Never selected impli-
citely as best path
MAVALANE IFT
100 200
100
200 100 200
100 100 100
200 100 100
100 100
100 100
ALTO MAE

MAPUTO TORRES
INNER RING IMMOVISA
100 (MW) 100
100 100
PARMALAT
100 100
100 100 200 EDUARDO MONDLANE
200
10.1.16.119
200
200 10

MSC1 / TDM HQ MSC2 / MCEL

13 Nokia 2016
IGP (OSPF): Metric review [with Microwave radio LAG]
BENFICA
Group1 10.1.16.117 LAULANE
Group2
Group3 MAPUTO OUTER RING
Group4 (MW) 200

10.1.16.118
PATRICE LUMUMBA 200
Lower capacity Link:
10.1.16.116
Never selected impli-
citely as best path
5000

IFT (Sommerschield)
10.1.16.112

10.1.16.113
100 200
200

100 100
ALTO MAE TORRES IMMOVISA
PARMALAT 1/3/7

10.1.16.115 10.1.16.114 MAPUTO 10.1.16.111


INNER RING
(MW)
100
100
10.1.16.119
200
200 EDUARDO MONDLANE

10
10GE Fiber

(MW Link - future)


10.1.16.127 10.1.16.126
14 Nokia 2016
MSC1 / TDM MSC2 / MCEL
MPLS LSP: Fast Reroute Protection optimization with one-to-one Detour
LSP
Ring Topology:
Upon failure on primary path on a transit node/link, rerouting might not be optimal when
FRR is used in Facility Mode (current implementation)
Impact: double traffic until traffic is switch to secondary, if configured (Ingress LER detects
failure)
Tail-End
Where the traffic is coupled with FRR Facility
MP Primary Path

FRR FacilityMP
FRR One-to-One MP

MP

Protected Node Head-End


15 Nokia 2016
Traffic over Mavalane-Laulane: LSP from inner ring to outer ring
Blue LSP (admin group1) example
BENFICA
LAULANE
MAPUTO OUTER RING
(MW) Loose hop: 200
End-node
Strict hop:
200 Laulane
PATRICE LUMUMBA
High IGP cost
metric => never
preferred 5000
Primary LSP
constraints to
use inter-ring
link
IFT (Sommerschield)
MAVALANE

Loose hop: 100 200


200 Mavalane
Blue
100 LSP 100
ALTO MAE
TORRES IMMOVISA
PARMALAT

100 Secondary LSP: will prefer Outer


ring by default, with several 100
possible paths
200
200 EDUARDO MONDLANE

10
10GE Fiber

16 Nokia 2016
MSC1 / TDM MSC2 / MCEL
Traffic over Mavalane-Laulane: LSP from outer ring to inner ring
Red LSP (admin group2) example
BENFICA
LAULANE
MAPUTO OUTER RING
(MW) 200

Primary LSP Loose hop:


200NODE ON Laulane
constraints to
PATRICE LUMUMBA OUTER RING
use inter-ring
RED link
LSP 5000 High IGP cost
metric => never
preferred

MAVALANE IFT (Sommerschield)

Loose hop:
Strict hop: 100 200
200 End-node
Mavalane

100 100
ALTO MAE
Secondary LSP: will prefer TORRES IMMOVISA
PARMALAT Outer ring by default, with
several possible paths

100
100

200
200 EDUARDO MONDLANE

10
10GE Fiber

17 Nokia 2016
MSC1 / TDM MSC2 / MCEL
Traffic over Mavalane-Laulane: LSP and path configuration
Inner ring to Outer ring to
outer ring Inner ring

/configure router mpls /configure router mpls


path "via-MAVA-LAULA" path "via-LAULA-MAVA"
hop 10 10.1.16.112 loose # Mavalane # hop 10 10.1.16.118 loose # Laulane #
hop 11 10.1.16.118 strict # Laulane # hop 11 10.1.16.112 strict # Mavalane #
hop 20 10.1.16.117 loose # Destination node # hop 20 10.1.16.113 loose # Destination node #
no shutdown no shutdown
exit exit
lsp "to_BENFICA" Lsp "to_IFT"
to 10.1.16.117 to 10.1.16.117
cspf cspf
include "group1" include "group1"
fast-reroute one-to-one fast-reroute one-to-one
exit exit
primary "via-MAVA-LAULA" primary "via-LAULA-MAVA"
exit exit
secondary dyn" secondary dyn"
standby standby
exit exit
no shutdown no shutdown
exit exit
lsp "to_BENFICA-group2" lsp "to_BENFICA-group2"
to 10.1.16.117 to 10.1.16.117
cspf cspf
include "group2" include "group2"
fast-reroute one-to-one fast-reroute one-to-one
exit exit
primary "via-MAVA-LAULA" primary "via-LAULA-MAVA"
exit exit
secondary "dyn" secondary "dyn"
standby standby
exit exit
no shutdown no shutdown
exit exit

18 Nokia 2016

You might also like