FROM LEGACY TO SMART GRID

A Practical Modernization Strategy

Market pressures to expand and improve energy grid
capabilities are driving the modernization of utilities
legacy communications network infrastructure.
As utilities are seeing the demands on their networks
grow tremendously, they are looking for ways to maximize
network valuein terms of what it costs to operate the
network, but also in the kind of value that the network
contributes to the business. Ciena provides the powerful
combination of the scalability and reliability of optical
networking with the exibility and low-cost economics
of Ethernet to enable utilities to transition to reliable,
next-generation application-driven networks that can
be used to solve underlying business challenges and
tap new opportunities more quickly and efciently.
Application Note A
Benets
>
Provides a practical,
cost-effective approach
to modernization of utility
communications networks
>
Delivers consistent,
predictable communications
with much more scalable
capacity, at a much lower cost
>
Transforms the network into
a highly programmable set
of resources,optimized for
new packet-based Smart Grid
applications
>
Provides secure and reliable
separation of critical operations
data, mission-critical IT trafc
and corporate communications
>
Unlocks the power of the
network to solve underlying
business challenges and
tap new opportunities more
quickly and efciently
Ciena builds the grids data communications layer, which is concerned with moving
information back and forth from the utility to the energy user across a series of
interconnected network tiers. The build-out of the communications layer provides
the foundation for advanced applications to operate.
Cienas solutions are standards-based, easy to implement, easy to manage, and quick
to deliver a Return on Investment (ROI)enabling the network to form a low-touch,
highly programmable set of resources that can accommodate plug-and-play capacity
increases. This automated network is resilient and adaptable to various services, trafc
types, and trafc patterns; helping it use resources most efciently, and optimizing it
for new packet-oriented applications.
Utility networks today typically consist of a core SONET ring infrastructure at OC-3
to OC-48, linking substations to the network control centers, as shown in Figure 1.
Devices in substations are connected to the communications network by a broad
range of costly, inexible legacy interfaces, and the networks themselves usually
consist of an assortment of copper leased-line and wireless facilities, in addition to
the SONET ber rings.
Evolution to the Smart Grid is driving the need for more
capacity and more control over the infrastructure, and Ethernet
and IP trafc is rapidly increasing with the introduction of new
packet-based applications. However, current legacy protocols
and TDM trafc are not going away anytime soon. Therefore,
the approach to network modernization must be a practical
one that enables a controlled, affordable, and manageable
evolution from todays network realities to a next-generation
infrastructure.
Practical Modernization: STEP 1
Add WDM to future-proof the network
Increasing bandwidth requirementsdriven by the growth
in meter data, video surveillance, and grid optimization
applicationsare driving core networks to Wave Division
Multiplexing (WDM). WDM unlocks the capacity of the ber
plant, providing the foundation for a high-bandwidth, exible,
and scalable utility transport network, as shown in Figure 2.
At the same time, to ensure reliability and security, regulations
are driving the segmentation of different trafc within the
utility. WDM provides the ability to transmit multiple separate
and independent signals, each with a different wavelength.
This enables the utility to consolidate operations on a single
cost-effective network while maintaining separation of grid
operations data, mission-critical IT trafc, and general
corporate communications.
The network can also play a critical role in implementing
a secure data management and Business Continuity/Disaster
Recovery (BC/DR) strategy. Using WDM technology, a utility
can add additional wavelengths to transport server and storage
data between primary and backup data center locations, as
shown in Figure 3, enabling the utility to implement a secure
and scalable infrastructure for managing the massive inux
of data from smart meters and grid optimization and control
systems.
2
OC-48 OC-3/12
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Primary Data
Center
Primary
Control
Center
OC-48
OC-3/12
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Primary
Data
Center
Primary
Control
Center
DWDM
Figure 1. Todays SONET network
Figure 2. Underlay SONET core with DWDM
By providing a WDM underlay to existing SONET/SDH
networks, the utility can accommodate legacy TDM protocols
while setting the stage for a transition to more versatile and
cost-effective packet protocols. Collapsing all three needs
TDM, packet, and WDMinto a Packet-Optical Transport
System (P-OTS) results in reduced cost and network complexity.
The value of P-OTS is evident when considering that new
Ethernet- and IP-enabled utility equipment and devices are
proliferating, and increased security requirements are driving
IP applications such as video surveillance further into the utility
network. For these packet-based applications, the traditional
SONET network is not the best option. A better approach is
simply to provision scalable Ethernet transport on the P-OTS
infrastructure, as shown in Figure 4, facilitating the migration
to a more versatile converged network.
Cienas Packet-Optical Transport portfolio is an industry-
leading family of products that addresses almost any
transport requirement or demand. Options for breadth
of service and interfaces include SONET/SDH, Ethernet,
Fibre Channel, ESCON

, FICON

, digital video, and more.

Standards-based Optical Transport Network (OTN) improves
efciency and lowers costs by requiring fewer wavelengths,
while sub-wavelength grooming capabilities provide a familiar
SONET-like look and feel.
The ActivFlex 6500 Series includes packet-optical platforms
that efciently manage and transport converged TDM, data,
and wavelength services. In addition, the ActivFlex 6100 Series
consists of compact, low-cost multiservice access products
optimized for deployment in collector networks where lower
service capacity is required.
Cienas ActivSpan 4200 Series and ActivSpan 5000 Series,
optimized around enterprise applications, offer a wide variety
of service interfaces as well as TDM and packet-switching
functionality and can provide sub-wavelength grooming and
ROADM technology to deliver services rapidly to any part of
the network.
3
OC-48
OC-3/12
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Backup Data
Center
Primary
Data
Center
Primary
Control
Center
DWDM
Fibre Channel
10GbE
OC-48
OC-3
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Backup Data
Center
Primary
Data
Center
Primary
Control
Center
10GbE
DWDM
Fibre Channel
10GbE
Add scalable Layer 2
packet transport
Figure 3. Grow storage transport on new DWDM channel
Figure 4. Add scalable Ethernet transport
Practical Modernization: STEP 2
Add Connection-Oriented Ethernet for reliable
and predictable backhaul
Ethernet is the most efcient and cost-effective transport
technology for handling the escalating volume of IP trafc
in utility networks. However, some utilities have lingering
concerns about the reliability and predictability of IP/Ethernet
transport for mission-critical data. To relieve those concerns,
the industry is moving toward the adoption of standards-based
connection-oriented Ethernet.
Connection-oriented Ethernet leverages the low cost of
Ethernet technology while dening predictable trafc-
engineered circuits to provide consistent, deterministic
communications under all conditions. The resultfrom a
management and reliability perspectiveis performance
on par with SONET, but with much more scalable capacity
at a much lower cost. Connection-oriented Ethernet is really
a collection of switching and protection technologiessuch
as PBB-TE, MPLS, and G.8032 Ethernet Ring Protection
that provide the benets of Ethernet access and aggregation
with robust transport provisioning and management, such as
sub-50 ms restoration.
Cienas Carrier Ethernet Service Delivery (CESD) portfolio
combines intelligent devicesservice delivery and aggregation
switchesand software to create a low-touch, common,
and consistent way to extend native Ethernet transport into
the distribution network, with seamless interworking with the
packet-optical core, as shown in Figure 5.
Key differentiators include an unmatched product portfolio
breadthincluding temperature-extended and weatherproof
platforms for outdoor, uncontrolled, and substation
environmentsand a common OS and unied management
platform for automated device conguration and provisioning,
OPEX reduction, and overall faster turn-up. The high switching
capacity and modularity of the larger aggregation platforms
allow the Ethernet network to scale easily with growing trafc
demands.
The rich CESD feature set includes industry-leading
Operations, Administration, and Maintenance (OAM)
and Quality of Service (QoS) capabilities so the utility has
the visibility and control necessary to manage the network,
and the ability to prevent different trafc ows, with different
service parameters, from interfering with each other.
As noted, the approach to network modernization must
be a practical one that enables a controlled, affordable,
and manageable evolution from todays network realities
to a next-generation infrastructure. T1 has been a common
medium to transport information from substation SCADA
RTUs to core operations centers. While utilities are in the
process of replacing their leased copper transport with ber-
based Carrier Ethernetand converting the legacy RTUs
to Ethernet-based devices over timethey need a method
to bring the legacy equipment onto the Ethernet network
in the interim. With the CESD portfolio, this is achieved with
multiservice delivery switches that support both Ethernet and
T1 interfaces and provide TDM Pseudowire Emulation (PWE)
services, offering a legacy on-ramp for TDM trafc over the
Ethernet network, as shown in Figure 6. This combination
provides a practical approach for migrating to a pure packet
network as the legacy RTUs and interfaces are all eventually
replaced and the original SONET network can be retired, as
shown in Figure 7.
4
OC-48
GbE
OC-3/12
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Backup Data
Center
Primary
Data
Center
Primary
Control
Center
10GbE
DWDM
Fibre Channel
10GbE
FE
Connection
Oriented
Ethernet
Figure 5. Add connection-oriented Ethernet
Practical Modernization: STEP 3
Add Ethernet radio backhaul for complete
territory coverage
The nal step in this practical modernization strategy is to
connect the end-usersthe Smart Grid consumerswith
the utility control and data centers.
In an Advanced Metering Infrastructure (AMI), the network
that connects to smart meters at the home or business is
often referred to as the Neighborhood Area Network (NAN),
and it is typically a wireless networkRF mesh, commercial
cellular, or WiMAXthat bridges communications between
the smart meters and the core network, allowing data to
ow from customers to the utility and vice versa. Typically,
smart meter trafc is aggregated at collector or take-out
points which dene the edge of the utilitys backhaul
network.
It is useful to think of the AMI backhaul network as analogous
to a mobile wireless backhaul network, with the combination
of smart meters, grid sensors, and mobile workforce devices
as the end-point devices generating the data to be
backhauled.
Ciena is a proven wireless backhaul leader, working with
leading microwave radio technology partners to provide
hybridber/microwave backhaul solutions. By engineering
large-scale commercial deployments, Ciena has resolved
the challenges associated with managing multiple radio links,
delivering an infrastructure that provides superior quality of
service, deterministic protection, and simplied management
and provisioning.
Microwave radio is already recognized by utilities as a exible
and reliable technology and a good t for their mission-critical
networks, providing a practical alternative to leasing facilities
or building out ber. As such, Cienas widely deployed mobile
backhaul solution, as depicted in Figure 8, combining Ethernet
switching with a hybrid ber/microwave network, provides a
robust utility data backhaul architecture between take-out
points and the core network, regardless of which technology
is employed in the NAN.
5
GbE
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Backup Data
Center
Primary
Data
Center
Primary
Control
Center
10GbE
DWDM
Fibre Channel
10GbE
FE
SAS
Figure 7. Retire SONET network
OC-48
GbE
OC-3/12
Substation
B
Substation
E
Substation A
T1
Substation C
Substation D
Backup
Control
Center
Backup Data
Center
Primary
Data
Center
Primary
Control
Center
10GbE
DWDM
Fibre Channel
10GbE
FE
SAS
Pseudowire Gateway
Figure 6. Migrate T1 trafc onto Ethernet using TDM pseudowires
Practical Modernization: Putting it all together
Properly executed, a modernized energy grid optimizes the
reliability, efciency and security of the entire energy delivery
system. It is built on a two-way communications foundation
that is highly reliable and constantly available, yet affordable
to install and operate.
Cienas solution for the practical modernization of utility
communications networks is based on the implementation
of converged optical Ethernetputting the right technologies
in the right place to maximize the value that the network
contributes to the business.
As shown in Figure 9, Cienas Smart Grid architecture delivers
WDM to expand and future-proof the network, combined with
connection-oriented Ethernet for reliable, deterministic packet
transport and Ethernet radio backhaul for complete territory
coverage.
The result is a Smart Grid network that is standards-based,
ultra-reliable and deterministic, secure and scalable, and less
expensive to build and operate.
Access Distribution Backbone
RF Mesh
> ZigBee

> 700 MHz

> WiFi
> Ethernet
> TDMoE
> uWave
Control
Center
Data Center
Substation
DWDM
Core
Network
Core Network Backhaul Layer Neighborhood
Area Network
Home Area
Network
RF Mesh
WIMAX
ZigBee

In-home
Display
Thermostat
Gas Meter
Small
Appliance
Home
Gateway
Collectors/
Take-out Points
Substation
SAS
12:00 70
Ciena
T1
FE
Smart
Meter
Figure 9. Ciena Smart Grid Reference Network
Ciena may from time to time make changes to the products or specications contained herein without notice.
Copyright 2010 Ciena

Corporation. All rights reserved. AN070 1.2011

Specialists in unlocking
network potential to help you
change the way you compete.
1201 Winterson Road
Linthicum, MD 21090
1.800.207.3714 (US and Canada)
1.410.865.8671 (outside US and Canada)
+44.20.7012.5555 (international)
www.ciena.com
GbE
Substation
B
Substation
E
Substation A
Substation C
Substation D
Backup
Control
Center
Backup Data
Center
Primary
Data
Center
Primary
Control
Center
10GbE
DWDM
Fibre Channel
10GbE
SAS
Figure 8. Add Ethernet radio backhaul for complete territory coverage