Power System Engineering, Inc.

CRN Smart Grid Summit

Communications Infrastructure for the Smart Grid

Rick A. Schmidt
Power System Engineering, Inc. Web Site: www.powersystem.org June 30th, 2010
1

Power System Engineering, Inc.

Rick A. Schmidt
Vice President System Design and Communications Phone: (608) 268-3502 Email: schmidtr@powersystem.org

Power System Engineering, Inc.

1532 W. Broadway Madison, WI 53713 Web Site at: www.powersystem.org

About the Presenter:

Rick leads the System Design and Communications Department, providing automation and communications planning consulting and engineering services, including: technology work plans,; strategic communications plans; and automation planning. This department also provides deployment services for: SCADA; distribution automation; substation automation and design; AMI; demand response; GIS; MWM; AVL; OMS; IVR; and a variety of automation applications. The communications media deployed include: land mobile radio; fiber; microwave backbones; mobile data; and others. Rick has over 25 years of professional relevant experience with an emphasis on the business side of technology. He has an MBA from Cardinal Stritch University in Milwaukee, WI.
2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Power System Engineering, Inc.

Agenda
The deployment of a communication network for AMI, Demand Response, and various forms of Distribution Automation involves five basic steps: 1.Complete a Multi-Application Communications Assessment 2.Define Communication System Requirements 3 Create and Select Communications Architecture 3.Create 4.Select Communication Media technology 5.Select Communication Media vendors
3

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

What is Driving the Need for Communications Infrastructure?

New Applications at Substations New SCADA & DA Applications New Demand Response & DG

Mobile Voice Mobile Data Backbone Data Transport

Control Center Integration

AMI
2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Power System Engineering, Inc.

Approach for Communication Projects

Approach 1: Develop a communication solution for a single application.
For example: AMI only without considerations for SCADA, load management, mobile radio, DA, etc. DA without considerations for other applications. Mobile service orders without considering mobile voice or the th backbone. b kb Load Management, etc. without considering AMI or the Intelligent/Smart Grid.
5

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Approach for Communication Projects

Approach 2: Develop a communication solution for multiple applications. Sometimes this can be called a Strategic i Communications i i Plan. l
Define the business requirements for the applications. For each application (e.g. SCADA, line device sites, video-security, load management, AMI, others) identify:

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Power System Engineering, Inc.

Utility Data Communications

New Trends in Utility Communications WAN
Sub. Stat

Load Man. Sub. Stat

Central Data Center

High-Speed g p Medium-Speed Low-Speed

District Office Sub. S b Stat Sub. Stat Sub. Stat

Communications Architecture: Multiple Application Shared Infrastructure

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Approach for Communication Projects

Forecast what applications will feed into the backbone.
What is the average meter density per Collector ? Will SCADA data feed into the backbone? Will AMI data feed into the backbone? Will C&I metering feed into the backbone?

How do you plan to transport your mobile radio voice system?

Any plans for mobile data or hotspots? Does Load Management exist now or in the future?

How many DA sites Do you have or plan to deploy?

Will any video monitoring feed into the backbone?

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Power System Engineering, Inc.

Data Communication System Characteristics

All data communications systems are specified by a set of characteristics. A few of the most common ones are: Throughput Latency Reliability Error Rate Topology T l Directionality (duplex, simplex, etc.) Packet Switched and Circuit Switched Applications that run on the link Security Needs
2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Frequency Alternatives for Mobile Voice or Data

What is the major difference?
Frequency and Propagation Impact
The lower the frequency the better the coverage
150 MHz 400 MHz 700 MHz 900 MHz 2.4 GHz

Better Propagation
Source: Power System Engineering (www.powersystem.org)

2010 Power System Engineering, Inc.

10

Power System Engineering, Inc.

Power System Engineering, Inc.

Introduction Communication Basics

Radio Bandwidth Allocation
Just a sample of spectrum examples

Data bandwidth is dependant on the various technologies

Reasons why traditional VHF/UHF data bandwidth is skinny

700 MHz 1 MHz

2010 Power System Engineering, Inc.

11

Power System Engineering, Inc.

Line-of-Sight (LOS)
700MHz and higher frequencies generally require Line-ofSight over longer distances to achieve reliable communications LOS is assessed with path studies

2010 Power System Engineering, Inc.

12

Power System Engineering, Inc.

Power System Engineering, Inc.

Utility Data Communications

Most utilities have a backbone of some t type. The major challenge is how best to reach beyond the backbone. WAN
Central Data Center Sub. Stat

District Office Sub. Stat

High-Speed Medium-Speed Low-Speed

2010 Power System Engineering, Inc.

13

Power System Engineering, Inc.

Use of Substations As DA Nodes

If NU shifts to Point-to Multi-Point technologies for DA, Line of Site becomes critical Substations near by critical. becomes data collection points for pole-top DA
Sub. Stat

WAN
Berlin Control Center

Trans Sub
AWC

High-Speed Medium-Speed Low-Speed

2010 Power System Engineering, Inc.

Sub. Stat

14

Power System Engineering, Inc.

Power System Engineering, Inc.

Coverage vs. Throughput

For Any Wireless Data Application

For illustrative purposes only

2010 Power System Engineering, Inc.

15

Power System Engineering, Inc.

Coverage: Where Do You Need to Reach?

Terrain Characteristics and Meter Density?

2010 Power System Engineering, Inc.

16

Power System Engineering, Inc.

Power System Engineering, Inc.

Agenda
The deployment of a communication network for AMI and various forms of Distribution Automation involves five basic steps:
1. Complete a Multi-Application Communications Assessment 2. Define Communication System Requirements 3. Create and d Select l Communications i i Architecture hi 4. Select Communication Media technology 5. Select Communication Media vendors
2010 Power System Engineering, Inc.

17

Power System Engineering, Inc.

Requirements For Utility Automation

AMI Take-Out Points Home Area Networks (Smart Metering) Substations Distribution Automation (DA) Mobile data Other Applications

Communication requirements at tower sites will vary based on how many field locations and applications will feed into the tower sites.
2010 Power System Engineering, Inc.

18

Power System Engineering, Inc.

Power System Engineering, Inc.

Communication Requirements for Substations

Distribution substations have become regional nodes for a variety of utility automation applications including:
SCADA AMI via PLC or Nodes for Fixed Wireless Take-Out points Direct connect via Ethernet into substation IEDs Video monitoring Communication hubs or concentration points for downline DA Hot-spots for mobile data
2010 Power System Engineering, Inc.

19

Power System Engineering, Inc.

Agenda
The deployment of a communication network for AMI and various forms of Distribution Automation involves five basic steps:
1. Complete a Multi-Application Communications Assessment 2. Define Communication System Requirements 3. Create and d Select l Communications i i Architecture hi 4. Select Communication Media technology 5. Select Communication Media vendors
2010 Power System Engineering, Inc.

20

Power System Engineering, Inc.

10

Power System Engineering, Inc.

Summary Data Communications Landscape

Technologies Ranked by Throughput

High Rate Systems

WiMAX

Fiber

Medium
10 Mbps

1 Mbps

100 kbps

Telco-Frac. T-1 700 MHz Rate Systems Cellular Edge & BPL Microwave, EVDO Licensed 802.11 Microwave Cellular: Telco-FR GPRS, cdma2000 Telco-FR Spread Spectrum VSAT-Broadband Licensed Radio Motient Cellular circuit

Low Rate Systems

10 kbps
Cellular:SMS

MAS

1 kbps

Satellite

Paging ReFlex

100 bps

10 bps

Telephone Cellular:Analog Control Leased Line Channel Power Line Carrier (PLC)

- bps: bits per second - MAS: Multiple Address System -VSAT: Very Small Aperture Terminal -FR: Frame Relay - GPRS: General Packet Radio Based

Cost
21

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

Communications Architecture Alternatives Redundant (ring-based) and Non-Redundant SONET, MPLS, Gig Ethernet, or Carrier Grade Ethernet # of Network Tiers

2010 Power System Engineering, Inc.

22

Power System Engineering, Inc.

11

Power System Engineering, Inc.

Non-Redundant Microwave Backbone

Illustrative sample
Crandall Hill
10.8 Mi. 11.4 Mi. 17.8 Mi.

EMS B il Hill Bailey Frontier Phone

16.7 Mi. 14.7 Mi.

Tower Hill
16.7 Mi.

8.6 Mi 1.5 Mi.

EMS Lyons Hill

10.8 Mi.

Mansfield Office

Lookout Mt.

16.0 Mi.

Cedar Mt.

Wellsboro Office 0.4 Mi. Hill

9.0 Mi.

Cherry Spring

EMS Dutch Hill

3.7 Mi. EMS Park

20.3 Mi. 17.1 Mi.

EMS Tamarack

EMS RT287

2010 Power System Engineering, Inc.

23

Power System Engineering, Inc.

Redundant Microwave Backbone

Illustrative sample

2010 Power System Engineering, Inc.

24

Power System Engineering, Inc.

12

Power System Engineering, Inc.

Ethernet Packet Switched (IP) Trend

Predominantly packet-based network traffic is:
The most cost-effective technology. The easiest to operate, operate support, support and maintain. maintain The most bandwidth efficient. The direction that the telecommunications industry is heading. Is software configurable and most Gig Ethernet supported hardware also supports MPLS. Has rigorous compliance standards and testing required. Dynamic y in allocation of data bandwidth. Has improved QoS enforcement.

SONET is no longer the green-field chosen technology.

Legacy transport for circuit-switched, not IP-switched technologies. Utilities are moving away from circuit-switched applications.
2010 Power System Engineering, Inc.

25

Power System Engineering, Inc.

Agenda
The deployment of a communication network for AMI and various forms of Distribution Automation involves five basic steps:
1. Complete a Multi-Application Communications Assessment 2. Define Communication System Requirements 3. Create and d Select l Communications i i Architecture hi 4. Select Communication Media technology 5. Select Communication Media vendors
2010 Power System Engineering, Inc.

26

Power System Engineering, Inc.

13

Power System Engineering, Inc.

High Rate Systems

When you need to move serious data > 10 Mbps

Primary y Purpose: p Most commonly used in the backbone with tower-to-tower connectivity as the substations feed into the towers. Can also be used to connect district offices with the main office. Sometimes for substations.

> 1 Mbps

2010 Power System Engineering, Inc.

27

Power System Engineering, Inc.

High Speed Backbone Communication Media Choices

Technology

Fiber (private or telco leased) Licensed 6, 12 and 18 GHz Point to Point Microwave Unlicensed 5.8 GHz and 2.4 GHz Point to Point Microwave

2010 Power System Engineering, Inc.

28

Power System Engineering, Inc.

14

Power System Engineering, Inc.

Medium Rate Communications Media

Primary Purpose: Most commonly used to connect substations b t ti with ith the th main i office ffi Fixed Wireless Node communications: AMI Backhaul Also used for DA backhaul located on distribution poles

~ 20Kbps to ~ 1 Mbps

Most wireless products for substations are point-to-multipoint.

2010 Power System Engineering, Inc.

29

Power System Engineering, Inc.

Last Mile Communication Media Choices

Technology Unlicensed 900MHz Spread Spectrum Unlicensed 900 ISM WiMax Point-to-Multipoint Unlicensed 900 ISM Mesh Cellular: 2.5/3G and now 4G C Cellular ll l Arcadian 700MHz Licensed Mesh 2.4 GHz/5.8GHz, or UHF/VHF Technology Satellite, VSAT 3.65 GHz WiMax: Point-to-Multi Point Licensed WiMAX from Full Spectrum Software-Defined Radio (40 MHz, 220 MHz, 450 MHz, 700 MHz or 900 MHz) Licensed 150 MHz to 450 MHz 50 KHz channels and in the future 200 KHz channels MPLS Telco services
30

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

15

Power System Engineering, Inc.

AMI Technology Comparison Overview

First, consider the context for the different types of AMI. 900 MHz and 2.4 GHz ISM Itron Elster Landis & Gyr Trilliant
31

900 MHz Licensed Sensus

220 MHz Licensed with Hybrid 900 MHz ISM Tantalus

PLC

Landis & Gyr Aclara Cooper/Cannon

2010 Power System Engineering, Inc.

Power System Engineering, Inc.

AMI Technology Alternatives Fixed Network

Collector Engine Collector Engine

Pole-top Repeater

Two-Way Fixed Network AMI:

As a way to expand coverage, coverage depending on the vendor: meters will talk to meters collectors will talk to collectors (some vendors) both collectors and meters will talk to each other
The number of actual locations where a third-party communications takeout will be necessary will vary greatly by AMI vendor.
2010 Power System Engineering, Inc.

32

Power System Engineering, Inc.

16

Power System Engineering, Inc.

Sophisticated p Vendor Ranking Approach for RFP Projects

2010 Power System Engineering, Inc.

33

Power System Engineering, Inc.

Moving Forward Towards Deployment

PSE Project Methodology
Discovery Create T h l Technology Plan Design Bid with RFPs Select & Build Integrate A Apps E End d To End

Strategic Planning Approach

Continuous interaction with project team Formal project management process Best balance between technology costs and functionality Address security, interoperability, and regulatory requirements Risk mitigation assessment Create the most favorable contract terms and costs Formal testing
2010 Power System Engineering, Inc.

34

Power System Engineering, Inc.

17

Power System Engineering, Inc.

Sample from RFP Analysis

Key Criteria EaseofCoverage/propagationwithnonlineofsight g /p p g withlineofsight g EaseofCoverage/propagation Throughputandlatency (fieldresults) Criticalquestionsscore Specificationsscore Levelofredundancy/selfhealingofnetwork/mesh supportarchitectureandsystemdesign Riskassessmentofvendorwirelessbusinessand proposedproductmaturity Coexistencewithotherwirelessproducts Generaleaseofmaintenanceincludingmaturenetwork managementsoftware ScalabilitypotentialofsolutiontoAMI Security hardwareandNMS Strengthofrebiddesign Radiosplitmountedw/passivecomponentsontopof towerandactivecomponentsatground level Rank 2 Criteria Wt. / A Rank Vendor 17 13 12 10 10 8 7 6 6 4 4 4 1 2 3 1 1 3 2 1 3 1 1 2 3 2 3 28 198 1 2 3 1 1 1 2 2 3 2 2 1 2 2 25 173

3 B Vendor

4 C Vendor 0 0 0 2 1 0 3 0 2 3 2 1 2 1 17 89

1 D Vendor 3 1 2 3 2 3 1 1 1 1 1 2 2 2 25 199 35

IntegratedRS232/485portwithIPencapsulationof 0 serialdata Total Vendors Ranking Points Total Vendors Weighted Ranking Points
2010 Power System Engineering, Inc.

Power System Engineering, Inc.

PSE would like to thank you for your time and the opportunity to speak at this event.

Thank You.

Rick Schmidt
VP, System Design and Communications Direct: 608-268-3502 Mobile: 608-358-5661 Email: schmidtr@powersystem.org

2010 Power System Engineering, Inc.

36

Power System Engineering, Inc.

18