IEEE San Diego - Power & Energy Power & Energy - Computer - Communications Power Electronics Utility Communications - Power Electronics Societies David E. Boroughs, P.E. Executive Advisor/Communications Practice Utility Communications Joint Presentation Executive Advisor/Communications Practice Area Director Quanta Technology www.quanta-technology.com [email protected](571) 358-7315 January 31, 2013
47
Embed
IEEE San Diego Utility Communications Utility - Amazon S3
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
IEEE San Diego
- Power & EnergyPower & Energy- Computer- Communications
Power Electronics Utility Communications- Power Electronics
Societies David E. Boroughs, P.E.Executive Advisor/Communications Practice
Utility Communications
Joint Presentation
Executive Advisor/Communications Practice Area DirectorQuanta Technology www.quanta-technology.com
• Overview of Smart Grid Communications Architecture• Performance Requirements and Applications• Technology Options to Meet Performance Requirements
2
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Smart Grid-What is It?
• Many definitions have been posed since the concept began…
The one we like –• The Smart Grid is a
i ti b dcommunications-basedsharing of information among the operating and management functions across the utility enterprise to improve reliability, optimize performance and energy efficiency, and reduce costs.
• The Smart Grid also requires intelligent functions andThe Smart Grid also requires intelligent functions and processing within the grid equipment.
3
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Concept Of The “Smart Grid” And An Enterprise-Wide Utility Focus.p y
T&D Planning & EngineeringAsset MgmtMaintenance
MgmtSystemsPlanning
SCADAEMS OOperations
Planning
DSMDMS
T&D OperationsExecutive Dashboards
Distribution ManagementMWMOMSGISProcurement & Market Ops
Planning &Forecasting
Bidding &Scheduling
Settlements
Trading &Contracts
ResourceDispatch
Customer ServicesMDMS CIS BillingCall Center
Power/Resource Scheduling
Enterprise Level
SystemsIntegration
Scheduling AMI Head End SystemsHAN
4
2013 IEEE San Diego - Power & Energy and Power Electronics SocietiesCommunications Infrastructure
Operational and Non-Operational DataNon-Operational Data• Operational Data
– Real-time mission critical monitoring and control data-SCADAReal time mission critical monitoring and control data SCADA
• Substation data
• Distribution automation data
– Historically: time division multiplex (TDM) based point-to-point
– Future: packet or data frame based
• Non-Operational Datap– Fault record files that capture a fault event (Operational Support)
– Video surveillance
M t d t– Meter data
– Corporate data
– Historically: anything from nothing, to TDM, to IP
5
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
– Future: packet or data frame based
Security Considerations
• “Convergence” Trend For Different Data Types To ShareConvergence Trend For Different Data Types To Share A Common Communications Infrastructure
• Security Considerations• Data Types Physically or Logically Separated to the Greatest
Extent Possible
• Guarantees Greater Security for Sensitive Operational Data
• NERC/CIP: Electronic Security Perimeters– Pertains to Data With Routable ProtocolsPertains to Data With Routable Protocols
• Utilization of Encryption and Authentication, especially wireless links
6
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
PERFORMANCE ANDPERFORMANCE AND APPLICATION REQUIREMENTS
Network AvailabilityNetwork LatencyQuality of Service (QoS) C it Pl iCapacity Planning
7
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Smart Grid Communications: Core & Access Networks
8
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Smart Grid Functionalities and Communications Needs
S O “C f S
9
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Source: DOE Publication “Communications Requirements of Smart Grid Technologies”, October 5, 2010
Performance Requirement 1: Network Availabilityy
• Network availability components.– The amount of time the network is available for use.
• Excluded times of use include:– Downtime.– Bit-error-rate degradation below a useable threshold.
AvailabilityObjective
Allowabledowntime
Comments
• Network availability (along with other performance parameters) should be stated in service level agreements with telecommunications service providers.
Objective downtimeper year
99.999% 5.3 mins Met with highest level of redundant equipment configurations and route diversity.
99.99% 53 mins Met with very high level of redundant equipment configurations Met with very high level of redundant equipment configurations and route diversity.
99.9% 8.8 hrs Met with high level of redundant equipment configurations and route diversity.
99.5% or 44 hours Met with moderate level of redundant equipment and route
10
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
99 5% oless
ou sor greater
et t ode ate e e o edu da t equ p e t a d outeconfigurations, but with some single “threads” in the network.
Performance Requirement 2: Network Latency
Response requirements (measured in sec.) are distinct from data rate requirements (measured in kb/s or
y
Mb/s), and must be met independently.
Different functions have different requirements for the
Function Delivery requirements
Different functions have different requirements for the delivery of the message, for example:
Data Delivery- Phasor Management Unit (PMU) and Operations Center/Visual device
50ms-100ms
Data Delivery- Between EMS and Endpoint- critical control data
1-2 seconds control data Data Delivery- Source to EMS operational data 5-10 seconds Retrieve Engineering Support Data 10 min. – 24 hours and upAMI Data Hourly
11
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
AMI Data Hourly
Performance Requirement 3: Quality of Service ProvisioningQ y g
• Refers to control mechanisms that can provide different service quality or priorities to different users or data flows.
• “Traffic contracts” established between transport and application software• Traffic contracts established between transport and application software during a session establishment phase.– Reserving capacity in network nodes.– Controlling the scheduling prioritiesControlling the scheduling priorities.– Releasing the reserved capacity when not required.
• Important in operational SCADA, as well as real-time streaming multimedia services.
Class Delay Throughput Loss Jitter
– VoIP or IP-based video.• QoS is not required when more than adequate BW is available
y g pGold Low Guarantee Low Low
Silver No Guarantee Guarantee Guarantee No Guarantee
Bronze No Guarantee Guarantee No Guarantee No Guarantee
12
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Best Effort No Guarantee No Guarantee No Guarantee No GuaranteeExample Service Provider Class of Service
Performance Requirement 4: Capacity Planningp y g
•Traffic Modelingg– “Operational” And “Non-Operational (fault data)”
TrafficS b t ti T ffi L d O B kb T t– Substation Traffic Load On Backbone Transport Network
– Distribution Automation Load On Access NetworkDistribution Automation Load On Access Network– AMI Traffic Load On Access Network– HAN Traffic Load On Access Network
•Overall Combined Traffic Effects On Total Network
13
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
SCADA: Intelligent Electronic Device (IED)
• Any device incorporating one or more processors with the capability to receive or send data/control from or to an external source (e.g., electronic multifunction meters, digital relays, controllers), g y , )
• Future Replacement for Remote Terminal Units (RTU)
14
2013 IEEE San Diego - Power & Energy and Power Electronics Societies14
Substation SCADA Data
• Typical IED Characteristicsyp
Operational Non-Operational
# of Analog # of Digital Bytes / Scan # of Analog # of Digital # of SOE # of DFRBytes / Upload
Analog Digital
Small IED 4 8 64 16 4 8 1 65,616
Medium IED 8 16 128 32 16 16 1 0 65,824
Large IED 16 24 256 48 32 24 1 1 8,706,096
15
2013 IEEE San Diego - Power & Energy and Power Electronics Societies15
Wide-Area Network Monitoring And Control (WAMPAC)/SCADA
GPS
Communication standardsIEEE C37 118 2 *
Timing standardsIEEE 1588 C37 238
Monitoring And Control (WAMPAC)/SCADA
Real Time Monitoring & Alarming
IEEE C37.118.2 *IEC 61850-90-5 *
ICCP
C37.238
EMS
Phasor Data Concentrator
Real-time controls
Concentrator (PDC)PMU
Measurement standards
C37.118.1*
PMU
Off-line Dynamics AnalysisData Storage
PMU
PMU
16
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
External users Data storage standardsIEEE C37.111 COMTRADE
PMU
Substation Synchrophasor/PMU DataSynchrophasor/PMU Data
• Constant Real-Time Monitoring of System Status– 30 samples per second PMU Packet Overhead (bytes): 18– 30 samples per second
(volts, amps, phase angle, etc.)– From Multiple Substations to
( y )
Transmit Rate (packets/sec): 30
Phasor Data format: 1=Integer; 2=Real RealFreq + DFreq 4
Phasor Data Concentrator at Control Center
• Data Also sent to ISO and other
q q 4Number of Phasors sent: 16
Number of Analogs 2
Number of Digital words 1D t Si (b t )/ i l PMU 160
Utilities in Region
• One PMU example = 54 kbpsTotal Data Volume Adds Up
Data Size (bytes)/single PMU 160
Total # of PMUs: 1
Data size for N PMUs (all same packet size) 160– Total Data Volume Adds Up
Quickly for Multiple PMUs– Would Need to Be Accounted
Sensors (i e Gas leak detection < 1 min 60 102 0 002740 0 1 70 1 70
23
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Sensors (i.e.. Gas leak detection, water leaks)
< 1 min 60 102 0.002740 0 1.70 1.70
Subtotal bytes/time period
1,734 6.52 614
bits/sec (avg)
0.16 52.13 16.37
Total System Loading Analysis-Backbone
200 Transmission Substations 100 collectors800 Distribution Substations 100% HAN customer acceptance base case
# of Subs or A l C t Di it l C t T t l C t MBit / S
Burst Loading Mbits / Burst Loading
System Level Communication Loading Analysis
Operational Data Non-Operational Data
field devicesAnalog Count Digital Count Total Count MBits / Scan
g(MBits/Sec) Upload
gMbits / Sec
3% of Substations participatingTransmission 6 6,720 4,320 11,040 4.00 1.17 4,337 2.86 Distribution 24 4,800 8,640 13,440 3.56 0.96 2,389 0.20 Substation DA Data 24 1,632 960 2,592 0.61 0.14 Feeder DA Data 90 20,160 10,080 30,240 8.67 1.72 AMI&HAN Meter Data 100 collectors 100% customers Base case 6 12
Operational Data Non-Operational Data
AMI&HAN Meter Data 100 collectors,100% customers Base case 6.12 PMU Data from Transmission Subs 200 full time data stream 10.80 Total 344 33,312 24,000 57,312 16.85 20.92 - 6,726 3.06 Comm Overhead 20% Communications Load (Mbps) 25.10 3.685% of Substations participatingTransmission 10 11,200 7,200 18,400 6.67 1.96 7,228 4.77
Operational Data Non-Operational Data
Distribution 40 8,000 14,400 22,400 5.94 1.60 3,982 0.33 Substation DA Data 40 2,720 1,600 4,320 1.02 0.23Feeder DA Data 150 33,600 16,800 50,400 14.45 2.87AMI&HAN Meter Data 100 collectors,100% customers Base case 6.12 PMU Data from Transmission Subs 200 full time data stream 10.80 Total 440 55 520 40 000 95 520 28 08 23 58 11 210 5 11Total 440 55,520 40,000 95,520 28.08 23.58 - 11,210 5.11 Comm Overhead 20% Communications Load (Mbps) 28.30 6.1310% of Substations participatingTransmission 20 22,400 14,400 36,800 13.35 3.91 14,455 9.55 Distribution 80 16,000 28,800 44,800 11.88 3.21 7,965 0.66 Substation DA Data 80 5,440 3,200 8,640 2.04 0.47Feeder DA Data 300 67,200 33,600 100,800 28.90 5.73
Operational Data Non-Operational Data
24
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
AMI&HAN Meter Data 100 collectors,100% customers Base case 6.12 PMU Data from Transmission Subs 200 full time data stream 10.80 Total 680 111,040 80,000 191,040 56.17 30.24 - 22,420 10.21 Comm Overhead 20% Communications Load (Mbps) 36.29 12.26
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
WiFi, WiMax, PLC, RF Mesh, GSM, CDMA
Zigbee, Bluetooth, HomePlug
Microwave, fiber, SONET, Ethernet, MPLS
Internet, HTTPS, VPN
Ethernet LAN
Choosing Technology to Meet Requirements
Access TechnologyAttributesT t C it /
Cellular SONETPLC BPLLicensed RF pt‐pt
Unlicensed RF pt‐pt
Meshed RF
Requirements
Transport Capacity/ Throughput Lo Hi Med Med Med Med HiScalability/ Flexibility Lo Lo Med Med Hi Hi Hi
/Reliability/ Restoration Lo Lo Lo Lo Hi Med HiSecurity Hi Hi Med Lo Lo Hi HiEase of Implementation/ Operation Med Hi Med Med Lo Lo MedCost Effectiveness Med Lo Med Med Hi Med Med
LEGENDLEGENDHi: Relatively high ranking among technology optionsMed: Relatively moderate ranking among technology optionsL R l ti l l ki t h l ti
26
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Lo: Relatively low ranking among technology options• Message here: No one size fits all!
OSI Seven Layer Model
OSI layer Examples
Applications7 Application ICCP, DNP 3.0
6 Presentation
ppCommunications
& Interfaces
5 Session
4 Transport TCP, UDP
3 Network IPv4, IPv6, IPSec
2 D t Li k ATM F R l Eth t
WAN Communications MPLS WAN Routers
2 Data Link ATM, Frame Relay, Ethernet
1 Physical 802.3 Hardware, RS-232, RS-485,
fib SONET WiFi WiM Zi b
& Interfaces
27
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
fiber, SONET, WiFi, WiMax, Zigbee
Options for Substation, Feeder, and Meter Communications ConnectivityCommunications Connectivity
“Wi d”“Wired”
“Wireless”
“Leased”
28
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Fiber Cable
• Extremely High Data Transmission Rates• Immunity From Electromagnetic Interference
C S C f• Can Be Brought Into the Substation Without Concern for Protection Against Ground Rise Voltages
• Available in Multi-conductor Bundles, – Multi-mode or Single-mode
– Optical Ground Wire (OPGW)
– All-Dielectric Self-Supporting (ADSS)
• Data Transport Schemes
– SONET– Ethernet– Wave Division Multiplexing
– Gigabit Passive Optical network (GPON)
– Point-to-multipoint, Fiber To The Premises Network Architecture In Which
29
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
p ,Unpowered Optical Splitters Are Used To Enable A Single Optical Fiber To Serve Multiple Premises, Typically 32-128.
Synchronous Optical Network (SONET)
• TDM on Optical Media With Synchronous Format• Fiber type is typically optical ground wire (OPGW) or all• Fiber type is typically optical ground wire (OPGW) or all-
dielectric self-supporting (ADSS) cables.• Network Established in a Diverse Fiber Ring for Protection– Fiber ring path
switching time < 50 msTechnology beingTechnology being Supersededby Ethernet, IP, MPLS
30
2013 IEEE San Diego - Power & Energy and Power Electronics Societies30
Wire: Power Line Communications (PLC)(PLC)
• Initial technology used for over 50 years.• Uses primary voltage distribution and transmission wiresUses primary voltage distribution and transmission wires.• Signal injected into the primary lines via an interface at the
transmission/distribution substation, distribution t f t t ’ itransformer, at customer’s premises.
• Three main typesPLC T h l F b d D t R t O ti l T i lPLC Technology Frequency band Data Rate Operational
rangeTypical Application
Ultra Narrowband 0.3 – 3 KHz30 – 300 Hz
~100 bps 150 km or more Relay protection
Narrowband 3-500 kHz Few bps – 500 kbps
Up to a few km AMR, AMI, DA
Broadband 1.8 – 250 MHz Few Mbps – few hundred Mbps
Up to fewer km Backhaul, multipurpose
31
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Power Line Carrier Available StandardsStandards•Narrowband PLC Standards
Standard Technology Frequency Band (kHz) Data Rate (kbps)
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
• Peer-to-Peer Meshed
Picture Source: Motorola
Radio Design Considerations
• Coverage– Frequency BandFrequency Band– Antenna Gain/Configuration: SISO, SIMO, MIMO– Power Output (ERP)
M d l ti S h• Modulation Scheme– OFDM, Spread Spectrum– Adaptive
• Performance– Designed to Meet
Intended Application– Latency– Fade Margin (Factor for Network Availability)– Spectral Efficiency (Data Throughput in Allowable Bandwidth)
34
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
– Duplexing: FDD, TDD
Licensed vs unlicensed
• Licensed Radio– Licensed from the Federal Communication Commission (FCC).( )– provide some protection against interference by others.– Limited bandwidth due to spectrum use restrictions– Typically 9.6 to 19.2 kbps in 900 Mhz bandTypically 9.6 to 19.2 kbps in 900 Mhz band– Higher capacity (Mbps) in microwave 6 and 11 Ghz band– Other frequencies 450, 800 Mhz Land Mobile radio– Other bands in future for utility use: 700 Mhz (shared); 3 65 Ghz WiMax– Other bands in future for utility use: 700 Mhz (shared); 3.65 Ghz WiMax
Q i k t– Quicker setup– Can be 10-15% less expensive than licensed system– Concerns for increasing interference due to proliferation of unlicensed devices
FCC t 15 247 Th i k t t f th t itt i t 6 dBi
35
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
– FCC part 15.247: The maximum peak output power of the transmitter into 6 dBiantenna shall not exceed 1 Watt.
Wireless Options –Point to Point
• Microwave RadioLicensed 6 11 Ghz Or Higher Frequency Bands– Licensed 6,11 Ghz Or Higher Frequency Bands Requiring Line Of Sight (25 mile hops)
– Often Used For Communications Backbone To Transmission SubstationsTransmission Substations
– Can Be Used To Connect Distribution Substations In Sight Of Microwave TowerC B D i d F Hi h R li bilit B t At A C t– Can Be Designed For High Reliability, But At A Cost
– Can Be Configured In SONET Rings (Adapted To Radio), Typically Multiple OC-3 Radios To Increase Capacity L t t T h l S t I d d t N ti TDM d Eth t– Latest Technology Supports Independent Native TDM and Ethernet Platforms• Adaptive Modulation Techniques
36
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Wireless: Multiple Address Radio (MAS)(MAS)
• Service up to 4.8 kbps but can be increased to 9.6 kbps (limited coverage).
• Capacity is limited by data speed and system scan time. Also, limited by the number of masters that can be physically installed in the system (location, topography, etc.).
• Requires line-of-sight, point-to-multipoint for master and remote radios. • Can typically reach 25 miles, can be extended by using repeaters.
• Reliability: can be improved with remote diagnostics, warm standby equipment and redundant architecture.
• Widely used forMAS
• Widely used for SCADA and DA (most common 900 MHz).
37
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
Wireless Options: Networked
•Unlicensed Spread Spectrum– 902-928 MHz or 2.4 GHz Band– Low Power, Spread-spectrum Transmission– Confined to Short Distances (Typically 2-4 Miles Max.)– Packet Switched Mesh “Ad Hoc” Network– Used to Support Peer-to-Peer Communications
Among Distribution Automation SwitchesAmong Distribution Automation Switches– Some Products Can Be Set for Repeating of Other
Radio Data
38
2013 IEEE San Diego - Power & Energy and Power Electronics Societies38
AMI Network Types: Mesh
Utility Systems
Head-End
Concentrator / Take Out Point
39
2013 IEEE San Diego - Power & Energy and Power Electronics Societies“Enterprise Integration of AMI to Maximize ROI,” Steklac & Tram, DistribuTECH 2006
Wireless: WiFi• Intended to improve the interoperability of wireless local area
network products based on the IEEE 802.11 standards:802.11
protocolRelease Freq.
(GHz)Bandwidth
(MHz)Max Data rate
per streamAllowable
MIMOModulation
protocol (GHz) (MHz) per stream (Mbit/s)
MIMO streams
--- Jun 1997 2.4 20 2 1 DSSS,FHSS
a Sep 1999 5 20 54 1 OFDM
b Sep 1999 2.4 20 11 1 DSSS
g Jun 2003 2.4 20 54 1 OFDM,DSSS
n Oct 2009 2 4/5 20 72 2 4 OFDM
• Allows connectivity in peer-to-peer mode.• Subscriber module sends data to access point over TCP/IP.
n Oct 2009 2.4/5 20 72.2 4 OFDM
40 150
• 5 GHz: latency < 1 ms (10 Mbps)• Power consumption is high compared to some other low-
bandwidth standards, such as ZigBee and Bluetooth.
40
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
• Line-of-sight is important.• 802.11i security can be implemented
Short Range Wireless Networked: ZigBeeZigBee
• High level protocols using small, low-power digital radios based on the IEEE 802.15.4 standard for wireless personal area networks (WPAN)(WPAN).
• Everything is small:• Very low cost • Extremely low power requirements• Bandwidth 20-250 kbps (okay for
many smart grid applications)y g pp )• Range of 10-75 meters
• Unlicensed 2.4 GHz, 915 MHz and 868 MHz.• Home area automation networkHome area automation network.• Designed for sensors and automation.• Selected by California utilities for meter-to-household (e.g.
thermostat) communications
41
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
PLC Narrowband Power Line Cooper Power Systems,PLC Narrowband Power Line Carrier
Cooper Power Systems, Archnet, ABB
BPL Broadband Power Line Carrier Ambient, Amperion, Current
SONET Fiber OC-12, OC-48, OC-192 Alcatel-Lucent, Fujitsu, NEC
45
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
jHardened
TDM/SONET/Ethernet T1, OC-48, 100M, 1G SEL, RFL, AMETEK, GE
Thank You!
46
2013 IEEE San Diego - Power & Energy and Power Electronics Societies
If you want to contribute or suggest topics to this series of technicalIf you want to contribute, or suggest, topics to this series of technicalpresentations, please contact: