Flexible Plug and Play - UK Power Networks€¦ · Flexible Plug and Play Communications Platform – SDRC 9.3 | 7 This provides remote, secure configurationand management from a

Flexible Plug and PlayCommunications Platform – SDRC 9.3 By Cable & Wireless Worldwide, Silver Spring Networks and UK Power Networks

March 2013

Definitions

Backbone Thetermbackbonenetworkisdefinedasthenetworkinfrastructurethat

interconnectsvariouspiecesoftelecommunicationsnetwork,providinga

virtualpathfortheexchangeofinformationbetweendifferentLocalArea

Networks(LANs)orsub-networks.

Back-haul Theback-haulnetworkisthecommunicationsconnectionbetweenthe

RFMeshNetwork andActiveNetworkManagement (ANM) solution

fordataexchange.Also,themanagementconnectionbetweentheRF

MeshNetworkandGridScapemanagementapplication.

Canopy Geographical coverage of the RF Mesh Network and the consequent

footprintforcommunicationsconnection.

CATT CommunicationsTester–softwarethattestsandcollectsdatafromRF

MeshNodes.

Ellipse The asset catalogue which contains information on all of UK Power

Networks’electricalassets.

FPPTrialZone An area of UK Power Networks’ Eastern Power Networks Plc

(EPN) distribution network that serves approximately 30km

diameter (700km2) between Peterborough and Cambridge

(theFlexiblePlugandPlayTrialZone)intheEastofEngland,UK.

Front-haul The front-haul network is UK Power Networks’ user access to the

GridScapemanagementapplication.

GoogleEarthPro Avirtualglobe,mapandgeographicalinformationprogramme.Usedin

thissolutiontoillustrateRFmeshgeographicalinformation.

HighAvailability Innetworkingterminology,high-availabilityisdefinedasanarchitecture

that has been designed, planned and installed with 99.999% (“five

nines”)availability.

Term Description Clauseref

Section3.2

Section3.2

Section1.0

Section4.4.2

Section4.4.7

Section2.2

Section4.3

Section4.4.4

Section3.2

MapInfoProfessional GeographicInformationSystem(GIS)usedformappingandlocationanalysis.

UsedinFPPdesigntovisualise,analyse,interpret,understandandoutput

datawithregardstotheRFMeshNetwork.Version11wasused.

Mozart C&WW’s access planning tool for feasibility/cost assessment for the

provisionofnetworkconnections in theUK linkedtocurrentnetwork

inventorydatabasesandBTonlineservices.

Ofcom Independent regulator and competition authority for the UK

communicationsindustries.

Off-net Isclassifiedasanetworkcircuitprovidedbyanothernetworkproviders’

access circuit with a network inter-connect with Cable and Wireless

Worldwide(C&WW).

Ofgem TheOfficeofGasandElectricityMarkets:regulatestheelectricityandgas

marketsinGreatBritain.

On-net IsclassifiedasanetworkcircuitprovidedbyadedicatedC&WWaccess

circuit.

RadioMobile It isasoftwaretoolwrittenbyRogerCoudé(VE2DBE)that isusedto

designandpredicttheperformanceofoutdoorradiosystems,suchas,

theRFMeshNetwork.ThesoftwareutilisestheIrregularTerrainModel

(ITM),alsoreferredtoastheLongley-Ricemodel.

RFMeshNetwork The wireless Radio Frequency Mesh Network delivered by SNN that

includesallRFMeshNodes –MastereBridges,RemoteeBridgesand

Relaytoprovideddataconnectivityandcoverage.

RFMeshNodes This defines the communication devices that make up the RF Mesh

Network–MastereBridges,RemoteeBridgesand/orRelay.

VLAN VirtualLocalAreaNetwork–typeofcomputernetworkingdomain

VMware VirtualMachineWare–cloudoperatingsystem.

VRF VirtualRouteForwarding–routingmethodusedinIPnetworking

Term Description Clauseref

Section4.4.4

Section4.3.1

Section4.4.1

Section4.3.2

Section2.1

Section4.3.2

Section4.4.4

Section1.0

Section1.0

Section4.3.4

Section6.4

Section4.3.2

4 | Flexible Plug and Play Communications Platform – SDRC 9.3

4.5 LocalAreaNetwork 38

4.6 GridScapeManagementApplication 39

4.7 End-to-endSolution 40

5 Training 42

5.1 FieldTraining 43

5.2 GridScapeTraining 44

6 IP Communications Infrastructure: Installation 45

6.1 Introduction 46

6.2 WideAreaNetwork 47

6.3 WirelessRadioFrequencyMeshNetwork 48

6.4 GridScapeManagementApplication 49

7 IP Communications Infrastructure: Testing 50

7.1 Introduction 51

7.2 WideAreaNetworkTesting 51

7.3 RFMeshNetworkTesting 52

7.3.1 RFMeshTesting 52

7.3.2 IEC61850Testing 52

8.0 Learning Outcomes 56

9.0 Conclusion 58

Contents Definitions 01

1 Executive Summary 05

2 Introduction 08

2.1 FlexiblePlugandPlay:Background 09

2.2 FlexiblePlugandPlay:TheTrialZone 10

2.3 FlexiblePlugandPlay:TheSolution 11

3 Communications Solution 12

3.1 DriversforIP-basedCommunications

andOpenStandards 13

3.2 FlexiblePlugandPlay:CommunicationsSolution 14

4 IP Communications Infrastructure: Design 15

4.1 Introduction 16

4.2 Requirements 17

4.3 WideAreaNetwork 19

4.3.1 DesignTools 19

4.3.2 DesignAssumptions 19

4.3.3 DesignProcess 19

4.3.4 Back-haulNetwork 20

4.3.5 Front-haulNetwork 21

4.4 WirelessRadioFrequencyMeshNetworkDesign 23

4.4.1 Introduction 23

4.4.2 RFMeshNodes 23

4.4.3 RFMeshDesignProcess 25

4.4.4 DesignTools 25

4.4.5 DesignAssumptions 25

4.4.6 DesignProcess 25

4.4.7 InitialFieldNetworkDesign 25

4.4.8 EnhancedFieldNetworkDesign 30

4.4.9 RFMeshNetworkOptimisation 33

4.4.10 FinalFieldNetworkDesign 34

1Executive Summary


Executive Summarythroughtheintegrationofsmartdevices,smartapplications

andsmartcommercialarrangements.

Inorder tosuccessfully integrate thesesmart components,

itwascrucialthattheFPPprojectutilisedacommunications

solutionthat:

• had self-healing capabilities to deliver reliable and

robust communications for the use of Active Network

Management (ANM)systemand implementationof the

smartcommercialarrangements

• supported the connection and integration of smart

devicesandsmartapplications fromvariousvendorsvia

theopen standardprotocol definedby the International

ElectrotechnicalCommission,IEC61850;

• was independentfromtheexistingUKPowerNetworks’

Supervisory Control And Data Acquisition (SCADA)

communicationsnetwork,canoperate inparallelwith it

andmeetUKPowerNetworks’ITSecurityrequirements;

• couldbedeployedwitheaseandspeedto facilitatethe

progressive,remoteandflexibleconnectionofDG;

• provide communications to both DNO buildings and

generator sites, suchas, substations inareasofvariable

terrainandurbandensities;and

• could be cost-effectively extended to provide access to

furthergeneratorsitesorsubstations.

Oneof the key requirements is the trial of the IEC 61850

protocol.WhileIEC61850isusedwidelyfortheintegration

ofdeviceswithinasubstationenvironment,thereislimited

experienceofitsuseandperformanceforcommunications

between substations. This is one of project’s significant

learningobjectives.

Aspartoftheanalysiscarriedoutduringthebidstage,the

FPPteamconsideredanumberofcommunicationsolutions

that could potentially meet the above requirements at

Flexible Plug and Play (FPP) is a Second Tier Low Carbon

NetworkFund(LCNF)projectthataimstoconnectDistributed

Generation (DG) onto constrained parts of the electricity

distribution network without the need for conventional

networkreinforcement.Toachievethis,anumberofinnovative

technicalandcommercialsolutionswillbetrialledtomanage

network constraints and maximise network utilisation, thus

enablingalternativesmartconnectionsolutionstobetrialledin

ordertofacilitate,accelerateandcostoptimisetheconnection

andoperationofDGinaconstraineddistributionnetwork.

The need for FPP arises directly from the objectives and

challengeshighlightedintheUKRenewableEnergyStrategy

which outlines a clear commitment for an increase in the

nation’suseofrenewableelectricity,withtheUKgovernment

settinganambitioustargetfor30%oftheUK’selectricityto

begeneratedfromrenewableenergysourcesby20201.

Much of this is likely to be connected at the distribution

network level, which presents sizeable commercial and

technical challenges to Distribution Network Operators

(DNOs).Therefore,akeyfocusthathasemergedistheability

forDNOs toaccommodate this volumeofnewgeneration

capacityinanacceleratedandcost-efficientmannerwhileat

thesametimemaintainingthereliabilityoftheirnetworks.

TheFPPprojectledbyUKPowerNetworkswilllooktoaddress

thisrequirementwithacollectiveofprojectpartnerstomove

theDNOfromthepassive‘fitandforget’approachbasedon

conventionalnetworkreinforcementtoonethatconsidersthe

activemanagement of network constraints andgeneration

export,drivinganinnovativeactive‘fitandflex’approachthat

willavoidordefernetworkreinforcement,whichcanoften

makeaconnectioneconomicallyunviableforaDGdeveloper.

The FPP solutionwill demonstrate this active ‘fit andflex’

approach through trialling smart connection solutions

1 The UK Renewable Energy Strategy published July 2009 see the Department of Energy and Climate Change website at: http://www.decc.gov.uk/assets/decc/What%20we%20do/UK%20energy%20supply/Energy%20mix/Renewable%20energy/Renewable%20Energy%20Strategy/1_20090717120647_e_@@_TheUKRenewableEnergyStrategy2009.pdf

Flexible Plug and Play Communications Platform – SDRC 9.3 | 7

Thisprovidesremote,secureconfigurationandmanagement

from a central point for effective management and

maintenance of the communications. UK Power Networks

willusethenetworkmanagementapplicationtomonitorand

evaluatetheperformanceofthecommunicationsnetwork.

The communications network devices were deployed in

thefieldbyUKPowerNetworks internalBusiness-as-Usual

staff. The operational FPP communications network has

beenadoptedandisnowoperatedbytherelevantinternal

departments.Theseareimportantaspectsoftheprojectas

theywillensurearapidtransitiontoBusiness-as-Usualofthis

technologyifUKPowerNetworksweretodecidetorollitout

acrossitslicenceareas.

In summary, the FPP project successfully met the project

Successful Delivery Reward Criterion (SDRC) for the

‘Communications Platform’ workstream, which was

referencedas9.3intheProjectDirection.

The SDRC 9.3 set out the milestone for an IP-based

communications solution to be deployed for the FPP

project by Q1 2013, and the workstream achieved this

inFebruary2013.

Furthermore,keyactivitieswereundertakenandachievedto

supportthismilestone,whichincluded:

• the successful installation and commissioning of

the combined RF Mesh Network/MSP IP-based

communicationssolution;and

• executing IEC 61850 trials using IEC 61850 simulators to

demonstratetheperformanceofthecommunicationsnetwork.

The FPP project intends to publish further information on

thetotalcostofownershipforthespecificsolutionandits

performanceatalaterstageintheproject.

differentcosts.Itwasconcludedthesolutiondescribedinthis

reportcanpotentiallymeetallrequirementsanditalsohas

attractivecharacteristicsintermsofscalingupandtotalcosts

forwide-scaledeployment.

TheFPPcommunicationssolutionisdeliveredinpartnership

withCable&WirelessWorldwide(C&WW)andSilverSpring

Networks (UK) Limited (SSN). The solution is an IP-based

platformthatcombinestheWideAreaNetwork(WAN)using

the Multi Service Platform (MSP) network with a Wireless

RadioFrequency(RF)MeshNetwork(RFMeshNetwork).The

RFMeshNetworkwasdesignedwitha ‘canopy’approach

and dynamic many-to-many communications connections.

ThismeansthattheRFMeshNetworkcoversadesignated

geographical footprint, which enables rapid feasibility

assessmentsandresponsestoDGdevelopers.Thelikelihood

of communicationsbeingdelivered tonewDGdevelopers

is assessed by geographically positioning the new site’s

location on the communications geographical footprint.

Whereimmediateconnectivity isnotavailable,thecanopy

can be easily extended by the deployment of additional

communicationsdevices,RFMeshNodes.

Furthermore, the RF Mesh Network’s many-to-many

connections approach delivers reliable and robust

communications.EachRFMeshNodewasdesignedtohave

multiple redundant paths to allow for ‘self-healing’ of the

communicationsnetwork.Therefore,intheeventoffailure,

forexample,thelossofanRFMeshNodeorisolatedpower

outage,thecommunicationspathcouldfailovertooneof

the redundant paths. Traditional communications solutions

used by the Distribution Network Operators (DNOs) such

as satellite, long range radio and GSM data are typically

deployedside-by-sidetoachieveredundancy.

Tomanage theRFMeshNetwork, theproject deployeda

web-based network management application, GridScape.

2Introduction


Flexible Plug and Play: Background 2.1

project 13GW onshore wind connected to the network by

20203. Currently the UK has more than 5GW of installed

onshorewindcapacityinoperation4.

With much of this likely to require connections at the

distribution network level, one area of focus that has

emergedistherequirementforDNOstoexploreinnovative

commercialand technical solutions toaccommodate these

volumesofnewgenerationcapacity inanacceleratedand

cost-efficientmannerwhile at the same timemaintaining

thereliabilityoftheirnetworks.

TheFPPproject,ledbyUKPowerNetworks,addressesthis

requirement inpartnershipwith10projectpartners:Cable

& Wireless Worldwide, Silver Spring Networks, Alstom

Grid, Smarter Grid Solutions, GL Garrad Hassan, University

of Cambridge, Imperial College London, the Institute

of Engineering and Technology, Fundamentals and

GEPowerConversion.

The FPP project funded under Ofgem’s LCNF Second

Tierschemeaimstofacilitatetheacceleration,growthand

expansionofDGconnectionsontothedistributionelectricity

network without the need for conventional network

reinforcement. Rather, the approach seeks to achieve

this by managing network constraints and maximising

networkutilisation.TheFPPprojectwilldothisthroughthe

integrationof smartdevices, smartapplicationsand smart

commercialarrangements.

The UK Renewable Energy Strategy outlines a clear

commitmentforanincreaseinthenation’suseofrenewable

electricity, with the UK government setting an ambitious

targetfor30%oftheUK’selectricitytobegeneratedfrom

renewable energy sources by 20202. Onshore wind is an

identified and proven technology that will be a leading

contributor to the achievement of the target and help

transitiontheUKtoalowcarboneconomy.TheDepartment

for Energy and Climate Change’s (DECC) latest scenarios

2 The UK Renewable Energy Strategy published July 2009 see the Department of Energy and Climate Change website at: http://www.decc.gov.uk/assets/decc/What%20we%20do/UK%20energy%20supply/Energy%20mix/Renewable%20energy/Renewable%20Energy%20Strategy/1_20090717120647_e_@@_TheUKRenewableEnergyStrategy2009.pdf

3 The UK Renewable Energy Map published July 2011 see the Department of Energy and Climate Change website at: www.decc.gov.uk/assets/decc/11/meeting-energy-demand/renewable-energy/2167-uk-renewable-energy-roadmap.pdf

4 July 2012 Figure. Onshore Wind-Call for Evidence – Part A published 20 September 2012 see http://www.decc.gov.uk/assets/decc/11/consultation/wind/6437-onshore-wind-call-for-evidence-document-part-a-com.pdf . Data based on analysis from DECC’s Renewable Energy Planning Database (REPD) which tracks renewable developments through the planning system. The REPD database can be found at https://restats.decc.gov.uk/cms/welcome-to-the-restats-web-site


Flexible Plug and Play: The Trial Zone2.2The location chosen for the FPP project is an area of

UK Power Networks’ Eastern Power Networks Plc (EPN)

distributionnetworkthatservesapproximately30kmdiameter

(700km²) between Peterborough and Cambridge (the FPP

TrialZone)intheEastofEngland,UK.Thisareaisfavourable

toDGdevelopers–windandsolarfarmsinparticular–dueto

geographyandweatherconditions.

Over recent years UK Power Networks has experienced

increased activity in DG development in this area, and a

rapid rise in connection applications; existing renewable DG

connections total 121MW, with 277.45MW of DG capacity

currentlyatvariousstagesoftheplanningprocessseekingto

connect as at February2013.Using conventional connection

approaches, theconnectionof thisanticipatedgrowth inDG

is expected to require significant network reinforcement to

managenetworkthermalandvoltageconstraintsandreverse

powerflowissues.

Forthisreason,theareabetweenPeterboroughandCambridge

serves as an ideal trial area for the FPP project to explore

alternativesmartconnectionsolutions.


Flexible Plug and Play: The Solution2.3

Smart Commercial Arrangements: As generators’ export

willbeactivelymanaged(i.e.theiroutputwillberegulated

tomeetdistributionnetworkconstraints),newcommercial

and connection arrangements will be established that

defineaccesstothedistributionnetworkcapacityavailable

inrealtime.Thiswillbeintheformofa‘non-firm’orso-

called‘interruptible’connectionagreement,firstexamplesof

whichhavebeenissuedbytheFPPprojecttoanumberof

generatorsinMarch2013.

In order to successfully integrate the smart devices and

applications, the FPP project has deployed an IP-based

communications infrastructure that will make use of the

latestdevelopments insmartgridopenstandards,suchas

IEC61850.

TheIP-basedcommunicationsinfrastructureestablishesdata

connectivitybothwithinandbetweensubstationsusingIEC

61850tofullycoordinateand leveragethebenefitsof the

smartdevices,andsmartapplications.Therequirementfor

therangeofsmartdevicestobecompliantwithIEC61850

addressesthechallengesassociatedwithinteroperability.

AdditionallytheIP-basedcommunicationsinfrastructurewill

facilitate thedataexchangeandcontrol capabilityofANM

usingIEC61850toimplementthetechnicalandcommercial

solutions in real time tomanagenetwork constraints. This

will allow for thedistributionnetwork to accept increased

levelsofDGoverall.

Therefore, the FPP solution will demonstrate how, through

alternativeconnectionsolutions,acceleratedandcost-effective

connectionofDGtoadistributionnetworkcanbeachieved.

TheFPPprojectistriallingsmartconnectionsolutions,inorder

tofacilitate,accelerateandcostoptimisetheconnectionand

operationofDGinaconstraineddistributionnetwork.

The project is trialling an alternative to the passive ‘fit

and forget’ approach based on conventional network

reinforcement–onethatconsiderstheactivemanagement

of network constraints and generation export, driving an

innovative active ‘fit and flex’ approach that will avoid or

defernetworkreinforcement.

The FPP solutionwill demonstrate this active ‘fit andflex’

approach through the integration of smart devices, smart

applicationsandsmartcommercialarrangements.

Smart Devices:Thesolutionwilldeploysmartdevicesfrom

variousvendorstoaddressandmanagespecificexistingor

anticipatednetwork constraintsandoperational limitations

of the network that either restrict DG connections or are

introducedbytheconnectionofDG.Therangeofsmartdevices

include:dynamiclineratings;activevoltagemanagement;a

QuadratureBoostercontrolsystem;‘frequentuse’switches;

andgenerationcontrollers.

Smart Applications:Asmartapplicationwillbeinstalledat

UKPowerNetworks’controlcentreatForeHamlet,Ipswich,

providinganActiveNetworkManagement (ANM) solution

to monitor real time network parameters by the smart

devices.TheANMwillalsomanagethegenerators’output

using the generation controllers, which will allow the DG

exporttotrackthereal-timeexportcapacityavailablewithin

the real-time constraints on the distribution network. The

ANMwill perform these functionswhileensuring that the

distribution network maintains its reliability and performs

withinoperationallimits.

3Communications Solution


Drivers for IP-based Communications and Open Standards

3.1proprietaryvendor IP-basedcommunications infrastructure

andindoingsoreducestherelianceona limitednumber

of technologyprovidersandproprietary systems. Thiswill

foster increased competition and innovation amongst the

technologyprovidersandimprovethesecurityoftheDNOs

supplychain.

Scalability: The RF Mesh Network’s connectivity and

geographical coverage can easily be extended through

the deployment of additional RF Mesh Nodes at required

locations. Therefore, this communicationsapproach canbe

scaledupinatimelyandcost-effectivemannerandbebuilt

uptocoveranyareaofthedistributionnetwork.

Robustness:TheRFMeshNetwork’smeshtopologyandits

dynamicmany-to-manyconnectionsallowfor‘self-healing’

ofthenetworkshouldanodebelost.

Repeatability: The communications infrastructure is an

approach that will provide communications in variable

terrain and urban density. It is not discriminative to the

vendorprovidersorthegeographicallocationsofthesites

andcanthereforebeappliedtoallGBdistributionnetworks.

The primary drivers for the FPP communications solution

beingbasedonIPcommunicationsandopenstandardswere:

Flexible Plug and Play:TheFPPcommunicationssolutionwill

demonstratetheactive‘fitandflex’approachoftheproject

by the ease and speed of deploying the communications

necessary to integrate new DG sites into the distribution

networkwithintheFPPTrialZone.Also,itwillfacilitatethe

progressive and flexible connection of smart devices and

applicationsfrommultiplevendors.

Interoperability: The FPP communications solution is built

onopenstandardsandallowsfortheintegrationofmultiple

technologyvendors’smartdevicesandapplicationsacrossa

commonplatform.Thisuniversalrequirementforequipment

to comply will enable an IP-based communications

infrastructure that is non-specific to any vendor and

that can integrate various technologies; specifically the

communications protocol used will be the open standard

protocol,IEC61850.

Increased Competition and Innovation: The FPP

communications solution avoids the build out of a


WebPortal

Flexible Plug and Play: Communications Solution

3.2The end-to-end IP-based communications infrastructure

solutioniscomprisedofthefollowingfourkeycomponents:

RF Mesh Network, Local Area Network (LAN), Wide Area

Network(WAN)andtheGridScapemanagement tool. It is

capable of IP encapsulation and transport of the IP-based

protocols such asDistributedNetwork Protocol 3.0 (DNP3)

andIEC61850.

The communications solution uses RF Mesh technology as

theprimaryconnectivitybetweensubstationsandtheend

FPPgeneratorsites.TheIPversion6(IPv6)basedRFMesh

technology operates on sub-GHz radio spectrum, 870-876

MHz,deliveringtherequiredpropagationandperformance

whilesupportingapracticaldatarateforcurrentandfuture

smartgridservices.

AllofthedevicesprovidedaspartoftheRFMeshNetwork

havetheabilitytosecurelypasstrafficbetweenthemand

toroutetothepreferredoralternateback-haulpointwhere

it connects to UK Power Networks’ WAN. The back-haul

andconnectivitytoUKPowerNetworks’WANusesC&WW’s

MSPnetwork.TheMSPisanIPbasednetworkthatprovides

a proven, secure and high availability platform already in

use as UK Power Networks’ core communications IP

backbonenetwork.

Network visibility of the RF Mesh Network elements is

providedviawebportalaccesstoSSN’sGridScapenetwork

managementsolution(amanagementapplicationprovided

asSoftwareasaService(SaaS)toUKPowerNetworks).

Figure 1 depicts a high-level representation of the FPP

communicationssolution:

Figure 1: High-level end-to-end IP-based communications infrastructure

CEMulti

Service Platform (MSP)

RF Mesh Network

RemoteeBridge

MastereBridge

RemoteeBridge

MastereBridge

AccessPoint

CE

AccessPoint

AP

AP

RemoteeBridge

RemoteeBridge

RemoteeBridge

DistributedGeneration

PrimarySubstation

PrimarySubstation

RFMeshNetwork LocalAreaNetwork WideAreaNetwork

GridSubstation

GridSubstation

CE

ActiveNetworkManagementServer

AccesstoGridScape

UK Power Networks’ Control Centre

UK Power Networks’ User

GridScapeServer

CE

Relays

LowVoltage(LV)DistributionPole

CE=CustomerEdgerouter

Key

4IP Communications Infrastructure: Design


Introduction4.1Thedesignprocessbringstogetherdiscretedesignelements

that combine to deliver an end-to-end IP communications

infrastructure that will allow the IP encapsulation and

transportoftraffic(includingDNP3andIEC61850)tomeet

theFPPprojectrequirements.TheIP-basedcommunications

infrastructureiscomprisedofthefollowingelements:

• WAN(WideAreaNetwork)

• WirelessRadioFrequencyMeshNetwork(RFMeshNetwork)

• LAN(LocalAreaNetwork)

• GridScapeManagementTool


Requirements4.2TheIP-basedcommunicationsinfrastructurewasdeveloped

tosupportspecificFPPprojectrequirementsforconnectivity,

coverage and availability. This includes the requirement

Requirements

MeshconnectivitytobeprovidedtoandbetweenthefollowingnodeswithintheFPPTrialZone:

• Two 132/33kV Grid substations:MarchandPeterboroughCentral.

• Ten 33/11kV Primary substations: March; Southery; Farcet; Littleport; Funthams Lane;

Northwold;Wissington(BritishSugar);Bury;WhittleseyandChatteris.

TheserverfortheANMsolutionwillbelocatedcentrallywithinUKPowerNetworks’control

centreatForeHamlet,Ipswich.Therefore,meshconnectivityisrequiredtotheANMserver.

The communications solution design is to establish a LAN within each of the identified

locationstoconnecttheRFMeshNetworktotheproposedsmartdevicesandenddevices

usingEthernetconnection:

• Ten 33/11kV Primary substations:

- Dynamic LineRating (DLR): Fourof thePrimary substations thatarepartof theFPP

TrialZoneareexpectedtohaveaDLRdeployed–Farcet,FunthamsLane,Marchand

Whittlesey.

- AutomaticVoltageControl(AVC):TwoofthePrimarysubstations,MarchandChatteris,

areexpectedtohaveanAVCdevicedeployed.

- Quadrature Booster Control System (QBCS): The Primary substation, Wissington, will

haveaQuadratureBoostertransformerdeployedonsitewithacontrolsystem.

• 33kV or 11kV interfacing substation:

- LocalANMcontroller:AgenerationcontrollerwillbeinstalledtoenabletheANMsolution

tomanagethegenerators’export.

• Two 33kV distribution poles: Connectivity to the indicative distribution pole locations

withintheFPPTrialZonewheretheFUSareexpectedtobemounted.

AninstanceoftheGridScapemanagementsystemwillbehostedatSSN’sDataCentre.Therefore,

connectivity is required to be established between the RF Mesh Network to the GridScape

instance.

Description

Node connectivity to substations

Node connectivity to the ANM solution

Smart Device and End Device Connectivity

GridScape Connectivity

Table 1: Communications Solution Requirements

to carry the required data protocols: DNP3 and the open

standardprotocolIEC61850.


Requirements

AcanopyapproachistobetakeninthedesignoftheRFMeshNetworktoprovidecoverageto

16newgeneratorlocations(eithera33kVor11kVinterfacingsubstation)thatareanticipated

toconnectwithintheFPPTrialZone.The16generatorpointsofconnectionareindicativeasthe

connectionrequestsarewithinUKPowerNetworks’earlyplanningprocess.

It shouldbenotedthat theexisting121MWofconnectedDGwithin theFPPTrialZonewill

notbeconnectedusingthecommunicationssolutionastheywillremainontheircurrentfirm

commercialandconnectionarrangementsandthereforewillnotbeactivelycontrolledbythe

ANMsolution.

Lowvoltage(LV)distributionpolesaretobeusedforextendedreach-abilityoftheRFMesh

Networkandtoenhancethemeshconnectivitybetweenthenodes.

TheFPPcommunicationssolutionshallsupportatleastthefollowingprotocols:

• DNP3overIP

• IEC61850

For clarity, the requirement for the communications solution is to support the Specific

CommunicationServiceMapping(SCSM)ofIEC61850standardcommunicationsasdefinedin

IEC61850-8-1:

• CoreAbstractCommunicationServiceInterface(ACSI)services,whichshallbesupportedvia

ManufacturingMessagingSpecification(MMS)ProtocolSuitesupport

• Timesynchronisationservices,whichshallbesupportedviaStandardNetworkTimeProtocol

(SNTP)support

Thereisnorequirementforthecommunicationssolutiontosupportthefollowingelementsof

SCSMofIEC61850standardcommunicationsasdefinedinIEC61850-8-1:

• SampledValue(SV)messaging

• GenericObjectOrientedSubstationEvents(GOOSE)

• GenericSubstationStateEvents(GSSE)

TheRFMeshNetworkistobedevelopedtosupportonesecondpollingtomeettheworstcase

scenarioofthedatapulloftheANMsolution.

ThemainfocusoftheFPPcommunicationssolutionisthefacilitationofANMtraffic;thereisno

requirementforprotectiongradedcommunicationsperformancetobedeliveredbytheRFMesh

Network.

Requirements

Coverage to new generators

Extension

Data Protocols

Capacity

Protection Systems


Final Design

ServiceChangeRequests

NetworkBuild

OrdersPlaced

C&WW High Level Design Produced

C&WW & OLO Site Surveys

Wide Area Network 4.3The WAN design was focused on the establishment of

Internet Protocol Virtual Private Network (IPVPN) access

circuits to support the ‘back-haul’ and ‘front-haul’ network

functionsofthecommunicationssolution.

Theback-haulnetworkincludes:

• the communications connection between the RF Mesh

NetworkandANMsolutionfordataexchange;and

• the management connection between the RF Mesh

NetworkandGridScapemanagementapplication.

Thefront-haulnetworkis:

• theprovisionofUKPowerNetworks’useraccesstothe

GridScapemanagementapplication.

4.3.1 Design Tools

TheC&WWcapacityplanningtool,Mozart,wasusedtodetermine

the bandwidth capacity available at the Grid substations

identifiedastheIPVPNandRFMeshinter-connectsites.

4.3.2 Design Assumptions

ThefollowingassumptionswereappliedintheWANdesign

processfortheFPPIPcommunicationsnetwork:

• 2Mbit/sofIPVPNbandwidthrequiredattheFPPIPVPNandRF

Meshinter-connectsites,PeterboroughCentralandMarchGrid.

• March Grid would need to be provisioned off-net using

newBritishTelecommunications(BT)fibrecapacity.

• Peterborough Central Grid would be provisioned on-net

usingnewC&WWfibrecapacity.

• New2MbitsVirtualRouteForwarding (VRF)wouldneed

to be provisioned into the existing WAN at UK Power

Networks’controlcentre,ForeHamlet,Ipswich.

4.3.3 Design Process

Thehigh-levelWANdesignprocessconsistsofanumberof

distinctphases,whichareoutlinedinFigure2:

ThesummaryoftheWANdesignprocessisasfollows:

Phase 1: C&WW Capacity Planning

C&WW capacity planning tools (i.e. Mozart) were used

to determine the feasibility and cost assessment for the

provision of network connections at UK Power Networks’

Gridsubstations,identifiedastheIPVPNandRFMeshinter-

connectsites,bylinkingtocurrentC&WWnetworkinventory

databasesandBTonlineservices.

Phase 2: C&WW and OLO Site Survey

FollowingthedesktopcapacityplanningexerciseC&WWor

anOtherLicensedOperator(OLO)e.g.BTworkingonC&WW’s

behalfcarriedoutaphysicalsitesurveyinordertoidentify

any local issues that may have an impact on the design

process.Theresultsofthesitesurveyswerefedbackintothe

Figure 2: WAN Design Process

C&WW Capacity Planning

UKPN Location Data

Site Surveys


capacityplanningprocessinordertobecapturedintheHigh

LevelDesigndocumentation.

Phase 3: C&WW High Level Design Produced

Theresultsofthecapacityplanningandsitesurveyphaseof

theWANdesignarenowincorporatedintotheHighLevelDesign

documentation, which details the types of services being

provisionedandwheretheyaretobephysicallyconnected.

Phase 4: Orders Placed and Network Build

Followingbothtechnicalandprojectgovernancesign-offofthe

HighLevelDesign,theinitialIPVPNservicesorderswereraised.

Itisduringthisinitialordergenerationthatitisalsoidentified

whereadditionalserviceswillneedtobeprovidedviaanOLO

(BTinthecaseofMarchGrid)whicharethenissuedtotheOLO

toprovideservicebacktoaC&WWnetworkinter-connectpoint.

As these individual services are physically delivered and

commissioned,thisiswhatisknownasthe“networkbuild”

stage–e.g.installationofCustomerEdge(CE)routers,which

uponcompletionwillbehandedovertoUKPowerNetworks

forservicecommencement.

Phase 5: Service Change Request

FollowingthenetworkbuildstageoftheWANdesignprocess

thereisanadditionalphaseknownasServiceChangeRequest

(SCR).ThisallowstheC&WWandSSNtechnicaldesignteam

tomakeadditionalcustomerspecificchanges(e.g.configuring

IProutesummarisationontheroutersatPeterboroughCentral

andMarchGrid)tothenetworkundercontrolledconditions.

TheSCRprocessisadditionallyusedoncethenetworkisin

thefinaldesignphase.Thisistoensurethattheappropriate

levelsoftechnicalgovernanceareapplied.

Phase 6: Final Design

Atthisstageofthedesignprocessthenetworkhasreached

the“asbuilt”finaldesignstate,and is thereforereadyfor

customerUserAcceptanceTesting(UAT)beforethenetwork

isreadytobeclassifiedasbeing“inproduction”andready

forliveservicestobemigratedtoit.

4.3.4 Back-haul Network

Theback-haulnetwork thatdelivers theRFMeshNetwork

data to the ANM solution, and provides the RF Mesh

management connection from GridScape includes the

followingcomponents:

• MSPIPVPNService

• MSPaccesscircuit(s)andCErouter(s)

• AdditionalVRFaccessbandwidthfromMSPintoForeHamlet

• InternetProtocolSecure(IPSec)accessbandwidthfromMSP

totheC&WWIPSecGateway–SSN’smanagementtraffic

Figure3providesanoverviewoftheVRFdesignandhowthis

integratesintoUKPowerNetworks’existinginfrastructure.

Figure3shows the IPVPNservice (UKPN_FPP_VRF1) that

has been provided into Peterborough Central and March

GridsubstationsutilisingC&WW’snewaccesscircuits.These

were terminated with standard Cisco 2901 CE routers,

presentingEthernetconnectivitytotheRFMeshNodesat

thoselocations.

Inaddition,connectivitywasupgradedat theForeHamlet

site for the FPP project’s ANM solution via a new Virtual

RoutingandForwarding(VRF)instanceontheMultiService

AccessBearers(MSAB)alreadyinstalledatthissite.Aspartof

thenewdesigna2Mbit/sFPPVRFwasprovidedspecifically

tokeepUKPowerNetworks’SupervisoryControlandData

Acquisition(SCADA)productionnetworkandtheFPPproject’s

networklogicallyseparate.

Furthermoreaseparate2Mbit/sVRFinstances-twoseparate

VRFsdeliveredinahubandspokeconfiguration-havebeen


provided for SSN management access (shown as the SSN

Management VLAN in Figure 3) to the RF Mesh Network

(shown as the FPP VLAN in Figure 3). This additional VRF

utilisesthesamephysical10/100Ethernetportreservedfor

FPP,anduses802.1qwiththeirassociatedVLANsviatheUK

PowerNetworksANMsolution’sFirewall.

4.3.5 Front-haul Network

Thefront-haulnetworkisdefinedastheIPcommunications

Figure 3: Back-haul Virtual Routing and Forwarding Design

infrastructurethatprovidesUKPowerNetworks’useraccess

totheGridScapemanagementapplication.Thisencompasses

bothIPSecaccessandconnections:

IPSec access to GridScape from the Corporate Network:The

front-haul network utilises UK Power Networks’ corporate

IPVPNanditsexistingconnectivitytotheInternettoestablish

thenewIPSecconnectionforUKPowerNetworks’accessto

theGridScapemanagementserver.

CE

GridScapeManagementServer

SSNUKPNIPSecManagementRouter

CE

CE

CE CEPeterboroughCentral

MarchGrid

FPPVLAN

SSNManagementVLAN

SCADAVLAN

ForeHamlet

SCADASite(s)

ANMFirewall

802.1qinterface

UKPN_FPP_VRF1

UKPN SCADA VRFSSN_MAN_SPOKE_VRF1Internet

CE

C&WWIPSecGateway

IPSecConnection

SSN

_MAN

_SPO

KE_V

RF1

UKPN

_FPP

_VRF

1

UKPN

SCA

DA V

RF

CE=CustomerEdgerouterPE=ProviderEdgerouter

Key

PEPE


This connection provides access to GridScape to monitor

the RF Mesh Network from a UK Power Networks user

perspective.Thislinkisnotintendedtoprovidemanagement

accesstotheRFMeshNetworkdevicesfromSSN.

Indeed, itshouldalsobenotedherethatwhilenewIPSec

connectivity will provide access to/from the GridScape

application located in the United States of America, no

FPP datawill traverse these links as these data flows are

containedwithinUKPowerNetworks’FPPnetwork,which

terminatesatForeHamlet.

IPSec Connections:Figure4providesaconceptualviewofthe

twonewIPSecconnections;eachIPSecconnectionprovides

aphysicallyseparateserviceandfunctionwhichhavebeen

providedaspartofthefinalFPPIPCommunicationsnetwork.

Figure 4: IPSec Conceptual Diagram

CE CEInternet CorpVRF FPP_VRF1

CE

CE CEInternet FPP_VRF1

CE

MarchGrid

PeterboroughCentral

MarchGrid

PeterboroughCentral

GridscapeServer(s)

SSNPerimeter LogicaDataCentrePerimeter FPPBackhaulSitesUKPNControlCenter

SSNPerimeter LogicaDataCentrePerimeter UKPNControlCenter

UKPNGridscapeAccess

SSNSNMPAccess

SSNGridscapeManagementTraffic

CustomerEdgerouter

Key

SSNAccessPoint

IPSec#1

IPSec#2

CE

SSN_MAN_VRF


Wireless Radio Frequency Mesh Network Design

4.44.4.1 Introduction

TheRFMeshNetworkelementconsistsofacontiguousgroup

ofRFMeshNodestoformanIPv6-enabledlogicalIPnetwork

acrosstheFPPTrialZone.ThissectiondescribestheRFMesh

Nodes and software that comprise the RF Mesh Network

elementoftheIP-basedcommunicationsinfrastructure.

SpecificfeaturesoftheRFMeshNodesareoutlinedbelow:

• The eBridges and Relays (and, for management traffic,

AccessPoints)automaticallyformaLayer2meshnetwork.

Devicescanautomaticallycommunicatewitheachother

bytransparentlyhoppingthroughotherdevices.

• Dual-stack, IP version 4 (IPv4) and IPv6 network

addressing. IPv4 is the network addressing currently in

usebyUKPowerNetworks’ITandSCADAnetwork.IPv6

is the network addressing for the management data

that provides the increased capacity to future proof the

communicationssolution.

• The RF Mesh Network has a dynamic and self-healing

capability.Asnewdevicescomeonlineandotherdevices

gooffline, thenetworkadjusts, and routes convergeon

newdestinations.

• Each device is responsible for keeping track of its

neighbours – other eBridges andRelayswithwhich the

devicecandirectlycommunicate.Ifaneighbourdeviceis

unavailable,thedevicecancommunicatethroughoneof

itsotherneighbours.

• AnRFMeshNodecanhavebetween1and127neighbours,

anyoneofwhichmaybethe‘nexthop’uptoaMaster

eBridgeorAccessPointthatisthe‘take-outpoint’forthe

network.TheRFMeshNodewillidentifyandregisterwith

twovalidtake-outpoints.However,therecanbemultiple

neighbourswhichwillgetittothetake-outpoint.

• TheRFMeshNetworkincludessecuritymeasuresbasedon

widelyusedstandards inthenetworkingindustry.These

securitymeasurescanfitseamlesslyintothepoliciesand

technologiesthatDNOsalreadyuseontheirnetworks.

• TheRFMeshNetworksupportsboth IP routingand raw

datatransport.

• TheRFMeshNetworkequipmentoperateswithinthe870-

876MHzRFspectrumusinganOfcomdevelopmentlicence

andwilluseomni-directionalantennas.


4.4.2 RF Mesh Nodes

Access Point

TheAccessPoint(AP)providesconnectivitybetweenRFMesh

Nodes and the remote Gridscape management application.

TheAP’sflexiblecommunicationfeaturesextendthereachand

coverageof thenetworktoendpoints,andofferscalability

thatdramaticallylowersthetotalcostofownership.Sinceit

hasabackupbattery,theAPcanreliablyroutemanagetasks

–evenduringanoutage–anditfeaturesrobustsecurityand

networksafety.

The APs were mounted internally within the Peterborough

CentralandMarchGridsubstationsandconnectedtotheWAN

networkviaahard-wiredEthernetconnection.TheAPsactas

an aggregation point for network management traffic only

andassuchdonotcarryoperationaltraffictotheUKPower

NetworksANMapplication.

Relay

The Relay acts as a repeater to extend network reach,

particularlywhenspanningoverlongerdistancesandaround

topographicalobstacles.Relaysaredesignatedtobe:

• Strategicforthosetobeinstalledinsupportofthedesign;or

• Tacticalforunforeseenoptimisation/remediationifrequired.

For the FPP project, Relays include a battery for backup

duringpoweroutagesandinthemainweredeployedatLV

distributionpoles.

eBridges

eBridgesareintelligentwirelessroutersforsecureIPandserial-

based, two-way, real-time communications between smart

devices/RTU and the management systems. eBridges are

manufacturedtoperformoneoftworoles:MasterorRemote.

• A Master eBridge provides the connection or take out point

fortheRemoteeBridgestothemanagementsystems.The

MastereBridgeEthernetporttypicallyconnectstothenetwork

leadingtothebackofficeortheelectricalsubstationsystems.

• The Remote eBridges connect to the smart devices/

RemoteterminalUnit(RTU)toprovideconnectivitybackto

theMastereBridge.ARemoteeBridgecanuseitsEthernet

port to connect to one or more smart devices/RTUs. All

inboundandoutboundtrafficfromtheUKPowerNetworks

ANMapplicationpassesthroughtheeBridges.

CATT and FSU

Communications Tester (CATT) is a software tool for

configuringanddiagnosingissuesonRFMeshNodes.Itruns

on a Windows-based PC or laptop and pairs with the Field

ServiceUnit(FSU)depictedtotheleftforestablishingmesh

connection.TheFSUisacompactfielddeviceequippedwith

SSN’sRFcommunicationsthatprovidesthelinkbetweenthe

fieldtoolsandRFMeshNodes.

The FSU can be used by the DNOs field engineers and

technicians, for example, to wirelessly configure and

troubleshootAPs,Relays,andeBridgesthataremountedon

DNOpolesorotherhard-to-reachlocations.

Access Point Relay Field Service UniteBridge


4.4.3 RF Mesh Design Process

The design of the RF Mesh Network was focused on

delivering reliable and robust communications. It was

developed to have multiple redundant paths to ensure

reliablecommunicationseven in theeventof failure inan

RFMeshNode,isolatedpoweroutagesandothercontinuity

events.Additionally,itwasdevelopedtobeflexibleinterms

ofproviding communications in variable terrainandurban

density.Furthermore,considerationwasgivennotonlytothe

FPPproject’scurrentneedsbutfutureneedsastheproject

evolvestoincludenewgeneratorlocations.

4.4.4 Design Tools

The RF Mesh Network was designed using MapInfo

ProfessionalGIS software in conjunctionwithGoogleEarth

Proforvisualanalysis.

Propagation simulationwasperformedwithRadioMobile;

thelanduse/clutterdatausedhasaresolutionof1km.This

toolcalculatestheperformanceofthelinkandpathprofile

betweentheRFMeshNodes.

4.4.5 Design Assumptions

• Sitesurveydataisaccurate

• Antennamountedwithoutobstructionfor360degrees

• 6decibels(dB)gainomniantennautilisedonalldevices

• AvailableRFspectrumis870-876MHz

• Radiopoweroutput–1Watt

4.4.6 Design Process

The design process consists of distinct phases, specifically

ordered to arrive at an optimal placement of RF Mesh

Nodes. In addition to the network design phases, the

networkoptimisationphaseiscrucialtoensuringthecorrect

performanceofthenetwork.ThedistinctphasesforRFMesh

NetworkdesignareshowninFigure5:

4.4.7 Initial Field Network Design

TheInitialFieldNetworkDesignisadraftplacementofRF

MeshNodes,takingintoconsideration:

• performancerequirements;

• RFsignalpropagation;

• physicaltopographyandclutter;and

• deploymentstrategies,andsiterestrictionsandpreferences.

Thisisa‘first-cut’networkapproximationtohaveastarting

point in determining RF Mesh Node install locations. The

reliabilityandaccuracyofboththeRFMeshNodeestimate

andpre-surveymappingwasdependentonthequalityand

depth of the gathered data. The pre-survey map is only

basedonenddevicesdensityandcoverageareaandserves

Figure 5: RF Mesh Design Phases

As BuiltFinalField Network Design

Optimisation & Remediation

NetworkBuild

EnhancedField Network Design

Site Surveys

Initial Field Network Design

UKPN Location Data

SiteSurveys


asanestimatedRFMeshNodecountonly,forscopingaswell

asforplanningandexecutingthesitesurveys.

Fortheinitialfieldnetworkdesign,aseriesofpropagation

studieswereperformed:

• Theoriginalpropagationstudieswereperformedutilising

very conservative parameters: modelling was performed

at a very conservative confidence level (measure of

variability) of 80/70/70 (time/location/situation) and

numberofretriessettozero.

• Are-runofthepropagationmodelusinglessconservative

parameter values were also undertaken to provide an

exampleofvariabilityofconnectivitythatcouldbeachieved.

Table 2 presents the outputs of the initial field network

design. The location data of the various connectivity and

coverage requirements were collated using UK Power

Networks’electricalassetcatalogue,Ellipse.

Asthelocationoftheenddevices(Gridsubstations,Primary

substationsandFUS)arefixed,thedesignconcentratedon

designingthebestlocationsforthedeploymentofRelays.

TheRelayswillenhancethemeshconnectivitybetweenthe

fixedlocationsandextendthereach-abilityoftheRFMesh

10x33/11kVPrimarysubstation

RemoteeBridges 30 2x132/33kVGridsubstation

16xInterfacinggeneratorsubstation(33kVor11kVsubstation)

2x33kVpoles

MastereBridges 2 2x132/33kVGridsubstation

AccessPoints 2 2x132/33kVGridsubstation

RFMeshNode Quantity InstallLocation

Table 2: Initial field network design – RF Mesh Node Quantity

StrategicRelays 14 14xLVdistributionpole

TacticalRelays 6 6xLVdistributionpole


Table 3: Initial field network design – Relay Quantity

Networktoenablemeshconnectiontotheanticipatednew

generatorandFUSlocationswhentheyareconnected.

Relaynumbersweredeterminedduring the initial design

phasetobe:


Figure6displaystheRFMeshNodeandtheStrategicRelay

locationsidentifiedthroughtheinitialdesignprocess.

Italso illustrates the indicativefixed locationof the33kV

poleswherethesmartdevice,theFUS, isexpectedtobe

deployedandwillsubsequentlyrequiremeshconnectivity,

FUS-1 and FUS-2. Furthermore, the indicative locations of

the anticipated sixteen new generators that have been

taken into considerationwithin thedesign, are identified

by‘NGI-X’.

Figure 6: eBridges and Relay sites


Figure7depictsthemodelledmeshlinksbetweenthefixed

nodes,theGridandPrimarysubstationsandthedetermined

StrategicRelaylocations.

The indication of link performance between the nodes is

represented by the link paths’ green shade – the lighter

greenlinkpathindicatesastrongperformancelevelandthe

darkergreenisonethatismarginallypoorer.Thelinkpath

depictedtobedarkergreenhasdegradedinlinkqualitydue

totheincreaseddistancebetweennodes.

Figure 7: Link Model with identified Relay sites


Figure8depictsthecoverageplotsofthenodeswithintheFPP

TrialZoneandhighlights the ‘canopy’approachachievedfor

thedesignoftheRFMeshNetwork.

The heat map represents the modelled signal strengths

excluding variables such as environmental effects that may

impairmeshconnectivity.Itprovidesavisualrepresentationof

theindicativesignalstrengthratingoftheRFMeshNodesand

thereforethelikelihoodofmeshconnectionsuccess.

It canbeassumed thatmeshconnection couldbeachieved

easilyifanewgeneratorweretobeinstalledwithinthegreen

areaof theheatmapand itcouldbe thecase if itwere to

belocatedattheoutskirtsofthelightblueareathataTactical

Relaymayberequiretobedeployedforextendedreach-ability.

Figure 8: Heat Map with identified Relay sites

Key


4.4.8 Enhanced Field Network Design

Theenhancedfieldnetworkdesignphaseisthedevelopment

ofthe‘to-be-built’RFMeshNetwork(bothforcurrentand

futureneeds)usingtheinitialfieldnetworkdesigninformed

bytheresultsofthesitesurveys.

ThesitesurveysattheinstalllocationsoftheStrategicRelays

andnetworkanalysisconsideredthefollowing:

• DistancebetweeneBridgesandapprovedinstalllocations

fortheStrategicRelays.

• Alternateapproved install locations –determine if other

DNO buildings and structures can be utilised for Relay

installations.

• Networknodecoveragebasedoncluttermodelconditions.

• Network redundancy – consideration must be given

to network redundancy to ensure alternate paths are

availabletoanAPandalsototheMastereBridges.

• Challenging conditions identifiedduring the site surveys

– identifyallproblemconditionsand identifyalternative

install locations to eliminate problem areas such as

areaswithheavyfoliageandlimitedLVdistributionpole

locationstoselect.

Thesitesurveysresultedin13ofthe14LVdistributionpole

locationstobeupdated/optimisedandforthirdpartytowers

tobeconsidered.

Table4presentstheresultoftheenhanceddesignactivities

andtheRFMeshNetworkbuiltexcludingtheTacticalRelays

whichwouldonlybeconsideredwithinnetworkoptimisation:

RemoteeBridges 12 10x33/11kVPrimarysubstation

2x132/33kVGridsubstation

MastereBridges 4 2x132/33kVGridsubstation

AccessPoints 2 2x132/33kVGridsubstation

StrategicRelays 13 13xLVdistributionpoleand1xC&WWtower

TacticalRelays 7 7xLVdistributionpole


Table 4: Enhanced Field Network Design – RF Mesh Node Quantity


Figure9depictsRFMeshNetworktomeetthecurrentand

futurepoints for connection. The locationsof theRFMesh

Nodes are the same as shown in Figure 6, however the

differenceswere:

• Relay18 which had previously been designed to be

installedatanLVdistributionpolewassubstituted fora

thirdpartytoweroperatedbyC&WW.Thereasonforthis

change was that the tower provided additional vertical

height, which corresponded to improved link quality

betweentheRFMeshNodes.

• Relay15hasbeenremovedasthisRelaywasre-categorised

tobeTacticalandthereforewouldnotbeinitiallybuiltout

aspartofthewholeRFMeshNetworkinstallation,unless

aneedwasidentifiedduringnetworkoptimisation.

Figure 9: eBridge and Relay sites



nodes, the Grid and Primary substations and the updated

Strategic Relay locations as part of the enhanced design

process.ComparingFigure10toFigure7,itcanbeseenthatthe

indicatedlinkperformancehasimproved,forexample,there

hasbeenanincreaseinthelightergreenpathsandnumberof

pathsaroundRelay18,whichindicatesastrongerperformance

level;thiswasadirectinfluenceoftherelocationtoatower.

Figure 10: Link model with identified Relay sites


Figure11illustratesthecoverageplotsofthenodeswithinthe

FPPTrialZonewiththechangeintheRelay18installlocation

andre-categorisationofRelay15.ComparingFigure11toFigure

8,theheatmapillustratesthatmeshconnectionsuccesswithin

the RF Mesh Network ‘canopy’ has improved. For instance,

thegreenareaoftheheatmaphasextendedaroundRelay18

and thereforehasprovideda stretch in thecommunications

coveragewithintheFPPTrialZonewhereitcanbeassumed

meshconnectionfornewgeneratorinstalmentscouldbeeasily

achievedwithouttheneedforTacticalRelaydeployment.


Key


4.4.9 RF Mesh Network Optimisation

Networkoptimisationisthefinalstageinthedeploymentof

theRFMeshNetwork.Thepurposeoftheoptimisationisto

ensurereliableandrobustoperationoftheRFMeshNetwork

aswellasdocumentingabaselineperformancethatcanbe

usedtopredicttrendsandre-optimisethenetworkastheFPP

solutionfootprintchangesintheFPPTrialZone.Thisprocess

sometimescallsfortherelocationorpossibleplacementof

additionalRFMeshNodes.

Thenetworkanalysisthatdrivesthisphaseistypicallyfocused

onendpointparameters:hopcount,andAPloadingandAP

andRelayutilisation.Thenetworkoptimisationisdesignedto

checkallaspectsof theRFMeshNetworkdesigntoensure

reliableandrobustoperation,following:

• Initialhealthandperformancecheck

• Connectivitytests

• Completeadjustments

• Performfinaloptimisation

The network optimisation involves connectivity tests to

validate the health and performance of the mesh links

and the successful connectionbetweennodes.As a result

of such tests, the network design may be optimised by

threeadjustments:

• DeploymentofadditionalTacticalRelayswithintheFPPTrial

Zonetorealisetheconnectivityrequired.

• Relocation of Strategic Relays to improve mesh links

betweenendpoints.

• Relocationofantennastobeinagreementoftheassumption:

Antennamountedwithoutobstructionfor360degrees.

Twoitemsofoptimisationwereidentifiedpostinstallationofthe

FPPRFMeshNetworkthroughtheconnectivitytestsundertaken:

• It was identified that Relay7 was not performing as

expected; it was only providing a communication link to

onenodewhenitshouldbesupportingat leasttwo.The

considerationforthisRelaynotperformingasexpectedwas

duetoitbeinginstalledatanLVdistributionpolethatwason

low-lyinggroundincomparisontothesurroundingRFMesh

Nodes deployed. Therefore, for improved performance, it

wasdecidedthattheRelayshouldberelocated.

• Additionally it was identified that the antenna for the

RemoteeBridgeatNorthwoldPrimary substation should

bemovedhigherandfacingwesttoavoidtheshadowof

thewoodenpolethattheantennahadbeeninstalledon.

4.4.10 Final Field Network Design

Thefinalfieldnetworkdesigniscarriedoutpostinstallation

andoptimisationoftheRFMeshNetwork.

Basedontheresultsfromthenetworkoptimisationactivities,

a sitesurveywasundertaken for the relocationofRelay7.

ThechangeinlocationisshowninFigure12.

TheantennaatNorthwoldPrimarywasmovedhigherandfaced

west.Thisrepositioningresultedinanimprovedsignalleveltothe

neighbouringRFMeshNodesandtheacquisitionofadditionalRF

MeshNodes,increasingoverallnetworkredundancy.

The design tools were used to analyse the impact of the

relocationofRelay7andadjustmenttoNorthwoldPrimary’s

antennaonthelinkmodelandheatmaps.Asthechanges

wereminimal,therewaslittlechangeontheoutputofthe

designcomparedtotheresultsobtainedfromtheenhanced

fieldnetworkdesign.

Figure13depictsthesameinstall locationsoftheRFMesh

NodesasinFigure9,withtheadjustedpositionofRelay7.


Figure 12: Network Optimisation: Relocation of Relay7

Figure 13: eBridges and Relay sites on Google Earth



nodes,theGridandPrimarysubstationsandtheStrategicRelay

locations.ComparingFigure14toFigure10,theindicatedlink

pathperformancesfromRelay7hasimprovedwithanincrease

inlinkpathsdenotedwithalightgreenshade.Additionally,

therehasbeenanincreaseinthenumberofmeshlinksfrom

it to itsneighbouringRFMeshNodes improving theoverall

redundancyoftheRFMeshNetwork.

Figure 14: Link Model with identified Relay sites


Figure 15 depicts the coverage plots of the nodes within

theFPPTrialZonewiththeamendedlocationatRelay7and

height and direction change for the antenna at Northwold

Primary.ComparingFigure15toFigure11,theheatmapnow


illustratesanincreaseinthegreen/yellowareaaroundRelay7,

whichindicatesanincreasedlikelihoodthatmeshconnection

couldbemoreeasilyachievedifanewgeneratorweretobe

installedwithinthatareaoftheFPPTrialZone.

Key


Local Area Network 4.5AnewVLANisestablishedwithineachoftheidentifiedGrid

substations–PeterboroughCentralandMarchGrid–toconnect

theRFMeshNodestotheIPVPNback-haulnetwork.Thenew

Figure 16: Conceptual LAN Diagram

MastereBridge #1

MastereBridge #2

Access Point (AP)

UKPN_FPP_VRF1

int Gig0/0/3

int Gig0/0/2

int Gig0/0/1

int Gig0/0/0

SV1 VLAN1

RIPv2

C&WWManagedCERouterCisco2901withHWIC-4ESW

10Mb/sEthernetAccessBearerRate-limitedto2Mb/s

InterfaceGig0/0.100

PE

eBG

P

VLANisachievedusinganintegratedLayer3switchmodule

(HWIC-4ES)withintheCisco2901routertoconnecttheMaster

eBridgesandAccessPoint,asshowninFigure16:


GridScape Management Application4.6To manage the RF Mesh Network the web-based network

management application, GridScape, was deployed. This

applicationisthecentralmanagementtoolthatwillprovide

thefollowingfunctions:

• Centralised management of the RF Mesh Network for

remoteandactiveconfigurationoftheRFMeshNodes.

• Visualisation of the geographic location of RF Mesh

Nodes(viaGoogleEarth/Maps)andfullawarenessofthe

underlyingtelemetrynetwork.

• Completeaccesstoreal-timeandhistoricnetworkstatistics

oftheRFMeshNetwork.

• Report/signalagivenproblemorfaultwiththenetwork.


End-to-end Solution 4.7

encapsulationandtransportoftraffic(includingDNP3andIEC

61850)betweennetworknodes:

Figure 17: High-level end-to-end communications solution

RF Mesh Network

The above elements combine to deliver an end-to-end

IP communications infrastructure that will allow the IP

AP

RemoteeBridge

MastereBridge1

MastereBridge2

March Grid

AccessPoint

FarcetPrimary

RemoteeBridge

ChatterisPrimary

RemoteeBridge

NorthwoldPrimary

RemoteeBridge

FunthamsLanePrimary

RemoteeBridge

WissingtonBSCPrimary

RemoteeBridgeSoutheryPrimary

RemoteeBridge

LittleportPrimary

RemoteeBridge

WhittleseyPrimary

RemoteeBridge

BuryPrimary

RemoteeBridge

MarchPrimary

RemoteeBridge

Relay1

Relay12 Relay10

Relay11

Relay13

Relay8

Relay6Relay5

Relay4

Relay7

Relay17

RelayatC&WWTower

AP

RemoteeBridge1

MastereBridge2

MastereBridge

Peterborough Central Grid

AccessPoint

Relay3A


MarchC&WWCERouter

C&WWPERouter

PeterboroughC&WWCERouter

GridscapeServer

C&WWFirewall

Firewall

ForeHamletC&WWCERouterB

Internet

C&WWPERouter

FPPVRF1

C&WW MPLS WAN

SSNFirewall

ForeHamletC&WWCERouterA

C&WWPERouter

C&WWPERouter

ANMServer

ANMDMZ

Fore Hamlet


5Training


Field Training5.1The training sessions were instrumental in developing the

FPP communications solution and project to an approach

that can be wrapped into a business-as-usual service. This

was achieved through the correct identification of internal

keyplayers.ThetrainingprovidedincludedFieldtrainingand

GridScapetraining.

Theengineerswhoreceived trainingwere thosewhowere

responsiblefor installing,configuringand/ormonitoringthe

RFMeshNetworkcomponentofthecommunicationsnetwork.

ThetrainingprovidedagoodunderstandingoftheRFMesh

Nodesandahigh-levelknowledgeof thefactors thatneed

tobeconsideredwhenplanningtheRFMeshNetwork.The

trainingalsoprovided‘on-the-job’trainingthatfocusedonthe

installationoftheRFMeshNodes.Theteamsinvolvedinthe

trainingandtheirresponsibilitieswere:

• NetworkOperations:installationofrelaysatLVdistribution

poles

• OperationalTelecommunications:installationofeBridgesat

GridandPrimarysubstations

It should be noted that the AP installation and antenna

infrastructure for connection to each RF Mesh Node was

undertakenbyasubcontractor.Connectionandconfiguration

wereundertakenbyOperationalTelecommunications.


GridScape Training5.2Twosessionswereprovided.SessiononeprovidedUKPower

NetworkswithanoverviewoftheGridScapefunctionalities.

Sessiontwowasmore‘handson’andprovided:

• AnoverviewoftheRFMeshNetwork

• AnintroductiontoGridScapeworkflows(includingcreating

users,devices,settingupjobsandrunningreports)

• A description of troubleshooting and configuration

managementthroughGridScape

Furthermore, as the network was being deployed it was

possibletodemonstratehowtocreatenetworks,toconfigure

andtopushconfigurationstotheRFMeshNodes.

6IP Communications Infrastructure: Installation


Introduction6.1The installation and commissioning process combined all

design elements – WAN, RF Mesh Network and LAN – to

deliveranend-to-endIP-basedcommunicationsinfrastructure.

The installation and commissioning elements can be

summarisedasfollows:

Wide Area Network:TheWANelementsofthesolutionwere

installed and commissioned in line with C&WW standard

provisioning processes including the use of third party (BT)

circuits. Installationwas carriedout by C&WWfield services

engineers.

C&WW,inconjunctionwithUKPowerNetworksandSSN,also

establishedthemeanstoprovideIPSecconnectivitybetween

theRFMeshNetworkandtheGridScapeapplication.

RF Mesh Network:TheeBridgeswereinstalledbyUKPower

Networks’engineersandtheAPandantennasbyUKPower

Networks’subcontractors.

Local Area Network: A new VLAN was established within

each of the identified Grid substations, using an integrated

Layer3switchmodulewithintheCisco2901routertoconnect

theMastereBridgesandAP. Installationwas carriedoutby

C&WW’sfieldservicesengineers;cablingwasundertakenby

UKPowerNetworks’engineers.


Wide Area Network6.2AspartoftheFPPproject,C&WWinstalledIPVPNEquipment

and an access circuit at both the Peterborough Central and

MarchGridsubstations.Theaccesscircuitatbothsiteswere

terminated with a standard Cisco 2901 MCPE router and

NetworkTerminationPoint,whichishousedwithinacabinet.


Wireless Radio Frequency Mesh Network6.3Installationguidelineswereprovidedduringthefieldtraining

andthe installation layoutatPeterboroughCentralGridand

MarchGridisshowninFigure18:

Figure 18: Install Arrangement at a Grid substation

Figure 19 depicts the installation layout for each of the

RemoteeBridges:

Figure 19: Install Arrangement at a Primary or interfacing substation

ExternalL-ComAntennas

RIPRouter

MastereBridge

MastereBridge

AP

C&WWPOP

RemoteeBridge RTU

Internal(sub-station)Antenna

Ethernet

LMR-600

=RoutingInformationProtocol

Key

RemoteeBridge RTU Ethernet

LMR-600

Key

ExternalL-ComAntenna

RIP

The relayswere installedon the LVdistributionpolesusing

mountingarmsandmountingkits.


The Gridscape environment which has been created for UK

PowerNetworksishostedinSSN’sco-locationdatacentrein

SanDiego,California.TheseconddatacentreislocatedinLas

Vegas.Bothlocationsareinterconnectedandbothconnected

totheInternetusingRFCconcentrators.

Theapplicationand supportingdatabaseenginearehosted

on a single dedicated VMware host. Additionally this host

containsadedicatedDomainNamesystem(DNS) service –

called “registrar”or “reg” – tomaintain the IPv6addresses

offielddevicesservicedbytheapplication.Thedatabase is

housedonaRedundantArrayofIndependentDisks(RAID)10

storagedeviceattachedtotheDataBase(DB)server.

Thevirtualhostsarerunning“RedHatEnterpriseLinuxServer

release5.7(Tikanga)”.

The VMware host is deployed in a VLAN dedicated to this

environment. The VLAN is isolated from other networks by

aNetworkAddress Translation (NAT)firewall. Access to the

environmentisallowedonlybyVirtualPowerNetwork(VPN)

fromamutuallyagreedupon(betweenUKPowerNetworks

and SSN) source IP. The DB is presented to the application

serveronadedicatedIPinthissameVLAN.

This environment is monitored 24/7 by SSN’s Network

OperationsCentre(NOC).

Figure 20 depicts the network diagram of the GridScape

managementapplication.

Figure 20: GridScape Network Diagram

SAN RFC 2893 Concentrator

San Diego Core

SAN RFC 2893 Concentrator

Las Vegas CoreSSN Backbone

PrimaryRFC2893connectiontoAPsinAT&T

SecondaryRFC2893connectiontoAPsinAT&T

PrimaryRFC2893inSanDiego.SanDiego

DistributionLayer.

SecondaryRFC2893inLasVegas.LasVegas

DistributionLayer.

SiSiSi Si

Internet

InternetBasedAT&TBackhaul

Si

GridScape Management Application6.4


7IP Communications Infrastructure: Testing


Introduction7.1Testingisanintegralpartofthecommissioningprocess,andit

hasafundamentalrelationshipwiththedesignprocess.Each

componentofthetestregimewasusedtospecificallyaddress

thefunctionalityandcapabilityunderlabandfieldconditions.

Additionallya full setofend-to-end testingwasperformed

ontheRFMeshNetworkandIPVPNinfrastructure,whichwas

witnessedandapprovedbyUKPowerNetworks.

TheacceptancestestingoftheIPcommunicationsinfrastructure

comprised:

• WANtesting

• RFMeshtesting

• IEC61850communicationtrials

Wide Area Network Testing7.2AspartoftheWANtesting,MSABtestingwasexecuted.MSAB

is a link thatenablesC&WWto connect from the customer

sitetoC&WWMSPnetworktodeploymultipleservices,e.g.

EthernetWireline&IPVPNQualityofSupply(QOS).

The testswereperformedprior to the IPVPNaccess circuits

beinghandedovertoUKPowerNetworks.

All tests performed were successful and the circuits were

broughtintoproduction.


RF Mesh Network Testing7.3TestingoftheRFMeshNetworkwasintwophases:RFMesh

acceptancetestingandIEC61850tests.

7.3.1 RF Mesh Testing

TheRFMeshNetworkacceptancetestswereexecutedattwo

keypointsintime:

• A sub-set of acceptance testswere executed in the field

in January 2013, once connectivity to one of the Grid

substationswasavailable(PeterboroughCentralGrid)and

severaloftheRemoteeBridgeshadbeendeployed.

• Theend-to-endacceptancetestswereexecutedinFebruary

2013, once all installations of the IP communications

infrastructurehadbeencompleted.

These acceptance tests were executed to ensure that the

end-to-endcommunicationssolution, includingtheRFMesh

Network,metorexceededtheexpectedperformancecriteria

setoutinthetestspecification.Whereverpossiblethetests

were conducted with the maximum number of RF device

hops,totestperformanceintheworstcasescenario.

Inessence,thesetofperformancetestswasdesignedtotest

theoverallFPPcommunicationssolutiononvariousparameters,

suchaslatency,bandwidth,congestion,corruption,overload,

failoverand redundancy. The twosetsofRFMeshNetwork

acceptancetestsincludedthefollowingcriteria:

• MastereBridgere-convergence

• RemoteeBridgeAcquisition

• Demonstratefirmwareupgradefunctionality

• Deterministicrouting,whichisthedemonstrationthatthe

RemoteeBridgeprefersthelowestcosttoandhopcountto

theMastereBridge

• MasterandRemoteeBridgedevicelatency

• Frame error rate (Layer 2), which also shows the data

successrate

• Demonstrateremotejobschedulingandon-demanddata

retrievalusingtheGridScapemanagementapplication

The differences between the sub-set and end-to-end

acceptancetestswere:

• For the demonstration of firmware upgrade, the sub-set

was performed locally and for the end-to-end tests they

wereexecutedremotely.

• Furthermore, additional tests were performed as part of

theend-to-endtests,whichwere:hubsiteredundancytest

(MastereBridgesfailover),AccessPointfailover;self-healing

oftheRFMeshNetwork,bandwidthcapacitytestsandthe

availabilityoftheRFMeshNodes.

• AnewarchitecturewiththeRemoteeBridgesdynamically

associatingwithanyofthefourMastereBridges.

Resultsoftheend-to-endtestswere:

• Functionalities:Firmwareupgrade,remotejobscheduling,

on-demand date retrieval, hop count and lowest cost

preferenceweredemonstrated.

• Reconvergence: Both the Master eBridge and Remote

eBridgewereabletore-convergeaftersimulatedfailures.

• Dual Redundancy: On a failure of each hub site, the

associated devices were seamless migrated to another,

illustrating the Remote eBridges dynamic capability to

associatetoanyofthefourMastereBridges.

• Latency and Throughput:Thelatencyanddatathroughput

haveexceededthesetspecificationcriteriafortheproject.

Specificdataonthelatencyperformancewillbereleased

atalaterstageoftheproject.

7.3.2 IEC 61850 Testing

TestingconsistedofIEC61850LabTestsandIEC61850FieldTests:

IEC 61850 Lab Tests

FunctionalverificationoftheRFMeshNode’sabilitytopass

simulatedIEC61850trafficwassuccessfullyperformed.The

lab tests were functional in nature and explicitly did not

include performance tests such as congestion, corruption,

overloadorfailover.


The testwasperformedusinga simulated IEC61850 client

and server. These were implemented using two laptops –

one running Triangle Microworks (TMW) Version 3.1.14.0

HammerasclientandtheothertheAnvilasserver.Network

connectivitybetweentheMastereBridgeandRemoteeBridge

was through an 870.2-875.8 MHz RF Mesh link. The tests

configurationalso includedaswitchandapacketsniffer,as

depictedintheconfigurationFigure21.

Fivetestswereperformed:

1. GetDirectorydiscoveryofdatacomponentsonaremoteserver

2. PeriodicGetDataValuespollingofdata

3. Progressively more rapid GetDataValues polls of data to

demonstratemultiplereadsperseconds

4. Exception Based Report in which data was sent from the

simulatedIEC61850ServertothesimulatedIEC61850client

5. Acombinedtestofpolling,exceptionbasedreporting,and

SNTPtimeupdatesofanRTU

Alltestswerepassedsuccessfully,withtheGetDirectorypulling

back a full model of the remote server’s data definition,

GetDataValues correctly retrieving discrete values from the

remoteserver,andexceptionbasedreportingdemonstratingfull

abilitytosendbackdataacrosstheRFMeshNetworktoanIEC

61850clientfromanIEC61850server.SNTPtimeupdatesalso

successfullyoccurredinparallelwithseveraloftheseoperations.

Figure 21: IEC 61805 Lab Test Set-up

Ethernet

NetgearSwitch

WiresharkPacket Sniffer

TMWHammer

MastereBridge

RemoteeBridge

TMWAnvil

Ethernet Ethernet


IEC 61850 Field Tests

The IEC61850FieldTestswereexecutedat thesamekey

points in timeas thatof theRFMeshNetworkTests. The

samefivetestswereruntothoseexecutedwithintheIEC

61850LabTestsandallweresuccessfullycompleted

Figure 22: IEC 61850 Field Test Environment

within the forecast parameters; the difference being the

testenvironment,whichisdepictedinFigure22–theTMW

AnviltestlaptopwasconnectedinbehinddifferentPrimary

RemoteeBridgesdependantonthetestbeingperformed:

Farcet Primary

RemoteeBridge

RF Mesh Network

AP

RemoteeBridge

MastereBridge1

MastereBridge2

March Grid

AccessPoint

RelayatC&WWTower

AP

RemoteeBridge1

MastereBridge2

MastereBridge

Peterborough Central Grid

AccessPoint

Relay(s)

TMWAnvilTestLaptop

Northwold Primary

RemoteeBridge

TMWAnvilTestLaptop

March Primary

RemoteeBridge

TMWAnvilTestLaptop


TMWHammerTestLaptopActive Network Management Server Connection

MarchC&WWCERouter

C&WWPERouter

PeterboroughC&WWCERouter

GridscapeServer

C&WWFirewall

Firewall

ForeHamletC&WWCERouterB

Internet

C&WWPERouter

FPPVRF1

C&WW MPLS WAN

SSNFirewall

ForeHamletC&WWCERouterA

C&WWPERouter

C&WWPERouter

ANMDMZ

Fore Hamlet


8Learning Outcomes


The process of designing, installing, commissioning

and testing the IP-based communications infrastructure

generatedseveralkey learningoutcomesandfirsts forUK

PowerNetworksandtheprojectpartners,C&WWandSSN.

Design and install of the FPP communications solution:

• Visibilityofthedesignstagesfortheproductionoftheoverall

communicationssolutionallowedforanincreasedunderstanding

ofhowtheIP-basedcommunicationsinfrastructureoperated.This

ledtotherefinementandenhancementofthecommunications

solutiontomeettherequirementsandoptimisethetechnical

approachfortheFPPproject.

• Aspartof thedesign stages for theRFMeshNetwork,

site surveys were undertaken to select an optimal

install locationfortheRelay.Thiswasanintegralphase

toundertakeas13of the14 install locations identified

in the initialdesktop surveywereamendeddue to the

site survey results showingunfavourableenvironmental

conditions likely to cause a negative impact on the

performanceofthecommunicationssolution.

• The installation of the IP-based communications

infrastructuregeneratedknowledgeandupskillingwithin

UKPowerNetworks’NetworkOperationsandOperational

Telecommunicationsdepartments.

• The learning generated through involvement in the

design and install phase of the FPP communications

solution,informedourpreparationsforthesolutiontobe

deployableasabusiness-asusualservice.Thiswasfurther

supportedbyspecificallytargetingtheUKPowerNetworks

departments for training that would own, manage and

maintainthesolutiongoingforward.

• It was apparent through the first-hand experience of

installing the RF Mesh Network that the communications

solutioncouldbeflexiblydeployedwithinshorttimescales.

Forinstance,theRelay,whichisinstalledataLVdistribution

pole,canbepre-assembledbeforegoingtosite.Furthermore,

thearrangementattheGridandPrimarysubstationssimply

involvedtheconnectionoftheeBridge(MasterandRemote)

and configuration check after the required antenna and

powersupplyinfrastructurewasinplace.Theonlyadditional

requirementattheGridsubstationwastheprerequisitethat

theWANhadbeencommissioned.

• Anappreciationwasgainedontheuseofaremotelyprovided

SaaSsolutionforthemanagementofcommunications.

• An understanding of the routing within a combined RF

MeshNetwork/MSPIP-basedcommunicationssolution.

• Learning on how to set-up support arrangements and

adedicatedservicedesk functiontoassistwith theon-

goingmanagementofthecommunicationssolution.This

included generating and testing fault notices to ensure

the relevant work party amongst UK Power Networks

andC&WWwouldbecorrectlyidentifiedandmobilisedto

investigateandremedythefault.

IEC 61850 communications trials using IEC 61850 simulators:

• TheexperienceindevelopinganIP-basedcommunications

infrastructure capable of sending data packets using

the open standard IEC 61850 protocol generated new

knowledgeandskillsamongstallparties.

• IEC 61850 Lab Tests: The RF Mesh Network component

successfullypassedallfunctionalverificationlabteststo

proveitsabilitytopassIEC61850traffic.

• IEC61850FieldTests:Twotestphaseswereexecutedusing

IEC61850simulatorsatvariouslocationswithintheFPP

TrialZoneaspartofasub-setofacceptancetestsandend-

to-endtests.Thetestsconfirmedthatthecommunications

platformwasandiscapableoftraffickingIEC61850.

A number of firsts have been realised in delivering the FPP

communications infrastructure:

• TheUK’sfirstPrimaryandGridlevelsmartgridRFMeshsolution

• UKPowerNetworks’firstdeploymentusingthesmartgrid

standard,IEC61850,toandbetweensubstations

• C&WW’sfirstsmartgriddeployment

Learning Outcomes


9Conclusion


The FPP communications solution - an IP-based

communications infrastructure that incorporates the Wide

AreaNetwork,RFMeshNetworkand LocalAreaNetwork

- was successfully developed to meet the FPP project

requirementsandinstalledinFebruary2013.

The communications trials using IEC 61850 simulators

within the FPP Trial Zonedemonstrated that the IP-based

communication infrastructure was and is capable of

traffickingtheopensmartgridstandard,IEC61850.

A reliable and robust communications solution was

developed due to the RF Mesh Network’s topology and

many-to-manyconnectionstoallowforself-healing.Itcan

be scaled up in a timely and cost-effective manner and

bebuiltup tocoveranyareaof thedistributionnetwork.

This is due to the RF Mesh Network’s connectivity and

geographicalcoveragethatcaneasilybeextendedthrough

the deployment of additional RF Mesh Nodes at required

locations.ThissupportstheFPPobjectivetoconnectnewDG

developersontothedistributionnetworkwithintheFPPTrial

Zoneusinganactive‘fitandflex’approach.

Furthermore, the successful establishment of data

connectivity using IEC 61850 will address the challenge

of interoperability when integrating multiple technology

vendors’smartdevicesandapplicationsintothedistribution

network.Thisavoidsthebuildoutofaproprietaryvendor

IP-based communications infrastructure and in doing so

reduces the reliance on a limited number of technology

providersandproprietarysystems.Thiswillfosterincreased

competition and innovation amongst the technology

providersandimprovethesecurityoftheDNOssupplychain.

Preparations were made for the FPP communications

solutiontobedevelopedandimplementedasabusiness-

as-usual service. Key staff were trained that would be

involved in installing, configuring and managing the

IP-based communications infrastructure. Also, business

support systems and a service desk function was set-up

for the on-going management and maintenance of the

communicationssolution.

Overall,theFPPprojectsuccessfullymettheassignedSDRC

9.3 for the ‘Communications Platform’ workstream, which

wastoinstallandcommissionanIP-basedcommunications

solutionacrosstheFPPTrialZonebyQ12013anddemonstrate

throughIEC61850trialsthattheend-to-endcommunications

solutionwasandiscapableoftraffickingIEC61850.

Thenextphaseof theprojectwillseektodemonstratethat

theFPPcommunicationssolutioncansupportIEC61850traffic

fromtheANMsolutionandsmartdevices,insteadofsimulated

IEC61850traffic.ThiswillalsoexhibitifFPPcanintegratesmart

devicesfrommultiplevendorsonacommonplatform.

Furthermore,thecommunicationssolutionwillbetrialledto

demonstrateitsabilitytofacilitatethedataexchangeand

control capability of the ANM to implement the technical

andcommercialsolutionsinrealtimetomanagenetwork

constraints. Thus enabling alternative smart connection

solutions to be trialled in order to facilitate, accelerate

andcostoptimisetheconnectionandoperationofDGina

constraineddistributionnetwork.

Conclusion

UK Power Networks Holdings LimitedRegisteredoffice:NewingtonHouse237SouthwarkBridgeRoadLondonSE16NPRegisteredinEnglandandWalesRegisterednumber:7290590

[email protected]

Flexible Plug and Play - UK Power Networks€¦ · Flexible Plug and Play Communications Platform – SDRC 9.3 | 7 This provides remote, secure configurationand management from a

Documents