IEEE Benchmarking Results for 2012 Datagrouper.ieee.org/groups/td/dist/sd/doc/Benchmarking...IEEE Benchmark Year 2013 Results for 2012 Data Results after July 23, 2013 General Meeting

IEEE Benchmark Year 2013Results for 2012 Data

Results after July 23, 2013 General Meeting

Distribution Reliability Working Group

Vancouver, BC

2

Background to IEEE Benchmarking

• Initiated in 2003, conducted annually

• Participants are anonymous with key identifier toretain anonymity

• Participation list is not revealed to anyone

• Each participant can choose to share their results

• No inference is made about good or bad reliability

• Intended to provide information for users to assesstheir performance relative to peers

3

Benchmarking

• Using annual key metrics (SAIDI, SAIFI and CAIDI) toassess performance of a system may be useful,however, needs to be tempered

• Data may not be directly comparable, since– Data collection & system differences exist

– Certain exclusion differences can occur

• IEEE 1366-2003/2012• addresses data basis issues by clearly defining the rules.

• It DOES NOT address the data collection issues

• Companies may not report all forms of outages, due to data collectionissues or other reasons

4

Northwest: 10Participants

Southwest: 11Participants

Midwest: 23Participants

South: 13Participants

Southeast : 6Participants

Northeast: 12Participants

Mid-Atlantic:28 Participants

Regions represented by the participants…

5

Classification of Respondents• 95,347,414 customers represented in US &

Canada• Small, Medium, Large

– Small =< 100,000 customers

– Medium >100,000 and <1,000,000 customers

– Large >= 1M customers

• 2013 Survey– 12 Small

– 63 Medium

– 31 Large

6

Classification of Respondents• Urban, Suburban, Rural

– Rural <= 50 cust/mi (31 cust/km)

– Suburban > 50 cust/mi <150 cust/mi

– Urban >= 150 cust/mi (93 cust/km)

• 2013 Survey

– 5 Urban companies

– 4 Urban/Suburban companies

– 14 Suburban companies

– 5 Evenly blended companies

– 15 Suburban/Rural companies

– 50 Rural companies

– 13 Unclassified companies

7

Respondents•More than 200 Companies have responded at some time

•2013 Survey

–103 unique entries responded in 2013; 106 total entries in2013

–Planned and source quartiles are not shown below

Quartile All Participants 106 SAIDI ALL SAIDI IEEE SAIFI ALL SAIFI IEEE CAIDI ALL CAIDI IEEE0 MIN 41 32 0.4 0.35 54 531 Q1 153 93 1.1 0.89 124 932 MEDIAN 236 126 1.5 1.08 165 1103 Q3 743 163 1.8 1.39 535 1304 MAX 6170 458 4.2 3.44 2043 226

8

Summary Details by Utility SizeQuartile Small 70 SAIDI ALL SAIDI IEEE SAIFI ALL SAIFI IEEE CAIDI ALL CAIDI IEEE

0 MIN 64 39 0.8 0.60 64 641 Q1 145 79 1.0 0.97 128 802 MEDIAN 355 116 1.6 1.11 176 943 Q3 589 190 2.0 1.59 336 137

4 MAX 6170 458 4.2 3.44 2043 226

Quartile Medium 44 SAIDI ALL SAIDI IEEE SAIFI ALL SAIFI IEEE CAIDI ALL CAIDI IEEE0 MIN 41 32 0.4 0.35 54 531 Q1 160 99 1.2 0.92 122 962 MEDIAN 238 142 1.5 1.19 167 1083 Q3 1357 167 1.9 1.37 684 1254 MAX 6170 458 4.2 3.44 2043 226

Quartile Large MAX SAIDI ALL SAIDI IEEE SAIFI ALL SAIFI IEEE CAIDI ALL CAIDI IEEE0 MIN 83 58 0.6 0.56 85 721 Q1 148 96 1.1 0.86 124 932 MEDIAN 222 115 1.3 1.00 155 1153 Q3 361 151 1.7 1.22 271 1344 MAX 2061 225 2.8 1.99 1194 220

9

The following slides…

• Show company performance using the IEEE 2.5 Beta method tosegregate data into:

– Day-to-Day operating Indices vs.

– Performance considering the whole customer experience (All)

– Separate data collected to evaluate impact of transmission(WOF) and both transmission and planned outages (WOP)

– Segregation by transmission (feed), planned and distribution

• To date more than 200 companies have participated in ourbenchmarking at sometime.

10

SAIDI IEEE, across the continent…

11

SAIFI IEEE, across the continent…

12

CAIDI IEEE, across the continent…

13







14

SAIDI, across the continent…

15

SAIFI, across the continent…

16

CAIDI, across the continent…

17







18

SAIDI WOF, across the continent…

19

SAIFI WOF, across the continent…

20

CAIDI WOF, across the continent…

21







22

SAIDI WOP, across the continent…

23

SAIFI WOP, across the continent…

24

CAIDI WOP, across the continent…

25

SAIDI By Area Segment…

26

SAIDI By Area Segment Expanded Scale…

98.3105.4 109.4

102.6

81.289.0

106.093.0

144.6 146.1 143.5

154.8

115.8

128.0

143.0

126.0

191.8198.0 200.1 196.3

166.9158.0

171.0163.0

50.0

70.0

90.0

110.0

130.0

150.0

170.0

190.0

210.0

2005 2006 2007 2008 2009 2010 2011 2012

Min

ute

s

2005 - 2012 IEEE SAIDI Quartiles2nd Qtrle SAIDI 3rd Qtrle SAIDI 4th Qtrle SAIDI

2005-2012 SAIDI Quartiles All Companies

1.09 1.111.06 1.06

0.890.93 0.96

0.89

1.39 1.36 1.33 1.34

1.121.17

1.161.08

1.631.70 1.71

1.60

1.49 1.46

1.55

1.39

0.500

0.700

0.900

1.100

1.300

1.500

1.700

1.900

2005 2006 2007 2008 2009 2010 2011 2012

Inte

rru

ptio

ns

2005 to 2012 IEEE SAIFI Quartiles2nd Qtrle SAIFI 3rd Qtrle SAIFI 4th Qtrle SAIFI

2005-2012 SAIFI Quartiles All Companies

82.5 81.7384.91

93.65

83.3188

99

93

104.87107.5 109.07 109.94

101.94106

117

110

127.4130.7

126.7

134.7

120.7 122.0

130.0 130.0

50.0

75.0

100.0

125.0

150.0

2005 2006 2007 2008 2009 2010 2011 2012

Min

ute

s2005 to 2012 IEEE CAIDI Quartiles2nd Qtrle CAIDI 3rd Qtrle CAIDI 4th Qtrle CAIDI

2005-2012 CAIDI Quartiles All Companies

99.2

88.294.0

101.096.0

126.5118.5

124.0

140.0

115.0

162.0152.2

158.0 160.0151.0

0.0

25.0

50.0

75.0

100.0

125.0

150.0

175.0

2008 2009 2010 2011 2012

Min

ute

s

IEEE SAIDI Benchmarking - Large Utilities2nd Qtrle SAIDI 3rd Qtrle SAIDI 4th Qtrle SAIDI

2005-2012 SAIDI Quartiles Large Utilities

0.88 0.860.90 0.93

0.86

1.08

0.981.06 1.03 1.00

1.411.37

1.24

1.33

1.22

0.000

0.200

0.400

0.600

0.800

1.000

1.200

1.400

1.600

2008 2009 2010 2011 2012

Inte

rru

ptio

ns

IEEE SAIFI Benchmarking - Large Utilties2nd Qtrle SAIFI 3rd Qtrle SAIFI 4th Qtrle SAIFI

2005-2012 SAIFI Quartiles Large Utilities

86.791.1 90.0 93.0 93.0

114.8107.6 110.0

118.0 115.0

136.4 136.7

128.0

139.0134.0

0.0

25.0

50.0

75.0

100.0

125.0

150.0

2008 2009 2010 2011 2012

Min

ute

s

IEEE CAIDI Benchmarking - Large Utilities2nd Qtrle CAIDI 3rd Qtrle CAIDI 4th Qtrle CAIDI

2005-2012 CAIDI Quartiles Large Utilities

131.7

101.8 95.0107.0

99.0

163.4180.5

132.0141.0 142.0

206.6

256.9

160.0170.0 167.0

0.0

50.0

100.0

150.0

200.0

250.0

300.0

2008 2009 2010 2011 2012

Min

ute

sIEEE SAIDI Benchmarking - Medium

Utilities2nd Qtrle SAIDI 3rd Qtrle SAIDI 4th Qtrle SAIDI

2005-2012 SAIDI Quartiles Medium Utilities

1.29

1.03 1.01 1.030.92

1.371.32

1.23 1.20 1.19

1.62

1.76

1.451.55

1.37

0.000

0.200

0.400

0.600

0.800

1.000

1.200

1.400

1.600

1.800

2.000

2008 2009 2010 2011 2012

Inte

rru

ptio

ns

IEEE SAIFI Benchmarking - Medium Utilties2nd Qtrle SAIFI 3rd Qtrle SAIFI 4th Qtrle SAIFI

2005-2012 SAIFI Quartiles Medium Utilities

94.9

83.491.0

99.0 96.0

117.0

102.8 106.0113.0

108.0

134.7

122.5 122.0127.0 125.0

0.0

25.0

50.0

75.0

100.0

125.0

150.0

2008 2009 2010 2011 2012

Min

ute

s

IEEE CAIDI Benchmarking - MediumUtilities

2nd Qtrle CAIDI 3rd Qtrle CAIDI 4th Qtrle CAIDI

2005-2012 CAIDI Quartiles Medium Utilities

122.7

74.6 76.0

140.0

79.0

196.8

109.5121.0

180.0

116.0

226.5

206.0

162.0

225.0

190.0

0.0

50.0

100.0

150.0

200.0

250.0

2008 2009 2010 2011 2012

Min

ute

s

IEEE SAIDI Benchmarking - Small Utilities2nd Qtrle SAIDI 3rd Qtrle SAIDI 4th Qtrle SAIDI

2005-2012 SAIDI Quartiles Small Utilities

1.21

0.94 0.92

1.15

0.97

1.64

1.26 1.24

1.41

1.11

2.20

1.83

1.47

1.701.59

0.000

0.500

1.000

1.500

2.000

2.500

2008 2009 2010 2011 2012

Inte

rru

ptio

ns

IEEE SAIFI Benchmarking - Small Utilties2nd Qtrle SAIFI 3rd Qtrle SAIFI 4th Qtrle SAIFI

2005-2012 SAIFI Quartiles Small Utilities

98.8

72.177.0

113.0

80.0

104.1

88.4

97.0

123.0

94.0

121.6

111.3117.0

129.0137.0

0.0

25.0

50.0

75.0

100.0

125.0

150.0

2008 2009 2010 2011 2012

Min

ute

s

IEEE CAIDI Benchmarking - Small Utilities2nd Qtrle CAIDI 3rd Qtrle CAIDI 4th Qtrle CAIDI

2005-2012 CAIDI Quartiles Small Utilities

Areas We’ve Discussed

Need to capture total company miles

• Need to capture total number of distribution circuits

• Consider data which helps the industry back into a scorecardfor storm performance

We can calculate company customer density/mile todetermine whether there’s any correlation to metrics

How to calculate circuit segmentation using 1782

Transmission outage impact to metrics?

• Daily beta variable calculations for future study

39

Major event methodology

40

Companies report that:

• 66% of their regulators accept IEEE 1366-2003/2012 (the 21/2β method) as the method for determining major events

• 34% use some other method or do not recognize the 2 ½ βmethod

In determining a major event for regulatory purposes:

• 58.5% are not constrained to a 24 hour clock for calling thebounds of a major event

• 41.5% are constrained to a 24 hour clock for bounding amajor event

Additional analysis of the data collected is planned

Areas To Review: Brainstorm

• Benchmark Data Collected:• Need to capture total number of distribution circuits

• Major Events• Testing of log-normality of entries

• Persistence of major events for each utility

• Daily beta variable calculations for future study

• Consider data which helps the industry back into a scorecardfor storm performance

41

42

IEEE Benchmarking Results for 2012 Datagrouper.ieee.org/groups/td/dist/sd/doc/Benchmarking...IEEE Benchmark Year 2013 Results for 2012 Data Results after July 23, 2013 General Meeting

Documents