Integrated Marketplace: Parallel Operations CWG – January 2014.

Integrated Marketplace:Parallel Operations

CWG – January 2014

IDT WEEKLY UPDATE

2

Agenda• IDT Debrief

• IDT 1/21 Preliminary Debrief• IDT 1/27 Look Ahead

• Analysis • Dispatch Simulator • Scenario Tracker

• Look-Ahead • Schedule: Upcoming IDTs and Scenarios • Reminders• Weekly Updates: Release Scorecard, Migration Report, Known Issues Log

3

01-21-14 Deployment Test Debrief• Overall the Twelfth Deployment test was a success

– All of the BAs and all but 1 MP were on the call 60 min before IDT. Thank you! The final MP was contacted and joined the call.

• Ramp Sharing for the Jan 21 IDT:– Off (0%) for Regulation Up and Regulation Down

– On at 100% for Spinning and Supplemental Reserves

• Another very smooth transition into test

• ACE controlled well

• Very good response from the majority of Resources providing Regulation – most of them within 5-10 MWs of their Setpoints for the majority of the test.

4Brian Strickland

01-21-14 Deployment Test Debrief

• Natural RSS Events– Had a ~120 MW Resource trip at around 10:00 AM

SPP asked MP to deploy Emergency MW

MP followed Setpoints correctly

Slightly above L10 due to “over-response” to the CR event

– Had a ~350 MW Resource trip at around 12:30 PM SPP requested 320 MW of contingency and the market responded

appropriately

SPP will analyze Reserve Zone Limits for future large RSS events to assure continued proper response

5Brian Strickland

01-21-14 Deployment Test Debrief

• Review of RSS Event Expectations– Entity that experiences the Resource trip submits the RSS

event

– SPP enters event into CRD tool

– MPs should follow Setpoints to respond

– Small events are handled solely through changes in Setpoints

– Large events could require unit commitments SPP will work directly with the MP to determine which units to

commit in order to respond to the event

6Brian Strickland

01-21-14 Deployment Test Debrief• Tested BAAL Control for the entire IDT:

– Tested managing the SPP BA ACE with BAAL control in place of CPS control

– During this time CPS2 violations aren’t applicable

– ACE dropped below SPP’s L10 two times:

Eastern Interconnect low frequency

Actual interchange slightly below scheduled interchange

– Had a .05 Hz frequency drop across interconnect during IDT SPP managed well with no issues

• The e-TerraArchive application lagged in sending data from EMS to IM:– MPs may have seen differences between XML and ICCP for units in Control

Mode 3 during the test

– SPP was able to implement a fix successfully during the IDT

7Brian Strickland

01-21-14 Deployment Test Debrief• IDT Conditions

– Tieline Drop at 12:15 PM Test went well – SPP collected good data

SPP exercised normal procedures as planned

SPP came out of the test when an RSS Event occurred, but good data still collected

– TARRFs of 1: Requested that MPs submit Turn Around Ramp Rate Factors of 1

– Dispatch Target Adjustment from 1:15P to 2:30P SPP tested internal procedure and functionality for generating Setpoints

differently if a severe RTBM outage were to occur

No issues for SPP or the MPs during this test

– Regulation Pre-Selection details to follow

– EDR Scenario: rescheduled for Jan 27 IDT

8Brian Strickland

01-21-14 Deployment Test Debrief

• webMirroring was off again for this IDT– Overall most MPs did a better job submitting dual schedule

– Only one MP not doing a good job of dual scheduling SPP reached out to MP directly to try to remedy

9Brian Strickland

IDT Schedule and Conditions

10

IDT Date IDT Times Conditions Notes

1/27/14 7:30A-4:30P7hr IDT begins at 8:30A

Tieline Checkout

Regulation Pre-selection

EDR

Turn Around Ramp Rate to Regular Submission

Reminder: Please submit Spin/Supp as ‘Market’

2/25/14 8:30A-12:30P2hr IDT begins at 9:30A

2/28/14 7:00P4hr IDT begins at 8:00P

Cutover for March 1 Go-Live

Brian Strickland

Dispatch Simulator – Preliminary results

11

•*Scenario document on spp.org here–spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Scenarios in Parallel Ops

0:00 1/15 to 23:59 1/17

•1/15 day was not successful.

•Commitments came from DBDA, DA Market, DARUC, IDRUC, and MP Self Commitments for the 16th and 17th as expected

– MPs should have received “Production-like” commitment notifications at expected timeframes

•SPP will overwrite meter settlement data for the three Operating days Jan 15, 16, 17 with RTBM setpoint instructions.

Alan Adams

Dispatch Simulator – Preliminary results

12

• A new control flag was introduced by Alstom with the latest patch that was not set correctly. This caused Generation Actuals to not update properly during the first several hours of the test. One COP True-Up Case that affected 1/15.

• SPP Continued to run its NSI True-up function to maintain Marketplace NSI with EIS NSI for any missing schedules.

• All other aspects of the simulator were successful and SPP committed Capacity is significantly less than the EIS capacity.

• MPs should be able to review their commitments for reasonability and we are asking specifically for any risk for voltage issues given the SPP commitment.

Alan Adams

13

14

15

• Summary – Scenarios in Parallel Ops:– 6 Scenarios, 2 Partial Scenarios, Dispatch Simulator Test successful:

Scenario 7 Must Offer Scenario 28a Scenario 15 Commitment Mismatch Part 2 Scenario 24 – success pending Settlements Scenario 13 DDR w/ Settlements Scenario 29 RSG Scenario 31 BDR w/ Settlements – success pending Settlements Scenario 36 GFA - success pending Settlements

Dispatch Simulator Test– Note: Dispatch Simulator Test occurred 12/6 – 12/9 and again 1/15 – 1/17.

• Summary – Retests Pending:– 2 entire Scenario retests pending

Scenario 11 scheduled for 1/27 Non-Functional Testing Scenario rescheduled for 1/23

– 3 individual retest requests pending

Scenario Tracker as of Jan 8

Ginny Watson

Look-Ahead: Jan 23 – Jan 31

16

Parallel Ops Calendar on spp.orgspp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

• Settlements details on the Settlements Calendar marketplace.spp.org > Public > Settlements > CalendarsJan 23 – Jan 25 Schedule:Thurs Jan 23: CWG

Fri Jan 24: No regular P Ops Meeting IDT Jan 27 Prep Call at 3P

Jan 26 – Jan 31 Schedule:Ramp Sharing On

Mon Jan 27: IDT Call7:30A – 4:30P, 7hr IDT begins at 8:30A Scenario 11 EDR

Tues Jan 28: IDT Debrief at 3P 16.1 / 16.2 Scenario for OD Jan 29

Wed Jan 29: 16.3 Mitigation Scenario for OD Jan 29

Fri Jan 31: Regular Friday Meeting at 9A, Parallel Ops Ends

Ginny Watson

Reminders

17

SPP will retest the Non-Functional Test Scenario on Jan 23 from 10P – 12A

SPP will retest Mitigation Scenarios 16.1 DA and 16.2 RUC on Jan 28 for OD Jan 29 and 16.3 – RTBM on Jan 29

•Any MP who wants to see results of Mitigation needs to fail the behavior test with at least one unit. Units will be picked up in the re-run.

•If you are interested in participating in Scenario 16.3 – RTBM Mitigation, please submit the Resource(s) you would like to see Mitigated via RMS (Parallel Ops Quick Pick) no later than Monday, Jan 27 at 12P CPT.

Ginny Watson

Migration and Maintenance Report

18

Migration and Maintenance Report posted to spp.orgspp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

Release ScorecardRelease Scorecard posted to spp.org:spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

Known Issues LogMarket Trials Known Issues Log posted on spp.orgspp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder

Market Trials Useful ResourcesIntegrated Marketplace Parallel Operations Project Documents spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

•Parallel Ops Presentations, Statistics, MP Meetings Folder•Parallel Ops Reference Documents Folder•Scenarios in Parallel Ops Folder > Scenarios Schedule•Parallel Ops Communication Plan•Parallel Ops MP Guide•Parallel Ops Calendar•Known Issues Log•Release Scorecard•Migration Report

Integrated Deployment Test (as part of Parallel Ops)spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test

•IDT MP Guide•Parallel Ops Calendar

Additional documents:•Settlements Calendar marketplace.spp.org > Public > Settlements > Calendars•Change Tracker spp.org > Integrated Marketplace > Marketplace Documents•Integrated Marketplace Structured/Unstructured Test Project Documents spp.org > Integrated Marketplace > Market Trials > Structured / Unstructured Test> Integrated Marketplace Structured / Unstructured Test Project Documents

19

MP CONCERNS DURING IDT

20

Concerns During IDT - Overview

• SPP has strived for operations during Parallel Operations and Integrated Deployment Tests to be as close to production as possible

• In some cases SPP has been unable, due to Market Participant or SPP actions, or non-actions to do so

• In these cases SPP has implemented workarounds to allow the tests to continue

• These workarounds have the ability to mask issues until Go-Live that SPP would have otherwise discovered in the Deployment Tests

21

Concerns – Tagging / SchedulingDual Scheduling•Issues have occurred prompting SPP to continue the NSI true-up process, which may be masking issues

– A few MPs are short staffed especially since Jan 1st and have reported an inability to submit dual schedules

– Scheduling Entities without generation are either not aware or not participating in Parallel Operations and not dual scheduling

– Next hour schedules are not being dual entered•Schedules on DC Ties

– NSI true-up works on an aggregate level. It spreads the difference between the true EIS NSI and the entered IM NSI over all AC ties with the assumption that DC ties schedules are correct. When DC ties are missing it can cause constraint calculation issues.

22

Concerns - Schedule Mismatch Example from January 8th shows to have had around net 1526 MW difference in Marketplace for schedules

Net Breakdown:•507 MW due to MISO issue that will be fixed in next market release

•67 MW due to mismatch in MWs on tags entered in Marketplace vs. EIS tag

•42 MW due to extra tags in Marketplace. There were several, but were fairly balanced between exports/imports; the net effect was only around 42 MWs

•768 due to tags missing from Marketplace. Not entered

•61 MW was due to tags that failed validation and were overridden

23

Concerns – Tagging / Scheduling Impact•Once live, Market Participants that have not adjusted their business processes to adhere to Marketplace tags/scheduling business validations, may not be able to perform interchange business

•Testing is encouraged

•MP are encouraged to practice adhering to Marketplace business validations immediately

24

Concerns – Resource Offers• Issues exist with MPs carrying Contingency Reserves that

are not reachable within the rules and systems of the Marketplace when a unit is on Regulation control:– In EIS some MPs are allowed to stop deploying Regulation in

order to serve contingency reserves - in the Integrated Marketplace this is not allowed per the protocols

• Ramp rates– Regulation and Contingency Ramp Rates need to match unit

capability

– Experience with Turn Around Ramp Rate is ongoing, but has significant impact

25

Concerns – Real Time Data

• Plant Shares– Some MPs have been providing data that is inconsistent with

how they are modeled in the Marketplace

• Load Calculations– Actual Load value from Load Serving Entities has sometimes

been incorrect causing error in load forecast

• Non-Conforming Load– Some members are not able to properly calculate and send

data on the non conforming loads – in a few cases these have been significant

26

Concerns - Other

• Fixed Reserves must be achievable within the ramp provided

• Some entities entered more reserves than can be ramped in 5 or 10 minutes

• Delay in following ramped Setpoint due to control dead band and point resetting on 5 minute boundaries

27

Load Aggregates LMP Available via ICCP?

• CWG requested SPP research making LMP for certain load aggregates available via ICCP– Data is already posted to Marketplace Portal

– To provide via ICCP, a new interface between the Market and ICCP systems would be required, points would be updated on a 5 minute basis. This would involve interface and testing hours

• Recommendation:

– SPP would not recommend adding this data to ICCP since it is already on the portal

28

RTBM Availability

• RTBM availability during Parallel Operations official ODs– 99.08% availability on average

– 19 of 39 days had 100% availability

29

99.08% average

2.69 average0

20

40

60

80

100

Count of Missed Intervals

Availability Percentage

RTBM Solution Times• RTBM solution times during Parallel Operations official ODs

– 89.95 seconds response time on average

30

89.95 average

0

20

40

60

80

100

120 Average RTBM Execution Times (seconds)

Parallel Operations Schedule Changes Changes are in RED

•January 17, 9:00 am – noon: Parallel Ops / Go-Live Checkpoint (no change)

•January 20, 3:00 pm: Pre IDT Call (no change)

•January 21, 7:30 am – 4:30 pm: Integrated Deployment Test - now 7 hours beginning at 8:30 a.m.

•January 22, 3:00 pm: Post IDT Call (no change)

•January 24: No Friday Parallel Ops / Go-Live Checkpoint (cancelled)

•January 24, 3:00 pm: Pre IDT Call

•January 27, 7:30 am – 4:30 pm: Integrated Deployment Test - now 7 hours beginning at 8:30 a.m.

•January 28, 3:00 pm: Post IDT Call (no change)

31

Parallel Operations Schedule Changes

• February 24, 3:00 pm: Pre IDT Call

• February 25, 8:30 am : 12:30 pm: Integrated Deployment test

• February 26, 3:00 pm: Post IDT Call

• February 28, 7:00 pm : Go Live Deployment

32