Readiness Scorecard – Market Readiness Series

http://nodal.ercot.com 1

Readiness Scorecard – Market Readiness Series

Brandon McElfreshNodal Readiness and Transition

April 29, 2010


Nodal Scorecard

Current Scores• As of 4/29/2010

http://scorecard.ercot.com

ERCOT metrics for the these areas will light up in Market Trials Phase 5

Only Network Model metric is N4 Single Entry Model

ERCOT Connectivity measure will be added after 5/4 NATF


Metrics Roadmap PURPLE

ORANGE

Timing and Design Confirmed

Timing subject to change, design in progress

MP15A

MP16

MP20

MP3

MP6

MP11 MP14C

E9

E1

N2 EMO9

CRR3

EMO6

MO4 MO5

CO1

CO2

CO3

CO4

CO5

CO6 CO7

CO8 CO9

C10

E7

E11

E12

EMO2

EMO3

EMO8

MO3

C1-C10

EMO13

MO7

CRR4

E5

IMM1

R0

R2

R3

MP15B

MP3

N1

E3

E10

R1

MP17

EMO7EMO1

CRR Metrics


Metric NameCurrent Score

Applies to

Weight Green % Yellow % Red %Not

Scored %Primary Criteria Notes

Market Participant Metrics

MP15-B CRR Connectivity Qualification

Green CRRAHsEven

weighting95.45% 0.0% 4.55% 0.0

Successful submission CRR transactions

63/66 CRRAHs qualified.

CRR3 Operation of CRR Auctions and

AllocationsGreen CRRAHs

Even weighting

95.2% 0% 0% 4.8%

Participation in at least one of the last two

auctions or allocations. AMBER/RED scores

light up 5/5/2010.

60/63 CRRAHs with adequate participation in March or April Auctions

or Allocations

ERCOT Metrics

CRR3 Operation of CRR Auctions and

Allocations

5/5/2010 ERCOT N/A N/A N/A N/A N/A

CRR Auction results distributed to

participants according to schedule defined in

CRR Handbook

Based on hitting 5/2 “2010 Balance of year auction results” to the

market


Allocated Revenue Rights in statistical

sample = 100% accurate

Results of Source/Sink prices / CRR Clearing prices report after 5/2 BOY auction clears

CO8 Verify CRR Auction Invoices

5/5/2010 (Will be Green)

ERCOT N/A N/A N/A N/A N/ACRR Auction Result for

MPn – CRR Auction Invoices for MPn = 0$

For March, April, and May 2010 auctions, S&B

validated that auction invoices accurately

reflected data received from the CRR system at

a CRRAH level.

5/5/2010 (Will be Green)

ERCOT N/A 100% 0% 0% 0%System Generated

CRR Auction Invoices not posted = 0

March 2010 Monthly = 40 of 40April 2010 Monthly = 38 of 38May 2010 Monthly = 48 of 48

Active Phase 3 Metric

Real-Time Metrics



Applies to




MP3 Market Submissions Connectivity Qualification

Green QSERsGeneration Ratio Share

99.0% 1.0% 0.0% 0.0%Successful submission

of RT and DAM transactions

81/84 QSERS Qualified (includes QSEs with Load Resources).

Green QSEsEven

weighting96.7% .06% .05% 2.2%

176/182 QSEs qualified. Below 95% threshold for

overall GREEN.

MP15-A Real-time Market Participation


99.0% 1.0% 0.0% 0.0%Weekly average of

daily SCED submissions

77/79 QSERs above 95% weekly average for

SCED submissions.

EMO6 Individual LFC Testing


91% 0% 0% 9%

80% of system-wide generation has

completed individual QSE tests for LFC

56/76 QSERs completed their individual LFC test

ERCOT Metrics

MO4 Verify SCED Execution Quality

Green ERCOT N/A 100% 0% 0% 0%

All of the successful SCED executions passed the post-execution price

validations for the given reporting period.

4/6-4/19 period - 4,030 Price Validation runs with no rule violations

MO5 Generate 6 Months of LMPs

Green ERCOT N/A 98.1%. 0% 1.9% 0%

Greater than 95% of the SCED executions produced and posted LMPs for the given reporting period.

4/6-4/19 period, 3,985 out of 4,063 SCED runs

with LMP posted correctly.

Active Phase 3 and 4 Metrics

Day-Ahead Market Metrics



Applies to




MP16 DAM Participation


97.5% 1.3% .2% 0%

Participation in 50% of the Day-Ahead Market

runs

72/78 QSERs with adequate participation

Amber QSEsEven

Weighting64% 16.4% 19.2% .4%

118 out of 184 QSEs with adequate participation

ERCOT Metrics

MO8 Verify DAM Execution Quality

5/19/2010 ERCOT N/A N/A N/A N/A Red

DAM execution pass the post-execution

price validations for the given reporting period

Will be reviewed at 5/4 NATF

MO9 Generate DAM LMPs


95 percent Day-Ahead Market execution as evidenced by Day-Ahead LMP posting

times


MO10 DRUC Execution

6/2/2010 ERCOT N/A N/A N/A N/A N/A95 percent DRUC

executionWill be reviewed at 6/1

NATF

Outage Scheduler Metrics



Applies to

Weight Green % Yellow % Red % Not Scored % Primary Criteria Notes


MP20 Outage Scheduler

Connectivity Qualification


98.1% 0.0% 0.0% 1.9%

Successful submission of OS

transactions

74/78 QSERS qualified.

Green TSPsOwnership Ratio Share

99.8% 0% 0% .02% 23/25 TSPs qualified.

ERCOT Metrics

EMO3 Verify Outage Evaluation System

Functionality6/2/2010 ERCOT N/A N/A N/A N/A N/A

A test of the Outage

Management Process is completed


Active Phase 3 Metric

Network Modeling Metrics



Applies to




MP14-C TSP Model Validation


99.9% .1% 0.0% 0.0%Network Model data

validated by TSP

24/28 TSPs have submitted model

validation e-mail to ERCOT.

MP6 Telemetry Compliance with Nodal

Protocols 3.10.7.5 (does not include 405

QSE CB and DSC points from TSP

outreach)


100% 0.0% 0.0% 0.0%Expected State

Estimator telemetry submitted.

78/78 complete. 3502 total SE points provided


100% 0.0% 0.0% 0.0%Expected SCED

telemetry submitted.78/78 complete. 7629 SCED points provided


99.3% 0.0% 0.0% .7%Expected TSP

telemetry per ICCP Handbook submitted

16/17 TSPs above 95% threshold for GREEN. 357 points outstanding

N2 Telemetry ICCP System Failover

Green/White only

QSERsGeneration Ratio Share

11.8% 0% 0% 88.2%

ICCP Failover test completed successfully prior to the 8-hour LFC

test.

18/78 QSERs completed ICCP telemetry failover

test

MP18 Mapping of Resources and Loads

in Private Use Networks

6/2/2010 QSERsGeneration Ratio Share

N/A N/A N/A N/A

# of QSE(n) PUN Points Provided / # of QSE(n) PUN Points

Expected

306 points across 7 QSEs with Resources. 15 points still assigned

to TDSP.

MP23 Telemetry Quality

7/14/2010 TSPsOwnership Ratio Share N/A N/A N/A N/A

# of TSP(n) Suspect/Bad points

provided / # of TSP(n) points total

1356 Suspect/Bad points (97.9% good

quality).

7/14/2010 QSERsGeneration Ratio Share

N/A N/A N/A N/A

# of QSER(n) Suspect/Bad points

provides / # of QSER(n) points total

871 Suspect/Bad points (94.9% good quality)

ERCOT MetricsEMO9 Validate Zonal and Nodal Security

Analysis5/19/2010 ERCOT N/A N/A N/A N/A N/A

Comparison of Nodal and Zonal constraints.


Active 4 Metric

Network Model Metrics

Resource Entity Metrics


Metric Name Current Score Applies to Weight Green % Yellow % Red % Not Scored % Primary Criteria Notes


MP11 Resource Registration

Green REs

Registered MW

Capacity Ratio Share

97.7% 1.82% .5% 0.0%

Decision Making Authority form submitted, and

GENMAP validated

151/157 Resources completed.

Readiness Metrics


Metric Name Current ScoreApplies

toPercentage (if

applicable)Primary Criteria Notes

ERCOT Metrics

E1 ERCOT Staff Completes Training

Green ERCOT 100%Training plans must be adhered to for

highly impacted departments15 out of 15 highly impacted departments

are up to date with their training plans.

E9 Develop Nodal Procedures

Green ERCOT 100%Procedures developed 1 month prior an

exercised in the appropriate Market Trials Phase

All MT4 and MT5 are now developed and the MT3 procedures were exercised during

MT3 as scheduled. MT4 procedures on target to be exercised by the end of MT4.

Useful Documents

Artifacts• Nodal Scorecard (http://scorecard.ercot.com)• Index of Nodal Metrics

(http://nodal.ercot.com/readiness/scorecard/metrics/index.html)• Others Artifacts on the Nodal Readiness Center• (http://nodal.ercot.com/readiness/scorecard/index.html)

• Active Metric Inventory• Completed Metric Inventory• Removed Metric Inventory• Metrics Update Calendar• Metrics Roadmap - Metrics overlaid on the Market Trials

Roadmap



Q&A

Q&A / Open Forum

Readiness Scorecard – Market Readiness Series

Documents

Transcript of Readiness Scorecard – Market Readiness Series