Efficiency and Prices in Real-Time Electricity...
Transcript of Efficiency and Prices in Real-Time Electricity...
Efficiency and Prices in Real-Time Electricity Markets
Nicolas Gast
EPFL and Inria
April 12, 2014
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 1 / 40
Quiz: what is the value of energy?
Average price is 20$/MWh.Average production is 0.
1 0$.
YES: If you are a privateconsumer.
2 150k$
YES: If you buy on thereal-time electricity market(Texas, mar 3 2012)
3 −150k$.
NO (but YES for the redcurve! Texas, march 3rd2012)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 2 / 40
Quiz: what is the value of energy?
Average price is 20$/MWh.Average production is 0.
1 0$.YES: If you are a privateconsumer.
2 150k$
YES: If you buy on thereal-time electricity market(Texas, mar 3 2012)
3 −150k$.
NO (but YES for the redcurve! Texas, march 3rd2012)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 2 / 40
Quiz: what is the value of energy?
Average price is 20$/MWh.Average production is 0.
1 0$.YES: If you are a privateconsumer.
2 150k$YES: If you buy on thereal-time electricity market(Texas, mar 3 2012)
3 −150k$.
NO (but YES for the redcurve! Texas, march 3rd2012)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 2 / 40
Quiz: what is the value of energy?
Average price is 20$/MWh.Average production is 0.
1 0$.YES: If you are a privateconsumer.
2 150k$YES: If you buy on thereal-time electricity market(Texas, mar 3 2012)
3 −150k$.NO (but YES for the redcurve! Texas, march 3rd2012)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 2 / 40
Can we explain real-time electricity markets?
Is it price manipulation or an efficient market?
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 3 / 40
Issue 1: The electric grid is a large, complex system
It is governed by a mix of economics (efficiency) and regulation (safety).
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 4 / 40
Issue 2: Mix of forecast (day-ahead) and real-time control
Mean error: 1–2% Mean error: 20%
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 5 / 40
Main message
Real-time prices can be used for controlI Decentralized control
But:I Price fluctuationI Under-investment, observability
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 6 / 40
Outline
1 Real-Time Market Model and Competitive Equilibria
2 Numerical Computation of an Equilibrium and Distributed Optimization
3 Consequences of the efficiency of the pricing scheme
4 Summary and Conclusion
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 7 / 40
Outline
1 Real-Time Market Model and Competitive Equilibria
2 Numerical Computation of an Equilibrium and Distributed Optimization
3 Consequences of the efficiency of the pricing scheme
4 Summary and Conclusion
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 8 / 40
We consider the simplest model that takes the dynamicalconstraints into account (extension of Cho-Meyn 2006)
•Demand Supplier
Flexible loads Storage (e.g. battery)
Generator constraints
: ζ− ≤ G (t)− G (s)
t − s≤ ζ+
Uncertainty of renewable and consumption.
Storage :
Finite power and energy capacity. Efficiency η ≤ 1.
Demand-response:
I Flexible consumption (temperature dead-band). For example:
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 9 / 40
We consider the simplest model that takes the dynamicalconstraints into account (extension of Cho-Meyn 2006)
•Demand Supplier
Flexible loads Storage (e.g. battery)
Generator constraints : ζ− ≤ G (t)− G (s)
t − s≤ ζ+
Uncertainty of renewable and consumption.
Storage : Finite power and energy capacity. Efficiency η ≤ 1.
Demand-response:I Flexible consumption (temperature dead-band). For example:
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 9 / 40
We assume perfect competition between 2, 3 or 4 playersPlayers={supplier, demand, storage operator, flexible demand aggregator}
Player i maximizes:
argmaxEi∈internal constraints of i
E
∫ ∞0
Wi (t)︸ ︷︷ ︸internal utility
− P(t)︸︷︷︸spot price
· Ei (t)︸ ︷︷ ︸bough/sold energy
dt
Players are assumed price-takers: they cannot influence P(t).
•Price P(t)
Demand Supplier
Flexible loads Storage (e.g. battery)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 10 / 40
We assume perfect competition between 2, 3 or 4 playersPlayers={supplier, demand, storage operator, flexible demand aggregator}
Player i maximizes:
argmaxEi∈internal constraints of i
E
∫ ∞0
Wi (t)︸ ︷︷ ︸internal utility
− P(t)︸︷︷︸spot price
· Ei (t)︸ ︷︷ ︸bough/sold energy
dt
Players are assumed price-takers: they cannot influence P(t).
•Price P(t)
Demand Supplier
Flexible loads Storage (e.g. battery)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 10 / 40
Each player has internal utility/constraints and exchangeenergy
Internal utility Sold energy Intern. constraints
Supplier Generation cost Generated energy ramping
Demand -disutiliy of b/o Consumed energy
Storage operator Aging (dis)charged power/efficiency
Flexible load Undesirable states Consumed energy temperaturedead-band
Special case (cho-meyn 2006): linear cost functions.
Linear cost of generation: cG (t)
Demand: v min(D(t),E (t))︸ ︷︷ ︸satisfied demand
−cbo max(D(t)− E (t), 0)︸ ︷︷ ︸frustrated demand
.
Storage : 0 ≤ B0 +t∑
s=1
Es(t) ≤ Bmax and −Dmax ≤ ES ≤ Cmax.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 11 / 40
Each player has internal utility/constraints and exchangeenergy
Internal utility Sold energy Intern. constraints
Supplier Generation cost Generated energy ramping
Demand -disutiliy of b/o Consumed energy
Storage operator Aging (dis)charged power/efficiency
Flexible load Undesirable states Consumed energy temperaturedead-band
Special case (cho-meyn 2006): linear cost functions.
Linear cost of generation: cG (t)
Demand: v min(D(t),E (t))︸ ︷︷ ︸satisfied demand
−cbo max(D(t)− E (t), 0)︸ ︷︷ ︸frustrated demand
.
Storage : 0 ≤ B0 +t∑
s=1
Es(t) ≤ Bmax and −Dmax ≤ ES ≤ Cmax.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 11 / 40
Energy balance and the social planner’s problem
(E e1 , . . . ,E
ej ) is socially optimal if it maximizes E
∫ ∞
0
∑i∈ players
Wi (t)︸ ︷︷ ︸social utility
dt
,
subject to
For any player i , E ei satisfies the constraints of player i .
The energy balance condition: for all t:∑i∈players
E ei (t) = 0.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 12 / 40
Definition: competitive equilibrium
(Pe ,E e1 , . . . ,E
ej ) is a competitive equilibrium if:
For any player i , E ei is a selfish best response to P:
argmaxEi∈internal constraints of i
E
∫ ∞0
Wi (t)︸ ︷︷ ︸internal utility
− P(t)Ei (t)︸ ︷︷ ︸bough/sold energy
dt
For all t:
∑i∈players
E ei (t) = 0
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 13 / 40
The market is efficient (first welfare theorem)
Theorem
Any competitive equilibrium is socially optimal.
Very general result (Cho-Meyn 2006, Wang et al. 2012, Gast et al. 2013,2014).
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 14 / 40
Proof. The first welfare theorem is a Lagrangiandecomposition
For any price process P:
maxEi satisfies constraints i
∀t :∑
i Ei (t) = 0
E
∑i∈players
∫Wi (t)dt
social planner’s problem
≤∑
i∈players
maxEi satisfies constraints i
E[∫
(Wi (t) + P(t)Ei (t))dt
]selfish response to prices
If the selfish responses are such that∑i
Ei (t) = 0, the inequality is an
equality.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 15 / 40
Proof. The first welfare theorem is a Lagrangiandecomposition
For any price process P:
maxEi satisfies constraints i
∀t :∑
i Ei (t) = 0
E
∑i∈players
∫Wi (t)dt
social planner’s problem
=∑
i∈players
maxEi satisfies constraints i
E[∫
(Wi (t) + P(t)Ei (t))dt
]selfish response to prices
If the selfish responses are such that∑i
Ei (t) = 0, the inequality is an
equality.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 15 / 40
What is the price equilibrium? Is it smooth?
Reminder
Price is such that: for any player i , E ei is a selfish best response:
argmaxEi∈internal constraints of i
E
∫ ∞0
Wi (t)︸ ︷︷ ︸internal utility
− P(t)Ei (t)︸ ︷︷ ︸bough/sold energy
dt
Production has ramping constraints,
Demand does not.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 16 / 40
What is the price equilibrium? Is it smooth?
Reminder
Price is such that: for any player i , E ei is a selfish best response:
argmaxEi∈internal constraints of i
E
∫ ∞0
Wi (t)︸ ︷︷ ︸internal utility
− P(t)Ei (t)︸ ︷︷ ︸bough/sold energy
dt
Production has ramping constraints,
Demand does not.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 16 / 40
Fact 1. Without storage, prices are never equal to themarginal production cost.
No storage
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 17 / 40
Fact 1. Without storage, prices are never equal to themarginal production cost.
No storage
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 17 / 40
Fact 2. Storage leads to a price concentration
Small storage Large storage
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 18 / 40
Fact 3. Because of (in)efficiency, the price oscillates, evenfor large storage
Large storage
Two modes in√η and 1/
√η
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 19 / 40
Outline
1 Real-Time Market Model and Competitive Equilibria
2 Numerical Computation of an Equilibrium and Distributed Optimization
3 Consequences of the efficiency of the pricing scheme
4 Summary and Conclusion
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 20 / 40
Reminder
If there exists a price such that selfish decisions leads to energy balance.
These decisions are optimal.
•Price P(t)
Demand Supplier
Flexible loads Storage (e.g. battery)
There exists such a price.
We can compute it.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 21 / 40
We design a decentralized optimization algorithm based onan iterative scheme
Price P(t)
Generator
Demand
...
Fridges
1. forecasted price P(1), . . . , P(T )
2. forecasted consumption
3. Update price
Iterate
Difficulties1 Forecast errors
2 Stochastic behavior of appliances
3 Convergence guarantee
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 22 / 40
We design a decentralized optimization algorithm based onan iterative scheme
Price P(t)
Generator
Demand
...
Fridges
1. forecasted price P(1), . . . , P(T )
2. forecasted consumption
3. Update price
Iterate
Difficulties1 Forecast errors
2 Stochastic behavior of appliances
3 Convergence guarantee
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 22 / 40
We design a decentralized optimization algorithm based onan iterative scheme
Price P(t)
Generator
Demand
...
Fridges
1. forecasted price P(1), . . . , P(T )
2. forecasted consumption
3. Update price
Iterate
Difficulties1 Forecast errors
2 Stochastic behavior of appliances
3 Convergence guarantee
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 22 / 40
We design a decentralized optimization algorithm based onan iterative scheme
Price P(t)
Generator
Demand
...
Fridges
1. forecasted price P(1), . . . , P(T )
2. forecasted consumption
3. Update price
Iterate
Difficulties1 Forecast errors
2 Stochastic behavior of appliances
3 Convergence guarantee
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 22 / 40
Solution 1: We represent forecast errors by multiplediscrete-time trajectories
0 t_1 8h t_2 16h 24h
−10
−5
0
5
10
time (in hours)
fore
cast
err
or (
in G
W)
Z1=Z3
=Z5=Z7
Z2=Z4
=Z6=Z8
Z4=Z8 Z2=Z6
Z1=Z5Z3=Z7
Z6
Z1
Z2
Z3 Z7
0 t_1 8h t_2 16h 24h
−10
−5
0
5
10
G1=...=G8
G1=G3=G5=G7
G2=G4=G6=G8
G1=G5
G3=G7 G2=G6
G4=G8
time (in hours)
Gen
erat
ion
G (
in G
W)
Finite number of observation point.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 23 / 40
Solution 1: We represent forecast errors by multiplediscrete-time trajectories
0 t_1 8h t_2 16h 24h
−10
−5
0
5
10
time (in hours)
fore
cast
err
or (
in G
W)
Z1=Z3
=Z5=Z7
Z2=Z4
=Z6=Z8
Z4=Z8 Z2=Z6
Z1=Z5Z3=Z7
Z6
Z1
Z2
Z3 Z7
0 t_1 8h t_2 16h 24h
−10
−5
0
5
10
G1=...=G8
G1=G3=G5=G7
G2=G4=G6=G8
G1=G5
G3=G7 G2=G6
G4=G8
time (in hours)
Gen
erat
ion
G (
in G
W)
Finite number of observation point.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 23 / 40
Solution 2: Each flexible appliance computes itsbest-response to price
=
Object = Markov chain
0
2
4
6
8
10
Price
Price
⇓ best response
0 5 10 15 20
0
2
4
6
8
10
12
14
undesirable states
undesirable states
time (in hour)
Sta
te X
(t)
Sample trajectories of 5 fridges
Average x−state (mean field approx.)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 24 / 40
The global behavior of the flexible appliances can beapproximated by a mean-field approx.
Original system Mean-field approximation(limit as number of appliances is large)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 25 / 40
The problem is convex.
minimize∑
i∈players
E [Wi (Ei )]
subject to Ei satisfies constraints of player i
For all t:∑
Ei (t) = 0
Constraints = observability + generator / demand / storage / flexible load.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 26 / 40
Dual ascent method is decentralized but not robust
Lagrangian:
L0(E ,P) :=∑
i∈players
Wi (Ei ) +∑t
P(t)
(∑i
Ei (t)
)
Dual ascent method:
E k+1 ∈ argmaxE
L0(E ,Pk)
Pk+1 := Pk − αk(∑i
E k+1i )
Good: distributed.Bad: converges... under some conditions.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 27 / 40
Method of multiplier is robust but not distributed
Augmented Lagrangian:
Lρ(E ,P) :=∑
i∈players
Wi (Ei ) +∑t
P(t)
(∑i
Ei (t)
)− ρ
2
(∑t
∑i
Ei (t)
)2
Method of multipliers:
E k+1 ∈ argmaxE
Lρ(E ,Pk)
Pk+1 := Pk − ρ(∑i
E k+1i )
Good: (almost) always converge.Bad: not distributed
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 28 / 40
Solution 3: add extra variables and use ADMM
Augmented Lagrangian:
Lρ(E ,P) :=∑
i∈players
Wi (Ei ) +∑t
P(t)
(∑i
Ei (t)
)− ρ
2
∑t,i
(Ei (t)− Ei (t)
)2
ADMM (alternating direction method of multipliers):
E k+1 ∈ argmaxE
Lρ(E , E k ,Pk)
E k+1 ∈ argmaxE s.t.
∑i Ei=0
Lρ(E k+1, E , ,Pk)
Pk+1 := Pk − ρ(∑i
E k+1i )
Good: distributed, always converge if convex.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 29 / 40
Outline
1 Real-Time Market Model and Competitive Equilibria
2 Numerical Computation of an Equilibrium and Distributed Optimization
3 Consequences of the efficiency of the pricing scheme
4 Summary and Conclusion
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 30 / 40
Reminder
There exists a price such that:
Selfish decision leads to a social optimum.
We know how to compute the price.
•Price P(t)
Demand Supplier
Flexible loads Storage (e.g. battery)
We can evaluate the effect of more flexible load / more storage.
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 31 / 40
In a perfect world, the benefit of demand-response issimilar to perfect storage
Social Welfare
Installed flexible power (in GW for UK)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 32 / 40
Problem 1: synchronization leads to observability problemNo demand-response
Totalconsumption
No problem: actual consumptionis close to forecast
With demand-response
Totalconsumption
Problem if we cannotobserve the initial state
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 33 / 40
Problem 1: synchronization leads to observability problemNo demand-response
Totalconsumption
No problem: actual consumptionis close to forecast
With demand-response
Totalconsumption
Problem if we cannotobserve the initial state
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 33 / 40
Problem 1. Observablity is detrimental if the penetration islarge
We assume that:
The demand-response operator knows the state of its fridges
The day-ahead forecast does not.
Social Welfare
Installed flexible power (in GW for UK)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 34 / 40
Problem 2. The market structure might lead tounder-investment
Welfare forstorage owner
Installed flexible power (in GW for UK)
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 35 / 40
Outline
1 Real-Time Market Model and Competitive Equilibria
2 Numerical Computation of an Equilibrium and Distributed Optimization
3 Consequences of the efficiency of the pricing scheme
4 Summary and Conclusion
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 36 / 40
Summary
1. Real-time market model (generation dynamics, flexible loads, storage)
•
Price P(t)
Demand Supplier
Flexible loads Storage (e.g. battery)
2. A price such that selfish decisions are feasible leads to a socialoptimum.
3. We know how to compute the price.
Trajectorial forecast and ADMM
4. Benefit of demand-response: flexibility, efficiencyDrawbacks: non-observability, under-investment
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 37 / 40
Conclusion and perspective
Methodology:I Distributed Lagrangian (ADMM) is powerfulI Use of trajectorial forecast makes it computableI Can be used for learning
Real-time MarketI Efficient but not robust
F Efficiency disregards safety, security, investment,...F Who wants real-time prices at home?
I Interesting applications: electric cars, voltage control
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 38 / 40
I belong to the Quanticol project
A Quantitative Approach to Management and Design of Collective andAdaptive Behaviors.
FET project, cousin of CASSTING.
Objectives:
Build a modelization toolI Stochastic models, fluid approximation, optimization, verification
Applications: smart-citiesI BusesI Bike-sharing systemsI Smart-grids
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 39 / 40
Nicolas Gast — http://mescal.imag.fr/membres/nicolas.gast/
Model
Dynamic competitive equilibria in electricity markets, G. Wang, M.Negrete-Pincetic, A. Kowli, E. Shafieepoorfard, S. Meyn and U. Shanbhag, Controland Optimization Methods for Electric Smart Grids, 35–62 2012,
A Control Theorist’s Perspective on Dynamic Competitive Equilibria in ElectricityMarkets. G. Wang, A. Kowli, M. Negrete-Pincetic, E. Shafieepoorfard, S. Meynand U. Shanbhag.
Storage and Demand-response
Impact of storage on the efficiency and prices in real-time electricity markets. NGast, JY Le Boudec, A Proutiere, DC Tomozei, e-Energy 2013
Impact of Demand-Response on the Efficiency and Prices in Real-Time ElectricityMarkets. N Gast, JY Le Boudec, DC Tomozei. e-Energy 2014
ADMM
Distributed Optimization and Statistical Learning via the Alternating DirectionMethod of Multipliers S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein.Foundations and Trends in Machine Learning, 3(1):1-122, 2011.
Supported by — http://www.quanticol.eu
Nicolas Gast (EPFL and Inria) Efficiency and Prices in Real-Time Electricity Markets April 12, 2014 40 / 40