Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

16
Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1

Transcript of Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

Page 1: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

Local and Global Optima

© 2011 Daniel Kirschen and University of Washington

1

Page 2: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

2

Which one is the real maximum?

© 2011 Daniel Kirschen and University of Washington

x

f(x)

A D

Page 3: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

3

Which one is the real optimum?

© 2011 Daniel Kirschen and University of Washington

x1

x2

B

A

C

D

Page 4: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

4

Local and Global Optima

• The optimality conditions are local conditions• They do not compare separate optima• They do not tell us which one is the global

optimum• In general, to find the global optimum, we

must find and compare all the optima• In large problems, this can be require so much

time that it is essentially an impossible task

© 2011 Daniel Kirschen and University of Washington

Page 5: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

5

Convexity

• If the feasible set is convex and the objective function is convex, there is only one minimum and it is thus the global minimum

© 2011 Daniel Kirschen and University of Washington

Page 6: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

6

Examples of Convex Feasible Sets

© 2011 Daniel Kirschen and University of Washington

x1

x2

x1

x2

x1x1

x2

x1min x1

max

Page 7: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

7

Example of Non-Convex Feasible Sets

© 2011 Daniel Kirschen and University of Washington

x1

x2

x1

x2

x1

x2

x1x1a x1

dx1b x1

c

x1

Page 8: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

8

Example of Convex Feasible Sets

x1

x2

x1

x2

x1

x2

A set is convex if, for any two points belonging to the set, all the points on the straight line joining these two points belong to the set

x1x1min x1

max

© 2011 Daniel Kirschen and University of Washington

Page 9: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

9

Example of Non-Convex Feasible Sets

x1

x2

x1

x2

x1

x2

x1x1a x1

dx1b x1

c

x1

© 2011 Daniel Kirschen and University of Washington

Page 10: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

10

Example of Convex Function

x

f(x)

© 2011 Daniel Kirschen and University of Washington

Page 11: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

11

Example of Convex Function

x1

x2

© 2011 Daniel Kirschen and University of Washington

Page 12: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

12

Example of Non-Convex Function

x

f(x)

© 2011 Daniel Kirschen and University of Washington

Page 13: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

13

Example of Non-Convex Function

x1

x2

B

A

C

D

© 2011 Daniel Kirschen and University of Washington

Page 14: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

14

Definition of a Convex Function

x

f(x)

xa xby

f(y)

z

A convex function is a function such that, for any two points xa and xb

belonging to the feasible set and any k such that 0 ≤ k ≤1, we have:

© 2011 Daniel Kirschen and University of Washington

Page 15: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

15

Example of Non-Convex Function

x

f(x)

© 2011 Daniel Kirschen and University of Washington

Page 16: Local and Global Optima © 2011 Daniel Kirschen and University of Washington 1.

16

Importance of Convexity• If we can prove that a minimization problem is convex:

– Convex feasible set– Convex objective function

Then, the problem has one and only one solution

• Proving convexity is often difficult• Power system problems are usually not convex There may be more than one solution to power system

optimization problems

© 2011 Daniel Kirschen and University of Washington