Stability Analysis of Nonlinear Systems Using Lyapunov ...

Lecture – 35

Stability Analysis of Nonlinear Systems Using Lyapunov Theory – III

Dr. Radhakant PadhiAsst. Professor

Dept. of Aerospace EngineeringIndian Institute of Science - Bangalore

ADVANCED CONTROL SYSTEM DESIGN Dr. Radhakant Padhi, AE Dept., IISc-Bangalore

Outline

Review of Lyapunov Theorems

LaSalle’s Theorem

Domain of Attraction

Review of Lyapunov Theorems

Definitions

System Dynamics

Equilibrium Point

( ) : (a locally Lipschitz map)

: an open and connected subset of

X f X f D

= →R

( ) 0e eX f X= =

Definitions

Stable Equilibrium

Unstable EquilibriumIf the above condition is not satisfied, then the equilibrium point is said to be unstable

is stable, provided for each 0, ( ) 0 :(0) ( ) ( )

XX X X t X t t

ε δ εδ ε ε

> ∃ >

− < ⇒ − < ∀ ≥

DefinitionsConvergent Equilibrium

Asymptotically StableIf an equilibrium point is both stable and convergent, then it is said to be asymptotically stable.

( ) ( )If : 0 lime etX X X t Xδ δ

→∞∃ − < ⇒ =

DefinitionsExponentially Stable

Convention

(without loss of generality)

( ) ( )( )

, 0 : 0 0

whenever 0

X t X X X e t

λα λ α

−∃ > − ≤ − ∀ >

The equilibrium point 0eX =

Lyapunov Stability TheoremsTheorem – 1 (Stability)

( )( )( )

Let 0 be an equilibrium point of , : .Let : be a continuously differentiable function such that:( ) 0 0

( ) 0, {0}

( ) 0, {0}Then 0 is "stable".

nX X f X f DV D

ii V X in D

iii V X in DX

= = →

≤ −

Lyapunov Stability TheoremsTheorem – 2 (Asymptotically stable)

( )( )( )

( ) 0, {0}

( ) 0, {0}Then 0 is "asymptotically stable".

nX X f X f DV D

ii V X in D

iii V X in DX

= = →

Lyapunov Stability TheoremsTheorem – 3 (Globally asymptotically stable)

( )( )( )( )

( ) 0, {0}

( ) is "radially unbounded"

( ) 0, {0}Then 0 is "glo

nX X f X f DV D

ii V X in D

iii V X

iv V X in DX

= = →

bally asymptotically stable".

Lyapunov Stability TheoremsTheorem – 3 (Exponentially stable)

( )( )

Suppose all conditions for asymptotic stability are satisfied.In addition to it, suppose constants , , , :

( )Then the origin 0 is "exponentially stable".Moreover, if

k k k p

i k X V X k X

ii V X k XX

≤ ≤

≤ −

= these conditions hold globally, then the

origin 0 is "globally exponentially stable".X =

Analysis of Linear Time Invariant System

System dynamics:

Lyapunov function:

Derivative analysis:

, n nX AX A ×= ∈R

V X PX X PXX A PX X PAX

X A P PA X

( ) ( ), 0 pdfTV X X PX P= >

Analysis of Linear Time Invariant System

For stability, we aim for

By comparing

For a non-trivial solution

( )T T TX A P PA X X QX+ = −

( )0TV X QX Q= − >

0TPA A P Q+ + =

(Lyapunov Equation)

Analysis of Linear Time Invariant Systems

Choose an arbitrary symmetric positive definite matrix

Solve for the matrix form the Lyapunov equation and verify whether it is positive definite

Result: If is positive definite, then and hence the origin is “asymptotically stable”.

( )Q Q I=

P ( ) 0V X <

Lyapunov’s Indirect Theorem

( )( )

Let the linearized system about 0 be .

The theorem says that if all the eigenvalues 1, ,

of the matrix satisfy Re 0 (i.e. the linearized systemis exponentially stable), then for t

X X A X

= Δ = Δ

he nonlinear system theorigin is locally exponentially stable.

Instability theoremConsider the autonomous dynamical system and assume

is an equilibrium point. Let have thefollowing properties:

Under these conditions, is unstable

( ) (0) 0( ) ,arbitrarily close to 0, such that 0

( ) 0 , where the set is defined as follows{ : and 0}

i Vii X X V X

iii V X U UU X D X V Xε

∃ ∈ = >

> ∀ ∈

= ∈ ≤ >

:V D →R

Construction of Lyapunov Functions

Variable Gradient Method:( )

( ) ( ) ( )0 0

Select a that contains some adjustable parameters

However, note that the intergal

V gV XX

VdV X dXX

V X V g X dX

∇ =∂∗ =∂

⎛ ⎞∂ ⎟⎜∗ = ⎟⎜ ⎟⎟⎜⎝ ⎠∂⎛ ⎞∂ ⎟⎜= ⎟⎜ ⎟⎟⎜⎝ ⎠∂

∫ ∫

∫value depends on the initial and final

states (not on the path followed). Hence, integration can be convenientlydone along each of the co-ordinate axes in turn; i.e.

Note:To recover a unique ,

( ) must satisfy the "Curl Condition":

. . ji

VV g X

ggi ex x

∂∂=

∂ ∂

Variable Gradient Method:

1 1 10

2 1 2 20

0,......, 0

,......, ,

Note The free parameter of are constrained to

satisfy the symmetric condition, which is satisfied

+ ( , , )

n n n nx x

V X g x dx

g x x dx

g x dx

by all gradients of a scalar functions.

Variable Gradient Method:( )

( ) ( )

Theorem: A function is the gradient of a scalar

function if and only if the matrix

is symmetric; where

g XV X

g gx x

⎡ ⎤∂⎢ ⎥⎢ ⎥∂⎣ ⎦

∂ ∂∂ ∂⎡ ⎤∂⎢ ⎥

⎢ ⎥∂⎣ ⎦ ∂ ∂∂ ∂ n

⎡ ⎤⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎣ ⎦

Krasovskii’s Method ( )

( ) ( ) ( ) ( )

Let us consider the system

Let : Jacobian matrix

If the matrix is ndf for all 0

then the equilibrium point is locally asymptotically stable and a

F X A X A X X D D

Theorem :

∂∂

∈ ∈

⎡ ⎤⎢ ⎥⎢ ⎥⎣ ⎦

( ) ( ) ( )( )

Lyapunov function for the system is

Note: If and is radially unbounded,

then the equilibrium point is globally asymptotically stable

V X f X f X

D V X=

Krasovskii’s Method( )

( ) ( )

Hence, if is negative definite, is ndf.

So, by Lyapunov's

F X V X

f fX X fX X

⎡ ⎤ ⎡ ⎤∂ ∂⎢ ⎥ ⎢ ⎥= +⎢ ⎥ ⎢ ⎥∂ ∂⎣ ⎦ ⎣ ⎦

theorem, 0 is asymptotically stable.X =

Generalized Krasovskii’s Theorem

( ) ( )

A sufficent condition for the origin to be asymptotically stable is that two pdf matrices and : 0, the matrix

is negative semi-

A P PA Q

Theorem

∃ ∀ ≠

⎡ ⎤∂⎢ ⎥⎢ ⎥∂⎣ ⎦

( ) ( ) ( )

definite in some neighbourhood of the origin.

In addition, if and is radially unbounded,

then the system is globally asymptotically stable

D V X f Xf X P= R

Generalized Krasovskii’sTheorem

( ) ( ) ( )( )

V X f X

f P f f P f

f ff P X X PfX X

f PA f f AP f

f PA AP

Proof =⎡ ⎤= +⎢ ⎥⎣ ⎦

⎡ ⎤⎛ ⎞ ⎛ ⎞∂ ∂⎢ ⎥⎟ ⎟⎜ ⎜= +⎟ ⎟⎜ ⎜⎢ ⎥⎟ ⎟⎜ ⎜⎝ ⎠ ⎝ ⎠∂ ∂⎢ ⎥⎣ ⎦= +

= + +( )( )

Hence, the result.

0 (ndf)

ndfnsdf

f PA AP Q f f Qf

= + + −

Invariant and Limit Sets

Invariant Set

( )( ) ( )

( )( )

A set is said to be an "invariant set" with respect to the

system if:

Examples:

(i) An equilibrium point ( )

(ii) Any trajectary of an autonomous system

M X t M t

∈ ⇒ ∈ ∀ >

Limit Set

( )( )

Definition:

Let be a trajectory of the dynamical

system .Then the set is called

the limit set (or positive limit set) of if

for any ,

X f X N

∈ { } [ ]( )

( )( )

a sequence of times

such that as

Note: Roughly, the limit set of is

whatever tends to in the limit.

∃ ∈ ∞

→ →∞

Limit Set

Example:

(i) An asymptotically stable equilibrium point is the limit set of any solution starting from a close neighbourhood of the equilibrium point.

(ii) A stable limit cycle is the limit set for any solution starting sufficiently close to it

LaSalle’s Theorem

A Useful Theorem(Subset of LaSalle’s Theorem)

( ) [ ]( )

Theorem : The equilibrium point 0 of the autonomous system

is asymptotically stable if:

(i) 0 (pdf) 0

(ii) 0 (nsdf) in a bounde

X X f X

V X X D D

> ∀ ∈ ∈

( )d region

(iii) does not vanish along any trajectory in

other than the null solution 0Morever,

If the above conditions hold good for R = a

( )nd is radially unbounded,

then 0 is globally asymptotically stable.

Example

( )( )

( ) ( )

22 2 1 1 2 2

2 21 2

Example:

Solution: Let , 0

x x x x x x

VV X f XX

=− − − +

⎛ ⎞∂ ⎟⎜= ⎟⎜ ⎟⎜⎝ ⎠∂

=[ ]( )( )

2 1 1 2 2

22 21 2 2 1 2 1 2 2

2 2 2 2

x x x x x

x x x x x x x x

⎡ ⎤⎢ ⎥⎢ ⎥− − +⎢ ⎥⎣ ⎦

= − − − +

Example

( ) ( )

( )( )

( ) ( )

222 1 2

2 1 1 2 2 2

(nsdf)

However,

x x x x x x

⎡ ⎤=− + +⎢ ⎥⎣ ⎦≤= ∀

⇔ = ∀⇒ =

− − − + = =⎡

⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥=⎢ ⎥ ⎢ ⎥⎣ ⎦⎦

Example

Here we have :

(i) does not vanish along any trajectory

other than 0

(ii) in

(iii) is radially unbounded,

Hence, the

origin is .Globally asymptotically stable

LaSalle’s Theorem

Let : be a continuously differentiable (not necessarily pdf) function and (i) be a compact set, which is

invariant with respect to the solution of

(ii) 0 i

V DM D

→⊂

( ){ }n

(iii) : and 0

i.e. is the set of all points of : 0 (iv) is the largest invariant set in

Then Every solution starting in approaches as

E X X M V X

E M VN E

= ∈ =

.t →∞

Lasalle’s Theorem

( )Remarks:

(i) is required only to be continuously differentiable

It need not be positive definite.(ii) LaSalle's Theorem applies not only to equilibrium points, but also to more general d

ynamic behaviours such as limit cycles.(iii) The earlier theorems (on asymptotic stability) can be derived as a corollary of this theorem.

Stability Analysis of a Limit Cycle Using LaSalle’s theorem

( )( )

2 2 21 2 1 1 2

2 2 22 1 2 1 2

2 2 21 2

Example:

Solution:

Morever,

x x x x x

x xddt

+ − −

+ − − >

⎡ ⎤ ⎡ ⎤⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥= ⇒ =⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦⎣ ⎦ ⎣ ⎦

( )( )

1 1 2 2

2 2 21 2 1 1 2

2 2 22 1 2 1 2

x x x x

x x x x x

= +⎡ ⎤= + − −⎢ ⎥⎣ ⎦

⎡ ⎤+ + − −⎢ ⎥⎣ ⎦

( ) ( )2 2 2 2 21 2 1 2

2 2 21 2

The set of points defined by

is an invariant set ; i.e any trajectory starting on this circle at t stays on the circle

x x x x

= + − −

= + =∴ + =

( )( )2 2 21 2

The trajectories on this invariant set are the solution of :

A clock-wise motion

X f Xβ+ =

∀ ≥

⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥= ⇒⎢ ⎥ ⎢ ⎥−⎣ ⎦ ⎣ ⎦

( ) ( ) ( )

( )( )( )

( ) [ ]( )( )

( )( )

22 2 2 21 2

2 2 22 1 1 22 2 2

1 2 1 2 2 2 21 2 1 2

2 2 2 2 2 2 21 2 1 2 1

[Note: 0 in ]

V X V X

x x x x

f XV Vx x f X

x xx x x x

x x x x

= + − ≥

⎡ ⎤⎡ ⎤∂ ∂ ⎢ ⎥⎢ ⎥= ⎢ ⎥⎢ ⎥∂ ∂ ⎢ ⎥⎣ ⎦ ⎣ ⎦⎡ ⎤+ − −⎢ ⎥= + − ⎢ ⎥⎢ ⎥+ − −⎣ ⎦

= + − + − −( )( )( )

( ) ( ) ( )

22 2 2 2 21 2 1 2

2 21 2Note:

x x x x

x x V X

β=− + + −

≤ =− +

( )( )2 2 2 2 2

1 2 1 2

origin Here, (i.e it is an equilibrium point)

Moreover

Either 0 or

i.e Either or

x x x x

⇔ + = + =

⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥=⎢ ⎥ ⎢ ⎥⎣ ⎦⎣ ⎦

2 21 2

Circle of radius It is an invariant set (i.e it is a limit cycle)

LaSalle's TheoremStep-1: For any , let us define

By constructi

on, is closed and bounded M

( )In this set, 0 (and this is true )

is an invariant set

∀ ∈∴

( ){ }

( ) { }[ ]

2 2 2 21 2

Step-2 To find :

It is already shown that

Step-3 To find : The largest invariant set in

Since both the subsets that

x x β

⎡ ⎤=⎢ ⎥⎣ ⎦

∪ + =R

2 2 21 2

constitute are invariant, Hence, By Lasalle's Theorem, every motion starting

in converges either to the origin or to the limit cycle,

M x x β

Stability Analysis (of limit cycle)

( ) ( )

22 2 21 2

2 2 21 2

Further analysis:

1Note that is a measure of

distance of a point to the limit cycle, since:

Also 4

⎡ ⎤⎢ ⎥⎢ ⎥⎣ ⎦

+ =⎛ ⎞⎟⎜ ⎟⎜ ⎟⎜⎜⎝ ⎠

⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥=⎢ ⎥ ⎢ ⎥⎟ ⎣ ⎦⎣ ⎦

( )( )

( ){ }

Selecting: (i) : (i.e.

(ii) :

(iii) :

Then applying LaSalle's theorem, it follows that any traject

/ 4 , 4)

(this excludes origin)

M X V X cR

β β β β

= ∈ ≤

ory in will converge to the limit cycle The limit cycle is Convergent /Attractive.

Corollary:

Letting 0 , this also shows that the origin is unstable!

( ) ( )

( ){ }

: Let , be trajectories of with initial

condition at 0 .Then the Domain of attraction is defined as

: , as

Philosophy : Around any asymptotically s

X t X f X

D X D X t X t

∈ → →∞

Definition

table equilibrium

point, there is a domain of attraction.Question : Can we estimate a domain of attraction ?

Ans: Yes!

32 1 1 2

21 1 1

Example: 3

Eq. point: 0

5 0 0 , 5

0 This system has three eq. points

x x x x

= − + −

− + = ⇒ = ±

∴⎡ ⎤⎢ ⎥⎣ ⎦

( ) 2 4 21 1 1 2 2

5 5 0 0

0 Let us study the stability of

Define

V X a x x x x xb c d= − + +

⎡ ⎤ ⎡ ⎤−⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

⎡ ⎤⎢ ⎥⎣ ⎦

( ) ( )( )

1 1 21 2

2 32 1 2

where, , , , need to be choosen "appropriately".

3 4 2 12

6 10 2

a b c d

xV VV X

x x xx x

c d x d b x x

a d c x x xc

∂ ∂=

− +∂ ∂

= − −

− −

⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥−⎣ ⎦⎣ ⎦

Choose:

2 12 012, 1, 6

6 10 2 0

(onechoice)

d ba b c d

− =⇒ = = = =

− − =

⎤⎥⎦

( ) ( )( )

( ) ( )

2 2 2 41 2 1 2 1

2 2 42 1 1

With this choice,

3 2 9 3

6 30 6

Hence, the system is locally asymptotically stable.

Note: Here, > 0 and

(locally )

V X x x x x x

V X x x x

V X V X

= + + + −

= − − +

0 as long as 1.6 1.6

2We may be tempted to conclude that : 1.6 1.6

is a region of attraction . The conclusion is incorrect

This is because is NOT a

∈ − < <

Surprise :

n invariant set

Theorem: Domain of Attraction

( )( )

Theorem:

Let (i) be an equilibrium point of the system

(ii) : be a continuously differentiable function

(iii) be a compact set containing such that " is invariant

X X f X

M D X M

with respect to the solution of the system"

(iv) is such that 0 in

Under these assumption, is a subset of the

V X X M

V ∀ ≠

domain of attraction, i.e. is an estimate of domain of attraction.

Proof: In LaSalle's theorem, : & 0 Hence the result !. e

E X X M XV= ∈ ==

Example….Contd.

( ) ( )( )

( ) ( )

2 4 21 1 1 2 2

2 2 42 1 1

12 6 6 0 0

6 30 6

We already know that

0 and 0 happens in

2 : 1.6

V X x x x x x

V X x x x

V X V X

= − + + =

= − − +

∈ − <

⎡ ⎤⎢ ⎥⎢ ⎥⎢ ⎥⎣ ⎦

= { }1 1.6x <

22 21.6

Let us find the minimum of along the

very edge of this set (to restrict this set further).Then

24.16 9.6 6

9.6 12 0

9.60.8

∂= + =

−⇒ = = −

( ) ( )

22 21.6

Similarly

24.16 9.6 6

9.6 12 0

Also 12 0

1.6 1.6has local minima when

0.8 0.8 = ,

x xx x

∂ ∂= − +

∂ ∂

= − + =

−∴

⎡ ⎤ ⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥ ⎢ ⎥

⎣ ⎦ ⎣ ⎦⎣ ⎦

( ) ( )

[ ]( ){ }

Moreover, 1.6, 0.8 1.6, 0.8 20.32

(i.e. both the minimums are equal)

Else, we need to choose the minimum of the two minimums.

= : 20.32 is an invariant set,

and hence,

M X V XD Dε

− − −

∴ ∈ −

≤ ⊂

is an estimate of the domain of attraction

Note: As long as 0, the local minimums are excluded.

Hence 0 as long as it starts in

An Interesting Result

( )( ) ( )( ) ( )

( )( ) ( )( )

If a real function satisfies the

in equality ,

Then 0

Proof:

then Note: 0

V t V t

V t e V

Z t V V

V V Z t Z t

≤ − ∈

+ = ≤

An Interesting Result( )

( ) ( ) ( ) ( )

( ) ( )

Let us consider as an "external input"

to this "linear system"Then

V t e V e Z d

V t e V

α τα

τ τ− −−

≥ ≤

= ⋅ ⋅∫

References

H. J. Marquez: Nonlinear Control Systems Analysis and Design, Wiley, 2003.

J-J. E. Slotine and W. Li: Applied Nonlinear Control, Prentice Hall, 1991.

H. K. Khalil: Nonlinear Systems, Prentice Hall, 1996.

Stability Analysis of Nonlinear Systems Using Lyapunov ...

Documents

Transcript of Stability Analysis of Nonlinear Systems Using Lyapunov ...

Nonlinear Systems: an Introduction to Lyapunov Stability ... · Lyapunov Theory!" There are at least three ways of assessing the stability (of an equilibrium point of a) system: •Solve

Nonlinear Control Lecture 7: Passivityele.aut.ac.ir/~abdollahi/Lec_6_N11.pdfOutline Passivity De nition L2 and Lyapunov Stability Feedback and Passivity Theorems Nonlinear Control

Nonlinear Systems: an Introduction to Lyapunov Stability Theory A. Pascoal, April 2013 (draft under revision)

Lyapunov stability of ground states of nonlinear ... Lyapunov Stability of Ground States of Nonlinear Dispersive Evolution Equations MICHAEL I. WEINSTEIN Princeton University Introduction

APPROXIMATION OF LYAPUNOV EXPONENTS OF NONLINEAR … · 2007-10-22 · The Lyapunov exponents of a stochastic dynamical system enable to study its stability. A survey of this important

Stability Analysis of Nonlinear Systems Using Lyapunov ... 31.pdf · Nonlinear Control, Prentice Hall, 1991. zH. K. Khalil: Nonlinear Systems, Prentice Hall, 1996. ADVANCED CONTROL

Lecture 4 â€” Lyapunov Stability

Short notes on Lyapunov stability 1 Introductionsanand/short_notes_stability.pdf · stability Lyapunov stability, invariant set stability, constructing Lyapunov functions, Converse

New universal Lyapunov functions for nonlinear kinetics

Dynamical Systems & Lyapunov Stability

Chapter 4 Lyapunov Stability - Hanyangccrs.hanyang.ac.kr/webpage_limdj/nonlinear/Chapter4Lec1.pdf · conditions for stability is called a Lyapunov function. The surface v (x) —

Appendix A Lyapunov Stability - Springer978-3-642-41572-2/1.pdf · Appendix A Lyapunov Stability Lyapunov stability theory [1] plays a central role in systems theory and engineering.

Stability of Nonlinear Systems An Introduction · 2015-08-20 · Introduction Lyapunov Stability ExamplesConclusions An Alternative Approach Pendulum example, continued no friction

Nonlinear Systems: an Introduction to Lyapunov Stability Theory A. Pascoal, Jan. 2014.

Stability Analysis of Nonlinear Systems Using Lyapunov ...nptel.ac.in/courses/101108047/module13/Lecture 31.pdf · Lecture – 33 Stability Analysis of Nonlinear Systems Using Lyapunov

Stability Analysis of Nonlinear Systems with Linear ... Analysis of Nonlinear Systems with Linear Programming A Lyapunov Functions Based Approach Von der Fakult¨at fur¨ Naturwissenschaften

HILBERT SPACE LYAPUNOV EXPONENT STABILITY

Lyapunov-Based Nonlinear Observer Design for an ...

Nonlinear Systems: an Introduction to Lyapunov … Systems: an Introduction to Lyapunov Stability Theory A. Pascoal , April 2013 (draft under revision)

Lyapunov Stability Analysis