An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also...

19
Pergamon Computers Math. Applic. Vol. 36, No. 3, pp. 87-105, 1998 @ 1998 Elsevier Science Ltd. All rights reaen4 Printed in Great Britain PII: SO898-1221(98)00131-X 0898-1221/98 $19.00 + 0.00 An Optimal Control Approach to Nonlinear Mixed Integer Programming Problems H. W. J. LEE Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, NT, Hong Kong xqcai0ee.cnhk.edu.hk K. L. TEO School of Mathematics and Statistics Curtin University of Technology GPO Box U1987, Perth, WA 6001, Australia teoQrabbit.ce.cuxtin.edu.au X. Q. CA1 Department of Systems Engineering and Engineering Management The Chinese University of Hong Kong Shatin, NT, Hong Kong (Received and accepted October 1997) Abstract-Motivated by the recent developments of the Control Parametrization Enhancing Tech- nique (CPET), a novel method for solving a general cleee of nonlinear mixed integer prcgramming problems is introduced in thii paper. By imposing appropriate dynamice as well ee a set of statistical variance type of functional constraints, a problem with mixed integer decision variables is first trans- formed into a discretevalued optimal control problem, and then transformed, by applying CPET, into a standard optimization problem involving only continuous values. @ 1998 Elsevier Science Ltd. All rights reserved. Keywords-Nonlinear discrete optimization, Mixed integer programming, Optimal control, Con- trol parametrization enhancing technique. 1. INTRODUCTION Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem with a nonlinear cost function of a mixture of discrete and continuous decision variables. Each discrete decision variable is restricted to take only certain prespecified discrete values, whereas, each continuous decision variables is allowed to take any value within a prespecified closed interval. In addition, there may be extra nonlinear constraints imposed onto both type of variables. This problem occurs quite naturally and frequently in many areas, since most of the real world problems are inherently problems of mixed discrete and continuous decision variables. Thii paper is partially supported by the Australian Research Council, and the Research Grants Council of Hong Kong under Earmarked Grants No. CUHK 356/963 and No. CUHK 278/943. 87

Transcript of An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also...

Page 1: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

Pergamon Computers Math. Applic. Vol. 36, No. 3, pp. 87-105, 1998

@ 1998 Elsevier Science Ltd. All rights reaen4 Printed in Great Britain

PII: SO898-1221(98)00131-X 0898-1221/98 $19.00 + 0.00

An Optimal Control Approach to Nonlinear Mixed Integer

Programming Problems

H. W. J. LEE Department of Systems Engineering and Engineering Management

The Chinese University of Hong Kong Shatin, NT, Hong Kong xqcai0ee.cnhk.edu.hk

K. L. TEO School of Mathematics and Statistics

Curtin University of Technology GPO Box U1987, Perth, WA 6001, Australia

teoQrabbit.ce.cuxtin.edu.au

X. Q. CA1 Department of Systems Engineering and Engineering Management

The Chinese University of Hong Kong Shatin, NT, Hong Kong

(Received and accepted October 1997)

Abstract-Motivated by the recent developments of the Control Parametrization Enhancing Tech- nique (CPET), a novel method for solving a general cleee of nonlinear mixed integer prcgramming problems is introduced in thii paper. By imposing appropriate dynamice as well ee a set of statistical variance type of functional constraints, a problem with mixed integer decision variables is first trans- formed into a discretevalued optimal control problem, and then transformed, by applying CPET, into a standard optimization problem involving only continuous values. @ 1998 Elsevier Science Ltd. All rights reserved.

Keywords-Nonlinear discrete optimization, Mixed integer programming, Optimal control, Con- trol parametrization enhancing technique.

1. INTRODUCTION

Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem with a nonlinear cost function of a mixture of discrete and continuous decision variables. Each discrete decision variable is restricted to take only certain prespecified discrete values, whereas, each continuous decision variables is allowed to take any value within a prespecified closed interval. In addition, there may be extra nonlinear constraints imposed onto both type of variables.

This problem occurs quite naturally and frequently in many areas, since most of the real world problems are inherently problems of mixed discrete and continuous decision variables.

Thii paper is partially supported by the Australian Research Council, and the Research Grants Council of Hong Kong under Earmarked Grants No. CUHK 356/963 and No. CUHK 278/943.

87

Page 2: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

88 H. W. J. LEE et al.

The major difficulty in solving this problem is that the set of the discrete variables does not form a convex set. The problem is, in fact, a combinatorial optimization problem, and hence, the computational cost is extremely expensive.

In practice, two main intuitive methods are regarded as conventional approaches for solving this nonlinear mixed integer programming problem, namely the cutting plane method (see [l]), and the branch and bound method [2-51. Note that global optimality is not guaranteed for these methods, see [6].

In addition to these two conventional approaches, methods based on the idea of penalty function can also be found in the literature. For details, see (6-91. In this approach, the discrete decision variables are treated as continuous ones, and a penalty function of these variables is added to the cost so as to penalized them from taking values other than the specified discrete values. In theory, optimal solution to this nondiscrete optimization problem is equivalent to that of the original mixed discrete problem. Thus, standard continuous optimization methods can be used. However, there is a major drawback about such an approach specifically, most of the proposed penalty functions are high-order polynomials which contain many local optima. Thus, many new local optima are introduced when such a penalty function is added to the cost.

For the moment, let us digress ourselves to some recent developments in the computational studies of optimal controls.

In [lO-121, a novel problem transform technique called the Control Parametrization Enhanc- ing Technique (CPET) is developed. This technique overcomes several numerical difficulties of finding switching times of controls by the classical control parametrization method (13-151. More importantly, optimal discretevalued control problems can thus be solved easily by the classical control parametrization method via CPET, see [11,12].

Motivated by these results, we propose a new approach in this paper to solve the nonlin- ear mixed integer programming problems by using this CPET. For illustration, two numerical examples are solved using the proposed approach.

2. PROBLEM FORMULATION Consider the optimization of a (nonlinear) cost function involving both continuous and discrete

decision variables with constraints in the following form:

withy= [Y~,Y~,...,Y,]~ andt= [&,&,...,JJT subject to

&(y,e)=o, i=1,2 ,.*., N,, (2.2)

war,e> 5 0, i=N,+l, qN,+2 )...) N,+Ni, (2.3)

yi E 0, i= 1,2 )...) 77-4 (24 & E vi, i=1,2 (...) ,n. (2.5)

where N, , Ni , and n are nonnegative integers, m is a positive integer, and Qi, i = 1,2,. . . , N, + Ni, are continuously differentiable with respect to all their arguments. For each i = 1,2,. . . , n,Vi~Eisacontinuoussetandforeachi=1,2,...,m,

is a discrete set of real numbers with Ji elements. For convenience, this mixed integer program- ming problem is referred to as Problem (Pl). As mentioned before, many real-world practical problems in a wide range of disciplines, such as engineering optimal design, can be cast in the form of Problem (Pl).

Page 3: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 89

3. EQUIVALENT OPTIMAL CONTROL PROBLEMS

Without loss of generality, let Ji = M, for all i = 1,2,. . . , m. LettE[O,l]andu=[ur,uz ,..., %lTwhere,foreachi=1,2 ,..., m,~i:[O,l)t+Diisa

measurable function. Define the following set of differential equations:

k = u, (3.la)

with the initial condition given by Z(0) = 0. (3.lb)

In addition, we restrict each ui to be constant control over [O, l), for i = 1,2, . . . , m. Consider the following combined optimal diiret+valued control and optimal parameter selection problem.

Subject to the dynamical system (3.1), find a set of & E I$ for j = 1,2,. . . , n, and a set of constant controls ui : [0, 1) H Di for i = 1,2,. . . , m, such that the terminal constraints

@,(z(l),<)=O, i=1,2 )...) N,, (3.2)

@i(4l),t) I 0, i=IV,+1, N,+2,...,N,+A$ (3.3)

are satisfied, and the terminal cost objective

@o(W), 0 (3.4)

is minimiid. Thii problem is referred to as problem (P2). Clearly, Problems (Pl) and (P2) are equivalent. Let us apply the control parametrization enhancing technique (CPET) developed in [11,12] to

transform Problem (P2) into the form so as the Classical Control Parametrization method [13] can be used to compute the solution exactly.

Note that all differential equations of (3.1) are decoupled. Thus, they are independent to each other. We can then apply CPET (11,121 individually to each differential equation so as to simplify the computation effort further.

Define a new time scale s E [O, M]. For each pi, we define a basic ordering sequence from Di

(3.5)

and we define a set of functions pi(s) as

/4(S) = fiii,j, s E li - Lj), (3.6)

fori=1,2 ,..., m. Define a set of enhancing controls by v(i, 8) L 0 for i = 1,2,. . . , m, where each ~(i, .) is a

piecewise constant function with interior knots located at the integers {1,2,. . . , M - 1). An enhancing control is referred to as a normalized enhancing control if it satisfied the following

constraints:

s

M

u(i, s) ds = 1, i=1,2 ,..., m. 0

Let var (-) denote the usual statistical variance function defined by

J M

var(u) = 0

22)(5)& - (1” ??++isJ1.

Page 4: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

90 H. W. J. LEE et al.

LEMMA 3.1. The minimum value of the variance over all possible normalized enhancing controis is l/12 and the corresponding shape of the normalized minimum variance enhancing control is .given by

v(s) = 1, SE [k-1$),

0, otherwise,

where k is an integer taking its value in {1,2, . . . , M}.

PROOF. For each normalized v(s), define

Vi = V(S), for S E [i -1, i),

for i = 1,2,..., M. Since, v(s) is normalized, it is clear that

M

c vi = 1. i=l

Then,

w(v) = J 0 M 221(5)dS - (I” svw?}

= 51’ s2v(s) ds + (~~~lsv~~~ d+2 i=l i-l i==l

M i =

Cl s2 vi ds +

i=l i-l

= gvi [;I:_, + (i&i ra:,)’

Hence, we can rewrite the variance function var (v) as a function of vi, i.e.,

f (Vl, V2, - * * ? V~~=~Vi(i2-i+g)-[~v~(i-l)]2’

(3.7)

(3.3)

(3.9)

(3.10)

(3.11)

Consider the following constrained optimization problem:

min l)l,~av..,~&f

f(Vl,V2, . . ..vM) =g i=l

,(i’-i+g- [~vi(i-;,l’}.

subject to M

h(‘Ul,V2, * * *, v&&=1, i=l

and $Ii(‘ul,V2,..., 2)M)=vizo, fori= 1,2 ,..., M.

We can write down the Kuhn-Tucker condition [16] for the above constrained optimization prob- lem as follows: for j = 1,2, . . . , M,

(3.12)

Page 5: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach

which is,

j2-j+5-2(4 (&(i-9) +A_77j4

91

(3.13)

forj=1,2,..., M. Now, consider the parabola

p(x) = x2 - 2 + ; - 2(x-9 ($+9) +A

=zz- (1+2(&+++ (:+ (&(i-9) +A) *

(3.14)

It is well known that there can be, at most, two real distinct solutions (or roots) that can satisfy the equation

p(z) = 0. (3.15)

Hence, there are at most, 2 of the 77j equal to zero, and the rest are all nonzero. If a particular qj of (3.13) equals zero, then the corresponding inequality constraint is nonactive.

Thus, vj must be nonzero. However, if a particular nj of (3.13) is nonzero, then the corresponding inequality constraint is active, and thus, Vj must be zero. Now we assume qkl = qka = 0 for some ki and kz. The corresponding vkl and ok, are nonzero, but the rest of the vj are zeros. Moreover, vkl + vka = 1. Hence,

= vuk, (

k12 - kl + f ) (

+vkn k22 - k2 + f )

- [w (kr;)+vt, (kr;)]2

= vk, k12 - kl + ; +(l-vkl) kz2-k2+; ( )

- [vkl (kr;) ( )I

2

+ (1 - ukl) kz - ;

= k + (vtcl - vi,) (ICI - kz)' .

Note that r& takes the value 0 or 1 when kl = k2 = k for some k. If kl # k2, we have 0 < Vkl < 1, which implies (Vkl - v”,,) > 0. Therefore, it is clear that the minimum of var (v) occurs when ki = k2 = k for some k. Moreover, minnormariz~ v{var (v)) = l/12. I

Hence, by adopting the idea of CPET to each decoupled differential equation of (3.1), we obtain the following constrained optimal control problem.

Subject to the dynamical system,

dxi(s) - = /4(s) v(i, s), ds

i= 1,2 ,...) m, (3.16a)

with initial condition Zi(0) = 0, i=1,2 )...) m,

find a set of enhancing controls v(i, s) 2 0 for i = 1,2,. . . , m, with

(3.16b)

J M

v(i,s)ds = 1, i = 1,2 ,..., m, (3.17) 0

Page 6: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

92 H. W. J. LEE et al.

1

0.8

0.6

0.4

0.2

0

L

I 1 , I

i~~~~~~~~‘~~___~~‘~~_, ::g{: _.

I

I 4

0

,

I I

8

I I I

I

I I

8 t

I

I

I I

,

, I

I I

, 0 , 0

, c________-___________

1 I I I

0 1 2 3 4 5 Figure 1. The plot of enhancing controls ~(1, a), ~(2, s) obtained versus 8.

and var (v(i, v)) = A, i=l,2 ,.**,m, (3.18)

such that the terminal constraints

W$q,<) = 0, i = 1,2 ,***> N,,

Q&(W,O < 0, i=N,+l, Ne+2,...,N,+Ni

are satisfied, and the terminal cost objective

(3.19)

(3.20)

QOGW), 0 (3.21)

is minimized. This problem is referred to as Problem (P3).

THEOREM 3.1. Problems (P2) and (P3) are equivalent problems.

PROOF. Applying Lemma 3.1 to each v(i, s) for i = 1,2,. . . ,m. It is clear that the con- straints (3.17) and (3.18) force each v(i, s) to be normalized minimum variance enhancing control. Thus, each v(i, s) satisfying the constraints (3.17) and (3.18) is given by

V(i, s) = {

1, sE[ki-l,k$),

0, otherwise,

for some integer ki. Hence, each of the corresponding w(t) is a constant control over t E [0, 1). The result follows. I

Note that Problem (P3) is in the form where the Classical Control Parametrization method [13] can be used to compute the solution exactly. As shown in [13], the Classical Control Parametrize tion method is basically nonlinear programming in disguise. Hence, we have finally transformed the problem into a standard optimization problem.

Problem (P3) is readily solvable by MISER3 [13-151, as described in [11,12], where the Classical Control Parametrization method is used.

Page 7: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 93

4. VARIANCE CONSTRAINTS RELAXATION

Note that if we impose control bounds on the enhancing controls v(i, s) in Problem (P3)

0 5 w(i,s) 5 1,

forallsE[O,M)andfori=1,2 ,..., m, the equality constraints (3.17) are not hard to satisfy.

1

0.8

0.6

0.4

0.2

1

0.6

0.6

0.4

0.2

3 4 5 6 7

(a) I I I I

‘v(2,s)’ -

0 -’

I I I I ,

0 1 2 3 4 5 6

(b)

Figure 2. The initial guess of v(i, s) = 0.5, for all s.

Page 8: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

94 H. W. J. LEE et al.

1

0.6

0.6

0.4

0.2

0

0 1 2 3 4 5 6 7

Cc)

Figure 2. (cont.)

Moreover, it is obvious that the set of ail v(i, s) that satisfy

J M v(i,s)ds = 1

0

is convex. However, the equality constraints (3.18) in Problem (P3) do not form a continuous feasible

set in the function space of piecewise constant functions. Instead, feasible solutions are discrete points in the piecewise constant function space. Hence, it will not be computationally sensible if we solve Problem (P3) by MISER3 in its current form.

In view of Lemma 3.1,

var (?J(i, *)) 2 4, i= 1,2 ,..., m,

for all normalizing u(i, -). Consider the following inequality constraints:

var (v(i, *)) 5 A+,, i=1,2 (...) m, (4-i)

where a is a positive constant. Note that (4.1) is more “relaxed” than (3.18) since we now have

f 5 var (v(i, *)) I & + a, i=1,2 ,..., m.

Hence, we can start the optimlzation process with a large value of CL Then, use the solution obtained to it as initial guess for another optimization process with a reduced value of o. By repeating the process, we obtain the solution to Problem (P3) in the limit.

Note that if the software package MISER3 is used in the above scheme, it is numerically advantages to use (3.18) instead of (4.1) when cr is close to zero. We have the following algorithm.

Page 9: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 95

ALGORITHM 4.1.

Step 1. Set Q := 1, and set v(i, s) = 0.5, for all s. Step 2. Solve Problem (P3) with (3.18) replaced by (4.1) using MISEFl.3, with initial solu-

tion v(i, s). Step 3. Update v(i, s) with the converged solution.

1

0.8

0.8

0.4

0.2

c

0 I. .._ __ ., __ __ ._ __ ._ ,_ __ ._ __ __

I , I I I t

1

0.8

0.8

0.4

0.2

O 1 2 3 4 5 6 7

1 __ _. __ __ __ o-

I I I I 1 I

0 1 2 3 4 5 6 7

(b)

Figure 3. The enhancing controls obtained for a = 1.

Page 10: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

96 H. W. J. LEE et al.

1

0.8

0.8

0.4

0.2

0

I-

I -

I -

0 2 3 4 5 6 7

Cc)

Figure 3. (cont.)

Step 4. Let cr := 0.5o. Step 5. If cr > e, then goto Step 2. Else, goto Step 6. Step 6. Solve Problem (P3) with (3.18) using MISER& with initial solution v(i, 5). Step 7. Stop.

In Algorithm 4.1, c is a small positive number depending on machine accuracy. We call each looping of Step 5 to Step 2 a variance constraints relaxation subproblem. Moreover,

we call the execution of Step 6 the final nonrelaxed subproblem.

5. TWO SIMPLE EXAMPLES EXAMPLE 1. Consider the following twodimensional Linear Integer Programming Problem with Y = bl,YzlT:

my Qob) = Yl + Y2,

subject to: 5~1 + 3Y2 5 15,

4Y1 + 5Yz 5 20,

where Yl E 9% 19% 31, Y2 E {0,1,2,3,4).

By applying the proposed method and CPET [ll], the above problem is transformed into the following equivlant problem.

Subject to the dynamical system,

h(s) - = Pi(S) v(i, s>, ds i=1,2 (5.1)

with initial condition X$(O) = 0, i = 1,2,

Page 11: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 97

find a set of enhancing controls v(i, s) 2 0 for i = 1,2, with

and

r 1

0.8

0.6

0.4

0.2

J 0 5 v(i,s)ds = 1, i = 1,2

1

0.3

0.8

0.4

0.2

1

0 1 2 3 4 5 6 7

r (4

I I I I I I

‘V(2,S)’ - 1

o- I-.- 0 1 2 3 4 5 6 7

(b)

Figure 4. The enhancing controls obtained for a = 0.5.

Page 12: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

98 H. W. J. LEE et al.

1

0.8

0.6

0.4

0.2

0 __

I 1 I I I I

0 1 2 3 4 5 6 7

(c)

Figure 4. (cont.)

so that the terminal constraints

-{521(5) + 322(5) - 15) 2 0,

-{&i(5) +5x2(5) - 20) L 0

are satisfied, and the terminal cost objective

-{Q&(5)) = a(5) + a(5))

is minimized, where p(s) = bi, ~21~ and

0, 8 E [O,l), 1, s E [W,

~~(8) = 2, 8 E [2,3),

3, a E [3,4), 4, s E [4,5).

Note that the transformed problem is now readily solvable by the optimal control package MISER3 [13-151.

Since this problem is simple and linear, MISER3 can handle it without the need of using the variance constraints relaxation (4.1) and Algorithm 4.1.

Our initial guess is ~(1, s) = 0.2 and ~(2, s) = 0.2,

for all s E [O, 5). That is to say, we do not assume to have any idea where the solution is. With this initial guess, MISER3 converged very quickly and with no problems. The minimum of the objective obtained is -4.0000, and the enhancing controls ~(1, .) and ~(2, e) obtained are shown in Figure 1.

Page 13: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 99

Observe that ~(1,s) = 0, elsewhere and ~(1, s) = 1 only at s = [1,2) which corresponds to

Pl = 1; and ~(2, s) = 0, elsewhere and ~(2, s) = 1 only at s = [3,4) which corresponds to ~2 = 3. Therefore, the optimal solution obtained to the original linear integer programming problem is Yl = 1 and Y2 = 3. Moreover, the optimal objective (maximum) obtained is +4.0000.

Note that it is quite easy to see that the solution to this linear integer programming problem is not unique. There should be two maximum points located at

Y=[O 41 and 2/=[1 31.

By using our proposed scheme, we have obtained one of them ss shown above.

0.0 -

0.6 -

0.4 -

0.2 -

0

I I I 1 I I 0 1 2 3 4 5 6 7

(a)

1

0.8

0.6

0.4

0.2

O.-

'V(2.S)' -

I I I I

0 1 2 3 4 5 6

(b)

Figure 5. The enhancing controls obtained for a = 0.25.

7

Page 14: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

100 H. W. J. LEE et al.

1

0.8

0.6

0.4

0.2

0

I 1 I 1 t I

0 1 2 3 4 5 6 7

(cl

Figure 5. (cont.)

EXAMPLE 2. Consider the problem of finding the minimum weight design of the three-bar truss [17, pp. 705-7071.

mV= @0(g) = 2y1 + ~2 + &~a,

subject to: l- fly2 + 1.932Y3 > o

l.5yryz + fiY2Y3 + 1.319YlY3 - '

l- 0.634~1 + 2.828~~

1.5~1~2 + 4~2~3 + l.3lgy1y3 2 0,

where

l- 0.5Yl - 2Y2 l.5ylyZ + fiy2y3 + l.3lgyly3

> 0,

1+ 0.5Yl - 2Y2 l.5ylyZ + fiY2Y3 + l.3lgyly3

2 0,

for i = 1,2,3.

yi E (0.1, 0.2, 0.3, 0.5, 0.8, 1.0, 1.2},

By applying the proposed method and CPET [ll], the above problem is transformed into the following equivlant problem.

Subject to the dynamical system,

dxi(s) - = /4(s) v(i, s), ds i = 1,2,3,

with initial condition Xi(O) = 0, i = 1,2,3,

find a set of enhancing controls v(i, s) > 0 for i = 1,2,3, with

J 7

v(i, s) ds = 1, i = 1,2,3 0

Page 15: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach

and

w.r (v(i, *)) = &, i = 1,2,3,

so that the terminal constraints

&k*(7) + 1.93223(7) l- 1.521(7)s2(7) + &x2(7)23(7) + 1.319z1(7)23(7) 1 OT

0.0

0.6

0.4

0.2

I 1 1 1 , 1

‘v(1.s)’ -

J

I

I

1

0.8

0.8

a.4

0.2

0

0 1 2 3 4 5 6 7

(4 , I I 1 I ,

‘V(2.8) -

I I I I 1 1 d 0 1 2 3 4 5 6 7

(b)

Figure 6. The enhancing controls obtained for Q = 0.125.

101

Page 16: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

102 H. W. J. LEE et al.

1

0.8

0.6

0.4

0.2

0

I 1 I I I I

0 1 2 5 0 3 4

(c)

Figure 6. (cont.)

7

0.634~1(7) + 2.828~(7) l- 1.5zr(7)22(7) + fizca(7)zs(7) + ~.~1~~1(7)~3(7) L Ov

0.521(7) - 2~(7) ’ - 1.5z1(7)zs(7) + &2(7)~(7) + 1.31%(7)Q(7) ’ ”

0.521(7) - 2~(7) ’ + 1.5z1(7)zs(7) + &2(7)~s(7) + 1.319~1(7)Q(7) ’ ”

are satisfied, and the terminal cost objective

9&s(7)) = 2~1(7) + ~(7) + &s(7)

is minimized, where p(s) = [p~,ps,ps]~ am 1

Pi(S) = (

’ 0.1, s E [O, l),

0.2, s E [1,2),

0.3, s E [2,3),

0.5, s E [3,4),

0.8, s E [4,5),

1.0, s E [5,6),

. 1.2, s E [6,7).

The transformed problem is now readily solvable by the optimal control package MISEFU. Note that this problem is nonlinear. Thus, we adopt the variance constraints relaxation (4.1)

v-al- (v(i, *>) I i + QY, i = 1,2,3,

and Algorithm 4.1.

Page 17: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 103

Again, we do not assume to have any idea where the solution is. Our initial guess is

?J(i, s) = 0.5, for i = 1,2,3,

for all s E [0,5) ss shown in Figure 2. Moreover, we take e = 0.1. MISER3 converged very quickly with no troubles for all the variance constraints relaxation

subproblems of CY = 1, 0.5, 0.25, 0.125 and for the final nonrelaxed subproblem. Figures 3-6

1

0.8

0.6

0.4

0.2

0 1 2 3 4 5 6 7

1 -

0.8 -

0.6 -

0.4 -

0.2 -

0

0 1 2 3 4 5 6 7

&I

Figure 7. The enhancing controls obtained for the final unrelaxed variance constraints subproblem.

Page 18: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

104 H. W. J. LEE et al.

0.8

0.6

0.4

0.2

0

I-

1 I I I ,

‘v(3,s)’ -

L

0 1 2 3 4 5 6 7

(cl

Figure 7. (cont.)

show the enhancing controls obtained for the variance constraints relaxation subproblems of cr = 1, 0.5, 0.25, 0.125, respectively, and Figure 7 shows the enhancing controls obtained for the final nonrelaxed subproblem. From Figure 7, observe that ~(1, s) = 0, elsewhere and ~(1, s) = 1 only at s = [6,7) which corresponds to ~1 = 1.2; $2, s) = 0, elsewhere and ~(2,s) = 1 only at s = [3,4) which corresponds to JLZ = 0.5; and ~(3, s) = 0, elsewhere and ~(3, s) = 1 only at s = [0, 1) which corresponds to ~1 = 0.1. Therefore, the optimal solution obtained to the original nonlinear integer programming problem is yi = 1.2, ys = 0.5, and ya = 0.1, and the corresponding optimal cost obtained is 3.041421. According to [17], this is the optimal solution ss required.

It is interesting to see how the shape of the enhancing controls (obtained from the sequences of the variance constraints relaxation subproblems) change, or evolve. See Figures 2-7. The advantage of using a dynamic (optimal control) approach to solve this problem is that, instead of searching within a restrictive Euclidean space like other static approaches adopting penalty functions method, we are now searching in a vast, less restrictive, function space.

6. CONCLUSIONS

Motivated by the recent results on CPET for optimal discrete-valued control, this paper pro- posed a method for solving nonlinear mixed integer programming problems. The proposed method is a problem transform technique which transforms a static mixed integer optimization problem into sequences of optimal control problems. Hence, the transformed problems do not possess any combinatorial nature. Moreover, the search space of the proposed method is a vast, less restrictive, function space instead of the conventional restrictive Euclidean space for methods using static approaches. Two simple examples are solved using the method for illustration.

REFERENCES 1. R.E. Gomory, An algorithm for integer solutions to linear programs, In Recent Aduancea in Mathematical

Programming, (Edited by Graves and Wolfe), McGraw-Hill, (1963). 2. A.H. Land and A. Doig, An automatic method of solving discrete programming problem, Econometrica 28,

497620, (1960).

Page 19: An Optimal Control Approach to Nonlinear Mixed …Nonlinear mixed integer programming problem, also known as nonlinear mixed discrete program- ming problem, is an optimization problem

An Optimal Control Approach 105

3. P. Hajela and C. Shih, Multiobjective optimum design in mixed integer and discrete design variable problems, AZAA Journal 28, 670-675, (1989).

4. E. Sandgren, Nonlinear integer and discrete programming in mechanical design optimization, Journal of Mechanical Design 112, 223-229, (1990).

5. C. Tseng and J. Arora, On implementation of computational algorithms for optimization design: Part I and Part II, Znt. J. Num. Meth. Eng. 26, 1365-1402, (1988).

6. H. Li and C. Chou, A global approach for nonlinear mixed discrete programming in design optimization, Eng. Opt. 22, 109-122, (1994).

7. H. Li, An approximate method for local optima for nonlinear mixed integer programming problems, Computer and Operations Research 19, 435-444, (1992).

8. D. Shin, 2. Gurdal and O.H. Griffin, A penalty approach for nonlinear optimization with discrete design variables, Eng. Opt. 16, 2942, (1990).

9. J.F. Fu, R.G. Frenton and W.L. Cleghorn, A mixed integer-discretecontinuous programming method and its application to engineering design optimization, Eng. Opt. 17, 263-280, (1991).

10. H.W.J. Lee, K.L. Teo, L.S. Jennings and V. Rehbock, Control parametrization enhancing technique for time optimal control problems, Dynamic Systems and Applications (to appear).

11. H.W.J. Lee, K.L. Teo, V. Ftehbock and L.S. Jennings, Control parametrization enhancing technique for optimal discrete-valued control problems, (submitted).

12. H.W.J. Lee, Computational Studies of Optimal Controls, Ph.D. Thesis, Department of Mathematics, The University of Western Australia, (November 1996).

13. K.L. Teo, C.J. Goh and K.H. Wong, A ZJnQied Computational Approach to Optimal Control Problems, Longman Scientific and Technical, (1991).

14. L.S. Jennings, M.E. Fisher, K.L. Teo and C.J. Goh, MISERS Optimal Control Software: Theory and User Manual, EMCOSS Pty. Ltd, (1990).

15. L.S. Jennings, M.E. Fisher, K.L. Teo and C.J. Goh, MISER% Solving optimal control problems-An update, Advance Engineering Software 13, 190-196, (1991).

16. D.G. Luenberger, Linear and Nonlinear Progmmming, 2 nd edition, Addison-Wesley, Heading, MA, (1984). 17. S.S. Bee, Engineering Optimiretion, Theory and Practice, 3 rd edition, Wiley Interscience, (1996). 18. D.P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods, Academic Press, New York,

(1982). 19. J. Cha and R. Mayne, Optimization with discrete variables via recursive quadratic programming: Part 2,

Runsaction of the ASME 111, 130-136, (1989). 20. Ft. Fletcher, Practical Methods of Optimization, John Wiley, Chichester, (1987). 21. A. Hinnooy Kan and G. Timmer, Towards global optimization methods (I and II), Mathematical Progmmming

39, 27-78, (1987). 22. K. Schittkowski, On the convergence of a sequential quadratic programming method with an augmented

Lagrangian linear search function, Math. Operations Forschung and Statistik Ser. Optimization 14, 197-216, (1983).

23. H. Taha, Integer Programming, Academic Press, Orlando, FL, (1975). 24. K.L. Teo, L.S. Jennings, H.W.J. Lee and V. Behbock, The Control Parametrization Enhancing L%ansform

for Con&mined Optimal Control Problems, (preprint). 25. K.L. Teo, V. Behbock and L.S. Jennings, A new computational algorithm for functional inequality constrained

optimization problems, Automatica 29 (3), 789-792, (1993). 26. S. Wang, K.L. Teo and H.W.J. Lee, A new approach to nonlinear mixed discrete programming problems,

(submitted). 27. J.L. Zhou, A.L. Tits and CT. Lawrence, User’s guide for FFSQP Version 3.6: A Fortran code for solving

constrained nonlinear (minimax) optimization problems, generating iterates satisfying ail inequality and linear constraints, Technical Report TR92-107r2, Dept. of Elect. Eng., University of Maryland, (1996).