L4-Lp Standard Form

download L4-Lp Standard Form

of 63

Transcript of L4-Lp Standard Form

  • 7/25/2019 L4-Lp Standard Form

    1/63

    Math 407A: Linear Optimization

    Lecture 4: LP Standard Form 1

    1Author: James Burke, University of Washington

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    2/63

    LPs in Standard Form

    Minimization maximization

    Linear equations to linear inequalities

    Lower and upper bounded variables

    Interval variable bounds

    Free variable

    Two Step Process to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    3/63

    LPs in Standard Form

    We say that an LP is in standard form

    if its matrix representationhas the form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    4/63

    LPs in Standard Form

    We say that an LP is in standard form

    if its matrix representationhas the form

    max cTx

    s.t. Ax b

    0

    x

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    5/63

    LPs in Standard Form

    We say that an LP is in standard form

    if its matrix representationhas the form

    max cTx It must be a maximization problem.

    s.t. Ax b

    0

    x

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    6/63

    LPs in Standard Form

    We say that an LP is in standard form if its matrix representationhas the form

    max cTx It must be a maximization problem.

    s.t. Ax b Only inequalities of the correct direction.

    0

    x

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    7/63

    LPs in Standard Form

    We say that an LP is in standard form if its matrix representationhas the form

    max cTx It must be a maximization problem.

    s.t. Ax b Only inequalities of the correct direction.

    0 x

    All variables must be non-negative.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    8/63

    Every LP can be Transformed to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    9/63

    Every LP can be Transformed to Standard Form

    minimization maximization

    http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    10/63

    Every LP can be Transformed to Standard Form

    minimization maximization

    To transform a minimization problem to a maximizationproblem multiply the objective function by 1.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    11/63

    Every LP can be Transformed to Standard Form

    minimization maximization

    To transform a minimization problem to a maximizationproblem multiply the objective function by 1.

    linear inequalities

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    12/63

    Every LP can be Transformed to Standard Form

    minimization maximization

    To transform a minimization problem to a maximizationproblem multiply the objective function by 1.

    linear inequalities

    If an LP has an inequality constraint of the form

    ai1x1+ ai2x2+ +ainxn bi,

    it can be transformed to one in standard form by multiplying

    the inequality through by 1 to get

    ai1x1 ai2x2 ainxn bi.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    13/63

    Every LP can be Transformed to Standard Form

    linear equations

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    14/63

    Every LP can be Transformed to Standard Form

    linear equationsThe linear equation

    ai1xi+ +ainxn= bi

    can be written as two linear inequalities

    ai1x1+ +ainxn bi

    and

    ai1x1+ +ainxn bi.

    The second of these inequalities can be transformed tostandard form by multiplying through by 1.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    15/63

    Every LP can be Transformed to Standard Form

    variables with lower bounds

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    16/63

    Every LP can be Transformed to Standard Form

    variables with lower bounds

    If a variable xihas lower bound liwhich is not zero (li xi),one obtains a non-negative variable wiwith the substitution

    xi =wi+li.

    In this case, the bound li

    xi

    is equivalent to the bound0 wi.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    17/63

    Every LP can be Transformed to Standard Form

    variables with lower bounds

    If a variable xihas lower bound liwhich is not zero (li xi),one obtains a non-negative variable wiwith the substitution

    xi =wi+li.

    In this case, the bound li

    xi

    is equivalent to the bound0 wi.

    variables with upper bounds

    f S

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    18/63

    Every LP can be Transformed to Standard Form

    variables with lower bounds

    If a variable xihas lower bound liwhich is not zero (li xi),one obtains a non-negative variable wiwith the substitution

    xi =wi+li.

    In this case, the bound li xi

    is equivalent to the bound0 wi.

    variables with upper bounds

    If a variable xihas an upper bound ui (xi ui) one obtains anon-negative variable wiwith the substitution

    xi=ui wi.

    In this case, the bound xi ui is equivalent to the bound0 wi.

    E LP b T f d S d d F

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    19/63

    Every LP can be Transformed to Standard Form

    variables with interval bounds

    E LP b T f d S d d F

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    20/63

    Every LP can be Transformed to Standard Form

    variables with interval boundsAn interval bound of the form li xi uican be transformedinto one non-negativity constraint and one linear inequalityconstraint in standard form by making the substitution

    xi =wi+li.

    E LP b T f d t St d d F

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    21/63

    Every LP can be Transformed to Standard Form

    variables with interval boundsAn interval bound of the form li xi uican be transformedinto one non-negativity constraint and one linear inequalityconstraint in standard form by making the substitution

    xi =wi+li.

    In this case, the bounds li xi uiare equivalent to theconstraints

    0 wi and wi ui li.

    E LP b T f d t St d d F

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    22/63

    Every LP can be Transformed to Standard Form

    free variables

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    23/63

    Transformation to Standard Form

  • 7/25/2019 L4-Lp Standard Form

    24/63

    Transformation to Standard Form

    Put the following LP into standard form.

    minimize 3x1 x2subject to x

    1 + 6x

    2 x

    3 + x

    4 3

    7x2 + x4 = 5x3 + x4 2

    1 x2, x3 5, 2 x4 2.

    Transformation to Standard Form

    http://goforward/http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    25/63

    Transformation to Standard Form

    The hardest part of the translation to standard form, or at least

    the part most susceptible to error, is the replacement of existingvariables with non-negative variables.

    Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    26/63

    Transformation to Standard Form

    The hardest part of the translation to standard form, or at least

    the part most susceptible to error, is the replacement of existingvariables with non-negative variables.

    Reduce errors by doing the transformation in two steps.

    Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    27/63

    Transformation to Standard Form

    The hardest part of the translation to standard form, or at least

    the part most susceptible to error, is the replacement of existingvariables with non-negative variables.

    Reduce errors by doing the transformation in two steps.

    Step 1: Make all of the changes that do not involve a variablesubstitution.

    Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    28/63

    Transformation to Standard Form

    The hardest part of the translation to standard form, or at least

    the part most susceptible to error, is the replacement of existingvariables with non-negative variables.

    Reduce errors by doing the transformation in two steps.

    Step 1: Make all of the changes that do not involve a variablesubstitution.

    Step 2: Make all of the variable substitutions.

    Must be a maximization problem

    http://goforward/http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    29/63

    Must be a maximization problem

    minimize 3x1 x2subject to x1 + 6x2 x3 + x4 3

    7x2 + x4 = 5x3 + x4 2

    1 x2,

    x3 5,

    2 x4 2.

    Must be a maximization problem

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    30/63

    Must be a maximization problem

    minimize 3x1 x2subject to x1 + 6x2 x3 + x4 3

    7x2 + x4 = 5x3 + x4 2

    1 x2,

    x3 5,

    2 x4 2.

    Minimization =maximization

    Must be a maximization problem

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    31/63

    Must be a maximization problem

    minimize 3x1 x2subject to x1 + 6x2 x3 + x4 3

    7x2 + x4 = 5x3 + x4 2

    1 x2,

    x3 5,

    2 x4 2.

    Minimization =maximization

    maximize 3x1+ x2.

    Inequalities must go the right way.

    http://goforward/http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    32/63

    Inequalities must go the right way.

    Inequalities must go the right way.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    33/63

    q g g y

    x1+ 6x2 x3+ x4 3

    Inequalities must go the right way.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    34/63

    q g g y

    x1+ 6x2 x3+ x4 3

    becomes

    Inequalities must go the right way.

    http://goforward/http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    35/63

    q g g y

    x1+ 6x2 x3+ x4 3

    becomes

    x1 6x2+ x3 x4 3.

    Equalities are replaced by 2 inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    36/63

    q p y q

    7x2+ x4= 5

    Equalities are replaced by 2 inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    37/63

    7x2+ x4= 5

    becomes

    Equalities are replaced by 2 inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    38/63

    7x2+ x4= 5

    becomes

    7x2+ x4 5

    Equalities are replaced by 2 inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    39/63

    7x2+ x4= 5

    becomes

    7x2+ x4 5

    and

    Equalities are replaced by 2 inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    40/63

    7x2+ x4= 5

    becomes

    7x2+ x4 5

    and

    7x2 x4 5

    Grouping upper bounds with the linear inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    41/63

    The double bound 2 x4 2 indicates that we should group theupper bound with the linear inequalities.

    Grouping upper bounds with the linear inequalities.

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    42/63

    The double bound 2 x4 2 indicates that we should group theupper bound with the linear inequalities.

    x4 2

    Step 1: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    43/63

    Combining all of these changes gives the LP

    maximize 3x1 + x2subject to x1 6x2 + x3 x4 3

    7x2 + x4 5 7x2 x4 5x3 + x4 2

    x4 2

    1 x2, x3 5, 2 x4.

    Step 2: Variable ReplacementTh i bl i f l i b

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    44/63

    The variable x1 is free, so we replace it by

    Step 2: Variable ReplacementTh i bl i f l i b

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    45/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    Step 2: Variable ReplacementTh i bl i f l it b

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    46/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    x2 has a non-zero lower bound (1 x2) so we replace it by

    Step 2: Variable ReplacementTh i bl i f l it b

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    47/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    x2 has a non-zero lower bound (1 x2) so we replace it by

    z2=x2+ 1 or x2=z2 1 with 0 z2.

    Step 2: Variable ReplacementThe variable x is free so we replace it by

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    48/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    x2 has a non-zero lower bound (1 x2) so we replace it by

    z2=x2+ 1 or x2=z2 1 with 0 z2.

    x3 is bounded above (x3 5), so we replace it by

    Step 2: Variable ReplacementThe variable x is free so we replace it by

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    49/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    x2 has a non-zero lower bound (1 x2) so we replace it by

    z2=x2+ 1 or x2=z2 1 with 0 z2.

    x3 is bounded above (x3 5), so we replace it by

    z3= 5 x3 or x3= 5 z3 with 0 z3.

    Step 2: Variable ReplacementThe variable x1 is free so we replace it by

    http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    50/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    x2 has a non-zero lower bound (1 x2) so we replace it by

    z2=x2+ 1 or x2=z2 1 with 0 z2.

    x3 is bounded above (x3 5), so we replace it by

    z3= 5 x3 or x3= 5 z3 with 0 z3.

    x4 is bounded below (2 x4), so we replace it by

    Step 2: Variable ReplacementThe variable x1 is free so we replace it by

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    51/63

    The variable x1 is free, so we replace it by

    x1=z+1 z

    1 with 0 z+1 , 0 z

    1 .

    x2 has a non-zero lower bound (1 x2) so we replace it by

    z2=x2+ 1 or x2=z2 1 with 0 z2.

    x3 is bounded above (x3 5), so we replace it by

    z3= 5 x3 or x3= 5 z3 with 0 z3.

    x4 is bounded below (2 x4), so we replace it by

    z4=x4+ 2 or x4=z4 2 with 0 z4.

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    52/63

    Substituting x1=z+1 z

    1 into

    maximize 3x1 + x2subject to x1 6x2 + x3 x4 3

    7x2 + x4 5

    7x2 x4 5x3 + x4 2

    x4 2

    1 x2, x3 5, 2 x4.

    gives

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    53/63

    maximize 3z+1 + 3z

    1 + x2subject to z+1 z

    1 6x2 + x3 x4 37x2 + x4 5

    7x2 x4 5x3 + x4 2

    x4 2

    0 z+1 , 0 z

    1 , 1 x2, x3 5, 2 x4.

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    54/63

    Substituting x2=z2 1 into

    maximize 3z+1 + 3z

    1 + x2subject to z+1 z

    1 6x2 + x3 x4 37x2 + x4 5

    7x2 x4 5x3 + x4 2

    x4 2

    0 z+1 , 0 z

    1 , 1 x2, x3 5, 2 x4.

    gives

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    55/63

    maximize 3z+1 + 3z

    1 + z2 1subject to z+1 z

    1 6z2 + x3 x4 3 6 = 37z2 + x4 5 + 7 = 12

    7z2 x4 5 7 = 12x3 + x4 2

    x4 2

    0 z+1 , 0 z

    1 , 0 z2, x3 5, 2 x4.

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    56/63

    maximize 3z+1 + 3z

    1 + z2subject to z+1 z

    1 6z2 + x3 x4 37z2 + x4 12

    7z2 x4 12x3 + x4 2

    x4 2

    0 z+1 , 0 z

    1 , 0 z2, x3 5, 2 x4.

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    57/63

    Substituting x3= 5 z3 into

    maximize 3z+1 + 3z

    1 + z2subject to z+1 z

    1 6z2 + x3 x4 37z2 + x4 12

    7z2 x4 12x3 + x4 2

    x4 2

    0 z+1 , 0 z

    1 , 0 z2, x3 5, 2 x4.

    gives

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    58/63

    maximize 3z+1 + 3z

    1 + z2subject to z+1 z

    1 6z2 z3 x4 3 5 = 87z2 + x4 12

    7z2 x4 12 z3 + x4 2 5 = 3

    x4 2

    0 z+1 , 0 z

    1 , 0 z2, 0 z3, 2 x4.

    Step 2: Transformation to Standard Form

    http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    59/63

    Substituting x4=z4 2 into

    maximize 3z+1 + 3z

    1 + z2subject to z+1 z

    1 6z2 z3 x4 87z2 + x4 12

    7z2 x4 12 z3 + x4 3

    x4 2

    0 z+1 , 0 z

    1 , 0 z2, 0 z3, 2 x4.

    gives

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    60/63

    maximize 3z+1 + 3z

    1 + z2subject to z+1 z

    1 6z2 z3 z4 8 2 = 17z2 + z4 12 + 2 = 1

    7z2 z4 12 2 = 1 z3 + z4 3 + 2 =

    z4 2 + 2 =

    0 z+1 , 0 z

    1 , 0 z2, 0 z3, 0 z4.

    which is in standard form.

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    61/63

    After making these substitutions, we get the following LP instandard form:

    Step 2: Transformation to Standard Form

    http://find/
  • 7/25/2019 L4-Lp Standard Form

    62/63

    After making these substitutions, we get the following LP instandard form:

    maximize 3z+1 + 3z

    1 + z2subject to z+1 z

    1 6z2 z3 z4 107z2 + z4 14

    7z2 z4 14 z3 + z4 1

    z4 4

    0 z+1

    , z

    1 , z

    2, z

    3, z

    4.

    Transformation to Standard Form: Practice

    http://goforward/http://find/http://goback/
  • 7/25/2019 L4-Lp Standard Form

    63/63

    Transform the following LP to an LP in standard form.

    minimize x1 12x2 + 2x3

    subject to 5x1 x2 + 3x3 = 152x1 + x2 20x3 300 x2 , 1 x3 4

    http://goforward/http://find/http://goback/