Top Banner
Duality and Post Optimal Analysis Rajesh P Mishra 1228A [email protected] Rajesh P Mishra lect 17 1
41

Engineering Optimisation Lecture

Dec 21, 2015

Download

Documents

jadgug

Lecture slides on Engineering Optimisation.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Engineering Optimisation Lecture

Duality and Post Optimal Analysis

Rajesh P Mishra

1228A

[email protected]

Rajesh P Mishra lect 17 1

Page 2: Engineering Optimisation Lecture

Mute ur call

Plz add

Engineering Optimization

group of facebook

(Rajesh Mishra)

Rajesh P Mishra lect 17 2

Page 3: Engineering Optimisation Lecture

1. Given a LPP (called the primal problem), we shall

associate another LPP called the dual problem of the

original (primal) problem.

2. We shall see that the Optimal values of the primal and

dual are the same provided both have finite feasible

solutions.

3. This topic is further used to develop another method of

solving LPPs and is also used in the sensitivity (or

post-optimal) analysis.

Rajesh P Mishra lect 17 3

Dual Problem of an LPP

Page 4: Engineering Optimisation Lecture

Definition of the dual problem

Given the primal problem (in standard form)

Maximize nnxcxcxcz ...2211

subject to 11 1 12 2 1 1

21 1 22 2 2 2

1 1 2 2

1 2 1 2

...

...

.

.

...

, ,..., 0, , ,..., 0

n n

n n

m m mn n m

n m

a x a x a x b

a x a x a x b

a x a x a x b

x x x b b b

Rajesh P Mishra lect 17 4

Page 5: Engineering Optimisation Lecture

the dual problem is the LPP

Minimize mm ybybybw ...2211

subject to

11 1 21 2 1 1

12 1 22 2 2 2

1 1 2 2

1 2

...

...

.

.

...

, ,..., unrestricted in sign

m m

m m

n n mn m n

n

a y a y a y c

a y a y a y c

a y a y a y c

y y y

Rajesh P Mishra lect 17 5

Page 6: Engineering Optimisation Lecture

If the primal problem (in standard form) is

Minimize nnxcxcxcz ...2211

subject to 11 1 12 2 1 1

21 1 22 2 2 2

1 1 2 2

1 2 1 2

...

...

.

.

...

, ,..., 0, , ,..., 0

n n

n n

m m mn n m

n m

a x a x a x b

a x a x a x b

a x a x a x b

x x x b b b

Rajesh P Mishra lect 17 6

Page 7: Engineering Optimisation Lecture

Then the dual problem is the LPP

Maximize mm ybybybw ...2211

subject to

11 1 21 2 1 1

12 1 22 2 2 2

1 1 2 2

1 2

...

...

.

.

...

, ,..., unrestricted in sign

m m

m m

n n mn m n

n

a y a y a y c

a y a y a y c

a y a y a y c

y y y

Rajesh P Mishra lect 17 7

Page 8: Engineering Optimisation Lecture

1. In the dual, there are as many (decision)

variables as there are constraints in the

primal.

We usually say yi is the dual variable

associated with the ith constraint of the

primal.

2. There are as many constraints in the dual

as there are variables in the primal.

We thus note the following:

Rajesh P Mishra lect 17 8

Page 9: Engineering Optimisation Lecture

3. If the primal is maximization then the

dual is minimization and all constraints

are

If the primal is minimization then the dual

is maximization and all constraints are

4. In the primal, all variables are 0 while

in the dual all the variables are

unrestricted in sign.

Rajesh P Mishra lect 17 9

Page 10: Engineering Optimisation Lecture

5. The objective function coefficients cj of

the primal are the RHS constants of the

dual constraints.

6. The RHS constants bi of the primal

constraints are the objective function

coefficients of the dual.

7. The coefficient matrix of the constraints

of the dual is the transpose of the

coefficient matrix of the constraints of

the primal. Rajesh P Mishra lect 17 10

Page 11: Engineering Optimisation Lecture

Write the dual of the LPP

21 25 xxz

subject to

0,

532

2

21

21

21

xx

xx

xx

Maximize

Rajesh P Mishra lect 17 11

Page 12: Engineering Optimisation Lecture

Thus the primal in the standard form is:

4321 0025 xxxxz

subject to

0,,,

532

2

4321

421

321

xxxx

xxx

xxx

Maximize

Rajesh P Mishra lect 17 12

Page 13: Engineering Optimisation Lecture

Hence the dual is:

21 52 yyw

subject to

1 2

1 2

1

2

1 2

2 5

3 2

0

0

, unrestricted in sign

y y

y y

y

y

y y

0,0 21 yy

Minimize

Rajesh P Mishra lect 17 13

Page 14: Engineering Optimisation Lecture

Write the dual of the LPP

21 36 xxz

subject to

0,,

543

236

321

321

321

xxx

xxx

xxx

Minimize

Rajesh P Mishra lect 17 14

Page 15: Engineering Optimisation Lecture

Thus the primal in the standard form is:

54321 00036 xxxxxz

subject to

0,,,,

543

236

54321

5321

4321

xxxxx

xxxx

xxxx

Minimize

Rajesh P Mishra lect 17 15

Page 16: Engineering Optimisation Lecture

Hence the dual is:

Maximize 21 52 yyw

subject to

1 2

1 2

1 2

1

2

1 2

6 3 6

3 4 3

0

0

0

, unrestricted in sign

y y

y y

y y

y

y

y y

0, 21 yy

Rajesh P Mishra lect 17 16

Page 17: Engineering Optimisation Lecture

Write the dual of the LPP

21 xxz subject to

1 2

1 2

1 2

2 5

3 6

, unrestricted in sign

x x

x x

x x

Maximize

Rajesh P Mishra lect 17 17

Page 18: Engineering Optimisation Lecture

Maximize 2211 xxxxz

subject to

0,,,

633

522

2211

2211

2211

xxxx

xxxx

xxxx

Thus the primal in the standard form is:

Rajesh P Mishra lect 17 18

Page 19: Engineering Optimisation Lecture

Minimize 21 65 yyw

subject to

1 2

1 2

1 2

1 2

1 2

2 3 1

2 3 1

1

1

, unrestricted in sign

y y

y y

y y

y y

y y

132 21 yy

121 yy

Hence the dual is:

Rajesh P Mishra lect 17 19

Page 20: Engineering Optimisation Lecture

From the above examples we get the

following SOB rules for writing the dual:

Label Maximization Minimization

Constraints Variables

Sensible form 0

Odd = form unrestricted Bizarre form 0

Variables Constraints

Sensible 0 form Odd unrestricted = form Bizarre 0 form

Rajesh P Mishra lect 17 20

Page 21: Engineering Optimisation Lecture

Theorem: The dual of the dual is the primal

(original problem).

Proof. Consider the primal problem (in standard

form) Maximize nnxcxcxcz ...2211

subject to 11 1 12 2 1 1

21 1 22 2 2 2

1 1 2 2

1 2

...

...

.

.

...

, ,..., 0

n n

n n

m m mn n m

n

a x a x a x b

a x a x a x b

a x a x a x b

x x x

Rajesh P Mishra lect 17 21

Page 22: Engineering Optimisation Lecture

The dual problem is the LPP

Minimize mm ybybybw ...2211

subject to 11 1 21 2 1 1

12 1 22 2 2 2

1 1 2 2

1 2

...

...

.

.

...

, ,..., unrestricted in sign

m m

m m

n n mn m n

n

a y a y a y c

a y a y a y c

a y a y a y c

y y y

Rajesh P Mishra lect 17 22

Page 23: Engineering Optimisation Lecture

Case (i): All cj 0. Then the dual problem in

the standard form is the LPP

Minimize n

mmmm

ttt

ybybybybw

0...00

...

21

1111

subject to

0,...,,,,,...,,

...

.

.

...

...

2111

1111

2222112112

1111111111

nmm

nnmmnmmnnn

mmmm

mmmm

tttyyyy

ctyayayaya

ctyayayaya

ctyayayaya

Rajesh P Mishra lect 17 23

Page 24: Engineering Optimisation Lecture

Hence its dual is the LPP

Maximize nnxcxcxcz ...2211

subject to 11 1 12 2 1 1

11 1 12 2 1 1

1 1 2 2

1 1 2 2

1 2

1 2

...

...

.

...

...

0, 0,..., 0

, ,..., unrestricted in sign

n n

n n

m m mn n m

m m mn n m

n

n

a x a x a x b

a x a x a x b

a x a x a x b

a x a x a x b

x x x

x x x

Rajesh P Mishra lect 17 24

Page 25: Engineering Optimisation Lecture

Which is nothing but the LPP

Maximize nnxcxcxcz ...2211

subject to

0,...,,

...

.

.

...

...

21

2211

22222121

11212111

n

mnmnmm

nn

nn

xxx

bxaxaxa

bxaxaxa

bxaxaxa

This is the primal problem. Rajesh P Mishra lect 17 25

Page 26: Engineering Optimisation Lecture

Case (ii): All cj 0 except c1. Then the dual

problem in the standard form is the LPP

Minimize n

mmmm

ttt

ybybybybw

0...00

...

21

1111

Subj-

ect

to

0,...,,,,,...,,

...

.

.

...

...

2111

1111

2222112112

1111111111

nmm

nnmmnmmnnn

mmmm

mmmm

tttyyyy

ctyayayaya

ctyayayaya

ctyayayaya

Rajesh P Mishra lect 17 26

Page 27: Engineering Optimisation Lecture

Hence its dual is the LPP

Maximize nnxcxcvcz ...2211

subject to 11 1 12 2 1 1

11 1 12 2 1 1

1 1 2 2

1 1 2 2

1 2

1 2

...

...

.

...

...

0, 0,..., 0

, ,..., unrestricted in sign

n n

n n

m m mn n m

m m mn n m

n

n

a v a x a x b

a v a x a x b

a v a x a x b

a v a x a x b

v x x

v x x

Rajesh P Mishra lect 17 27

Page 28: Engineering Optimisation Lecture

Which is nothing but the LPP

Maximize nnxcxcvcz ...2211

subject to

0,...,,0

...

.

.

...

...

21

2211

22222121

11212111

n

mnmnmm

nn

nn

xxv

bxaxava

bxaxava

bxaxava

Putting 11 vx

Rajesh P Mishra lect 17 28

Page 29: Engineering Optimisation Lecture

This is nothing but the LPP

Maximize nnxcxcxcz ...2211

subject to 11 1 12 2 1 1

21 1 22 2 2 2

1 1 2 2

1 2

...

...

.

.

...

, ,..., 0

n n

n n

m m mn n m

n

a x a x a x b

a x a x a x b

a x a x a x b

x x x

This is the primal problem. Cases where

other cj are 0 are similarly treated. Rajesh P Mishra lect 17 29

Page 30: Engineering Optimisation Lecture

Duality theorems

Finding the dual optimal solution from the

primal optimal tableau

Page 31: Engineering Optimisation Lecture

In this lecture we shall present the primal

and dual problems in matrix form and

prove certain results on the feasible and

optimal solutions of the primal and dual

problems.

Dual problem in Matrix form

Page 32: Engineering Optimisation Lecture

Suppose the primal in (Matrix and ) standard

form is

0b0X

b,XA

,

subject to

Xcz

Dual problem in Matrix form

Maximize

Page 33: Engineering Optimisation Lecture

where

nccc ..21C

nx

x

x

.

.

2

1

X, ,

mnmm

n

n

aaa

aaa

aaa

..

.

.

..

..

21

22221

11211

A

1

2

.

.

m

b

b

b

b

Page 34: Engineering Optimisation Lecture

Letting myyy ..21Y

the dual LPP in matrix form becomes

Minimize bYw

subject to

Y A c,

Y unrestricted in sign

Page 35: Engineering Optimisation Lecture

If the primal LPP is a minimization problem

the dual LPP in matrix form becomes

Maximize bYw

subject to

Y A c,

Y unrestricted in sign

Minimize Xcz

0b0X

b,XA

,

subject to

Page 36: Engineering Optimisation Lecture

Rajesh P Mishra lect 17 36

Page 37: Engineering Optimisation Lecture

Optimal Dual Solution • The primal and dual solutions are so closely

related that the optimal solution of either problem directly yields (with little additional computation) the optimal solution to the other.

• Thus, in an LP model in which the number of variables is considerably smaller than the number of constraints, computational savings may be realized by solving the dual, from which the primal solution is determined automatically

Rajesh P Mishra lect 17 37

Page 38: Engineering Optimisation Lecture

Rajesh P Mishra lect 17 38

Page 39: Engineering Optimisation Lecture

Rajesh P Mishra lect 17 39

Page 40: Engineering Optimisation Lecture

Rajesh P Mishra lect 17 40

Page 41: Engineering Optimisation Lecture

Rajesh P Mishra lect 17 41