Top Banner
Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21
21

Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Oct 17, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Computer Vision: Lecture 9

Magnus Oskarsson

2015-02-18

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Page 2: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Todays Lecture

Reconstruction and Optimization

Objective Function: Reconstruction Error

Principles of Local Optimization

Least Squares Optimization

Non-Linear Least Squares

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 2 / 21

Page 3: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error

Under the assumption that image points are corrupted by Gaussian noise,minimize the reprojection error.

The reprojection error

In regular coordinates(x = (x , y)) the projection is(

P1X

P3X,P2X

P3X

),

P1,P2,P3 are the rows of P.The reprojection error is

||(x − P1X

P3X, y − P2X

P3X

)||2.

C

x

PX

X

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 3 / 21

Page 4: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error

Calibrated Structure and Motion

Given image projections {(xij , yij)} (i = point nr, j = image nr), find 3Dpoints Xi and cameras Pj =

[Rj tj

]such that

∑ij

||

(xij −

P1j Xi

P3j Xi

, yij −P2j Xi

P3j Xi

)||2,

is minimized.

Complicated non linear expression.

No closed form solution.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 4 / 21

Page 5: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Pick a starting point.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 5 / 21

Page 6: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Approximate the function using 2nd order Taylor expansion andminimize.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 6 / 21

Page 7: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Repeat.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 7 / 21

Page 8: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Newtons method.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 8 / 21

Page 9: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Different starting point.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 9 / 21

Page 10: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Different starting point.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 10 / 21

Page 11: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Leads to local minimum.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 11 / 21

Page 12: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Third starting point, leads to local maximum.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 12 / 21

Page 13: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Why not just sample the function?One dimensional function:

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 13 / 21

Page 14: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Why not just sample the function?One dimensional function:

Sample 10 points, pick lowest value. Probably works.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 14 / 21

Page 15: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Why not just sample the function?Two dimensional function:

102 samples.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 15 / 21

Page 16: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

Why not just sample the function?Three dimensional function:

103 samples.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 16 / 21

Page 17: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Minimizing Reprojection Error, Locally

How many variables do we have?

The cathedral dataset:

480 camera matrices [Ri ti ].Rotation part 3 dof, translationpart 3 dof.Totally: 480(3 + 3) = 2880.

91178 3D points.3 dof each.Totally: 91178 · 3 = 273534

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 17 / 21

Page 18: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Local Optimization

See lecture notes.

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 18 / 21

Page 19: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Steepest Descent

See lecture notes.Demonstration...

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 19 / 21

Page 20: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Gauss-Newton

See lecture notes.Demonstration...

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 20 / 21

Page 21: Computer Vision: Lecture 9 · Computer Vision: Lecture 9 Magnus Oskarsson 2015-02-18 Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 1 / 21

Levenberg-Marquard

See lecture notes.Demonstration...

Magnus Oskarsson Computer Vision: Lecture 9 2015-02-18 21 / 21