Top Banner
Corner Detection COMP 4900D Winter 2006
19

Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Mar 27, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Corner Detection

COMP 4900D

Winter 2006

Page 2: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Motivation: Features for Recognition

Image search: find the book in an image.

Page 3: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Motivation: Build a Panorama

M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003

Page 4: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

How do we build panorama?

We need to match (align) images

Page 5: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Matching with Features

•Detect feature points in both images

Page 6: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Matching with Features

•Detect feature points in both images

•Find corresponding pairs

Page 7: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Matching with Features

•Detect feature points in both images

•Find corresponding pairs

•Use these pairs to align images

Page 8: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

More motivation…

Feature points are used also for:• Image alignment (homography, fundamental matrix)

• 3D reconstruction

• Motion tracking

• Object recognition

• Indexing and database retrieval

• Robot navigation

• … other

Page 9: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Corner Feature

Corners are image locations that have large intensity changes

in more than one directions.

Shifting a window in any direction should give a large change in intensity

Page 10: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Examples of Corner Features

Page 11: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Harris Detector: Basic Idea

“flat” region:

no change in

all directions

“edge”:

no change along

the edge direction

“corner”:

significant change

in all directions

C.Harris, M.Stephens. “A Combined Corner and Edge Detector”. 1988

Page 12: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Change of Intensity

The intensity change along some direction can be quantified

by sum-of-squared-difference (SSD).

( )∑ −++=ji

jiIvjuiIvuD,

2),(),(),(

v

u

),( jiI

),( vjuiI ++

Page 13: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Change Approximation

If u and v are small, by Taylor theorem:

vIuIjiIvjuiI yx ++≈++ ),(),(

wherey

IIand

x

II yx

∂=

∂=

therefore

( ) ( )

( )

[ ]

=

++=

+=

−++=−++

v

u

III

IIIvu

vIuvIIuI

vIuI

jiIvIuIjiIjiIvjuiI

yyx

yxx

yyxx

yx

yx

2

2

2222

2

22

2

),(),(),(),(

Page 14: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Gradient Variation Matrix

[ ]

=

∑∑∑∑

v

u

III

IIIvuvuD

yyx

yxx

2

2

),(

This is a function of ellipse.

=

∑∑∑∑

2

2

yyx

yxx

III

IIIC

Matrix C characterizes how intensity changes

in a certain direction.

Page 15: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Eigenvalue Analysis – simple case

=

=

∑∑∑∑

2

1

2

2

0

0

λ

λ

yyx

yxx

III

IIIC

First, consider case where:

This means dominant gradient directions align with x or y axis

If either λ is close to 0, then this is not a corner, so look for

locations where both are large.

Slide credit: David Jacobs

Page 16: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

General Case

It can be shown that since C is symmetric:

QQCT

=

2

1

0

0

λ

λ

So every case is like a rotated version of the one on last

slide.

(λmax)-1/2

(λmin)-1/2

Page 17: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Gradient Orientation

Closeup

Page 18: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Corner Detection Summary

• if the area is a region of constant intensity, both eigenvalues will be very

small.

• if it contains an edge, there will be one large and one small eigenvalue (the

eigenvector associated with the large eigenvalue will be parallel to the

image gradient).

• if it contains edges at two or more orientations (i.e., a corner), there will be

two large eigenvalues (the eigenvectors will be parallel to the image

gradients).

Page 19: Corner Detection - Carleton Universitypeople.scs.carleton.ca/~c_shu/Courses/comp4900d/notes/lect9_corner.pdf · Corner Detection Summary • if the area is a region of constant intensity,

Corner Detection Algorithm