Top Banner
Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010
38

Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Jun 08, 2018

Download

Documents

NguyễnKhánh
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Lecture:Shape Analysis

Moment InvariantsGuido Gerig

CS 7960, Spring 2010

Page 2: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

References

• Cho-Hua Teh, Roland T. Chin, On Image Analysis by the Methods of Moments, IEEE T-PAMI, 1988

• Ming-Kuei Hu, Visual Pattern Recognition by Moment Invariants, IEEE Transactions on Information Theory, 1962

• M.R. Teague, Image analysis via the general theory of moments, J. Opt. Soc. Am. Vol. 70, No. 8, Aug 1980, pp. 920ff

• Materials Erik W. Anderson, SCI PhD student

Page 3: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Motivation

Reconstruction of letter E by a) Legendre Moments, b) Zernike Moments, and c) pseudo Zernike Moments (from Teh/Chin 1988)

Page 4: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Basic Concept

Extract set of Features

Invariant Features

Representative of Shape Class

Page 5: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Basic Concept ctd.

Extract set of Features

Invariant Features

Comparison btw feature vectors

Page 6: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Basic Concept ctd.

Classify (recognize) each shape into one of the shape classes

Page 7: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Method

• Moments mpq: projection of image ϱ(x,y) to basis xpyq.

• ϱ(x,y): piecewise continuous function with non-zero values in a portion of the plane = image.

• Raw image moments:

Page 8: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Raw Moments

• M00:??• M10: ??• M01: ??

• Centroid coordinates: ??

Page 9: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Raw Moments

• M00: area/volume, #pixels if binary image• M10: sum over x• M01: sum over y

• Centroid coordinates:

00

10

MMx =

00

01

MMy =

Page 10: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Translation Invariance

• Statistics: nth moment about the mean, or nth central moment of a random variable X is defined as:

Page 11: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Translation Invariance

• Statistics: nth moment about the mean, or nth central moment of a random variable X is defined as:

• Extension to 2D, discrete sampling:

00

10

MMx =

00

01

MMy =

Page 12: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Central Moments

Page 13: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Central Moments ctd.

→ central moments constructed from raw moments

Page 14: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Scale Invariance• f’(x,y): new image scaled by λ

Page 15: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Scale Invariance ctd.

• Concept: Set total area to 1

• Scaling invariant modes:

Page 16: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Rotation Invariance

• f’(x,y): new image rotated by Θ

Page 17: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Rotation Invariance ctd.

see Teague p. 925

Page 18: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Rotation Invariance ctd.

• Rotation to first axis of inertia:

see Teague p. 925

Page 19: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Rotation Invariance ctd.

• Discussion Rotation Invariance:– Basis {xpyq} doesn’t have simple rotation

properties– Building of moments that are invariant to

rotation is very difficult

• Solution: New function system that has better rotational properties

Page 20: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Orthogonal Invariants by Hu method

• Invariants are independent of position, size and orientation• However: This is not a complete set, and there is no simple

way for reconstruction!

Page 21: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Complex Moments

• Abu-Mostafa, Yaser S., and Demetri Psaltis. Image normalization by complex moments; T-PAMIJan 85 46-55

Page 22: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Complex Moments ctd.

Notation: p+q=n: Orderp-q=l: Repetition

Page 23: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Relationship to Raw Moments

Page 24: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Properties of CM

conjugate complex

Page 25: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Translation Invariance

Setting M10 and M01 to 0 makes series translational invariant

Page 26: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Scale Invariance

(see earlier discussion with raw moments)

Page 27: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

CM under Rotation

CMs have very clear, simple rotational properties

Page 28: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Set of CM’s

Order

#coefficients order n: n+1 CM’s

#coefficients till order n: ∑=

++=+

n

k

nnk0 2

)2)(1()1(

Page 29: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

CMs with Rotation Invariance

• Building of algebraic combination of CMs, so that rotational component disappears

Rotation Invariants:

Rotation Invariants:

Page 30: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

CMs with Rotation Invariance

Rotation Invariants:

Page 31: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

CMs with Rotation Invariance

Order n

Normalization to standard representation

Page 32: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Rotation to invariant position

Eliminate rotational part of 2nd order ellipsoid

Page 33: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Reconstruction

• Inverse generation of representative shape from normalized moments.

• Building of normal model as shape template for equivalence class.

• Procedure: Systematic reconstruction of phase and coefficients of normalized shape from invariant moments.

Page 34: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Example: Reconstruction from invariant CMs (20th order)

Page 35: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Example: Airplane Recognition

Page 36: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Classification• Image I(x,y) → set of invariants = feature vector v• Statistical pattern recognition: Clustering in

multi-dimensional feature space

• Criteria: good discrimination, small set of features (→ Zernike, pseudo Zernika, Teh/Chin)

Image space Feature space

Page 37: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Zernike PolynomialsSo far: Non-orthogonal basis: Set of moments is complete, but new higher orders influence lower orders.. Solution: Orthogonal basis: Zernike Polynomials: Teh & Chin, 1988

Zernicke Polynomials:

Orthogonality:

Unit disk

Same rotational properties as CMs, building of invariants is equivalent

Page 38: Lecture: Shape Analysis Moment Invariantsgerig/CS7960-S2010/handouts/CS7960-AdvImProc … · Lecture: Shape Analysis Moment Invariants Guido Gerig CS 7960, Spring 2010

Zernike Polynomials