Top Banner
The Planar-Reflective Symmetry Transform Princeton University
69
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: The Planar-Reflective Symmetry Transform Princeton University.

The Planar-Reflective Symmetry TransformThe Planar-Reflective Symmetry Transform

Princeton University

Page 2: The Planar-Reflective Symmetry Transform Princeton University.

MotivationMotivation

Symmetry is everywhere

Page 3: The Planar-Reflective Symmetry Transform Princeton University.

MotivationMotivation

Symmetry is everywhere

Perfect Symmetry[Blum ’64, ’67][Wolter ’85][Minovic ’97] [Martinet ’05]

Page 4: The Planar-Reflective Symmetry Transform Princeton University.

MotivationMotivation

Symmetry is everywhere

Local Symmetry[Blum ’78][Mitra ’06] [Simari ’06]

Page 5: The Planar-Reflective Symmetry Transform Princeton University.

MotivationMotivation

Symmetry is everywhere

Partial Symmetry[Zabrodsky ’95][Kazhdan ’03]

Page 6: The Planar-Reflective Symmetry Transform Princeton University.

GoalGoal

A computational representation that describes all planar symmetries of a shape

?Input Model

Page 7: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry TransformSymmetry Transform

A computational representation that describesall planar symmetries of a shape

?Input Model Symmetry Transform

Page 8: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry TransformSymmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 1.0Perfect Symmetry

Page 9: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry TransformSymmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 0.0Zero Symmetry

Page 10: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry TransformSymmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 0.3Local Symmetry

Page 11: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry TransformSymmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 0.2Partial Symmetry

Page 12: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry MeasureSymmetry Measure

Symmetry of a shape is measured by correlation with its reflection

Page 13: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry MeasureSymmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD Symmetry = 0.7

Page 14: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry MeasureSymmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD Symmetry = 0.3

Page 15: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry MeasureSymmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD

Page 16: The Planar-Reflective Symmetry Transform Princeton University.

Symmetry MeasureSymmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD Symmetry = 0.1

Page 17: The Planar-Reflective Symmetry Transform Princeton University.

OutlineOutline

• Introduction• Algorithm

– Computing Discrete Transform– Finding Local Maxima Precisely

• Applications– Alignment– Segmentation

• Summary

– Matching– Viewpoint Selection

Page 18: The Planar-Reflective Symmetry Transform Princeton University.

n p

lan

esComputing Discrete TransformComputing Discrete Transform

• Brute Force• Convolution• Monte-Carlo

Page 19: The Planar-Reflective Symmetry Transform Princeton University.

n p

lan

esComputing Discrete TransformComputing Discrete Transform

• Brute Force O(n6)• Convolution• Monte-Carlo

O(n3) planes

X = O(n6)

O(n3) dot product

Page 20: The Planar-Reflective Symmetry Transform Princeton University.

n p

lan

es

Computing Discrete TransformComputing Discrete Transform

• Brute Force O(n6)• Convolution O(n5Log n)• Monte-Carlo

O(n2) normal directions

X = O(n5log n)

O(n3log n) per direction

Page 21: The Planar-Reflective Symmetry Transform Princeton University.

Computing Discrete TransformComputing Discrete Transform

• Brute Force O(n6)• Convolution O(n5Log n)• Monte-Carlo O(n4) For 3D meshes

– Most of the dot product contains zeros.– Use Monte-Carlo Importance Sampling.

Page 22: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Input Model Symmetry Transform

Page 23: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Monte Carlo sample for single plane

Input Model Symmetry Transform

Page 24: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Input Model Symmetry Transform

Page 25: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Input Model Symmetry Transform

Page 26: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Input Model Symmetry Transform

Page 27: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Input Model Symmetry Transform

Page 28: The Planar-Reflective Symmetry Transform Princeton University.

Monte Carlo AlgorithmMonte Carlo Algorithm

Off

set

Angle

Input Model Symmetry Transform

Page 29: The Planar-Reflective Symmetry Transform Princeton University.

Weighting SamplesWeighting Samples

Need to weight sample pairs by the inverse of the distance between them

P1

P2

d

Page 30: The Planar-Reflective Symmetry Transform Princeton University.

Weighting SamplesWeighting Samples

Need to weight sample pairs by the inverse of the distance between them

Two planes of (equal) perfect symmetry

Page 31: The Planar-Reflective Symmetry Transform Princeton University.

Weighting SamplesWeighting Samples

Need to weight sample pairs by the inverse of the distance between them

Votes for vertical plane…

Page 32: The Planar-Reflective Symmetry Transform Princeton University.

Weighting SamplesWeighting Samples

Votes for horizontal plane.

Need to weight sample pairs by the inverse of the distance between them

Page 33: The Planar-Reflective Symmetry Transform Princeton University.

OutlineOutline

• Introduction• Algorithm

– Computing Discrete Transform– Finding Local Maxima Precisely

• Applications– Alignment– Segmentation

• Summary

– Matching– Viewpoint Selection

Page 34: The Planar-Reflective Symmetry Transform Princeton University.

Finding Local Maxima PreciselyFinding Local Maxima Precisely

Motivation:• Significant symmetries will be local maxima of the

transform: the Principal Symmetries of the model

Principal Symmetries

Page 35: The Planar-Reflective Symmetry Transform Princeton University.

Finding Local Maxima PreciselyFinding Local Maxima Precisely

Approach:• Start from local maxima of discrete transform

Page 36: The Planar-Reflective Symmetry Transform Princeton University.

Finding Local Maxima PreciselyFinding Local Maxima Precisely

Initial Guess Final Result

……….

Approach:• Start from local maxima of discrete transform• Refine iteratively to find local maxima precisely

Page 37: The Planar-Reflective Symmetry Transform Princeton University.

OutlineOutline

• Introduction• Algorithm

– Computing discrete transform– Finding Local Maxima Precisely

• Applications– Alignment– Segmentation

• Summary

– Matching– Viewpoint Selection

Page 38: The Planar-Reflective Symmetry Transform Princeton University.

Application: AlignmentApplication: Alignment

Motivation:• Composition of range scans• Feature mapping

PCA Alignment

Page 39: The Planar-Reflective Symmetry Transform Princeton University.

Application: AlignmentApplication: Alignment

Approach:• Perpendicular planes with the greatest symmetries

create a symmetry-based coordinate system.

Page 40: The Planar-Reflective Symmetry Transform Princeton University.

Application: AlignmentApplication: Alignment

Approach:• Perpendicular planes with the greatest symmetries

create a symmetry-based coordinate system.

Page 41: The Planar-Reflective Symmetry Transform Princeton University.

Application: AlignmentApplication: Alignment

Approach:• Perpendicular planes with the greatest symmetries

create a symmetry-based coordinate system.

Page 42: The Planar-Reflective Symmetry Transform Princeton University.

Application: AlignmentApplication: Alignment

Approach:• Perpendicular planes with the greatest symmetries

create a symmetry-based coordinate system.

Page 43: The Planar-Reflective Symmetry Transform Princeton University.

Application: AlignmentApplication: Alignment

Symmetry Alignment

PCA Alignment

Results:

Page 44: The Planar-Reflective Symmetry Transform Princeton University.

Application: MatchingApplication: Matching

Motivation:• Database searching

Database Best MatchQuery

=

Page 45: The Planar-Reflective Symmetry Transform Princeton University.

Application: MatchingApplication: Matching

Observation:• All chairs display similar principal symmetries

Page 46: The Planar-Reflective Symmetry Transform Princeton University.

Application: MatchingApplication: Matching

Approach:• Use Symmetry transform as shape descriptor

Database Best MatchQuery

=

Transform

Page 47: The Planar-Reflective Symmetry Transform Princeton University.

Application: MatchingApplication: Matching

Results: • The PRST provides orthogonal information about

models and can therefore be combined with other shape descriptors

Page 48: The Planar-Reflective Symmetry Transform Princeton University.

Application: MatchingApplication: Matching

Results: • The PRST provides orthogonal information about

models and can therefore be combined with other shape descriptors

Page 49: The Planar-Reflective Symmetry Transform Princeton University.

Application: MatchingApplication: Matching

Results: • The PRST provides orthogonal information about

models and can therefore be combined with other shape descriptors

Page 50: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Motivation:• Modeling by parts• Collision detection

[Chazelle ’95][Li ’01][Mangan ’99][Garland ’01]

[Katz ’03]

Page 51: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Observation:• Components will have strong local symmetries not

shared by other components

Page 52: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Observation:• Components will have strong local symmetries not

shared by other components

Page 53: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Observation:• Components will have strong local symmetries not

shared by other components

Page 54: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Observation:• Components will have strong local symmetries not

shared by other components

Page 55: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Observation:• Components will have strong local symmetries not

shared by other components

Page 56: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Approach:• Cluster points on the surface by how well they

support different symmetries

Symmetry Vector = { 0.1 , 0.5 , …. , 0.9 }

Support = 0.1 Support = 0.5 Support = 0.9

…..

Page 57: The Planar-Reflective Symmetry Transform Princeton University.

Application: SegmentationApplication: Segmentation

Results:

Page 58: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Motivation:• Catalog generation• Image Based Rendering

[Blanz ’99][Vasquez ’01][Lee ’05][Abbasi ’00]

Picture from Blanz et al. ‘99

Page 59: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Approach:• Symmetry represents redundancy in information.

Page 60: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Approach:• Symmetry represents redundancy in information• Minimize the amount of visible symmetry• Every plane of symmetry votes for a viewing

direction perpendicular to it

Best Viewing Directions

Page 61: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Results:

Viewpoint Function

Page 62: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Results:

Viewpoint Function

Best Viewpoint

Page 63: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Results:

Viewpoint Function

Best Viewpoint

Worst Viewpoint

Page 64: The Planar-Reflective Symmetry Transform Princeton University.

Application: Viewpoint SelectionApplication: Viewpoint Selection

Results:

Page 65: The Planar-Reflective Symmetry Transform Princeton University.

SummarySummary

• Symmetry Transform– Symmetry measure for all planes in space

• Algorithms– Discrete set of planes– Finding local maxima precisely

• Applications– Alignment– Matching– Segmentation– Viewpoint Selection

Page 66: The Planar-Reflective Symmetry Transform Princeton University.

Future WorkFuture Work

Extended forms of symmetry• Rotational symmetry• Point symmetry• General transform symmetrySignal processing

Further applications • Compression• Constrained editing• Etc.

Page 67: The Planar-Reflective Symmetry Transform Princeton University.

Acknowledgements: Acknowledgements:

Princeton Graphics• Chris DeCoro• Michael Kazhdan

Funding• Air Force Research Lab grant #FA8650-04-1-1718• NSF grant #CCF-0347427• NSF grant #CCR-0093343• NSF grant #IIS-0121446• The Sloan Foundation

Page 68: The Planar-Reflective Symmetry Transform Princeton University.

The End

Page 69: The Planar-Reflective Symmetry Transform Princeton University.

ComparisonComparison

Podolak et al. Mitra et al.

Goal Transform Discrete symmetry

Sampling Uniform grid Clustering

Voting Points only Points, normals, curvature

Symmetry Types

Planar reflection Reflection/Rotation/etc.

Detection Types

Perfect, partial, and continuous symmetries

Perfect and Partial and approximate symmetries