Top Banner
Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey
22

Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Dec 19, 2015

Download

Documents

Cory Lee
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Scale Normalization for Isometric Shape Matching

Yusuf Sahillioğlu and Yücel YemezComputer Eng. Dept., Koç University, Istanbul, Turkey

Page 2: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Problem Definition & Scope2 / 22

Scale problem inherent to isometric shape correspondence.

Scale normalization tested by shape correspondence. One shape is an isometric part of the other up to an

arbitrary scale.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 3: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Motivation3 / 22

Shape interpolation, animation.

Shape registration.

Shape recognition.

Time-varying reconstruction.

Statistical shape analysis.

Mapping between two shapes initiates cool apps.

Attribute transfer.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 4: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Contributions

A novel scale-invariant isometric distortion function.

Embedding avoided.

Correspondences are partial and dense at the same time.

No restriction on topology and triangulation type.

4 / 22

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 5: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Isometry

Our method is purely isometric. Intrinsic global property.

Similar shapes have similar metric structures.

Metric: geodesic distance.

5 / 22

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 6: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Scale Normalization

Scale normalization to prepare geodesic distances for the upcoming isometric distortion computations.

6 / 22

Complete shapes (scale by max geodesic)

Partial shapes (max geodesic based normalization fails)

Partial shapes (scale by trusted matches) Partial shapes (scale by Euclidean embedding, e.g., Möbius)

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 7: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Isometric Distortion Given , measure its isometric distortion:

O(N2) for a map of size N.

7 / 22

in the most general setting.

: normalized geodesic distance b/w two vertices.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 8: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Isometric Distortion8 / 22

g ggggg

g g

average for .

in action:

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 9: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Scale-invariant Isometric Distortion

Given , measure its scale-inv. isometric distortion:

This measure based on raw geodesics provides few trusted matches to be used in scale normalization.

O(N3) for a map of size N.

9 / 22

: raw geodesic distance b/w two vertices.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 10: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Scale-invariant Isometric Distortion10 / 22

in action:

average for .

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 11: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Minimizing Isometric Distortion11 / 22

Optimization for completely isometric shapes.

Optimization for partially isometric shapes.

Covers complete shape matching naturally.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 12: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Shape Matching Algorithm

Combinatorial optimization of for initial coarse correspondence.

The most extreme M source vertices are matched w/ |T| target extremities in the guidance of scale-inv. isometric distortion measure.

computational complexity where we set M=5.

12 / 22

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 13: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Shape Matching Algorithm

Two isometric distortion measures in action. Scale-invariant isometric distortion .

Isometric distortion w/ normalized geodesics .

13 / 22

Winner

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 14: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Shape Matching Algorithm

Use initial coarse correspondence to bring the meshes to the same scale.

Scale the target mesh by

Dense sampling.

14 / 22

100 here

Same radius

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 15: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Shape Matching Algorithm

Dense matching.

Minimum-weight perfect matching on cost matrix C.

ci,j = cost of matching si to tj //generating is traversed by

(si, tj).

Symmetric flip caring: repeat above (scaling, sampling, matching) with K-1 more generating initial coarse correspondences that follow in sorted distortions list.

15 / 22

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 16: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Computational Complexity16 / 22

Initial coarse correspondence:

Extension to dense map of size U: which also requires dense sampling.

Initial coarse correspondence dominates all.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 17: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Isometric part matching.

Results17 / 22

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 18: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Also for complete matching

and for pairs w/ incompatible max geodesics.

Results18 / 22

Comparison w/ Möbius Voting (MV).

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

MV: bad extremity matching, triangulation-sensitive.

Page 19: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Different choices of M.

Results19 / 22

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Too small. computation less reliable.

Too large. High computational

load. Inconsistent joint

sampling.

Page 20: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

20 / 22

Limitation & Future Work

Presence of uncommon parts may fail this framework which forces to match M=5 most extremes as a whole. Embedding into a more sophisticated framework should

help as it handles arbitrary scaling of the similar parts to be matched.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 21: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

Conclusion21 / 22

A novel scale normalization method that proves useful for isometric partial and complete correspondence.

Scale-invariant isometric distortion minimized in the original 3D Euclidean space wherein isometry is defined. So does dense isometric matching.

Correspondences are partial and dense at the same time. Care for symmetric flips. No restriction on topology and triangulation. Applicable in its current form to 3D part retrieval problem.

Yusuf Sahillioğlu & Yücel Yemez, Scale Normalization for Isometric Shape Matching, Pacific Graphics, 2012.

Page 22: Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.

People

Assoc. Prof. Yücel Yemez, supervisor

Yusuf, PhD student

22 / 22