Top Banner
INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel Max-Planck Institut für Informatik
42

INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

Jan 03, 2016

Download

Documents

Lionel Bailey
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIK

Laplacian Surface EditingOlga Sorkine Daniel Cohen-Or Yaron Lipman

Tel Aviv University

Marc Alexa

TU Darmstadt

Christian Rössl Hans-Peter Seidel

Max-Planck Institut für Informatik

Page 2: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDifferential coordinates

Intrinsic surface representation Allows various surface editing operations:

– Detail-preserving mesh editing

Page 3: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDifferential coordinates

Intrinsic surface representation Allows various surface editing operations:

– Detail-preserving mesh editing– Coating transfer

Page 4: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDifferential coordinates

Intrinsic surface representation Allows various surface editing operations:

– Detail-preserving mesh editing– Coating transfer– Mesh transplanting

Page 5: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKWhat is it?

Differential coordinates are defined by the discrete Laplacian operator:

For highly irregular meshes: cotangent weights [Desbrun et al. 99]

( )

1( )

j N ii

Ld

i i i jδ v v v

average of the neighbors

Page 6: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKWhy differential coordinates?

They represent the local detail / local shape description– The direction approximates the normal– The size approximates the mean curvature

( )

1

N iid

i iv

δ v v 1

( )ds

len

i

v

v v

( ) 0

1lim ( )

( )lends H

len

i i i

v

v v v n

Page 7: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKWhy differential coordinates?

Local detail representation – enables detail preservation through various modeling tasks

Representation with sparse matrices Efficient linear surface reconstruction

Page 8: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKOverall framework

Compute differential representation

Pose modeling constraints

Reconstruct the surface – in least-squares sense

( )L V

,i i i C v u

2 2arg min ( ) i

i Ci

VV L V

uv

Page 9: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKOverall framework

ROI is bounded by a belt (static anchors) Manipulation through handle(s)

Page 10: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKRelated work

Multi-resolution: [Zorin el al. 97], [Kobbelt et al. 98], [Guskov et al. 99], [Boier-Martin et al. 04], [Botsch and Kobbelt 04] 2

Laplacian smoothing: Taubin [SIGGRAPH 95] Laplacian Morphing: Alexa [TVC 03] Image editing: Perez et al. [SIGGRAPH 03] Mesh Editing: Yu et al. [SIGGRAPH 04]

Page 11: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKProblem: invariance to transformations

The basic Laplacian operator is translation-invariant, but not rotation- and scale-invariant

Reconstruction attempts to preserve the original global orientation of the details

Page 12: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKInvariance – solutions

Explicit transformation of the differential coordinates prior to surface reconstruction

– Lipman, Sorkine, Cohen-Or, Levin, Rössl and Seidel, “Differential Coordinates for Interactive Mesh Editing“, SMI 2004

• Estimation of rotations from naive reconstruction

– Yu, Zhou, Xu, Shi, Bao, Guo and Shum, “Mesh Editing With Poisson-Based Gradient Field Manipulation“, SIGGRAPH 2004

• Propagation of handle transformation to the rest of the ROI

Page 13: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKEstimation of rotations

[Lipman et al. 2004] estimate rotation of local frames– Reconstruct the surface with the original Laplacians– Estimate the normals of underlying smooth surface– Rotate the Laplacians and reconstruct again

Page 14: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKExplicit assignment of rotations

Disadvantages:– Heuristic estimation of the rotations– Speed depends on the support of the smooth normal estimation

operator; for highly detailed surfaces it must be large

almost a height field not a height field

Page 15: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKImplicit definition of transformations

The idea: solve for local transformations AND the edited surface simultaneously!

22

1

arg min ( ) ( )n

ii jV

ji

ij C

LV T

δv v u

Transformationof the local frame

Page 16: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDefining the transformations Ti

How to formulate Ti ?

– Based on the local (1-ring) neighborhood

– Linear dependence on the unknown vi’

1

2 2

1

kk

ii

i

i

i

i

i i

i

T

T

T

v v

v

v

v

v

22

1

arg min ( ) ( )n

ii jV

ji

ij C

LV T

δv v u

Members of the 1-ring of i-th vertex

iT

Page 17: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDefining the transformations Ti

First attempt: define Ti simply by solving

2

1

arg minj j

i

i

k

i ij

iT

TT

v v

1 21 2

| | |

| | |

| | |

| | |k ki i i i iiiT

vv v vv v

Page 18: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDefining the transformations Ti

Plug the expressions for Ti into the least-squares reconstruction formula:

22

1

arg min ( )n

i ji

i ij

jV C

V TL

v vδ u

Linear combination

of the unknown vi’

Page 19: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKConstraining Ti

Trivial solution for Ti will result in membrane surface reconstruction

To preserve the shape of the details we constrain Ti to rotations, uniform scales and translations

11 12 13 14

21 22 23 24

31 32 33 34

41 42 43 44

i

t t t t

t t t tT

t t t t

t t t t

Linear constraints on tlm

so that Ti is rotation+scale+translation

??

Page 20: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKConstraining Ti – 2D case

Easy in 2D:

0 0 cos sin

0 0 sin cos

0 0 1 0 0 1 0 0 1

x x

i y y

s d w a t

T s d a w t

Page 21: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKConstraining Ti – 3D case

Not linear in 3D:

Linearize by dropping the quadratic term

rotation +exp

uniform scaleTs H s I H

h h

is 3 3 skew-symmetric, H H x h x

Page 22: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKAdjusting Ti

Due to linearization, Ti scale the space along the h axis by cos

When is large, this causes anisotropy

Possible correction:– Compute Ti , remove the scaling component and reconstruct the

surface again from the corrected i

– Apply our technique from [Lipman et al. 04] first, and then the current technique – with small .

Page 23: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKSome results

Page 24: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKSome results

Page 25: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKSome results

Page 26: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKSome results

Page 27: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKSome results

Video...

Page 28: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDetail transfer and mixing

“Peel“ the coating of one surface and transfer to another

Page 29: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDetail transfer and mixing

Correspondence:

– Parameterization onto a common domain and elastic warp to align the features, if needed

Page 30: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDetail transfer and mixing

Detail peeling:

i i i

i iSmoothing by

[Desbrun et al.99]

Page 31: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDetail transfer and mixing

Changing local frames:

ii

Page 32: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKDetail transfer and mixing

Reconstruction of target surface from :

target i i

target

Page 33: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKExamples

Page 34: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKExamples

Page 35: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKMixing Laplacians

Taking weighted average of i and ‘i

Page 36: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKMesh transplanting

The user defines– Part to transplant– Where to transplant– Spatial orientation and scale

Topological stitching Geometrical stitching via Laplacian mixing

Page 37: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKMesh transplanting

Details gradually change in the transition area

Page 38: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKMesh transplanting

Details gradually change in the transition area

Page 39: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKConclusions

Differential coordinates are useful for applications that need to preserve local details

Reconstruction by linear least-squares – smoothly distributes the error across the domain

Linearization of 3D rotations was needed in order to solve for optimal local transformations – can we do better?

Page 40: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKAcknowledgments

German Israel Foundation (GIF) Israel Science Foundation (founded by the Israel

Academy of Sciences and Humanities) Israeli Ministry of Science

Bunny, Dragon, Feline courtesy of Stanford University Octopus courtesy of Mark Pauly

Page 41: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIK

Thank you!

Page 42: INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

INFORMATIKGradual transition