Top Banner
Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, Ligang Liu University of Science and Technology of China
44

Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Oct 29, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Computational Peeling Art Design

Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, Ligang Liu

University of Science and Technology of China

Page 2: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Peeling art design

Page 3: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Popular art form

Page 4: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Peeling art examples

Page 5: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Yoshihiro Okada’s method

Page 6: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Peeling art design problem

Page 7: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Challenges of the computational method

• Non-trivial to optimize the similarity

• Unsuitable input shape

Page 8: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Existing work: cut generation

• Minimum spanning tree method [Chai et al. 2018; Sheffer 2002; Sheffer and Hart 2002]

• Mesh segmentation approaches [Julius et al. 2005; Lévy et al. 2002; Sander et al. 2002, 2003; Zhang et al. 2005; Zhou et al. 2004]

• Simultaneous optimization [Li et al. 2018; Poranne et al.2017]

• Variational method [Sharp and Crane 2018]

Page 9: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Existing work: cut generation

• Minimum spanning tree method [Chai et al. 2018; Sheffer 2002; Sheffer and Hart 2002]

• Mesh segmentation approaches [Julius et al. 2005; Lévy et al. 2002; Sander et al. 2002, 2003; Zhang et al. 2005; Zhou et al. 2004]

• Simultaneous optimization [Li et al. 2018; Poranne et al.2017]

• Variational method [Sharp and Crane 2018]

unfolded shapes ≠ input shapes

Page 10: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Our approach

Cut generation

Page 11: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Key idea

Cut generation

Difficult

Mapping computation

Easy

Page 12: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

𝑅

𝑆𝑚 = Φ(𝑆)Input 𝑆

min𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 + 𝑤𝐸𝑠ℎ𝑟(𝑅)

Mapping computation

Φ

Two goals:1. Low isometric distortion 2. Area of 𝑅 approaches zero

Page 13: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

• ARAP distortion metric [Liu et al. 2008]

Isometric energy

𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 =

𝑖=1

𝑁𝑓

𝐴𝑟𝑒𝑎 𝑓𝑖 ||𝐽𝑖 − 𝑅𝑖||𝐹2

𝑅𝑖 is an orthogonal matrix

Page 14: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

• Our novel rank-one energy

𝐸𝑠ℎ𝑟 𝑅 = 𝑖=1𝑁𝑅𝑓𝐴𝑟𝑒𝑎 𝑡𝑖 ||𝐽𝑖 − 𝐵𝑖||𝐹

2

𝐵𝑖 is a rank one matrix

Shrink energy

||𝐽𝑖||𝐹2 det 𝐽𝑖 rank-oneInput

• Other choices• Frobenius energy ||𝐽𝑖||𝐹

2

• Determinant energy det 𝐽𝑖

Page 15: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Local-global solver min𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 + 𝑤𝐸𝑠ℎ𝑟(𝑅)

𝑠𝑡. 𝜕𝑅 = 𝜕𝑆𝑚 and 𝑣𝑚, 𝑣𝑅 ∈ 𝑀

𝐸𝑖𝑠𝑜 𝑆𝑚, 𝑆 =

𝑖=1

𝑁𝑓

𝐴𝑟𝑒𝑎 𝑓𝑖 ||𝐽𝑖 − 𝑅𝑖||𝐹2 𝑅𝑖 = 𝑈𝑖𝑉𝑖

𝑇

𝐵𝑖 = 𝑈𝑖𝑑𝑖𝑎𝑔 𝜎𝑖 , 0 𝑉𝑖𝑇

𝐸𝑠ℎ𝑟 𝑅 =

𝑖=1

𝑁𝑅𝑓

𝐴𝑟𝑒𝑎 𝑡𝑖 ||𝐽𝑖 − 𝐵𝑖||𝐹2

𝑣𝑎𝑟𝑖𝑎𝑏𝑙𝑒𝑠 𝛿𝑣𝑘 𝑖𝑛 tangent space 𝑣𝑘𝑛𝑒𝑤 = 𝑃(𝑣𝑘 + 𝛿𝑣𝑘)

Local step:

Global step:

𝛿𝑣𝑘 𝑖𝑛 𝐹𝑗 𝑖𝑠 𝛿𝑣𝑘𝑗= 𝐹𝑘

𝑗 𝑇𝐹𝑘𝑣𝛿𝑣𝑘

Page 16: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Some details

stalk locations

Representations of M

Page 17: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Suitable input

Page 18: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Unsuitable input

Page 19: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Almost cover

Mapping Process

Interaction Process

Iterative interaction

Cut Generation

Final resulting cut

Iterative design

Page 20: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction place

Prune and Decompose

Unfold𝑆𝑚 and 𝑅

Page 21: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 1: shape augmentation

Page 22: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 2: part deletion

Page 23: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 3: angle augmentation

Page 24: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 4: curvature reduction

Page 25: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 5: pre-processing

Unprocessedhigh distortion

Processedlow distortion

Input Input with specify area

Page 26: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Interaction 5: pre-processing

Input with specify area Unprocessed: high distortion

Processed: low distortionAlign to initialize

Page 27: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Cut generation

Resulting cutMapped shape

Simplify boundary

Page 28: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Real peeling

Page 29: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Real design

Page 30: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Real peeling

Page 31: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Experiments

Page 32: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Shapes designed by Yoshihiro Okada

Page 33: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Comparison to Yoshihiro Okada

Okada’s

Ours

Dove Eagle Shrimp

Page 34: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 35: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Our results

Page 36: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 37: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 38: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 39: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 40: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design
Page 41: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

More results

Page 42: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Conclusion

• A computational tool for peeling art design and construction.

• Unsuitable input 2D shapes are rectified by an iterative process.

Page 43: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Limitations: conservation principle

User input

Interaction many times also cannot keep posture

Page 44: Peeling Art Designˆ˜浩.pdf · Computational Peeling Art Design Hao Liu, Xiao-Teng Zhang, Xiao-Ming Fu, Zhi-Chao Dong, ... Conclusion •A computational tool for peeling art design

Thank you