Top Banner
Vector Solid Textures Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Yizhou Yu University of Illinois at Urbana-Champaign Baining Guo Tsinghua University Microsoft Research Asia
37

Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Dec 17, 2015

Download

Documents

Allan Harvey
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vector Solid Textures

Lvdi WangTsinghua University

Microsoft Research Asia

Kun ZhouZhejiang University

Yizhou YuUniversity of Illinois at

Urbana-Champaign

Baining GuoTsinghua University

Microsoft Research Asia

Page 2: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Bitmap TexturesEfficient random access in renderingA choice between resolution and memory

Texture mapping

Without texture With bitmap texture

Page 3: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Bitmap TexturesEfficient random access in renderingA choice between resolution and memory

Resolution: 2562 Memory: 0.2 MB

Resolution: 10242 Memory: 3.0 MB

Page 4: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Bitmap Solid TexturesNo need for parameterizationConsistent interior & exteriorMemory consumption increases cubically!

[Kopf et al. 07] [Dong et al. 08] [Takayama et al. 08]

Page 5: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Bitmap Solid TexturesNo need for parameterizationConsistent interior & exteriorMemory consumption increases cubically!

[Dong et al. 08] [Takayama et al. 08][Kopf et al. 07]

Page 6: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vector GraphicsCompact and resolution-independentLimited to 2D content

SVG (www.croczilla.com) Diffusion Curves [Orzan et al. 08]

Page 7: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vector Solid TexturesResolution-independentEfficient renderingCompact storageBenefits of solid textures

A VST textured modelRendered at 110 Fps

Size: 1.55 MB

Page 8: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

OVERVIEWVector Solid Textures

Page 9: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Texture Decomposition• Sharp discontinuities + Smooth variations

2D texture

Bitmap texture(linear interpolation)

Vector texture

Page 10: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Texture Decomposition• Sharp discontinuities + Smooth variations

Solid texture Discontinuities highlighted

Surfaces formed by discontinuities

Page 11: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Key Components• Region boundaries• Region labels• Color variations

Page 12: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Key Components• Region boundaries• Region labels• Color variations

» Signed distance function» Stored on a 3D grid» Tricubic interpolation

3D surfacesSigned distance function

-1.0

0.0

+1.0

Page 13: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Key Components• Region boundaries• Region labels• Color variations

» Conceptually:Stored on the SDF grid

» In practice:Efficient compression

Region labels

Page 14: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Key Components• Region boundaries• Region labels• Color variations

» Radial Basis Functions (RBF)

RBFs illustrated in 2D

Page 15: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Real-Time Rendering• Basic rasterization pipeline:

SDF Labels

Final color

RBFs

p

Tex. volume

t D(t) L(t)

Page 16: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

VECTORIZATIONBitmap Solid Texture

Page 17: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vectorization• Create SDF• Label Regions• RBF Fitting

Page 18: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vectorization• Create SDF• Label Regions• RBF Fitting

» Does there already exist one?» Texture synthesis algorithms use

them as Feature Maps[Lefebvre & Hoppe 06] [Kopf et al. 07] …

color mask SDFcolor SDF

Input 2D exemplar Output solid texture

Page 19: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vectorization• Create SDF• Label Regions• RBF Fitting

» We can also create one» Image Analogy [Hertzmann et al. 01]

: : : :

Solid texture2D slice 2D mask2D SDF

3D SDF

Page 20: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vectorization• Create SDF• Label Regions• RBF Fitting

» Find connected components in the signed distance function

Signed distance function Region labels

Page 21: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Vectorization• Create SDF• Label Regions• RBF Fitting

» Find n RBFs that best approximate the existing color distribution

» Techniques:» L-BFGS-B minimizer [Zhu et al. 97]

» Teleportation [Cohen-Steiner et al. 04]

Page 22: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

RESULTS & APPLICATIONSVector Solid Textures

Page 23: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Bitmap solid textureResolution: 1283

Memory: 6.0 MB

Vector solid textureNum. RBFs: 5183

Memory: 1.2 MB

Page 24: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Bitmap solid textureResolution: 1283

Storage: 6.0 MB

Vector solid textureNum. RBFs: 5183

Storage: 1.2 MB

Page 25: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.
Page 26: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Num. RBFs: 7137

Storage: 1.3 MB

Page 27: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Texture Composition• Algebraic and Boolean operations on textures

+ =

VST #1 VST #2 Hybrid VST

Page 28: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Texture Composition• Self-similar textures

1 scale 2 scales 3 scales

Page 29: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Statistics• Performance: 90-700 Fps

NVidia GeForce 8800GTX, 8002 window

• Storage: 17-26%of the respective input bitmap solid texture

Page 30: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

DISCUSSION

Page 31: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Region Label Pairs• Store two region labels at every voxel• Octree compression [Lefebvre et al. 05]

• Save 70% - 99.998% storage

• Useful in rendering

Page 32: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Anti-aliasing• Utilize SDF and region label pairs

High quality anti-aliasingLittle performance overhead

Without anti-aliasing With anti-aliasing

δ

Page 33: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Boundary Softness• Some boundaries are not that sharp• Same as anti-aliasing, but with different δ

Page 34: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Boundary Softness

Page 35: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Explicit vs. ImplicitExplicit surface Implicit surface

» Random-access

» Vectorization

» Compactness

» Flexibility

Root finding

Compression

2-colorable constraint

Surface fitting

Direct & utilizes GPU

Robust and efficient

Adaptive

Less constraint Multiple SDFs

Page 36: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

Conclusion• Contribution:

A compact random-access vector representation for solid textures

• Future work: Interactive texture authoring tool

Page 37: Lvdi Wang Tsinghua University Microsoft Research Asia Lvdi Wang Tsinghua University Microsoft Research Asia Kun Zhou Zhejiang University Kun Zhou Zhejiang.

THANK YOU!