Interactive Point-based Modeling of Complex Objects from Images Pierre Poulin (a,b) Marc Stamminger (a,c) François Duranleau (b) Marie-Claude Frasson (a) George Drettakis (a) (a) REVES, INRIA Sophia Antipolis (b) DIRO, Université de Montréal (c) University of Erlangen
57
Embed
Interactive Point-based Modeling of Complex Objects from Images
Interactive Point-based Modeling of Complex Objects from Images. Pierre Poulin ( a,b ) Marc Stamminger ( a,c ) François Duranleau ( b ) Marie-Claude Frasson ( a ) George Drettakis ( a ) ( a ) REVES, INRIA Sophia Antipolis ( b ) DIRO, Université de Montréal ( c ) University of Erlangen. - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Interactive Point-based Modeling of Complex Objects from Images
Pierre Poulin (a,b)Marc Stamminger (a,c)François Duranleau (b)
Marie-Claude Frasson (a)George Drettakis (a)
(a) REVES, INRIA Sophia Antipolis(b) DIRO, Université de Montréal
(c) University of Erlangen
Modeling Complex Objects
Modeling Complex Objects
• High visual complexity
• Time consuming
• Algorithms for specialized objects– e.g., plants, mountains, etc.
• Adaptive rendering
• Many applications need such objects
Key Observations
• Extracting complex models from photos is a very powerful approach
• Point-based representation is very effective for complex models– Efficient display and storage
• User interaction is beneficial when extracting quality models– Specify where details are needed
– Resolve some ambiguities
Image-based Point Modeling
• Images are very flexible– Reality-based (photos)– Acquisition is easy
Image-based Point Modeling
• Points are very flexible– Fast rendering (hardware support)– Adaptive rendering for interactive display
Stamminger
Image-based Point Modeling
• Points are very flexible– Hierarchical organization and levels of detail
Q-splat
Image-based Point Modeling
• Points are very flexible– Visual quality– Many recent advances
Deussen
Automatic ReconstructionImages
ReconstructionProcess
Constraints
3D Model
Image
Interactive ReconstructionImages
ReconstructionProcess
Constraints
3D Model
Image
User
new imagesrequantizerecalibrate
Interactive ReconstructionImages
ReconstructionProcess
Constraints
3D Model
Image
User
color comparisonsplausibility threshold
new depth mapszone of interest
Interactive ReconstructionImages
ReconstructionProcess
Constraints
3D Model
Image
Userrevalidate the pointsrequest more pointsdecimate the points
jitter the pointssample with patterns
hole filling
Interactive ReconstructionImages
ReconstructionProcess
Constraints
3D Model
Image
User
undo changesremove pointsadd polygons
Interactive Reconstruction
• Interactive display– 6 M points/sec. on a PIII 1GHz with GeForce3
• Efficient reconstruction algorithm– Test more than 1K points/sec.
• Simple and intuitive controls– Direct interaction with the points
Computer Vision Contributions
• 3D scanners
• Structured light
• Stereo – N-views
• Shape-from-X
• Volumetric
Volumetric Reconstruction
• Voxel coloring and Space carving– If a voxel is impossible, carved out of object– Silhouettes, transparency, shading– Photo-consistency