1 Combining Approximate Geometry Combining Approximate Geometry with VDTM – A Hybrid Approach to with VDTM – A Hybrid Approach to 3D Video Teleconferencing 3D Video Teleconferencing Celso Kurashima Celso Kurashima 2 , Ruigang Yang , Ruigang Yang 1 , Anselmo , Anselmo Lastra Lastra 1 1 Department of Computer Science Department of Computer Science University of North Carolina at Chapel Hill University of North Carolina at Chapel Hill 2 Laboratório de Sistemas Integráveis - LSI Laboratório de Sistemas Integráveis - LSI Escola Politécnica da Universidade de São Paulo Escola Politécnica da Universidade de São Paulo Fortaleza, October 8th, 2002 Fortaleza, October 8th, 2002 SIBGRAPI 2002
21
Embed
1 Combining Approximate Geometry with VDTM – A Hybrid Approach to 3D Video Teleconferencing Celso Kurashima 2, Ruigang Yang 1, Anselmo Lastra 1 1 Department.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Combining Approximate GeometryCombining Approximate Geometrywith VDTM – A Hybrid Approach towith VDTM – A Hybrid Approach to
3D Video Teleconferencing3D Video Teleconferencing
11Department of Computer ScienceDepartment of Computer ScienceUniversity of North Carolina at Chapel HillUniversity of North Carolina at Chapel Hill
22Laboratório de Sistemas Integráveis - LSILaboratório de Sistemas Integráveis - LSIEscola Politécnica da Universidade de São PauloEscola Politécnica da Universidade de São Paulo
Fortaleza, October 8th, 2002Fortaleza, October 8th, 2002
Combining Approximate GeometryCombining Approximate Geometrywith VDTM – A Hybrid Approach towith VDTM – A Hybrid Approach to
3D Video Teleconferencing3D Video Teleconferencing
11Department of Computer ScienceDepartment of Computer ScienceUniversity of North Carolina at Chapel HillUniversity of North Carolina at Chapel Hill
22Laboratório de Sistemas Integráveis - LSILaboratório de Sistemas Integráveis - LSIEscola Politécnica da Universidade de São PauloEscola Politécnica da Universidade de São Paulo
Fortaleza, October 8th, 2002Fortaleza, October 8th, 2002
No eye contactNo eye contact Eye contactEye contact
Standard VideoStandard Video Computer Vision & Computer Vision & Computer GraphicsComputer Graphics
4
OutlineOutline
• 3D Video Teleconference System3D Video Teleconference System
• Geometry ExtractionGeometry Extraction
• Rendering Images with VDTMRendering Images with VDTM
• ResultsResults
• ConclusionConclusion
• 3D Video Teleconference System3D Video Teleconference System
• Geometry ExtractionGeometry Extraction
• Rendering Images with VDTMRendering Images with VDTM
• ResultsResults
• ConclusionConclusion
5
3D Video Teleconference 3D Video Teleconference System System (1/3)(1/3)
• Top ViewTop View• Top ViewTop View
(A)(A) (B)(B) (A)(A) (B)(B)
PCCLUSTER
PCCLUSTER
PCCLUSTER
PCCLUSTER
6
3D-Video Teleconference System 3D-Video Teleconference System (2/3)(2/3)
Projector
.
.
FirewireCameras
Geometry/Renderer PC
Screen
.
VideoCapture
PC's
LAN
7
3D-Video Teleconference System 3D-Video Teleconference System (3/3)(3/3)
• How does it work?How does it work?
• 11stst: Create a geometry proxy of the : Create a geometry proxy of the personperson
• 22ndnd: Texture map images onto the proxy : Texture map images onto the proxy with VDTM : an IBR method developed with VDTM : an IBR method developed by Debevec by Debevec et alet al..(’96, ’98)(’96, ’98)
• How does it work?How does it work?
• 11stst: Create a geometry proxy of the : Create a geometry proxy of the personperson
• 22ndnd: Texture map images onto the proxy : Texture map images onto the proxy with VDTM : an IBR method developed with VDTM : an IBR method developed by Debevec by Debevec et alet al..(’96, ’98)(’96, ’98)
• Video Frame Rate: 3-4 fpsVideo Frame Rate: 3-4 fps
17
Results Results (3/3)(3/3)
• 3D Video Teleconferencing3D Video Teleconferencing
MovieMovie
• 3D Video Teleconferencing3D Video Teleconferencing
MovieMovie
18
ConclusionsConclusions
• A hybrid system for 3D Video A hybrid system for 3D Video TeleconferencingTeleconferencing
• Fast geometry proxy extraction, using a Fast geometry proxy extraction, using a robust plane fitting method and stereo robust plane fitting method and stereo feature tracking, combined with view-feature tracking, combined with view-dependent texture mappingdependent texture mapping
• Real-time demonstration with personal Real-time demonstration with personal computers and commodity graphics cardcomputers and commodity graphics card
• A hybrid system for 3D Video A hybrid system for 3D Video TeleconferencingTeleconferencing
• Fast geometry proxy extraction, using a Fast geometry proxy extraction, using a robust plane fitting method and stereo robust plane fitting method and stereo feature tracking, combined with view-feature tracking, combined with view-dependent texture mappingdependent texture mapping
• Real-time demonstration with personal Real-time demonstration with personal computers and commodity graphics cardcomputers and commodity graphics card
19
Future WorkFuture Work
• Vision-based head-tracking for Vision-based head-tracking for viewpoint controlviewpoint control
• Increase of the frame rate with faster Increase of the frame rate with faster segmentationsegmentation
• Vision-based head-tracking for Vision-based head-tracking for viewpoint controlviewpoint control
• Increase of the frame rate with faster Increase of the frame rate with faster segmentationsegmentation
20
AcknowledgementsAcknowledgements
• Herman TowlesHerman Towles
• Office of the FutureOffice of the Future (OOTF) group at (OOTF) group at UNC-CHUNC-CH
• U.S. Dept. of Energy and Sandia U.S. Dept. of Energy and Sandia National Labs.National Labs.
• U.S. National Science FoundationU.S. National Science Foundation
• NEC/CPDIANEC/CPDIA
• Herman TowlesHerman Towles
• Office of the FutureOffice of the Future (OOTF) group at (OOTF) group at UNC-CHUNC-CH
• U.S. Dept. of Energy and Sandia U.S. Dept. of Energy and Sandia National Labs.National Labs.
• U.S. National Science FoundationU.S. National Science Foundation