Spring 2003 Spring 2003 IBMR: Image Based IBMR: Image Based Modeling and Modeling and Rendering Rendering Jack Tumblin Jack Tumblin Computer Science Dept., Computer Science Dept., Northwestern University Northwestern University [email protected][email protected]
48
Embed
Spring 2003 IBMR: Image Based Modeling and Rendering Jack Tumblin Computer Science Dept., Northwestern University [email protected].
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Spring 2003Spring 2003
IBMR: Image Based IBMR: Image Based Modeling and RenderingModeling and Rendering
Jack Tumblin Jack Tumblin Computer Science Dept., Computer Science Dept., Northwestern UniversityNorthwestern University
‘‘3D Scene’ 3D Scene’ DescriptionDescription ‘‘Optical’ Optical’
DescriptionDescription
?! New ?! New Research?Research?
IBMR Apps : Why Bother?IBMR Apps : Why Bother?
• Movie Special FX: Mix real & syntheticMovie Special FX: Mix real & synthetic
• Augmented Photography/Video:Augmented Photography/Video:– Any Camera Position, Any Camera Position, – Any Lighting, Any Lighting, – Any moment in TimeAny moment in Time
at each pixel, at each pixel, get Interactive get Interactive
re-lighting...re-lighting...
• for a given scene, describe for a given scene, describe ALL rays through ALL rays through – ALLALL pixels, of pixels, of – ALLALL cameras, at cameras, at – ALLALL wavelengths, wavelengths, – ALLALL time time
Can you find ray intersections? Or ray depth?Can you find ray intersections? Or ray depth?
Ray colors might Ray colors might not match for not match for shiny materials shiny materials (BRDF)(BRDF)
? Can we recover ? Can we recover Surface Material Surface Material ??
Can you find ray intersections? Or ray depth?Can you find ray intersections? Or ray depth?
Ray colors might Ray colors might not match for not match for shiny materials shiny materials (BRDF)(BRDF)
Hey, wait…Hey, wait…
• ‘‘Light field’ describes light Light field’ describes light LEAVINGLEAVING the the enclosing surface….enclosing surface….
• ? Isn’t there a complementary ‘light field’ for ? Isn’t there a complementary ‘light field’ for the light the light ENTERINGENTERING the surface? the surface?
‘‘Full 8-D Light Field’ Full 8-D Light Field’ (10-D, actually: time, (10-D, actually: time, ))
cameracamera
projectorprojector
‘‘Full 8-D Light Field’ Full 8-D Light Field’ (10-D, actually: time, (10-D, actually: time, ))
• ! Complete !! Complete !– Geometry, Lighting, BRDF,…Geometry, Lighting, BRDF,…it’s it’s allall there, there, – It’s all LINEAR,It’s all LINEAR,– But it’s an But it’s an 8-D8-D function! function! Stupendously Huge!Stupendously Huge!
(40GB data sets, 32 hours / object…)(40GB data sets, 32 hours / object…)
• What Subsets Are Useful?What Subsets Are Useful?– Fixed camera, vary lighting? compositing?Fixed camera, vary lighting? compositing?– Fixed lighting, vary camera? animation?Fixed lighting, vary camera? animation?– Recover some shape? silhouettes? Recover some shape? silhouettes? – Recover some reflectance? Recover some reflectance? – Recover some new hybrid?Recover some new hybrid?
• Heavy overlap with computer vision: Heavy overlap with computer vision: careful not to re-invent & re-name!careful not to re-invent & re-name!
• Elegant Geometry is Elegant Geometry is at the heart of it allat the heart of it all, , even surface reflectance, illumination, etc. even surface reflectance, illumination, etc. etc. 8-10 dimensional, but linear functions.etc. 8-10 dimensional, but linear functions.
• Melting barrier between real, synthetic 3D.Melting barrier between real, synthetic 3D.
IBMR: Visiting Lecturers IBMR: Visiting Lecturers
3D Scanning for 3D Scanning for
Cultural Heritage ApplicationsCultural Heritage Applications Holly Rushmeier, IBM TJ WatsonHolly Rushmeier, IBM TJ Watson
Friday May 16 3:00pm, Rm 381, CS Dept. Friday May 16 3:00pm, Rm 381, CS Dept.
?Subsurface Scattering? ?Subsurface Scattering? ?Rendering Human Hair??Rendering Human Hair?
Steve Marschner, Cornell UniversitySteve Marschner, Cornell University Friday May 23 3:00pm, Rm 381, CS Dept.Friday May 23 3:00pm, Rm 381, CS Dept.