Inverse Global Illumination: Inverse Global Illumination: Recovering Reflectance Models Recovering Reflectance Models of Real Scenes from Photographs of Real Scenes from Photographs Computer Science Division University of California at Berkeley zhou Yu, Paul Debevec, Jitendra Malik & Tim Hawki
30
Embed
Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs Computer Science Division University of California at Berkeley.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Inverse Global Illumination:Inverse Global Illumination:Recovering Reflectance Models of Real Recovering Reflectance Models of Real
Scenes from PhotographsScenes from Photographs
Inverse Global Illumination:Inverse Global Illumination:Recovering Reflectance Models of Real Recovering Reflectance Models of Real
Scenes from PhotographsScenes from Photographs
Computer Science Division
University of California at Berkeley
Computer Science Division
University of California at Berkeley
Yizhou Yu, Paul Debevec, Jitendra Malik & Tim Hawkins
Image-based Modeling and RenderingImage-based Modeling and RenderingImage-based Modeling and RenderingImage-based Modeling and Rendering
• 1st Generation---- vary viewpoint but not lighting– Recover geometry ( explicit or implicit )
– Acquire photographs
– Facade, Plenoptic Modeling, View Morphing, Lumigraph, Layered Depth Images, (Light Field Rendering) etc.
• 1st Generation---- vary viewpoint but not lighting– Recover geometry ( explicit or implicit )
– Acquire photographs
– Facade, Plenoptic Modeling, View Morphing, Lumigraph, Layered Depth Images, (Light Field Rendering) etc.
Image-based Modeling and RenderingImage-based Modeling and RenderingImage-based Modeling and RenderingImage-based Modeling and Rendering
• Photographs are not Reflectance Maps !
• 2nd Generation---- vary viewpoint and lighting for non-diffuse scenes– Recover geometry
– Recover reflectance properties
– Render using light transport simulation
• Photographs are not Reflectance Maps !
• 2nd Generation---- vary viewpoint and lighting for non-diffuse scenes– Recover geometry
– Recover reflectance properties
– Render using light transport simulation
Illumination Radiance
Reflectance
Previous WorkPrevious WorkPrevious WorkPrevious Work
• BRDF Measurement in the Laboratory– [ Ward 92 ], [Dana, Ginneken, Nayar & Koenderink 97]
• Isolated Objects under Direct Illumination– [ Sato, Wheeler & Ikeuchi 97 ]
• Isolated Objects under General Illumination– [ Yu & Malik 98], [ Debevec 98]
• BRDF Measurement in the Laboratory– [ Ward 92 ], [Dana, Ginneken, Nayar & Koenderink 97]
• Isolated Objects under Direct Illumination– [ Sato, Wheeler & Ikeuchi 97 ]
• Isolated Objects under General Illumination– [ Yu & Malik 98], [ Debevec 98]
The ProblemThe ProblemThe ProblemThe Problem
• General case of multiple objects under mutual illumination has not been studied.
Global IlluminationGlobal IlluminationGlobal IlluminationGlobal Illumination
Reflectance Properties
Radiance Images
Geometry Illumination
Inverse Global IlluminationInverse Global IlluminationInverse Global IlluminationInverse Global Illumination
Lambertian Surfaces under Lambertian Surfaces under Mutual IlluminationMutual IlluminationLambertian Surfaces under Lambertian Surfaces under Mutual IlluminationMutual Illumination
j
ijjiii FBEB j
ijjiii FBEB
• Bi, Bj, Ei measured
• Form-factor Fij known
• Solve for diffuse albedo
• Bi, Bj, Ei measured
• Form-factor Fij known
• Solve for diffuse albedo i
iB
jBijF
Source
Target
Parametric BRDF Model [ Ward 92 ]Parametric BRDF Model [ Ward 92 ]Parametric BRDF Model [ Ward 92 ]Parametric BRDF Model [ Ward 92 ]
Non-diffuse Surfaces under Non-diffuse Surfaces under Mutual IlluminationMutual IlluminationNon-diffuse Surfaces under Non-diffuse Surfaces under Mutual IlluminationMutual Illumination
• LPiAj is not known. ( unlike diffuse case, where LPiAj = LCkAj )
• LPiAj is not known. ( unlike diffuse case, where LPiAj = LCkAj )
• Specular properties assumed uniform across each surface, but diffuse albedo allowed to vary.
•
•
• Specular properties assumed uniform across each surface, but diffuse albedo allowed to vary.
•
•
)()()( xLxLxL sd
)(/)()( xIxLx dd
ResultsResultsResultsResults
• A simulated cubical room• A simulated cubical room
Results for the Simulated CaseResults for the Simulated CaseResults for the Simulated CaseResults for the Simulated Case
Diffuse Albedo
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
1 2 3 4 5 60
0.05
0.1
0.15
0.2
0.25
0.3
0.35
1 2 3 4 5 6
Specular Roughness
ResultsResultsResultsResults
• A real conference room• A real conference room
Real vs. Synthetic for Original Lighting Real vs. Synthetic for Original Lighting Real vs. Synthetic for Original Lighting Real vs. Synthetic for Original Lighting
Real
Synthetic
Diffuse Albedo Maps of Identical Diffuse Albedo Maps of Identical Posters in Different PositionsPosters in Different PositionsDiffuse Albedo Maps of Identical Diffuse Albedo Maps of Identical Posters in Different PositionsPosters in Different Positions
Poster A Poster B Poster C
Inverting Color BleedInverting Color BleedInverting Color BleedInverting Color Bleed
Input Photograph Output Albedo Map
Real vs. Synthetic for Novel LightingReal vs. Synthetic for Novel LightingReal vs. Synthetic for Novel LightingReal vs. Synthetic for Novel Lighting