Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu Image Fusion for Context Enhancement and Video Surrealism Adrian Ilie Adrian Ilie UNC Chapel Hill UNC Chapel Hill Ramesh Raskar Ramesh Raskar Mitsubishi Electric Research Mitsubishi Electric Research Labs, Labs, (MERL) (MERL) Jingyi Yu Jingyi Yu MIT MIT
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
Image Fusion for Context Enhancementand Video Surrealism
Adrian IlieAdrian Ilie
UNC Chapel HillUNC Chapel Hill
Ramesh RaskarRamesh Raskar
Mitsubishi Electric Mitsubishi Electric Research Labs,Research Labs,
(MERL)(MERL)
Jingyi YuJingyi Yu
MITMIT
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
Dark Bldgs
Reflections on bldgs
Unknown shapes
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
‘Well-lit’ Bldgs
Reflections in bldgs windows
Tree, Street shapes
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, YuBackground is captured from day-time scene using the same fixed camera
Night Image
Day Image
Context Enhanced Image
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
Mask is automatically computed from scene contrast
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
But, Simple Pixel Blending Creates Ugly Artifacts
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, YuPixel Blending
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, YuPixel Blending
Our Method:Integration of
blended Gradients
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
OutlineOutline
• Context Enhancement
• Gradient-based Fusion
• Video Enhancement
• Surrealism
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
Nighttime imageNighttime image
Daytime imageDaytime image
Gradient fieldGradient field
Importance Importance image Wimage W
Fina
l res
ult
Fina
l res
ult
Gradient fieldGradient field
Mixed gradient fieldMixed gradient field
GG11 GG11
GG22 GG22
xx YY
xx YY
II11
I2
GG GGxx YY
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu
Reconstruction from Gradient Reconstruction from Gradient FieldField
• Problem: minimize errorI’ – G|• Estimate I’ so that
G = I’
• Poisson equation
I’ = div G
• Full multigridsolver
I’I’
GGXX
GGYY
Mitsubishi Electric Research Laboratories Image Fusion for Context Enhancement Raskar, Ilie, Yu