Top Banner
Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali Blau, Nir Geva Dept. Elect. Eng . Technion – Israel Institute of Technology
13

Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Dec 22, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Attenuating Natural Flicker Patterns

Yoav Y. Schechner

Nir Karpel

Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF

Ack: Yoav Fhiler, Naftali Blau, Nir Geva

Dept. Elect. Eng.Technion – Israel Institute of Technology

Page 2: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Spatio-Temporal Illumination Patterns

Y. Schechner & N. Karpel, Attenuating flicker

• Spatially nonuniform illumination• Temporally varying illuminaton• May disrupt computer-vision

Page 3: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Spatio-Temporal Patterns

Y. Schechner & N. Karpel, Attenuating flicker

Spatiotemporal pattern = Caustic networks = Flicker

Page 4: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Dependency on Depth: Normalized-Amplitude

Y. Schechner & N. Karpel, Attenuating flicker

strong flicker at shallow depths

strong flicker when very deep

Walker 1994

Marine Light Field Statistics

Page 5: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Y. Schechner & N. Karpel, Attenuating flicker

Dependency on Depth: Temporal Frequency

z

z

1max ~

Walker 1994

Marine Light Field Statistics

Page 6: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

max

Inte

nsity

1 Hz 2 Hz 3 Hz

Broadband Temporal Spectrum

Conclusion: Need seconds to average out flicker

Walker 1994

Marine Light Field Statistics

Page 7: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

z

1What Do We Want?

we need seconds to average out flicker

but for video…

we want O(0.1 sec) to eliminate flicker

linear method

nonlinear method

Y. Schechner & N. Karpel, Attenuating flicker

Page 8: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Failure of Trivial Methods

Raw frames

Y. Schechner & N. Karpel, Attenuating flicker

Page 9: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

spatial derivative

temporal median

integration

Weiss 2001Matsushita et. al. 2002

Shadow Removal in Open Air

median of derivative

Page 10: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Hypothesis: A similar method can be applied

to handle underwater flicker

Distinguishing aspects

DC (mean energy) value: implication to color

Very frequent changes (spatially and temporally)

Gradual changes (spatially and temporally)

Veiling light (not multiplicative)

Page 11: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Spatio-Temporal Patterns

Y. Schechner & N. Karpel, Attenuating flicker

Raw frames

Flicker-removed

Page 12: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Spatio-Temporal Patterns

Flicker-removed

Raw frames

Y. Schechner & N. Karpel, Attenuating flicker

Page 13: Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali.

Not a Final Word

Stabilize illumination

This is heuristic.

…Place for better sophistication?

Yoav Schechner & Nir Karpel