Top Banner
Computational Photography
85

Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Aug 25, 2018

Download

Documents

vohuong
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Computational Photography

Page 2: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Digital photography

Photography has been rapidly changing in recent years, with

the transition from analog to digital

Page 3: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Digital photography

Computing can now be involved in every step of the imaging

process. This is having a huge impact on the art and

practice of photography.

We don’t just take a picture – we sample the light field

Page 4: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

The light field

Page 5: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

The light field

• The light field describes the amount of light (radiance)

traveling in every direction through every point in space

– Possibly also as a function of wavelength and time

– The plenoptic function

• One goal of image based rendering is to construct the light

field from a set of images, so that new images can be

synthesized

Page 6: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Computational photography

• Traditional (analog and digital) cameras have limitations,

e.g.:

– Cannot capture scenes with significant differences between bright

and dark areas

– Limited field of view

– Can only focus at a single plane

• Computational photography is an emerging research

field that attempts to extend or enhance the capabilities of

digital photography by adding computational elements to

the imaging process

– Optics + sensors + illumination + processing + interaction

– Convergence of computer vision, digital imaging, and graphics

Page 7: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Computational photography

• Typical process: take several images, combine them

(perhaps with user interaction), create “better” image(s)

• May modify

– Field of view, depth of field/focus, dynamic range, spatial

resolution, wavelength resolution, temporal resolution

– Aperture, focus, sensor design, exposures, illumination

• Computational photography can provide

– Improved dynamic range

– Variable focus, resolution, and depth of field

– Aesthetic image framing

– Content-based image editing

– Hints about shape, reflectance, and lighting

– New interactive forms of photography

Page 8: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Traditional Photography

Lens

Sensor array

Pixels

Image

Page 9: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Computation

Computational Photography

Generalized

Optics

Generalized sensor

Samples

Image

Page 10: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

E.g., a computational lens

Varioptic Liquid Lens: Electrowetting

Applied voltage modifies the curvature of the liquid-

liquid interface, leading to a variable focal length lens

Page 11: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

The Plenoptic Function (a.k.a. the light field)

Q: What is the set of all things that we can ever see?

A: The Plenoptic Function

Let’s start with a stationary person and try to parameterize

everything that he can see…

Page 12: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

A grayscale image

…is intensity of light

Seen from a single view point

At a single time

Averaged over the wavelengths of the visible spectrum

(can also do P(x,y), but spherical coordinate are nicer)

P(q,f)

Page 13: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

A color image

…is intensity of light

Seen from a single view point

At a single time

As a function of wavelength

P(q,f,l)

Page 14: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

A color movie

…is intensity of light

Seen from a single view point

Over time

As a function of wavelength

P(q,f,l,t)

Page 15: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

A holographic movie

…is intensity of light

Seen from ANY viewpoint

Over time

As a function of wavelength

P(q,f,l,t,VX,VY,VZ)

Page 16: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

The Plenoptic Function

Can reconstruct every possible view, at every moment, from

every position, at every wavelength

Contains every photograph, every movie, everything that

anyone has ever seen! It completely captures our visual

reality.

P(q,f,l,t,VX,VY,VZ)

Page 17: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Sampling the Plenoptic Function (top view)

Page 18: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Synthesizing novel views

Page 19: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Image based rendering

We don’t need a (3D) model

of the object

Instead, model the object by

storing its light field

Stuff

Page 20: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Some examples of computational photography

Research and products

Page 21: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Flash/no-flash image pairs

Flash

No-flash

Result

Eisemann and Durand SIGGRAPH04

Petschnigg et al. SIGGRAPH04

Page 22: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Flash/no-flash image pairs Agrawal et al. SIGGRAPH05

Flash Result Ambient Reflection Layer

Page 23: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

High dynamic range imaging

Ambient Flash

Raskar et al.

Page 24: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

HDR imaging: varying exposure

Page 25: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Exposure Time

Flash

Brightness

Page 26: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

?

?

?

Result

Page 27: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Image retargeting

Setlur et al. SIGGRAPH04

Rearranging the image content to optimize the information of interest,

given the constraints (e.g., reduced aspect ratio)

Page 28: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

The Lytro camera

Link

Page 29: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

A practical light field camera

uv-plane st-plane

Page 30: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

4000 × 4000 pixels ÷ 292 × 292 lenses = 14 × 14 pixels per lens

Adaptive Optics microlens array 125μ square-sided microlenses

The prototype camera

Page 31: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Digital refocusing

• refocusing = summing windows extracted from

several microlenses

Σ

Σ

Page 32: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Example of digital refocusing

Page 33: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Cinemagraph (www.cinemagraph.com)

• Still photographs in which a minor (and repeated)

movement occurs

– Typically in Animated GIF format

• “A Cinemagraph is an image that contains within itself a

living moment that allows a glimpse of time to be

experienced and preserved endlessly.”

–34

Page 34: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Coded aperture photography

• Regular camera with “patterned aperture” (made from

cardboard!) in place of regular aperture

• From this, can get scene depth and do refocusing

• Uses deconvolution with the known patterns

Levin et al. SIGGRAPH 2007

Page 35: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Single input image:

Output #1: Depth map

Output #2: All-focused image

Page 36: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent
Page 37: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent
Page 38: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens

Camera

sensor

Point spread

function

Image of a point

light source

Lens and defocus

Focal plane

Lens’ aperture

Page 39: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens Object

Camera

sensor

Point spread

function

Image of a

defocused point

light source

Lens and defocus

Lens’ aperture

Focal plane

Page 40: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens Camera

sensor

Point spread

function

Image of a

defocused point

light source

Lens and defocus

Object

Lens’ aperture

Focal plane

Page 41: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens Camera

sensor

Point spread

function

Image of a

defocused point

light source

Lens’ aperture

Lens and defocus

Object

Focal plane

Page 42: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens and defocus

Lens Camera

sensor

Point spread

function

Image of a

defocused point

light source

Lens’ aperture

Object

Focal plane

Page 43: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Idea 2: Coded Aperture

• Mask (code) in aperture plane

- make defocus patterns different from

natural images and easier to discriminate

Conventional

aperture Our coded aperture

Page 44: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens Camera

sensor

Point spread

function

Object

Solution: lens with occluder

Focal plane

Page 45: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens with coded

aperture

Camera

sensor

Point spread

function

Image of a

defocused point

light source

Aperture pattern

Solution: lens with occluder

Object

Focal plane

Page 46: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens with coded

aperture

Camera

sensor

Point spread

function

Image of a

defocused point

light source

Aperture pattern

Solution: lens with occluder

Object

Focal plane

Page 47: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens with coded

aperture

Camera

sensor

Point spread

function

Image of a

defocused point

light source

Aperture pattern

Solution: lens with occluder

Object

Focal plane

Page 48: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Lens with coded

aperture

Camera

sensor

Point spread

function

Image of a

defocused point

light source

Aperture pattern

Solution: lens with occluder

Object

Focal plane

Page 49: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Solution: lens with occluder

Lens with coded

aperture

Camera

sensor

Point spread

function

Image of a

defocused point

light source

Aperture pattern

Object

Focal plane

Page 50: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Input Local depth estimation Regularized depth

Regularizing depth estimation

2|| minarg yxfx

_

i ix )(l

2

+

Convolution error Derivatives prior

Try deblurring with 10 different aperture scales

Keep minimal error scale in each local window + regularization

Page 51: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Input

Local depth estimation

Regularized depth

Regularizing depth estimation

Page 52: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Input

Page 53: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

All-focused

(deconvolved)

Page 54: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Original image

All-focus image

Close-up

Page 55: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Input

Page 56: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

All-focused

(deconvolved)

Page 57: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 58: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 59: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 60: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 61: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 62: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 63: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Application: Digital refocusing from a single image

Page 64: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Image AND depth at a single shot

No loss of image resolution

Simple modification to lens

Depth is coarse

But depth is a pure bonus

Loss some light

But deconvolution increases depth of field

Coded aperture: pros and cons

unable to get depth at untextured areas,

might need manual corrections.

-

+ +

+ - +

+

Page 65: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Some projects in computational photography

Page 66: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Composition Context Photography

w/Daniel Vaquero

Page 67: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Composition context photography

How can the act of framing an image help to produce better

images? A wider array of images to choose from?

– Higher resolution, higher SNR, wider FOV, optimal subject pose,

etc.

Page 68: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Composition context photography

The composition context of a picture: the viewfinder frames, their capture

parameters, and inertial sensor data collected while the user is framing the

photograph

Page 69: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Page 70: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

The Frankencamera

• An open source experimental camera architecture and API

for computational photography

• Fully programmable: permits control and synchronization

of the sensor and image processing pipeline at the

microsecond time scale, as well as the ability to

incorporate and synchronize external hardware like lenses

and flashes.

Stanford, Ulm, Nokia RC, UCSB, Disney Research (SIGGRAPH 2010)

Page 71: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Page 72: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Generalized Autofocus

w/Daniel Vaquero

Page 73: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Generalized autofocus

• Choices have to be made in focusing images

• Large depth-of-field small aperture noisy image

• Can we provide alternatives? New focusing options?

– Large depth-of-field with wide aperture?

– Selective focus?

Page 74: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

All-in-focus imaging

Images focused at different distances

(focal stack)

Page 75: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

What is our work about?

• The capture process for focal stacks

– For fusion, we use existing techniques,

but we do it on-camera

• Our scenario, typical in camera phones and low-end

consumer cameras

– Fixed lens aperture

– Handheld camera

– Limited memory and processing power

Page 76: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Contrast-based passive autofocus

Sharp

But low SNR

Page 77: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Our method: Generalized autofocus

• Contribution: autofocus for focal stacks

• Find the minimal set of required images to generate an all-

in-focus composite

– The choice of this set depends on the scene

• Why is minimizing the number of images important?

– Faster capture

– Less sensitive to motion

– Requires less memory and processing power

depth

Page 78: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Method overview

1. Capture a focal stack of low-resolution images while

continuously changing the focal distance (“lens sweep”)

2. Analyze sharpness of low-resolution focal stack

3. Determine the minimal set of required images

4. Recapture the images in the minimal set in high-resolution

5. Perform fusion of the images on-camera

Desired: Good user interface to specify what should be in focus

Nokia N900

depth

Page 79: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Page 80: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Standard autofocus

Page 81: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

All-in-focus result (24 image in stack, 3 used)

Page 82: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Stack images (4)

Page 83: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

All-in-focus result (24 image in stack, 4 used)

Page 84: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Generalized Autofocus

Page 85: Computational Photography - UCSB Computer Sciencemturk/Tampere/5. Computational Photography.pdf · Tampere 8.2012 Digital photography Photography has been rapidly changing in recent

Tampere 8.2012

Ongoing work

• Improve image fusion

• User selectable focus

– Location and range

– Between x and y

– In focus here and here and here…

• Provide focusing opportunities not possible with lens-only

solutions