Top Banner
3A-L1 Cameras and images CS4495/6495 Introduction to Computer Vision
40

CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Jul 24, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

3A-L1 Cameras and images

CS4495/6495 Introduction to Computer Vision

Page 2: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

What is an image?

• Up until now: a function – a 2D pattern of intensity values

• Today: a 2D projection of 3D points

Page 3: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

First Known Photograph – Heliograph

Reproduction, 1952 View from the Window at le Gras,

Joseph Nicéphore Niépce 1826

Page 4: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Projection

Page 5: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Projection

Page 6: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Image formation – (bad) method

Page 7: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Pinhole camera

Page 8: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Camera Obscura (Latin: Darkened Room)

Page 9: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Home-made pinhole camera

http://www.debevec.org/Pinhole/

Why so

blurry?

Page 10: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Shrinking the aperture

Page 11: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Shrinking the aperture

Page 12: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

A little bit of computational photography

Page 13: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Adding a lens – and concept of focus

“circle of

confusion”

Page 14: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

focal point

F

Lenses

Page 15: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Thin lenses

Slide by Steve Seitz

Page 16: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens

Computer Vision - A Modern Approach

Slides by D.A. Forsyth

|| ' ||z || ||z

Page 17: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens

|| ' ||

|| ||

y z

y z

|| ' ||z || ||z

Page 18: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens

|| ' ||y z f

y f

|| ' || || ' ||

|| ||

z z f

z f

|| ' ||z || ||z

|| ' ||

|| ||

y z

y z

Page 19: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens equation

1 1 1

|| || || ||z f z

1 1 1

|| || || ||z z f

|| ' ||z || ||z

|| ' || || ' ||

|| ||

z z f

z f

Page 20: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens equation

1 1 1

|| || || ||z z f

Any object point satisfying this equation is in focus.

|| ' ||z || ||z

Page 21: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Thin lenses

http://www.phy.ntnu.edu.tw/java/Lens/lens_e.html

(by Fu-Kwun Hwang )

Page 22: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Varying Focus

Ren Ng

Page 23: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Depth of field

f / 32 = small aperture

f / 5.6 = large aperture

Flower images from Wikipedia http://en.wikipedia.org/wiki/Depth_of_field

Page 24: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Nice Depth of Field effect

Page 25: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Field of View (Zoom)

Page 26: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Field of View (Zoom)

Page 27: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

FOV depends on Focal Length

Larger Focal Length => Smaller FOV

1/ 2

2 tand

f

d is the “retina” or

sensor size f

Page 28: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Zooming and Moving are not the same…

Page 29: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Field of View / Focal Length

Large FOV, small f

Camera close to car

Small FOV, large f

Camera far from the car

Page 30: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Perspective and Portraits

Page 31: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Perspective and Portraits

Page 32: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

From Zisserman & Hartley

Effect of focal length on perspective effect

Page 33: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Dolly Zoom

Pioneered by Hitchcock in Vertigo (1958)

Original(YouTube link) (2:07) Widely used (YouTube link)

Jim Rehg

Page 34: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

But reality can be a problem…

Page 35: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Geometric Distortion

No distortion Pin cushion Barrel

Page 36: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Correcting radial distortion

from Helmut Dersch

Page 37: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Chromatic Aberration

Rays of different wavelength focus in different planes

Page 38: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Chromatic Aberration

Page 39: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Vignetting

Page 40: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Lens systems Nikon 24-70mm zoom