Top Banner
Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010. 1. Jing Luo | Megvii Tech Talk | Feb 2018
31

Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Jun 29, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Image Formation

Computer Vision:Algorithms and Applications

Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010. 1.

Jing Luo | Megvii Tech Talk | Feb 2018

Page 2: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

1.Geometric primitives and transformations

Page 3: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Geometric primitives

▣ 2D points

▣ 2D lines

polar coordinates

Page 4: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Geometric primitives

▣ Use homogeneous coordinatesIntersection of two lines:

The line joining two points:

▣ 3D points

▣ 3D planes

Page 5: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Geometric primitives

▣ 3D lines

Page 6: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

2D transformations

▣ Frequent 2D transformations

Page 7: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

2D transformations

▣ Translation ▣ Rotation + Translation

Page 8: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

2D transformations

▣ Scaled rotation

▣ Affine

▣ Projective

Page 9: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

2D transformations

▣ Hierarchy of 2D coordinate transformations

Page 10: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

▣ Stretch/squash

▣ Planar surface flow

▣ Bilinear interpolation

2D transformations

Page 11: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D transformations

Page 12: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D rotations

▣ Euler angles? ▣ Axis/angle

Page 13: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D rotations

▣ Rodriguez’s formula

Page 14: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D rotations

▣ Unit quaternions

Page 15: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D to 2D projections

▣ Orthography

Page 16: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D to 2D projections

▣ Scaled orthography ▣ Para-perspectiveAffine

Page 17: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3D to 2D projections

▣ 3D perspective

Page 18: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Lens distortions

▣ Straight lines in the world = straight lines in the image?Many wide-angle lenses have noticeable radial distortion

Page 19: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Lens distortions

Page 20: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Lens distortions

▣ Compensate for radio distortion

Page 21: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

2.Photometric image formation

Page 22: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Lighting

▣ Point light

Location, intensity, color spectrum L(λ).

▣ Area light sources

A finite rectangular area emitting light equally in all directions.

Environment map: maps incident light directions v̂ to color values.

Page 23: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Reflectance and shading

▣ Bidirectional Reflectance Distribution Function (BRDF)

Page 24: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Optics

▣ Rule of optics

Page 25: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Optics

▣ Chromatic aberration

Page 26: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

3.The digital camera

Page 27: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Image sensing pipeline

Page 28: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Color

▣ Additive colors / subtractive colors

Page 29: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Color

▣ RGB / XYZ / LAB

Page 30: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Color filter arrays

▣ Bayer RGB pattern

Page 31: Computer Vision: Algorithms and Applications...Image Formation Computer Vision: Algorithms and Applications Reference: R. Szeliski. Computer Vision: Algorithms and Applications. 2010.

Compression

▣ Discrete cosine transform (DCT)Both MPEG and JPEG use 8 × 8 DCT transforms.

▣ PSNR: quality of a compression algorithms