Top Banner
GV12/3072 Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince
30

Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Jun 02, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

1

Image Processing

Gabriel Brostow & Simon Prince

Page 2: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

2

Page 3: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

3

Motivation and Goals

• Grounding in image processing techniques

• Concentrate on algorithms used in machine

vision, graphics, medical imaging

• Best sensors ever!

Page 4: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

4

Motivation and Goals

• Grounding in image processing techniques

• Concentrate on algorithms used in machine

vision, graphics, medical imaging

• Best sensors ever! With a few problems…

Page 5: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Transmission interference

5

Page 6: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Compression artefacts

6

Page 7: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Spilling

7

Page 8: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Scratches, Sensor noise

8

Page 9: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Bad contrast

9

Page 10: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Resolution Super resolution?

10

Page 11: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Super resolution

11

Page 12: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Removing motion blur

Original image

Cropped subwindow

After motion blur removal

[Images from Amit Agrawal]12

Page 13: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Removing motion blur

13

Page 14: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

14

Page 15: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Removing motion blur

15

Page 16: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

16

Syllabus

1. The digital image

2. Image segmentation*

3. Image transformations

4. Morphological operations*

5. Feature characterization

*= Homework will be assigned

Page 17: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

17

Features and Object Recognition

Page 18: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

18

Syllabus (GV12/3072)

6. Image Filtering

7. Edge detection*

8. Corner detection

9. Color images*

10.Template matching

*= Homework will be assigned

Page 19: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

19

Why Now?

• Why are these sectors paying more attention?

•Medicine• Automatic or assisted diagnosis

• Image-guided surgery

•Agriculture

•Film and television

•Surveillance and police work

•Military

•http://www.cs.ubc.ca/spider/lowe/vision.html

Page 20: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

20

Course content

• Lots of material!

• Some mathematics• Calculus (light)

• Geometry and matrix algebra

• Probability and statistics (light)

• Some programming – Matlab

Page 21: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

21

Lectures and notes

• http://www.cs.ucl.ac.uk/staff/G.Brostow/classes/IP2009/

• Mon 16:00-17:00 (Drayton Ricardo LT)

• Wed 09:00-11:00 (Roberts G08, Sir David Davies LT)

• Lab sessions

– Monday 11-12 (Malet Place Eng 4.06)

Monday 12-13 (Malet Place Eng 4.06)

Monday 17-18 (Malet Place Eng 4.06)

• subject: “join” to [email protected]

Page 22: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

22

Page 23: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

24

Assessment

• Exam 80%

• Four Courseworks 20%.• Implement and test algorithms in Matlab

• Honor System

Page 24: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

27

Unassessed CW Assignment

• Matlab introduction

• Start matlab:

% matlab or

% /opt/matlab7/bin/matlab

• Download any simple image

• Load it into matlab:

>> I = imread(‘foo.jpg’);

Page 25: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

28

Unassessed CW Assignment

• Display the image in Matlab:

>> imshow(I);

• Print the image data array:

>> I

(Ha! It’s a trap! – use Ctrl-C to make it stop)

• Print the size of the image array and create a subimage:

>> size( I )

>> Isubwindow = I(72:92, 62:82);

>> imshow(Isubwindow);

Page 26: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

29

Unassessed CW Assignment

• Start the Matlab help tool (Help menu).

• In the “Contents” pane to the left of the

window. Click on MATLAB.

• Go through the “Getting Started” section.

• Continue to the “Using MATLAB” section

when you have time.

Page 27: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

IP is Only Part of the Picture

• See Machine Vision

(GI04) in MPEB 1.03

Tuesday at 10am

• Why?

– To work on fun projects!

30

MRI of GJB A Computational Investigation into

the Human Representation and

Processing of Visual Information

Page 28: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

• 3D Gesture Interfaces

(Xbox 360)

• Build Your Own 3D Scanner: Optical Triangulation for

Beginners (Lanman + Taubin)

GV12/3072

Image Processing.

31

Page 29: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

GV12/3072

Image Processing.

32

Developing Drosophila eye (30 hours)With Franck PichaudEpithelial Morphogenesis & Cell PolarityLMCB, Cell Biology Unit, MRC, UCLNeeded Innovations:

- Locate & track branching structures

- Propagate confidence to neighbors

Page 30: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus

Next Time: The Digital Image

GV12/3072

Image Processing.

33