Top Banner
UCF REU: Weeks 1 & 2
29

UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Jan 03, 2016

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

UCF REU:Weeks 1 & 2

Page 2: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Gradient

Code

Page 3: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.
Page 4: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Gradient

Page 5: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Direction of the Gradient:Calculating theta

Page 6: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Picking a threshold for the gradient map

Page 7: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Subtract the gradient from the original image display

it

Detailing oncamera

Page 8: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Edge Detection

Page 9: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Sobel approximation to the derivative

Filters

Lapacian of Gaussian (LoG)

Page 10: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Canny Edge DetectorGaussian filter to smooth image

1st derivative kernel to detect edges

Non-maximal suppression

Page 11: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Median filter

• B = medfilt2(im) does a median filtering of the image im in two dimensions.

• Each output pixel contains the median value in the 3 x 3 neighborhood around the corresponding pixel in the input image. It pads the image with zeros on the edges, so the median values for points on the edge of the image may appear darker.

• Median filtering is most often used to reduce "salt and pepper" noise.

• A median filter is more effective than convolution when the goal is to simultaneously reduce noise and preserve edges.

Page 12: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Harris Corner Detector

Shifting the window in any direction should yield a large change in appearance

-aka what happens at a corner!

Page 13: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Code for Harris Corner

Page 14: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Optical Flow (Lucas Kanade with

pyramids)

Shows the vectors of motion.

Page 15: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Optical Flow (Liu)

• Found YouTube clip of Olympic diver: https://www.youtube.com/watch?v=djou2oLUeuo

• Clipped the video into a 3 second clip of just the action of diving

• Converted the clipped video into a sequence of jpg images• Example:

Page 16: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

• Made a loop in demo flow to run through the sequence of diving images

• Took the optical flow images and converted them into an animated gif:Olympic Diver: http://makeagif.com/I27cPy

Page 17: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.
Page 18: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Scale Invariant Feature Transform (SIFT)

Page 19: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Code (for one image)

Page 20: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Code to collect all images

Have to do these 2 pieces of code for every 15 categories

Page 21: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Input images

Basic matching using SIFT points

Page 22: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Result

Page 23: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Code

Page 24: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Adaboost

Page 25: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

SVM (Support Vector Machine)

Pick classifier where the distance between the support vectors and the linear classifier is maximized.

Page 26: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Bag Of Words

Page 27: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Project Preference 1Project: Multimodal data analysis for the

detection of Attention Deficit Hyperactive Disorder

Mentor: Soumyabrata Dey

Began his reading most recent paper on the project

Have taken discrete systems which has graph theory which will help because: looking at the brain as a series of nodes and edges

Page 28: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Project Preference 2Project: Deep Tracker

Mentor: Afshin Dehghan

I know python

Looked at papers on deep learning

Page 29: UCF REU: Weeks 1 & 2. Gradient Code Gradient Direction of the Gradient: Calculating theta.

Project Preference 3Project: Action Recognition in Temporally

Untrimmed videos

Mentor: Amir R. Zamir

Have a solid grasp of frame work

Very interested in topic