Top Banner
Image Recognition Christian Cosgrove Kelly Li Rebecca Lin Shree Nadkarni Samanvit Vijapur Priscilla Wong Yanjun Yang Kate Yuan Daniel Zheng Drew University New Jersey Governor’s School in the Sciences
23

Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Jan 03, 2016

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Image Recognition

Christian Cosgrove

Kelly Li Rebecca Lin

Shree Nadkarni Samanvit Vijapur

Priscilla Wong

Yanjun Yang Kate Yuan Daniel Zheng

Drew UniversityNew Jersey Governor’s School in the

Sciences

Page 2: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.
Page 3: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Dog

Page 4: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.
Page 5: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

What is image recognition?

Page 6: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Machine Learning

• Testing and Training

Page 7: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Database

Feature Extraction

Classification

Page 8: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Digit Database

• 515 images per digit

Page 9: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

AT&T Face Database

• 40 subjects

• 10 images per subject

Page 10: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

NJGSS Face Database

• 40 subjects

• 10 images per subject

Page 11: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Feature Extraction

Vertical Edges

Intensity

Horizontal Edges

Within each patch:

Page 12: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Classification

Nearest Neighbor Centroid

Page 13: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Classification

Nearest Neighbor Centroid

Page 14: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Output: Confusion Matrix

Page 15: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Output: Confusion Matrix

Page 16: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Network Graph

Page 17: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Network Graph

Page 18: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Digit Classification Performance

WHAT IS “N PATCHES”?

Number of patches

2 2 2 2 2 2 2

Nearest Neighbor

Centroids

2 2 2

Number of patches

Per

cen

t Acc

urac

y

Page 19: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Facial Classification Performance

Nearest Neighbor

Centroids

Number of patches

2 2 2 2 2 2 2 2 2

Per

cen

t Acc

ura

cy

Page 20: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Colored Nearest Neighbor

Colored Centroids

Grayscale Nearest Neighbor

Grayscale Centroids

Number of Training Pictures

Per

cen

t Acc

ura

cy

Page 21: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Conclusions

Optimal Performance• Digits: 588 features, 14x14 patches

91%• AT&T Grayscale Faces: 480 features, 16x8/8x4

patches99% ± 0.67%

• NJGSS RGB Faces: 360 features, 16x8/8x4 patches96% ± 1.20%

Page 22: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

ConclusionsImprovements• Prioritization of feature• More training• Tolerance for rotation

and reflections of subjects• Tolerance for

background differences/lighting

Applications• Personal security• Social media• Robotics• Medical examination

Page 23: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University.

Acknowledgements

Dr. Minjoon KouhMr. Michael Clancy

NJ Governor’s School in the Sciences

Dr. Adam Cassano Dr. Steve Surace

Yumi KouhBayer Health Care Dr. Robert Mayans

AT&T

Laura (NJGSS ’86) and John Overdeck

NJGSS Alumnae and Parents of Alumnae

Board of Overseers, New Jersey Governor’s

SchoolsState of New Jersey

Drew University

And all of NJGSS’s generous sponsors!