Top Banner
제로부터 시작하는 인공지능 Artificial Intelligence 중앙대학교 의료보안연구소 Mario Cho (조만석) [email protected]
60

Deep machine learning by Mario Cho

Jan 24, 2018

Download

Technology

Mario Cho
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Deep machine learning by Mario Cho

제로부터시작하는인공지능

Artificial Intelligence

중앙대학교의료보안연구소

Mario Cho (조만석)

[email protected]

Page 2: Deep machine learning by Mario Cho

Contents

• 기계학습이란?

• 신경망이란

• 인공지능 SW TensorFlow

• 딥러닝실습

• 딥러닝응용

Page 3: Deep machine learning by Mario Cho

Mario ChoDevelopment Experience◆ Image Recognition using Neural Network◆ Bio-Medical Data Processing◆ Human Brain Mapping on High Performance

Computing◆ Medical Image Reconstruction

(Computer Tomography) ◆Enterprise System◆Open Source Software Developer

Open Source Software Developer◆ OPNFV (NFV&SDN) & OpenStack◆ Machine Learning (TensorFlow)

Book◆ Unix V6 Kernel Chungan Univercity

Mario [email protected]

Page 4: Deep machine learning by Mario Cho

The Future of Jobs

“The Fourth Industrial Revolution, which includes developments in previously disjointed fields such as artificial intelligence & machine-learning, robotics, nanotechnology, 3-D printing, and genetics & biotechnology, will cause widespread disruption not only to business models but also to labor market over the next five years, with enormous change predicted in the skill sets needed to thrive in the new landscape.”

Page 5: Deep machine learning by Mario Cho

Today’s information

* http://www.cray.com/Assets/Images/urika/edge/analytics-infographic.html

Page 6: Deep machine learning by Mario Cho

Google (2)

Page 7: Deep machine learning by Mario Cho

What is the Machine Learning ?• Field of Computer Science that evolved from the study of pattern recognition and computational learning theory into Artificial Intelligence.

• Its goal is to give computers the ability to learn without being explicitly programmed.

• For this purpose, Machine Learning uses mathematical / statistical techniques to construct models from a set of observed data rather than have specific set of instructions entered by the user that define the model for that set of data.

Page 8: Deep machine learning by Mario Cho

What is Artificial Intelligence?

Page 9: Deep machine learning by Mario Cho

Artificial IntelligenceUnderstand information, To Learn, To Reason, & Act upon it

Page 10: Deep machine learning by Mario Cho

Object Recognition

Page 11: Deep machine learning by Mario Cho

Make predictions on data

Page 12: Deep machine learning by Mario Cho

Human-Level Object Recognition

• ImageNet• Large-Scale Visual Recognition Challenge� Image Classification / Localization�1.2M labeled images, 1000 classes�Convolutional Neural Networks (CNNs)has been dominating the contest since..� 2012 non-CNN: 26.2% (top-5 error)� 2012: (Hinton, AlexNet)15.3%� 2013: (Clarifai) 11.2%� 2014: (Google, GoogLeNet) 6.7%� 2015: (Google) 4.9%� Beyond human-level performance

Page 13: Deep machine learning by Mario Cho

Traditional learning vs Deep Machine Learning

Eiffel Tower

Eiffel Tower

RAW data

RAW data

Deep Learning Network

FeatureExtraction

Vectored Classification

Traditional Learning

Deep Learning

Page 14: Deep machine learning by Mario Cho

What is a neural network?

Yes/No(Mug or not?)

Data (image)

!

x1 ∈!5 , !x2∈!5

x2 = (W1 × x1)+x3 = (W2 × x2)+

x1 x2 x3x4

x5

W4W3W2W1

Page 15: Deep machine learning by Mario Cho

Neural network vs Learning networkNeural Network Deep Learning Network

Page 16: Deep machine learning by Mario Cho

Neural Network

W1

W2

W3

f(x)

1.4

-2.5

-0.06

Page 17: Deep machine learning by Mario Cho

Neural Network

2.7

-8.6

0.002

f(x)

1.4

-2.5

-0.06

x = -0.06×2.7 + 2.5×8.6 + 1.4×0.002 = 21.34

Page 18: Deep machine learning by Mario Cho

Convolution Feature

Page 19: Deep machine learning by Mario Cho

Why is Deep Learning taking off?

Engine

Fuel

Large neural networks

Labeled data (x,y pairs)

Page 20: Deep machine learning by Mario Cho

Training Process

Page 21: Deep machine learning by Mario Cho

Deep learning - CNN

Page 22: Deep machine learning by Mario Cho

Deep learning : CNN

Page 23: Deep machine learning by Mario Cho

The Big Players

Page 24: Deep machine learning by Mario Cho

Open Source Software for Machine Learning

Caffe

Theano

Convnet.js

Torch7

Chainer

DL4J

TensorFlow

Neon

SANOA

Summingbird

Apache SA

Flink ML

Mahout

Spark MLlib

RapidMiner

Weka

Knife

Scikit-learn

Amazon ML

BigML

DataRobot

FICO

Google prediction API

HPE haven OnDemand

IBM Watson

PurePredictive

Yottamine

Deep Learning

StreamAnalytics

Big DataMachine Learning

Data Mining

Machine Learning As a Service

Pylearn2

Page 25: Deep machine learning by Mario Cho

Google Tensorflow

Page 26: Deep machine learning by Mario Cho

* Source: Oriol Vinyals – Research Scientist at Google Brain

Page 27: Deep machine learning by Mario Cho

Expressing High-Level ML Computations

• Core in C++ • Different front ends for specifying/driving the computation

• Python and C++ today, easy to add more

* Source: Jeff Dean– Research Scientist at Google Brain

Page 28: Deep machine learning by Mario Cho

Hello World on TensorFlow

Page 29: Deep machine learning by Mario Cho

Image recognition in Google Map

* Source: Oriol Vinyals – Research Scientist at Google Brain

Page 30: Deep machine learning by Mario Cho

Deep Learning Hello World == MNIST

Page 31: Deep machine learning by Mario Cho

MNIST (predict number of image)

Page 32: Deep machine learning by Mario Cho

CNN (convolution neural network) training

Page 33: Deep machine learning by Mario Cho

MNIST code

Page 34: Deep machine learning by Mario Cho

MNIST

Page 35: Deep machine learning by Mario Cho

Old Character Recognition

Page 36: Deep machine learning by Mario Cho

Face extraction method

Page 37: Deep machine learning by Mario Cho

Face recognition data- sets?

Page 38: Deep machine learning by Mario Cho

Human-Level Face Recognition

• Convolutional neural networks based face recognition system is dominant

• 99.15% face verification accuracy on LFW dataset in DeepID2 (2014)� Beyond human-level recognition

Source: Taigman et al. DeepFace: Closing the Gap to Human-Level Performance in Face Verification, CVPR’14

Page 39: Deep machine learning by Mario Cho

Image Recognition

* Source: Oriol Vinyals – Research Scientist at Google Brain

Page 40: Deep machine learning by Mario Cho

Object Classification and Detection

Page 41: Deep machine learning by Mario Cho

How to the Object recognition ?

Page 42: Deep machine learning by Mario Cho

Language Generating

* Source: Oriol Vinyals – Research Scientist at Google Brain

Page 43: Deep machine learning by Mario Cho

Image Caption Generation

Page 44: Deep machine learning by Mario Cho

Neural Conversational Model

Page 45: Deep machine learning by Mario Cho

Neuro Painter

Page 46: Deep machine learning by Mario Cho

Deep Art

Page 47: Deep machine learning by Mario Cho

Inceptionism

Page 48: Deep machine learning by Mario Cho

Automatic Colorization of Black and White Images

Page 49: Deep machine learning by Mario Cho

Image Generate

Page 50: Deep machine learning by Mario Cho

Image Segmentation

Page 51: Deep machine learning by Mario Cho

Scene Parsing

[Farabet et al. ICML 2012, PAMI 2013]

Page 52: Deep machine learning by Mario Cho

Scene Parsing

[Farabet et al. ICML 2012, PAMI 2013]

Page 53: Deep machine learning by Mario Cho

Auto pilot car

Page 54: Deep machine learning by Mario Cho

Q-Learning

Page 55: Deep machine learning by Mario Cho
Page 56: Deep machine learning by Mario Cho

How do data science techniques scale with amount of data?

Page 57: Deep machine learning by Mario Cho
Page 58: Deep machine learning by Mario Cho

GPU

Page 59: Deep machine learning by Mario Cho

Inspirer Humanity

Page 60: Deep machine learning by Mario Cho

Thanks you!

Q&A