YOU ARE DOWNLOADING DOCUMENT

Please tick the box to continue:

Transcript
Page 1: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Machine Learning empowered by Python

Francis [email protected]

http://fraka6.blogspot.com/

14 april 2009Python-Montreal

http://montrealpython.org/

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 2: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Hand writing digit recognition

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 3: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why a talk about machine learning and python?

Machine Learning 101Supervised Learning (classification)Important Concepts

Let’s dive into an exampleWhy Python?Data exampleTraining and Testing (python-mlboost)

Conclusion

Questions?

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 4: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why Machine Learning empowered by Python?

I Integrated real live prototypes ⇒ Probability(success) ⇑I Python allows extreme prototyping

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 5: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Speaker: Francis Pieraut, eng. M.Sc.A.

I Master@LISA - Statistical Machine Learning - udm(flayers: C++ Neural Networks lib)

I Industry - 6 years in Machine Learning/AI startups(mlboost: Python Machine Learning Boost lib)

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 6: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Supervised Learning (classification)Important Concepts

AI and Machine Learning

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 7: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Supervised Learning (classification)Important Concepts

Machine Learning

I Learning from data

I Classification vs Clustering

I Applications: Fraud detection, Vision, Target-Marketing,Search Engine, Insurance (Risk) etc.

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 8: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Supervised Learning (classification)Important Concepts

Supervised Learning (need class tag for each example)

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 9: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Supervised Learning (classification)Important Concepts

Important Concepts

I Datasets (features + class)I Generalization vs OverfittingI Classification vs ClusteringI Features Quality (invariant and informative)

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 10: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why Python?Data exampleTraining and Testing (python-mlboost)

Why Python? Prototyping Extreme Efficiency

I C++, sed, awk...⇒ N yearsI Python ⇒ N weeks

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 11: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why Python?Data exampleTraining and Testing (python-mlboost)

Hand writing digit recognition - Data examples

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 12: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why Python?Data exampleTraining and Testing (python-mlboost)

Hand writing digit recognition - Training

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 13: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why Python?Data exampleTraining and Testing (python-mlboost)

Digit recognition (Demo)

I Naive Machine Learning: Training on raw pixels

I Testing example visualization

I Real-time demo

I Naive machine learning limitations

I Feature extraction visualisation

I Training on new features

I Real-time demo

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 14: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Why Python?Data exampleTraining and Testing (python-mlboost)

Want to try the Demo or contribute?

I try it easy install digipy (soon)

I http://bitbucket.org/fraka6/digipy/

I http://bitbucket.org/fraka6/mlboost

I http://bitbucket.org/fraka6/flayers

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 15: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

What you should remember?

I Machine learning algorithms applications ⇑I goal = generalization⇒good prediction (DON’T OVERFIT)

I 80-90% pre or post-processing + data visualization

I Python provide amazing integration

I try it, easy install digipy

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python

Page 16: Machine Learning empowered by Python April2009

OutlineWhy a talk about machine learning and python?

Machine Learning 101Let’s dive into an example

ConclusionQuestions?

Any questions?...A special thanks to Yannick Gingras help for the UI and thepackaging, Pierre-Alexandre Fournier and Jeremy Barnes feedbacksand Caroline patienceeasy install digipyhttp://fraka6.blogspot.com/icml2009 - Internation Conference on Machine Learning(June 14-18, Montreal 2009)..Thanks,Francis Pieraut - alias [email protected]

Francis Pieraut [email protected] http://fraka6.blogspot.com/ Machine Learning empowered by Python