Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Machine Learning

StephanRobert|HEIG-Vd|SummerUniversity2017

Few good books (Not necessary to buy them, just download them. Free access)

Few good books (Not necessary to buy them, just download them. Free access)

•  Machine Learning, Tom Mitchell•  Machine Learning, Kevin Murphy

Web page and links... Handoutsandlectureslides

  Documentation,links,softwareresources

  Announcementsandschedule

  Email(labs)

  Slidesathttp://www.stephan-robert.ch/teaching/machine-learning

… and links...

  Kaggle.com(competitions,jobs,…)

  Datascience.net

Python tutorials and books

  docs.python.org/3/tutorial/index.html

  wiki.python.org/moin/IntroductoryBooks

Python environment

  Pythonrelease3.6

  AnacondaNavigator(Jupyter,Ipython,Spyder,…)

Python libraries

  Numpy

  Pandas

  Matplotlib

  Scikit-learn

  Scipy

Syllabus

  Lesson1:IntroductiontoMachineLeraning,GradientDescent(costfunction,manyvariables)

  Lesson2:Linearregression,logisticregression

  Lesson3:Supportvectormachines

  Lesson4:Unsupervisedlearning(PCA,k-means,K-nearestneighbor,classification)

Homeworks

  HW1:GradientDescent

  HW2:Linearandlogisticregression

  HW3:SupportVectorMachines

  HW4:Unsupervisedlearning

Eachgroupofstudents(1-2studentspergroup)mustwritetheirowncodefortheprogrammingpartPleasedon’tsearchforanswersontheweb,Google,previousyears’homeworks,etc.

  HW1,2,3:Groupoftwostudents(1fromSNU+1fromHEIG-Vd)

  HW4:Individual

Homeworks

Grading

•  4homeworks -Deadlines: HW1:August15,24:00 HW2:August16,24:00 HW3:August17,24:00 HW4:August18,24:00

•  Final written test/quiz (1 hour), August 18 (No

documentation)

Machine Learning is changing the world

© Emily Fox

Few videos...

•  NVIDIA Opening Keynote Highlights at CES 2017https://www.youtube.com/watch?v=ljSpat74w10

What is Machine Learning?

•  Study of algorithms that improve their performances at some tasks with experience

Supervised learning

•  Knowledgeofoutput

Learningwiththepresenceofanexpert(e.g.NeuralNetworks,SupportVectorMachines,DecisionTrees,BayesianClassifiers,…)

ExampleofhousespricesinLausanne

House price prediction Supervised learning: regression

House price prediction Supervised learning

House price prediction Supervised learning

House price prediction Supervised learning

Spam filtering Supervised learning: classification

NotSpamTextofemail,IPSource,… Spam

input output

Other examples Supervised learning: classification

•  Sentimentanalysis•  Personalizedmedicaldiagnosis(multiple

outputs:flu,healthy,…)

Stock prediction Supervised learning

Depends on recent historyof stock market, newsevents,…

(Vodafone)

Unsupervised learning

•  NoKnowledgeofoutput

Learningwithoutthepresenceofanexpert(e.gk-means,clusteringapproaches,…)

Unsupervised learning

news.google.com

Unsupervised learning

Clusteringimages,groupas:

•  Clouds•  Mountains•  Roads

Unsupervised learning

Otherexamples

•  UsersonWebsites(groups,activities)•  Words(Firstnames,lastnames,location

words,…)