Top Banner
Algorithm independant machine learning Ganesh, Owen, Zach
41

Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Aug 29, 2018

Download

Documents

nguyenbao
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Algorithm independant machine learning

Ganesh, Owen, Zach

Page 2: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 3: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 4: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 5: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 6: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 7: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 8: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 9: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 10: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 11: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 12: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 13: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 14: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 15: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 16: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 17: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 18: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 19: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 20: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 21: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 22: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 23: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 24: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 25: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting
Page 26: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Arcing, Bagging, and Boosting

Page 27: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Why Perform Bagging?

Page 28: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Boosting

Page 29: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Boosting II

Page 30: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Boosting III

Page 31: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Boosting IV - Choosing n

Page 32: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

AdaBoost I

Page 33: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

AdaBoost II - Algorithm

Page 34: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

AdaBoost III - Classification/Error Rate

Page 35: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

AdaBoost IV - Error Rate

Page 36: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

AdaBoost V - Observations

Page 37: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Queries and the Oracle

Page 38: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Queries and the Oracle Example

Page 39: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Customer Churn

Page 40: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

Customer Churn Error Rates

Page 41: Algorithm independant machine learning - cs.rit.edurlaz/PatternRecognition/slides/chap9.pdf · Ganesh, Owen, Zach. Arcing, Bagging, and Boosting. Why Perform Bagging? Boosting. Boosting

References

Duda, Richard, Hart, Peter, and Stork, David. Pattern Classification. New York: John Wily & Sons, 2001.Shao Jinbo, Li Xiu, Liu Wenhuang. The Application of AdaBoost in Customer Churn Prediction. In Service Systems and Service Management, 2007 International Conference on, pages 1-6, June 2007.