Clustering and the K-means algorithm - MIT Mathematicsmath.mit.edu/~rothvoss/18.304.1PM/Presentations/1-Yihui-Talk1.pdf · Clustering and the K-means algorithm Yihui Saw 18.304 Seminar

Clustering and the K-means algorithm

Yihui Saw18.304 Seminar Talk I

March 6, 2013

Saturday, March 16, 13

Clustering examples

• Customer purchase patterns

• Language family models

• Data compression


Original Image


2 colors


4 colors


8 colors


The clustering problem


Distance metric


The cost of clustering


K-means algorithm


K-means algorithm


K-means algorithm


K-means algorithm


K-means algorithm


K-means algorithm


Proof of convergence• Each iterative step necessarily lowers the

cost - the cost monotonically decrease


Proof of convergence• Each iterative step necessarily lowers the

cost - the cost monotonically decrease

]


Convergence to local minimum














Clustering and the K-means algorithm - MIT Mathematicsmath.mit.edu/~rothvoss/18.304.1PM/Presentations/1-Yihui-Talk1.pdf · Clustering and the K-means algorithm Yihui Saw 18.304 Seminar

Documents