Lecture 3-4 Clustering (1hr) Gaussian Mixture and EM (1hr)

EE462 MLCV

1

Lecture 3-4Clustering (1hr)Gaussian Mixture and EM (1hr)

Tae-Kyun Kim

EE462 MLCV

2

Vector Clustering

EE462 MLCV

3

``

RGB

Pixel Clustering (Image Quantisation)

EE462 MLCV

4

dim

ensi

on

D…

……

……

or raw pixels

…

K codewords

Patch Clustering

EE462 MLCV

5

Refer to Lecture 9-10 for BoW

EE462 MLCV

6

……

Image Clustering

EE462 MLCV

7

K-means vs GMM

Hard clustering

Soft clustering

EE462 MLCV

8

Matrix and Vector Derivatives

EE462 MLCV

9

EE462 MLCV

10

K-means Clustering

EE462 MLCV

11

EE462 MLCV

12

EE462 MLCV

13

EE462 MLCV

14

EE462 MLCV

15

EE462 MLCV

16

EE462 MLCV

17

Statistical Pattern Recognition Toolbox for Matlab

http://cmp.felk.cvut.cz/cmp/software/stprtool/

…\stprtool\probab\cmeans.m…\stprtool\probab\cmeans_tk.m

EE462 MLCV

18

Mixture of Gaussians

EE462 MLCV

19

EE462 MLCV

20

EE462 MLCV

21

EE462 MLCV

22

Maximum Likelihood

EE462 MLCV

23

EE462 MLCV

24

EE462 MLCV

25

EE462 MLCV

26

EE462 MLCV

27

EE462 MLCV

28

EE462 MLCV

29

Statistical Pattern Recognition Toolbox for Matlab

http://cmp.felk.cvut.cz/cmp/software/stprtool/

…\stprtool\visual\pgmm.m…\stprtool\demos\demo_emgmm.m

EE462 MLCV

30

Advanced topic (optional)

http://www.iis.ee.ic.ac.uk/~tkkim/mlcv/lecture_clustering_em.pdf

EE462 MLCV

31

EM Algorithm in General

EE462 MLCV

32

EE462 MLCV

33