Education 2 discrete markov chain

1. 1 Bab 3 Karlin 2. 2 2-2 3. 3 2-3 Markov Chain  Stochastic process that takes values in a countable set  Example: {0,1,2,…,m}, or {0,1,2,…}  Elements represent…