Slide 1 Markov Chains - 1 Markov Chains Chapter 16 Slide 2 Markov Chains - 2 Overview Stochastic Process Markov Chains Chapman-Kolmogorov Equations State classification First…