1. Introduction to Markov chainsExamples of Markov chains:- Random walk on a line 2. Introduction to Markov chainsExamples of Markov chains:- Random walk on a graph 3. Introduction…