Markov chains / Markov chains : Markov chain Markov Chain Finite Markov chains / Denumerable Markov chains / Markov games Gray markov chain Gray markov chain method Markov chain Monte Carlo