Markov Chains (Cambridge Series In Statistical And Probabilistic Mathematics, Series Number 2)

Finite Markov Chains And Algorithmic Applications (London Mathematical Society Student Texts, Series Number 52)

Understanding Markov Chains: Examples And Applications (Springer Undergraduate Mathematics Series)

Markov Chain Process (Theory And Cases)

Markov Chains And Stochastic Stability (Cambridge Mathematical Library)

Finite Markov Chains: With A New Appendix "Generalization Of A Fundamental Matrix" (Undergraduate Texts In Mathematics)

Markov Chain Monte Carlo (Chapman & Hall/CRC Texts In Statistical Science)

Handbook Of Markov Chain Monte Carlo (Chapman & Hall/CRC Handbooks Of Modern Statistical Methods)

Markov Processes (Advances In Applied Mathematics)

Image Analysis, Random Fields And Markov Chain Monte Carlo Methods: A Mathematical Introduction (Stochastic Modelling And Applied Probability Book 27)

Markov Chain Monte Carlo In Practice (Chapman & Hall/CRC Interdisciplinary Statistics)

Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley Series In Probability And Statistics)

Advanced Markov Chain Monte Carlo By Faming Liang:

Markov Set-Chains (Lecture Notes In Mathematics, 1695)

Controlled Markov Processes And Viscosity Solutions (Stochastic Modelling And Applied Probability, 25)

Mixture And Hidden Markov Models With R (Use R!)

Finite Mixture And Markov Switching Models (Springer Series In Statistics)

Image Analysis, Random Fields And Markov Chain Monte Carlo Methods: A Mathematical Introduction (Stochastic Modelling And Applied Probability, 27)

Markov Processes: An Introduction For Physical Scientists

MCMC From Scratch: A Practical Introduction To Markov Chain Monte Carlo

Algorithms For Random Generation And Counting: A Markov Chain

Competitive Markov Decision Processes

Markov Processes From K. Ito's Perspective (Annals Of Mathematics Studies, 155)

Diffusions, Markov Processes And Martingales (Cambridge Mathematical Library)

Applied Stochastic Analysis (Courant Lecture Notes)

Markov Chains (Springer Series In Operations Research And Financial Engineering)