Understanding Markov Chains Examples and Applications /

• Main Author: Privault, Nicolas (Author, http://id.loc.gov/vocabulary/relators/aut)
• Corporate Author: SpringerLink (Online service)
• Format: Electronic eBook
• Language: English
• Published: Singapore : Springer Singapore : Imprint: Springer, 2018.
• Edition: 2nd ed. 2018.
• Series: Springer Undergraduate Mathematics Series,
• Subjects: Probabilities.; Statistics .; Probability Theory and Stochastic Processes.; Statistical Theory and Methods.; Statistics for Engineering, Physics, Computer Science, Chemistry and Earth Sciences.

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as r...

Table of Contents:

• Probability Background
• Gambling Problems
• Random Walks
• Discrete-Time Markov Chains
• First Step Analysis
• Classification of States
• Long-Run Behavior of Markov Chains
• Branching Processes
• Continuous-Time Markov Chains
• Discrete-Time Martingales
• Spatial Poisson Processes
• Reliability Theory.