Markov Chains: Models, Algorithms and Applications

• Main Authors: Ching, Wai-Ki (Author), Ng, Michael K. (Author)
• Corporate Author: SpringerLink (Online service)
• Format: Electronic eBook
• Language: English
• Published: Boston, MA : Springer US, 2006.
• Series: International Series in Operations Research & Management Science, 83
• Subjects: Mathematics.; Production management.; Operations research.; Decision making.; Mathematical statistics.; Computer science > Mathematics.; Mathematical models.; Probabilities.; Probability Theory and Stochastic Processes.; Operation Research/Decision Theory.; Mathematical Modeling and Industrial Mathematics.; Operations Management.; Probability and Statistics in Computer Science.; Math Applications in Computer Science.

Markov chains are a particularly powerful and widely used tool for analyzing a variety of stochastic (probabilistic) systems over time. This monograph will present a series of Markov models, starting from the basic models and then building up to higher-order models. Included in the higher-order disc...

Table of Contents:

• Queueing Systems and the Web
• Re-manufacturing Systems
• Hidden Markov Model for Customers Classification
• Markov Decision Process for Customer Lifetime Value
• Higher-order Markov Chains
• Multivariate Markov Chains
• Hidden Markov Chains.