Simulation-Based Algorithms for Markov Decision Processes

• Main Authors: Chang, Hyeong Soo (Author), Hu, Jiaqiao (Author), Fu, Michael C. (Author), Marcus, Steven I. (Author)
• Corporate Author: SpringerLink (Online service)
• Format: Electronic eBook
• Language: English
• Published: London : Springer London : Imprint: Springer, 2013.
• Edition: 2nd ed. 2013.
• Series: Communications and Control Engineering,
• Subjects: Engineering.; Operations research.; Decision making.; Algorithms.; System theory.; Management science.; Probabilities.; Control engineering.; Control.; Systems Theory, Control.; Probability Theory and Stochastic Processes.; Operations Research, Management Science.; Algorithm Analysis and Problem Complexity.; Operation Research/Decision Theory.

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences.  Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dim...