Text this: Simulation-based Algorithms for Markov Decision Processes