1 Markov Decision Processes Alan Fern * * Based in part on slides by Craig Boutilier and Daniel Weld.