Papers on Markov Decision Processes


A Note on the Representational Incompatibility of Function Approximation and Factored Dynamics,
(with Sanjeev Arora, Michael Kearns, Cristopher Moore, and Alexander Russell), in Proc. 16th Annual Conference on Neural Information Processing Systems (NIPS 2002), MIT Press, 2003, pp. 431--437.

Complexity of Finite-Horizon Markov Decision Process Problems,
(with Martin Mundhenk, Judy Goldsmith, and Christopher Lusena). Journal of the ACM 47 (2000) 681 - 720. An earlier version appeared in MFCS 1997, LNCS 1295, pp. 129-138.