Discovering hidden structure in factored MDPs

Markov Decision Processes (MDPs) describe a wide variety of planning scenarios ranging from military operations planning to controlling a Mars rover. However, today@?s solution techniques scale poorly, limiting MDPs@? practical applicability. In this work, we propose algorithms that automatically discover and exploit the hidden structure ...More