Weathering Ongoing Uncertainty: Learning and Planning in a Time-Varying Partially Observable Environment
Gokul Puthumanaillam,Xiangyu Liu,Negar Mehr,Melkior Ornik,Gokul Puthumanaillam,Xiangyu Liu,Negar Mehr,Melkior Ornik
Optimal decision-making presents a significant challenge for autonomous systems operating in uncertain, stochastic and time-varying environments. Environmental variability over time can significantly impact the system’s optimal decision making strategy for mission completion. To model such environments, our work combines the previous notion of Time-Varying Markov Decision Processes (TVMDP) with pa...