Dynamic programming with total variational distance uncertainty
AuthorCharalambous, Charalambos D.
SourceProceedings of the IEEE Conference on Decision and Control
Proceedings of the IEEE Conference on Decision and Control
Google Scholar check
MetadataShow full item record
The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variational distance uncertainty on the conditional distribution of the controlled process. Utilizing concepts from signed measures, the maximization of a linear functional on the space of probability measures on abstract spaces is investigated, among those probability measures which are within a total variational distance from a nominal probability measure. The maximizing probability measure is found in closed form. These results are then applied to solve minimax stochastic control with deterministic control strategies, under a Markovian assumption on the conditional distributions of the controlled process. The results include: 1) Optimization subject to total variational distance constraints, 2) new dynamic programming recursions, which involve the oscillator seminorm of the value function. © 2012 IEEE.
Showing items related by title, author, creator and subject.
Decentralized fault accommodation of a class of interconnected nonlinear systems using an adaptive approximation approach Panagi, P.; Polycarpou, Marios M. (2009)This paper presents a decentralized adaptive approximation design for the fault tolerant control of interconnected subsystems. We consider faults that occur in the subsystems local dynamics as well as in the interconnection ...
Olama, M. M.; Shajaat, S. M.; Djouadi, S. M.; Charalambous, Charalambos D. (2005)The performance of stochastic optimal power control of time-varying wireless short-term flat fading channels, in which the evolution of the dynamical channel is described by a stochastic state space representation, is ...
Infinite horizon average cost dynamic programming subject to ambiguity on conditional distribution Tzortzis, I.; Charalambous, Charalambos D.; Charalambous, T. (Institute of Electrical and Electronics Engineers Inc., 2015)This paper addresses the optimality of stochastic control strategies based on the infinite horizon average cost criterion, subject to total variation distance ambiguity on the conditional distribution of the controlled ...