Dynamic programming with total variational distance uncertainty
Date
2012Source
Proceedings of the IEEE Conference on Decision and ControlProceedings of the IEEE Conference on Decision and Control
Pages
1909-1914Google Scholar check
Keyword(s):
Metadata
Show full item recordAbstract
The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variational distance uncertainty on the conditional distribution of the controlled process. Utilizing concepts from signed measures, the maximization of a linear functional on the space of probability measures on abstract spaces is investigated, among those probability measures which are within a total variational distance from a nominal probability measure. The maximizing probability measure is found in closed form. These results are then applied to solve minimax stochastic control with deterministic control strategies, under a Markovian assumption on the conditional distributions of the controlled process. The results include: 1) Optimization subject to total variational distance constraints, 2) new dynamic programming recursions, which involve the oscillator seminorm of the value function. © 2012 IEEE.
Collections
Cite as
Related items
Showing items related by title, author, creator and subject.
-
Conference Object
A scalable iterative convex design for nonlinear systems
Baldi, S.; Ioannou, Petros A.; Kosmatopoulos, E. B. (2012)A recently developed control scheme for approximately optimal control of nonlinear systems is the so-called Convex Control Design (ConvCD) methodology, that transforms the control problem of generic nonlinear systems into ...
-
Article
Multiple model adaptive control with mixing
Kuipers, M.; Ioannou, Petros A. (2010)Despite the remarkable theoretical accomplishments and successful applications of adaptive control, the field is not sufficiently mature to solve challenging control problems where strict performance and robustness guarantees ...
-
Article
Convex design control for practical nonlinear systems
Baldi, S.; Michailidis, I.; Kosmatopoulos, E. B.; Papachristodoulou, A.; Ioannou, Petros A. (2014)This paper describes a new control scheme for approximately optimal control (AOC) of nonlinear systems, convex control design (ConvCD). The key idea of ConvCD is to transform the approximate optimal control problem into a ...