Stochastic optimal control subject to variational norm uncertainty: Dynamic programming and HJB equation
Date
2014ISBN
978-3-9524173-9-3Publisher
Institute of Electrical and Electronics Engineers Inc.Source
2009 European Control Conference, ECC 20092009 European Control Conference, ECC 2009
Pages
1185-1190Google Scholar check
Keyword(s):
Metadata
Show full item recordAbstract
This paper is concerned with the application of recent results in optimization of stochastic uncertain systems on general abstract spaces, when the uncertain probability measure of the system is described by a ball with respect to the variational norm, centered at the nominal measure having certain radius. The pay-off is a linear functional of the uncertain measure. The maximization of the linear functional over the uncertainty ball is shown to be equivalent to an optimization of a convex combination of L1 and L∞ norms. Further, the maximizing measure is constructed from the family of tilted exponential probability measures. The abstract results are applied to uncertain continuous-time nonlinear stochastic controlled systems, in which the control seeks to minimize a linear functional while the measure seeks to maximize it over the variational norm uncertainty set. By invoking the maximizing measure obtained at the abstract setting, the resulting pay-off which is minimized over the admissible controls is a non-linear functional of the nominal measure. The resulting non-standard optimal control problem is addressed by deriving a new type of principle of optimality, while dynamic programming is employed to derive a generalized Hamilton-Jacobi-Bellman (HJB) equation satisfied by the value function. © 2009 EUCA.
Collections
Cite as
Related items
Showing items related by title, author, creator and subject.
-
Article
Classes of nonlinear partially observable stochastic optimal control problems with explicit optimal control laws
Charalambous, Charalambos D.; Elliott, R. J. (1998)This paper introduces certain nonlinear partially observable stochastic optimal control problems which are equivalent to completely observable control problems with finite-dimensional state space. In some cases the optimal ...
-
Article
Adaptive LQ control with anti-windup augmentation to optimize UAV performance in autonomous soaring applications
Kahveci, N. E.; Ioannou, Petros A.; Mirmirani, M. D. (2008)The performance of a glider can be considerably improved by means of soaring and optimization of its trajectory. Recent advances in the area of static soaring assume known linear glider dynamics and no actuator saturation ...
-
Article
Information Transfer of Control Strategies: Dualities of Stochastic Optimal Control Theory and Feedback Capacity of Information Theory
Charalambous, Charalambos D.; Kourtellaris, C. K.; Tzortzis, I. (2017)The control-coding capacity of stochastic control systems is introduced, and its operational meaning is established using randomized control strategies, which simultaneously control output processes encode information, and ...