Stochastic minimum principle for partially observed systems subject to continuous and jump diffusion processes and driven by relaxed controls
Date
2013Source
SIAM Journal on Control and OptimizationVolume
51Issue
4Pages
3235-3257Google Scholar check
Keyword(s):
Metadata
Show full item recordAbstract
In this paper, we consider nonconvex control problems of stochastic differential equations driven by relaxed controls adapted, in the weak star sense, to a current of sigma algebras generated by observable processes. We cover in a unified way both continuous diffusion and jump processes. We present existence of optimal controls before we construct the necessary conditions of optimality (unlike some papers in this area) using only functional analysis. We develop a stochastic Hamiltonian system of equations on a rigorous basis using the semimartingale representation theory and the Riesz representation theorem, leading naturally to the existence of the adjoint process which satisfies a backward stochastic differential equation. In other words, our approach predicts the existence of the adjoint process as a natural consequence of Riesz representation theory ensuring at the same time the (weak star) measurability. This is unlike other papers, where the adjoint process is introduced before its existence is proved. We believe this is one of our major contributions in this paper. We also discuss the realizability of relaxed controls by regular controls using the Krein- Millman theorem. We believe this is another major contribution of this paper. We also believe that our approach is direct and easy to understand following simply the precise logic of functional analysis. © 2013 Society for Industrial and Applied Mathematics.
Collections
Cite as
Related items
Showing items related by title, author, creator and subject.
-
Conference Object
A scalable iterative convex design for nonlinear systems
Baldi, S.; Ioannou, Petros A.; Kosmatopoulos, E. B. (2012)A recently developed control scheme for approximately optimal control of nonlinear systems is the so-called Convex Control Design (ConvCD) methodology, that transforms the control problem of generic nonlinear systems into ...
-
Article
Multiple model adaptive control with mixing
Kuipers, M.; Ioannou, Petros A. (2010)Despite the remarkable theoretical accomplishments and successful applications of adaptive control, the field is not sufficiently mature to solve challenging control problems where strict performance and robustness guarantees ...
-
Article
Convex design control for practical nonlinear systems
Baldi, S.; Michailidis, I.; Kosmatopoulos, E. B.; Papachristodoulou, A.; Ioannou, Petros A. (2014)This paper describes a new control scheme for approximately optimal control (AOC) of nonlinear systems, convex control design (ConvCD). The key idea of ConvCD is to transform the approximate optimal control problem into a ...