Stochastic minimum principle for partially observed systems subject to continuous and jump diffusion processes and driven by relaxed controls
AuthorAhmed, N. U.
Charalambous, Charalambos D.
SourceSIAM Journal on Control and Optimization
Google Scholar check
MetadataShow full item record
In this paper, we consider nonconvex control problems of stochastic differential equations driven by relaxed controls adapted, in the weak star sense, to a current of sigma algebras generated by observable processes. We cover in a unified way both continuous diffusion and jump processes. We present existence of optimal controls before we construct the necessary conditions of optimality (unlike some papers in this area) using only functional analysis. We develop a stochastic Hamiltonian system of equations on a rigorous basis using the semimartingale representation theory and the Riesz representation theorem, leading naturally to the existence of the adjoint process which satisfies a backward stochastic differential equation. In other words, our approach predicts the existence of the adjoint process as a natural consequence of Riesz representation theory ensuring at the same time the (weak star) measurability. This is unlike other papers, where the adjoint process is introduced before its existence is proved. We believe this is one of our major contributions in this paper. We also discuss the realizability of relaxed controls by regular controls using the Krein- Millman theorem. We believe this is another major contribution of this paper. We also believe that our approach is direct and easy to understand following simply the precise logic of functional analysis. © 2013 Society for Industrial and Applied Mathematics.
Showing items related by title, author, creator and subject.
Decentralized fault accommodation of a class of interconnected nonlinear systems using an adaptive approximation approach Panagi, P.; Polycarpou, Marios M. (2009)This paper presents a decentralized adaptive approximation design for the fault tolerant control of interconnected subsystems. We consider faults that occur in the subsystems local dynamics as well as in the interconnection ...
Olama, M. M.; Shajaat, S. M.; Djouadi, S. M.; Charalambous, Charalambos D. (2005)The performance of stochastic optimal power control of time-varying wireless short-term flat fading channels, in which the evolution of the dynamical channel is described by a stochastic state space representation, is ...
Infinite horizon average cost dynamic programming subject to ambiguity on conditional distribution Tzortzis, I.; Charalambous, Charalambos D.; Charalambous, T. (Institute of Electrical and Electronics Engineers Inc., 2015)This paper addresses the optimality of stochastic control strategies based on the infinite horizon average cost criterion, subject to total variation distance ambiguity on the conditional distribution of the controlled ...