Information Transfer of Control Strategies: Dualities of Stochastic Optimal Control Theory and Feedback Capacity of Information Theory
Date
2017Source
IEEE Transactions on Automatic ControlVolume
62Issue
10Pages
5010-5025Google Scholar check
Keyword(s):
Metadata
Show full item recordAbstract
The control-coding capacity of stochastic control systems is introduced, and its operational meaning is established using randomized control strategies, which simultaneously control output processes encode information, and communicate information from control processes to output processes. The control-coding capacity is the analog Shannon's coding-capacity of noisy channels. Furthermore, duality relations to stochastic optimal control problems with deterministic and randomized control strategies are identified including the following. First, extremum problems of stochastic optimal control with directed information payoff are equivalent to feedback capacity problems of information theory, in which the control system act as a communication channel. Second, for Gaussian linear decision models with average quadratic constraints, it is shown that optimal randomized strategies are Gaussian, and decompose into a deterministic part and a random part. The deterministic part is precisely the optimal strategy of the linear quadratic Gaussian stochastic optimal control problem, whereas the random part is the solution of an water-filling information transmission problem that encodes information, which is estimated by a decoder. © 1963-2012 IEEE.
Collections
Cite as
Related items
Showing items related by title, author, creator and subject.
-
Article
LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels
Charalambous, Charalambos D.; Farhadi, A. (2008)This paper is concerned with control of stochastic systems subject to finite communication channel capacity. Necessary conditions for reconstruction and stability of system outputs are derived using the Information ...
-
Article
Information Structures for Feedback Capacity of Channels with Memory and Transmission Cost: Stochastic Optimal Control & Variational Equalities
Kourtellaris, C. K.; Charalambous, Charalambos D. (2017)The Finite Transmission Feedback Information (FTFI) capacity is characterized for any class of channel conditional distributions PBi|Bi-1, Ai and P Bi|Bi-1 i-M, Ai, where M is the memory of the channel, Bi ? {B-1, B0,..., ...
-
Conference Object
Examples of optimal control for nonlinear stochastic control problems with partial information
Charalambous, Charalambos D.; Elliott, Robert J. (IEEE, 1995)Partially observable stochastic optimal control problems are considered. It is shown, via an information state approach and dynamic programming, that several classes of nonlinear systems with non-linearities in the dynamics ...