Browsing by Subject "Directed information"
Now showing items 1-17 of 17
-
Conference Object
Capacity of channels with memory and feedback: Encoder properties and dynamic programming
(2010)This paper is concerned with capacity formulae for channels with memory and feedback, properties of the capacity achieving encoder, and dynamic programming for designing optimal encoders. The source is general and the ...
-
Conference Object
Capacity of channels with memory and feedback: Encoder properties and dynamic programming
(2010)This paper is concerned with capacity formulae for channels with memory and feedback, properties of the capacity achieving encoder, and dynamic programming for designing optimal encoders. The source is general and the ...
-
Conference Object
Directed information on abstract spaces: Properties and extremum problems
(2012)This paper describes a framework in which directed information is defined on abstract spaces. The framework is employed to derive properties of directed information such as convexity, concavity, lower semicontinuity, by ...
-
Article
Directed Information on Abstract Spaces: Properties and Variational Equalities
(2016)Directed information or its variants are utilized extensively in the characterization of the capacity of channels with memory and feedback, nonanticipative lossy data compression, and their generalizations to networks. In ...
-
Article
Information Structures for Feedback Capacity of Channels with Memory and Transmission Cost: Stochastic Optimal Control & Variational Equalities
(2017)The Finite Transmission Feedback Information (FTFI) capacity is characterized for any class of channel conditional distributions PBi|Bi-1, Ai and P Bi|Bi-1 i-M, Ai, where M is the memory of the channel, Bi ? {B-1, B0,..., ...
-
Conference Object
Information structures of capacity achieving distribution for channels with memory and feedback
(Institute of Electrical and Electronics Engineers Inc., 2016)The information structures of the optimal channel input distributions P[0,n] t {PAi|Ai-1,Bi-1 : i = 0,1.,n}, which correspond to the extremum problem of feedback capacity equation are identified, for any class of channel ...
-
Article
Information Transfer of Control Strategies: Dualities of Stochastic Optimal Control Theory and Feedback Capacity of Information Theory
(2017)The control-coding capacity of stochastic control systems is introduced, and its operational meaning is established using randomized control strategies, which simultaneously control output processes encode information, and ...
-
Conference Object
On the relation of nonanticipative rate distortion function and filtering theory
(2013)In this paper the relation between nonanticipative rate distortion function (RDF) and Bayesian filtering theory is investigated using the topology of weak convergence of probability measures on Polish spaces. The relation ...
-
Conference Object
Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback
(2011)This paper is concerned with the joint design of encoder/control strategies which minimize a control payoff subject to a rate constraint on the feedback information provided by the system. The control system is described ...
-
Conference Object
Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback
(2011)This paper is concerned with the joint design of encoder/control strategies which minimize a control payoff subject to a rate constraint on the feedback information provided by the system. The control system is described ...
-
Conference Object
Optimal encoders maximizing directed information of channels with memory and feedback: Stochastic control and dynamic programming
(2011)This paper is concerned with the stochastic control formulation of the capacity of channel with memory and feedback. The pay-off is the directed information from the source sequence to the channel output sequence, while ...
-
Conference Object
Optimal encoders maximizing directed information of channels with memory and feedback: Stochastic control and dynamic programming
(2011)This paper is concerned with the stochastic control formulation of the capacity of channel with memory and feedback. The pay-off is the directed information from the source sequence to the channel output sequence, while ...
-
Conference Object
Optimization of directed information and relations to filtering theory
(Institute of Electrical and Electronics Engineers Inc., 2014)In this paper we generalize the relation between nonanticipative Rate Distortion Function (RDF) and filtering theory, to processes which are affected by the reproduction process, by utilizing the topology of weak convergence ...
-
Conference Object
Rate distortion function with causal decoding
(2010)This paper considers source coding of general sources with memory, when causal feedback is available at the decoder. The rate distortion function is defined as the infimum of the so-called directed information over causal ...
-
Article
Sequential Necessary and Sufficient Conditions for Capacity Achieving Distributions of Channels with Memory and Feedback
(2017)We derive sequential necessary and sufficient conditions for any channel input conditional distribution P0,n δ {PXt |Xt?1,Yt?1 : T = 0, . . . , n} to maximize the finite-Time horizon directed information defined by CFB ...
-
Conference Object
Stochastic control over finite capacity channels: Causality and feedback
(Institute of Electrical and Electronics Engineers Inc., 2014)Optimal communication/control analysis and design of dynamical controlled systems, when there are finite capacity communication constraints often involve information and control theoretic analysis. This paper, employees ...
-
Conference Object
Variational equalities of directed information and applications
(2013)In this paper we introduce two variational equalities of directed information, which are analogous to those of mutual information employed in the Blahut-Arimoto Algorithm (BAA). Subsequently, we introduce nonanticipative ...