Information Structures for Feedback Capacity of Channels with Memory and Transmission Cost: Stochastic Optimal Control & Variational Equalities
dc.contributor.author | Kourtellaris, C. K. | en |
dc.contributor.author | Charalambous, Charalambos D. | en |
dc.creator | Kourtellaris, C. K. | en |
dc.creator | Charalambous, Charalambos D. | en |
dc.date.accessioned | 2019-04-08T07:46:33Z | |
dc.date.available | 2019-04-08T07:46:33Z | |
dc.date.issued | 2017 | |
dc.identifier.uri | http://gnosis.library.ucy.ac.cy/handle/7/43853 | |
dc.description.abstract | The Finite Transmission Feedback Information (FTFI) capacity is characterized for any class of channel conditional distributions PBi|Bi-1, Ai and P Bi|Bi-1 i-M, Ai, where M is the memory of the channel, Bi ? {B-1, B0,..., Bi} are the channel outputs and Ai ? {A0, A1,...,Ai}, for i=0,...,n. The characterizations of FTFI capacity, are obtained by first identifying the information structures of the optimal channel input conditional distributions P[0,n] ? {P Ai|Ai-1, Bi-1 : i=0,...,n}, which maximize directed information C FB An?Bn ? sup p[0,n] I(An ? Bn), I(An ? Bn) ? n?i=0 I(Ai;Bi|Bi-1).. The main theorem states that, for any channel with memory M, the optimal channel input conditional distributions occur in the subset satisfying conditional independence P[0,n] ? {P Ai|A i-1, Bi-1 = P Ai|Bi-1 i-M : i = 1,...,n}, and the characterization of FTFI capacity is given by C F B, M An?Bn ? sup p[0,n] n?i=0 I(Ai;Bi|Bi-1 i-M). Similar conclusions are derived for problems with average cost constraints of the form 1/n+1 E {c0,n(An, Bn-1)} = k, k > 0, for specific functions c0,n( a n, b n-1).The feedback capacity is addressed by investigating lim n?8 1/n+1 CF B, M An?Bn. The methodology utilizes stochastic optimal control theory, to identify the control process, the controlled process, and often a variational equality of directed information, to derive upper bounds on I(An ? Bn), which are achievable over specific subsets of channel input conditional distributions P[0,n], which are characterized by conditional independence. The main results illustrate a direct analogy, in terms of conditional independence, of the characterizations of FTFI capacity and Shannon’s capacity formulae of Memoryless Channels. An example is presented to illustrate the role of optimal channel input process in the derivations of the direct and converse coding theorems. IEEE | en |
dc.source | IEEE Transactions on Information Theory | en |
dc.source.uri | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85040052183&doi=10.1109%2fTIT.2017.2786551&partnerID=40&md5=69fc21ce6fb46b5580bd348da9406c67 | |
dc.subject | Feedback | en |
dc.subject | Stochastic control systems | en |
dc.subject | Stochastic systems | en |
dc.subject | Information structures | en |
dc.subject | Directed information | en |
dc.subject | Conditional distribution | en |
dc.subject | Feed back information | en |
dc.subject | Process control | en |
dc.subject | Channel capacity | en |
dc.subject | Decoding | en |
dc.subject | Encoding | en |
dc.subject | Stochastic optimal control | en |
dc.subject | Encoding (symbols) | en |
dc.subject | Characterization | en |
dc.subject | Conditional independences | en |
dc.subject | Manganese | en |
dc.subject | Space stations | en |
dc.subject | Structural optimization | en |
dc.subject | Upper bound | en |
dc.subject | Variational equalities | en |
dc.title | Information Structures for Feedback Capacity of Channels with Memory and Transmission Cost: Stochastic Optimal Control & Variational Equalities | en |
dc.type | info:eu-repo/semantics/article | |
dc.identifier.doi | 10.1109/TIT.2017.2786551 | |
dc.description.issue | Journal Article | en |
dc.author.faculty | Πολυτεχνική Σχολή / Faculty of Engineering | |
dc.author.department | Τμήμα Ηλεκτρολόγων Μηχανικών και Μηχανικών Υπολογιστών / Department of Electrical and Computer Engineering | |
dc.type.uhtype | Article | en |
dc.source.abbreviation | IEEE Trans.Inf.Theory | en |
dc.contributor.orcid | Charalambous, Charalambos D. [0000-0002-2168-0231] | |
dc.gnosis.orcid | 0000-0002-2168-0231 |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |