dc.contributor.author | Charalambous, Charalambos D. | en |
dc.contributor.author | Kourtellaris, C. K. | en |
dc.contributor.author | Hadjicostis, Christoforos N. | en |
dc.creator | Charalambous, Charalambos D. | en |
dc.creator | Kourtellaris, C. K. | en |
dc.creator | Hadjicostis, Christoforos N. | en |
dc.date.accessioned | 2019-04-08T07:45:16Z | |
dc.date.available | 2019-04-08T07:45:16Z | |
dc.date.issued | 2010 | |
dc.identifier.isbn | 978-1-4244-8214-6 | |
dc.identifier.uri | http://gnosis.library.ucy.ac.cy/handle/7/43088 | |
dc.description.abstract | This paper is concerned with capacity formulae for channels with memory and feedback, properties of the capacity achieving encoder, and dynamic programming for designing optimal encoders. The source is general and the techniques discussed include outputs of dynamic systems whose conditional probability distribution depends causally on the channel output and encoder law. First, encoder strategies are identified to maximize directed information, between the source and the channel output. Second, various definitions of information capacity are introduced via directed information, and converse coding theorems are derived. Encoder properties which lead to a tight upper bound on achievable rates are identified. Specifically, it is shown that channel inputs need to be independent of past channel outputs. Third, the form of the capacity achieving encoder is described. The encoder law is a functional of the a posteriori distribution of the source output given a sequence of observable channel outputs. Here a generalization of the Posterior Matching Scheme to channels with memory and feedback is shown to hold. Finally, dynamic programming is discussed, identifying analogies with optimal stochastic control under partial information. ©2010 IEEE. | en |
dc.source | 2010 48th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2010 | en |
dc.source | 2010 48th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2010 | en |
dc.source.uri | https://www.scopus.com/inward/record.uri?eid=2-s2.0-79952383240&doi=10.1109%2fALLERTON.2010.5707084&partnerID=40&md5=2c4e4eea6e55b492de3fdff92218cd34 | |
dc.subject | Optimization | en |
dc.subject | Dynamic programming | en |
dc.subject | Channel output | en |
dc.subject | Channels with memory | en |
dc.subject | Directed information | en |
dc.subject | Matching scheme | en |
dc.subject | Achievable rate | en |
dc.subject | Channel inputs | en |
dc.subject | Coding theorems | en |
dc.subject | Conditional probability distributions | en |
dc.subject | Dynamic systems | en |
dc.subject | Information capacities | en |
dc.subject | Optical communication | en |
dc.subject | Optimal stochastic control | en |
dc.subject | Partial information | en |
dc.subject | Posteriori distribution | en |
dc.subject | Probability distributions | en |
dc.subject | Upper bound | en |
dc.title | Capacity of channels with memory and feedback: Encoder properties and dynamic programming | en |
dc.type | info:eu-repo/semantics/conferenceObject | |
dc.identifier.doi | 10.1109/ALLERTON.2010.5707084 | |
dc.description.startingpage | 1450 | |
dc.description.endingpage | 1457 | |
dc.author.faculty | Πολυτεχνική Σχολή / Faculty of Engineering | |
dc.author.department | Τμήμα Ηλεκτρολόγων Μηχανικών και Μηχανικών Υπολογιστών / Department of Electrical and Computer Engineering | |
dc.type.uhtype | Conference Object | en |
dc.contributor.orcid | Hadjicostis, Christoforos N. [0000-0002-1706-708X] | |
dc.contributor.orcid | Charalambous, Charalambos D. [0000-0002-2168-0231] | |
dc.gnosis.orcid | 0000-0002-1706-708X | |
dc.gnosis.orcid | 0000-0002-2168-0231 | |