Is robustness of stochastic uncertain systems related to information theory and statistical mechanics?
AuthorCharalambous, C. D.
PublisherAffiliation: Department of Electrical and Computer Engineering, University of Cyprus, Nicosia, Cyprus
Affiliation: Department of Mechanical and Manufacturing Engineering, University of Cyprus, Nicosia, Cyprus
Affiliation: School of Information Technology and Engineering, University of Ottawa, 161 Louis Pasteur, A519, Ottawa, Ont. K1N 6N5, Canada
Correspondence Address: Charalambous, C.D.
Department of Electrical and Computer Engineering, University of Cyprus, Nicosia, Cyprus
SourceProceedings of SPIE - The International Society for Optical Engineering
Google Scholar check
MetadataShow full item record
Fifty years ago, when Claude Shannon was developing the Mathematical Theory of Communications, for reliable data transmission, which evolved into the subject of information theory, another discipline was developing dealing with Feedback Control of Dynamical System, which evolved into a scientific subject dealing with decision, stability, and optimization. More recently, a separate discipline dealing with robustness of uncertain systems was born in response to the codification of high performance and reliability in the presence of modeling uncertainties. In principle, robustness in dynamical systems is captured through power dissipation via induced norms and dynamic games, while reliable data transmission is captured through measures of information via entropy, relative entropy, and certain laws of Large Deviations theory. The main ingredient in Large Deviations is the rate functional (or action functional in the classical mechanics terminology), often identified through the Cramer or Legendre-Fenchel Transform. On the other hand, robustness of stochastic uncertain systems is currently under development, using information theoretic as well as statistical mechanics concepts, such as, partition functions, free energy, relative entropy, and entropy rate functional. This lecture will summarize certain connections between fundamental concepts of robustness, information theory, and statistical mechanics, and possibly make future projections into the convergence of these disciplines.
Showing items related by title, author, creator and subject.
Structural controllability and observability of linear systems over finite fields with applications to multi-agent systems Sundaram, S.; Hadjicostis, Christoforos N. (2013)We develop a graph-theoretic characterization of controllability and observability of linear systems over finite fields. Specifically, we show that a linear system will be structurally controllable and observable over a ...
Decentralized fault accommodation of a class of interconnected nonlinear systems using an adaptive approximation approach Panagi, P.; Polycarpou, Marios M. (2009)This paper presents a decentralized adaptive approximation design for the fault tolerant control of interconnected subsystems. We consider faults that occur in the subsystems local dynamics as well as in the interconnection ...
Centralized Versus Decentralized Optimization of Distributed Stochastic Differential Decision Systems with Different Information Structures-Part I: A General Theory Charalambous, Charalambos D.; Ahmed, N. U. (2017)Decentralized optimization of distributed stochastic dynamical systems with two or more controls of the decision makers (DMs) has been an active area of research for over half a century. Although, such decentralized ...