Centralized Versus Decentralized Optimization of Distributed Stochastic Differential Decision Systems with Different Information Structures-Part I: A General Theory
AuthorCharalambous, Charalambos D.
Ahmed, N. U.
SourceIEEE Transactions on Automatic Control
Google Scholar check
MetadataShow full item record
Decentralized optimization of distributed stochastic dynamical systems with two or more controls of the decision makers (DMs) has been an active area of research for over half a century. Although, such decentralized optimization problems are often formulated utilizing static team and person-by-person (PbP) optimality criteria, the corresponding static team theory results have not been extended to dynamical systems. In this first part of the two-part paper, we derive team and PbP optimality conditions for distributed stochastic differential systems, when the controls of the DMs generate actions based on different information structures. The necessary conditions are given by a Hamiltonian System described by coupled backward and forward stochastic differential equations (SDEs) and a conditional Hamiltonian, conditioned on the information structures available to the controls of the DMs. The sufficient conditions state that PbP optimality implies team optimality, if the Hamiltonian is convex in the state and/or actions spaces of the controls of the DMs. We show existence of relaxed team optimal strategies, when the information structures are not affected by the controls of the DMs. Throughout the paper we discuss similarities to analogous optimality conditions of centralized decision or control of stochastic systems, and we note a connections to mean field stochastic optimal control problems. © 1963-2012 IEEE.
Showing items related by title, author, creator and subject.
Centralized Versus Decentralized Optimization of Distributed Stochastic Differential Decision Systems with Different Information Structures-Part II: Applications Charalambous, Charalambos D.; Ahmed, N. U. (2017)In this second part of the two-part paper, a stochastic maximum principle, conditional Hamiltonians and the coupled backward-forward stochastic differential equations (SDEs) of the first part  are employed to derive ...
Ahmed, N. U.; Charalambous, Charalambos D. (2005)This paper considers minimax problems, in which the control minimizes the pay-off induced by a measure which maximizes the pay-off over the class of measures described by a relative entropy set between the uncertain and ...
Team optimality conditions of distributed stochastic differential decision systems with decentralized noisy information structures Charalambous, Charalambos D.; Ahmed, N. U. (2017)A team problem formulation of distributed stochastic differential systems with decentralized noisy information structures is considered, and a stochastic Pontryagin's maximum principle is applied to derive sufficient team ...