Centralized Versus Decentralized Optimization of Distributed Stochastic Differential Decision Systems with Different Information Structures-Part I: A General Theory
Date
2017Source
IEEE Transactions on Automatic ControlVolume
62Issue
3Pages
1194-1209Google Scholar check
Keyword(s):
Metadata
Show full item recordAbstract
Decentralized optimization of distributed stochastic dynamical systems with two or more controls of the decision makers (DMs) has been an active area of research for over half a century. Although, such decentralized optimization problems are often formulated utilizing static team and person-by-person (PbP) optimality criteria, the corresponding static team theory results have not been extended to dynamical systems. In this first part of the two-part paper, we derive team and PbP optimality conditions for distributed stochastic differential systems, when the controls of the DMs generate actions based on different information structures. The necessary conditions are given by a Hamiltonian System described by coupled backward and forward stochastic differential equations (SDEs) and a conditional Hamiltonian, conditioned on the information structures available to the controls of the DMs. The sufficient conditions state that PbP optimality implies team optimality, if the Hamiltonian is convex in the state and/or actions spaces of the controls of the DMs. We show existence of relaxed team optimal strategies, when the information structures are not affected by the controls of the DMs. Throughout the paper we discuss similarities to analogous optimality conditions of centralized decision or control of stochastic systems, and we note a connections to mean field stochastic optimal control problems. © 1963-2012 IEEE.
Collections
Cite as
Related items
Showing items related by title, author, creator and subject.
-
Article
Centralized Versus Decentralized Optimization of Distributed Stochastic Differential Decision Systems with Different Information Structures-Part II: Applications
Charalambous, Charalambos D.; Ahmed, N. U. (2017)In this second part of the two-part paper, a stochastic maximum principle, conditional Hamiltonians and the coupled backward-forward stochastic differential equations (SDEs) of the first part [1] are employed to derive ...
-
Article
A deductive approach to the solution of the problem of optimal pairs trading from the viewpoint of stochastic control with time-dependent parameters
Charalambous, Kyriakos; Sophocleous, Christodoulos; O'Hara, John G.; Leach, Peter G. L. (2015)In a fairly recent paper (2008 American Control Conference, June 11-13, 1035-1039), the problem of dealing with trading in optimal pairs was treated from the viewpoint of stochastic control. The analysis of the subsequent ...
-
Conference Object
Optimization of fully observable nonlinear stochastic uncertain controlled diffusion: Monotonicity properties and optimal sensitivity
Rezaei, F.; Charalambous, Charalambos D.; Kyprianou, Andreas (2004)This paper is concerned with fully observable nonlinear stochastically controlled diffusions, in which uncertainty is described by a relative entropy constraint between the nominal measure and the uncertain measure, while ...