1 March 1993 in SIAM Journal on Control and Optimization
EFEmmanuel Fernández-Gaucherand
Emmanuel Fernández-Gaucherand
This work is a survey of the average cost control problem for discrete-time Markov processes. The authors have attempted to put together a comprehensive account of the considerable research on this problem over the past three decades. The exposition ranges from finite to Borel state and action spaces and includes a variety of methodologies to find and characterize optimal policies. The authors have included a brief historical perspective of the research efforts in this area and have compiled a substantial yet not exhaustive bibliography. The authors have also identified several important questions that are still open to investigation.
1 May 1989 in Journal of Guidance, Control, and Dynamics
29 October 2007 in IEEE Transactions on Information Theory
This correspondence is motivated by two different scenarios. The first is a cognitive radio system where a cognitive radio knows a ldquodumbrdquo radio's message and the second is a sensor network in a correlated field where sensors possessing a nested message structure assist one another's information transmission. Both scenarios are modeled using the framework of discrete memoryless interference channels with degraded message sets (IFC-DMS), a setting where one of the two transmitters in an interference channel knows both the messages to be conveyed to the receivers. Both inner and outer bounds are provided for a class of IFC-DMS channels. The case of the Gaussian interference channels with degraded message sets is also investigated. In this case, achievability and converse arguments are presented for a class of ldquoweakrdquo interference channels, resulting in a characterization of this class' capacity region.
1 October 1985 in IEEE Transactions on Circuits and Systems
1 November 1997 in SIAM Journal on Control and Optimization
We study the ergodic control problem of switching diffusions representing a typical hybrid system that arises in numerous applications such as fault-tolerant control systems, flexible manufacturing systems, etc. Under fairly general conditions, we establish the existence of a stable, nonrandomized Markov policy which almost surely minimizes the pathwise long-run average cost. We then study the corresponding Hamilton--Jacobi--Bellman (HJB) equation and establish the existence of a unique solution in a certain class. Using this, we characterize the optimal policy as a minimizing selector of the Hamiltonian associated with the HJB equations. As an example we apply the results to a failure-prone manufacturing system and obtain closed form solutions for the optimal policy.