6 January 2024 in Autonomous Agents and Multi-Agent Systems
Communication is an effective mechanism for coordinating the behaviors of multiple agents, broadening their views of the environment, and to support their collaborations. In the field of multi-agent deep reinforcement learning (MADRL), agents can improve the overall learning performance and achieve their objectives by communication. Agents can communicate various types of messages, either to all agents or to specific agent groups, or conditioned on specific constraints. With the growing body of research work in MADRL with communication (Comm-MADRL), there is a lack of a systematic and structural approach to distinguish and classify existing Comm-MADRL approaches. In this paper, we survey recent works in the Comm-MADRL field and consider various aspects of communication that can play a role in designing and developing multi-agent reinforcement learning systems. With these aspects in mind, we propose 9 dimensions along which Comm-MADRL approaches can be analyzed, developed, and compared. By projecting existing works into the multi-dimensional space, we discover interesting trends. We also propose some novel directions for designing future Comm-MADRL systems through exploring possible combinations of the dimensions.
16 March 2024 in Autonomous Agents and Multi-Agent Systems
Guideline of Comm-MADRL systems. The guideline positions dimensions where communication influences interaction with the environment and training phases.
3 March 2021 in IEEE Transactions on Affective Computing
Aspect level sentiment classification aims to classify the sentiment polarity of a given aspect term or aspect category in a sentence. For sentiment classification towards a given aspect term, since a sentence may contain more than one aspect term, there may exist some opinions which are not the modifiers of the given aspect term. It is necessary to capture relevant opinion for a certain aspect term. Previous works use the relative distance between an aspect term and all other words in a sentence, in order to capture the nearest opinion of the aspect term. This can be infeasible when the sentence has a complex syntactic structure. In this paper, we detect the dependency relation between an aspect term and its related sentiment words in the dependency parse tree. Then, we integrate this relationship into CNN and Bi-LSTM respectively. Experiments show that the related sentiment features for an aspect term is helpful for models to discriminate its sentiment polarity, and our proposed models achieve state-of-the-art results among neural network models.
14 May 2025 in Neural Computing and Applications
In multi-agent deep reinforcement learning (MADRL), agents can learn to communicate to broaden their view and understanding of the environment and their teammates. Previous works on communication in MADRL mainly rely on centralized or independent value functions for learning communication, which cannot differentiate how communicating agents individually contribute to the overall learning process. Moreover, continuous environments that incorporate continuous state/action spaces have received limited attention in previous research. In this paper, we propose a novel architecture for communicating agents and apply centralized but factorized value functions to differentiate how each agent contributes to learning during communication, along with gradient backpropagation. Additionally, to address the complexity introduced by communication, we investigate the use of an attention mechanism that aggregates messages, enabling policies to maintain a fixed input length. We then present a new policy gradient method termed communication with factorized policy gradients (CFPG), featuring full backpropagation from factorized value functions to communicating agents’ architecture. We demonstrate that CFPG can enhance performance and accelerate learning in continuous predator–prey scenarios and multi-agent MuJoCo, when compared to other learning communication methods.
29 December 2022 in Autonomous Agents and Multi-Agent Systems