Changxi Zhu

Changxi Zhu

Auto-generated profile, based on publicly available information

Changxi Zhu

Department of Information and Computing Sciences Utrecht University Utrecht Netherlands

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 January 2024 in Autonomous Agents and Multi-Agent Systems
Verified
Journal Article
Open access
PDF file
CZChangxi Zhu
Changxi Zhu
MDMehdi Dastani
Mehdi Dastani
SWShihan Wang
Shihan Wang
Communication is an effective mechanism for coordinating the behaviors of multiple agents, broadening their views of the environment, and to support their collaborations. In the field of multi-agent deep reinforcement learning (MADRL), agents can improve the overall learning performance and achieve their objectives by communication. Agents can communicate various types of messages, either to all agents or to specific agent groups, or conditioned on specific constraints. With the growing body of research work in MADRL with communication (Comm-MADRL), there is a lack of a systematic and structural approach to distinguish and classify existing Comm-MADRL approaches. In this paper, we survey recent works in the Comm-MADRL field and consider various aspects of communication that can play a role in designing and developing multi-agent reinforcement learning systems. With these aspects in mind, we propose 9 dimensions along which Comm-MADRL approaches can be analyzed, developed, and compared. By projecting existing works into the multi-dimensional space, we discover interesting trends. We also propose some novel directions for designing future Comm-MADRL systems through exploring possible combinations of the dimensions.

16 March 2024 in Autonomous Agents and Multi-Agent Systems
Verified
Journal Article
Open access
PDF file
CZChangxi Zhu
Changxi Zhu
MDMehdi Dastani
Mehdi Dastani
SWShihan Wang
Shihan Wang
Guideline of Comm-MADRL systems. The guideline positions dimensions where communication influences interaction with the environment and training phases.

3 March 2021 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
XZXing Zhang
Xing Zhang
JXJingyun Xu
Jingyun Xu
YCYi Cai
Yi Cai
XTXingwei Tan
Xingwei Tan
CZChangxi Zhu
Changxi Zhu
Aspect level sentiment classification aims to classify the sentiment polarity of a given aspect term or aspect category in a sentence. For sentiment classification towards a given aspect term, since a sentence may contain more than one aspect term, there may exist some opinions which are not the modifiers of the given aspect term. It is necessary to capture relevant opinion for a certain aspect term. Previous works use the relative distance between an aspect term and all other words in a sentence, in order to capture the nearest opinion of the aspect term. This can be infeasible when the sentence has a complex syntactic structure. In this paper, we detect the dependency relation between an aspect term and its related sentiment words in the dependency parse tree. Then, we integrate this relationship into CNN and Bi-LSTM respectively. Experiments show that the related sentiment features for an aspect term is helpful for models to discriminate its sentiment polarity, and our proposed models achieve state-of-the-art results among neural network models.

14 May 2025 in Neural Computing and Applications
Verified
Journal Article
Open access
PDF file
CZChangxi Zhu
Changxi Zhu
MDMehdi Dastani
Mehdi Dastani
SWShihan Wang
Shihan Wang
In multi-agent deep reinforcement learning (MADRL), agents can learn to communicate to broaden their view and understanding of the environment and their teammates. Previous works on communication in MADRL mainly rely on centralized or independent value functions for learning communication, which cannot differentiate how communicating agents individually contribute to the overall learning process. Moreover, continuous environments that incorporate continuous state/action spaces have received limited attention in previous research. In this paper, we propose a novel architecture for communicating agents and apply centralized but factorized value functions to differentiate how each agent contributes to learning during communication, along with gradient backpropagation. Additionally, to address the complexity introduced by communication, we investigate the use of an attention mechanism that aggregates messages, enabling policies to maintain a fixed input length. We then present a new policy gradient method termed communication with factorized policy gradients (CFPG), featuring full backpropagation from factorized value functions to communicating agents’ architecture. We demonstrate that CFPG can enhance performance and accelerate learning in continuous predator–prey scenarios and multi-agent MuJoCo, when compared to other learning communication methods.

29 December 2022 in Autonomous Agents and Multi-Agent Systems
Verified
Journal Article
Closed access
PDF file
CZChangxi Zhu
Changxi Zhu
YCYi Cai
Yi Cai
SHShuyue Hu
Shuyue Hu
HLHo-Fung Leung
Ho-Fung Leung
DCDickson K. W. Chiu
Dickson K. W. Chiu

6 November 2025 in arXiv
Verified
Preprint
Open access
PDF file
CZChangxi Zhu
Changxi Zhu
MDMehdi Dastani
Mehdi Dastani
SWShihan Wang
Shihan Wang
In multi-agent deep reinforcement learning (MADRL), agents can communicate with one another to perform a task in a coordinated manner. When multiple tasks are involved, agents can also leverage knowledge from one task to improve learning in other tasks. In this paper, we propose Multi-task Communication Skills (MCS), a MADRL with communication method that learns and performs multiple tasks simultaneously, with agents interacting through learnable communication protocols. MCS employs a Transformer encoder to encode task-specific observations into a shared message space, capturing shared communication skills among agents. To enhance coordination among agents, we introduce a prediction network that correlates messages with the actions of sender agents in each task. We adapt three multi-agent benchmark environments to multi-task settings, where the number of agents as well as the observation and action spaces vary across tasks. Experimental results demonstrate that MCS achieves better performance than multi-task MADRL baselines without communication, as well as single-task MADRL baselines with and without communication.