Ao Ma

Dr. Ao Ma


Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 October 2025 in Electronics
Verified
Journal Article
Open access
PDF file
AMAo Ma
Ao Ma
PLPeng Li
Peng Li
XSXiaolong Su
Xiaolong Su
Offline reinforcement learning suffers from critical vulnerability to data corruption from sensor noise or adversarial attacks. Recent research has achieved a lot by downweighting corrupted samples and fixing the corrupted data, while data corruption induces feature entanglement that undermines policy robustness. Existing methods fail to identify causal features behind performance degradation caused by corruption. To analyze causal relationships in corrupted data, we propose a method, Robust Causal Feature Disentanglement(RCFD). Our method introduces a learnable causal feature disentanglement mechanism specifically designed for reinforcement learning scenarios, integrating the CausalVAE framework to disentangle causal features governing environmental dynamics from corruption-sensitive non-causal features. Theoretically, this disentanglement confers a robustness advantage under data corruption conditions. Concurrently, causality-preserving perturbation training injects Gaussian noise solely into non-causal features to generate counterfactual samples and is enhanced by dual-path feature alignment and contrastive learning for representation invariance. A dynamic graph diagnostic module further employs graph convolutional attention networks to model spatiotemporal relationships and identify corrupted edges through structural consistency analysis, enabling precise data repair. The results exhibit highly robust performance across D4rl benchmarks under diverse data corruption conditions. This confirms that causal feature invariance helps bridge distributional gaps, promoting reliable deployment in complex real-world settings.

8 May 2026 in Complex & Intelligent Systems
Verified
Journal Article
Open access
PDF file
AMAo Ma
Ao Ma
PLPeng Li
Peng Li
JCJiaxing Chen
Jiaxing Chen
XSXiaolong Su
Xiaolong Su
SCShaofei Chen
Shaofei Chen
Traditional reinforcement learning (RL) methods typically assume complete observation data, but real-world scenarios are often far more complex. Real-world deployments face missing data where part of the state dimensions become unavailable due to sensor failures, communication blackouts, or temporal sampling discontinuities. While recent research has achieved significant progress in handling missing data scenarios, current methodologies remain fundamentally constrained by their inability to effectively manage prolonged observation gaps and their low tolerance thresholds for high missing rates. In this work, we investigate the performance of reinforcement learning under the condition of missing data. We introduce a novel method, Mutual Information Aligned Generative Reinforcement Learning(MIA-GRL), which employs a spatiotemporal collaborative reconstruction to learn from historical reinforcement learning trajectories. This method synthesizes trajectories that encapsulate environmental characteristics and diversity through contextual information. We design an auxiliary loss function based on mutual information maximization, aiming to maximize the mutual information between the completed data and the original data, thereby ensuring that the completed data retains as much critical information from the original data as possible. Additionally, we utilize missing-aware contrastive learning to learn representations robust to missing patterns, enabling the policy network to capture intrinsic features relevant to the task. Experiments show our method outperforms state-of-the-art methods under the missing data conditions.