Dongyang Xu

Dongyang Xu

Auto-generated profile, based on publicly available information

Dongyang Xu

Tsinghua University

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 October 2024
Verified
Book Chapter
Closed access
PDF file
ZSZiying Song
Ziying Song
LYLei Yang
Lei Yang
SXShaoqing Xu
Shaoqing Xu
LLLin Liu
Lin Liu
DXDongyang Xu
Dongyang Xu
LWLi Wang
Li Wang

12 May 2025
Verified
Book Chapter
Closed access
PDF file
DXDongyang Xu
Dongyang Xu
QWQingfan Wang
Qingfan Wang
JMJi Ma
Ji Ma
XZXiangyun Zeng
Xiangyun Zeng
LCLei Chen
Lei Chen

19 March 2024 in arXiv
Verified
Preprint
Open access
PDF file
DXDongyang Xu
Dongyang Xu
HLHaokun Li
Haokun Li
QWQingfan Wang
Qingfan Wang
ZSZiying Song
Ziying Song
LCLei Chen
Lei Chen
HDHanming Deng
Hanming Deng
End-to-end autonomous driving has witnessed remarkable progress. However, the extensive deployment of autonomous vehicles has yet to be realized, primarily due to 1) inefficient multi-modal environment perception: how to integrate data from multi-modal sensors more efficiently; 2) non-human-like scene understanding: how to effectively locate and predict critical risky agents in traffic scenarios like an experienced driver. To overcome these challenges, in this paper, we propose a Multi-Modal fusion transformer incorporating Driver Attention (M2DA) for autonomous driving. To better fuse multi-modal data and achieve higher alignment between different modalities, a novel Lidar-Vision-Attention-based Fusion (LVAFusion) module is proposed. By incorporating driver attention, we empower the human-like scene understanding ability to autonomous vehicles to identify crucial areas within complex scenarios precisely and ensure safety. We conduct experiments on the CARLA simulator and achieve state-of-the-art performance with less data in closed-loop benchmarks. Source codes are available at https://anonymous.4open.science/r/M2DA-4772.

24 July 2024 in arXiv
Verified
Preprint
Open access
PDF file
DXDongyang Xu
Dongyang Xu
QWQingfan Wang
Qingfan Wang
JMJi Ma
Ji Ma
XZXiangyun Zeng
Xiangyun Zeng
LCLei Chen
Lei Chen
Accurate driver attention prediction can serve as a critical reference for intelligent vehicles in understanding traffic scenes and making informed driving decisions. Though existing studies on driver attention prediction improved performance by incorporating advanced saliency detection techniques, they overlooked the opportunity to achieve human-inspired prediction by analyzing driving tasks from a cognitive science perspective. During driving, drivers' working memory and long-term memory play crucial roles in scene comprehension and experience retrieval, respectively. Together, they form situational awareness, facilitating drivers to quickly understand the current traffic situation and make optimal decisions based on past driving experiences. To explicitly integrate these two types of memory, this paper proposes an Adaptive Hybrid-Memory-Fusion (AHMF) driver attention prediction model to achieve more human-like predictions. Specifically, the model first encodes information about specific hazardous stimuli in the current scene to form working memories. Then, it adaptively retrieves similar situational experiences from the long-term memory for final prediction. Utilizing domain adaptation techniques, the model performs parallel training across multiple datasets, thereby enriching the accumulated driving experience within the long-term memory module. Compared to existing models, our model demonstrates significant improvements across various metrics on multiple public datasets, proving the effectiveness of integrating hybrid memories in driver attention prediction.