Weiduo Chen

Weiduo Chen

Auto-generated profile, based on publicly available information

Weiduo Chen

School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 April 2021 in The Journal of Supercomputing
Verified
Journal Article
Closed access
PDF file
WCWeiduo Chen
Weiduo Chen
XDXiaoshe Dong
Xiaoshe Dong
HCHeng Chen
Heng Chen
QWQiang Wang
Qiang Wang
XYXingda Yu
Xingda Yu
XZXingjun Zhang
Xingjun Zhang

20 March 2025 in ACM Transactions on Architecture and Code Optimization
Verified
Journal Article
Open access
WCWeiduo Chen
Weiduo Chen
XDXiaoshe Dong
Xiaoshe Dong
FZFan Zhang
Fan Zhang
BLBowen Li
Bowen Li
YWYufei Wang
Yufei Wang
QWQiang Wang
Qiang Wang
Due to the limited GPU memory, the performance of large DNNs training is constrained by the unscalable batch size. Existing studies partially address the issue of GPU memory limit through tensor recomputation and swapping, but overlook the exploration of optimal performance. In response, we propose ATP, a recomputation and swapping based GPU memory management framework that aims to maximize training performance by breaking GPU memory constraints. ATP utilizes a throughput model and we propose to evaluate the theoretical peak performance achievable by DNN training on GPU, and provide the optimum memory size required for recomputation and swapping. We optimize the mechanisms for GPU memory pool and CUDA stream control, employ an optimization method to search for specific tensors requiring recomputation and swapping, thereby bringing the actual DNN training performance on ATP closer to theoretical values. Evaluations with different types of large DNN models indicate that ATP achieve throughput improvements ranging from 1.14∼ 1.49×, while support model training exceeding the GPU memory limit by up to 9.2×.

1 November 2023 in Future Generation Computer Systems
Verified
Journal Article
Closed access
WCWeiduo Chen
Weiduo Chen
XDXiaoshe Dong
Xiaoshe Dong
XCXinhang Chen
Xinhang Chen
SLSong Liu
Song Liu
QXQin Xia
Qin Xia
QWQiang Wang
Qiang Wang

31 May 2024 in Future Generation Computer Systems
Verified
Journal Article
Closed access
BLBowen Li
Bowen Li
XDXiaoshe Dong
Xiaoshe Dong
JMJue Mi
Jue Mi
YWYufei Wang
Yufei Wang
LWLongxiang Wang
Longxiang Wang
WCWeiduo Chen
Weiduo Chen

12 August 2025 in Future Generation Computer Systems
Verified
Journal Article
Closed access
WCWeiduo Chen
Weiduo Chen
XDXiaoshe Dong
Xiaoshe Dong
QWQiang Wang
Qiang Wang