Zheng Wei

Zheng Wei

Auto-generated profile, based on publicly available information

Zheng Wei

School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an, China

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 October 2021 in CCF Transactions on High Performance Computing
Verified
Journal Article
Closed access
PDF file
JLJingbo Li
Jingbo Li
XZXingjun Zhang
Xingjun Zhang
ZWZheng Wei
Zheng Wei
JWJia Wei
Jia Wei
ZJZeyu JI
Zeyu JI

12 October 2021 in Scientific Reports
Verified
Journal Article
Open access
PDF file
JWJia Wei
Jia Wei
XZXingjun Zhang
Xingjun Zhang
ZJZeyu JI
Zeyu JI
JLJingbo Li
Jingbo Li
ZWZheng Wei
Zheng Wei
Due to the increase in computing power, it is possible to improve the feature extraction and data fitting capabilities of DNN networks by increasing their depth and model complexity. However, the big data and complex models greatly increase the training overhead of DNN, so accelerating their training process becomes a key task. The Tianhe-3 peak speed is designed to target E-class, and the huge computing power provides a potential opportunity for DNN training. We implement and extend LeNet, AlexNet, VGG, and ResNet model training for a single MT-2000+ and FT-2000+ compute nodes, as well as extended multi-node clusters, and propose an improved gradient synchronization process for Dynamic Allreduce communication optimization strategy for the gradient synchronization process base on the ARM architecture features of the Tianhe-3 prototype, providing experimental data and theoretical basis for further enhancing and improving the performance of the Tianhe-3 prototype in large-scale distributed training of neural networks.

14 December 2023 in ACM Transactions on Architecture and Code Optimization
Verified
Journal Article
Open access
JWJia Wei
Jia Wei
XZXingjun Zhang
Xingjun Zhang
LWLongxiang Wang
Longxiang Wang
ZWZheng Wei
Zheng Wei
In recent years, benefiting from the increase in model size and complexity, deep learning has achieved tremendous success in computer vision (CV) and (NLP). Training deep learning models using accelerators such as GPUs often requires much iterative data to be transferred from NVMe SSD to GPU memory. Much recent work has focused on data transfer during the pre-processing phase and has introduced techniques such as multiprocessing and GPU Direct Storage (GDS) to accelerate it. However, tensor data during training (such as Checkpoints, logs, and intermediate feature maps), which is also time-consuming, is often transferred using traditional serial, long-I/O-path transfer methods. In this article, based on GDS technology, we built Fastensor, an efficient tool for tensor data transfer between the NVMe SSDs and GPUs. To achieve higher tensor data I/O throughput, we optimized the traditional data I/O process. We also proposed a data and runtime context-aware tensor I/O algorithm. Fastensor can select the most suitable data transfer tool for the current tensor from a candidate set of tools during model training. The optimal tool is derived from a dictionary generated by our adaptive exploration algorithm in the first few training iterations. We used Fastensor’s unified interface to test the read/write bandwidth and energy consumption of different transfer tools for different sizes of tensor blocks. We found that the execution efficiency of different tensor transfer tools is related to both the tensor block size and the runtime context. We then deployed Fastensor in the widely applicable Pytorch deep learning framework. We showed that Fastensor could perform superior in typical scenarios of model parameter saving and intermediate feature map transfer with the same hardware configuration. Fastensor achieves a 5.37x read performance improvement compared to torch.save () when used for model parameter saving. When used for intermediate feature map transfer, Fastensor can increase the supported training batch size by 20x, while the total read and write speed is increased by 2.96x compared to the torch I/O API.

21 April 2022 in The Journal of Supercomputing
Verified
Journal Article
Closed access
PDF file
ZJZeyu JI
Zeyu JI
XZXingjun Zhang
Xingjun Zhang
JLJingbo Li
Jingbo Li
JWJia Wei
Jia Wei
ZWZheng Wei
Zheng Wei

1 August 2014
Verified
Conference Paper
Closed access
SCShumei Cui
Shumei Cui
XYXue Yong
Xue Yong
ZTZhao Tianxu
Zhao Tianxu
HSHan Shouliang
Han Shouliang
ZWZheng Wei
Zheng Wei
High-latitude cold climate could have the adverse effects on electric vehicles. This paper studies the effects of low temperature characteristics on the motor for electric vehicles by designs and builds the test platform. This article carries out three studies including starting performance of the motor, operational efficiency of motor, load capacity of motor under high-low temperature environment. Research results show that starting resistant moment, starting current, starting voltage increasing obviously with the decreasing of environment temperature; Motor efficiency is affected by the temperature changing when motor is at low speed (under 1000rpm); The load capacity of motor at rated speed is limited due to low temperatures. Research results of this paper will have a direct guidance and reference for designing and improving motor temperature characteristics.

3 February 2025 in Neural Networks
Verified
Journal Article
Closed access
ZWZheng Wei
Zheng Wei
XZXingjun Zhang
Xingjun Zhang
ZTZhendong Tan
Zhendong Tan