Yuxin Zhang

Yuxin Zhang

Auto-generated profile, based on publicly available information

Yuxin Zhang

Fudan University, Shanghai, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 July 2025 in Engineering
Verified
Journal Article
Open access
YZYuxin Zhang
Yuxin Zhang
ZLZheng Lin
Zheng Lin
ZCZhe Chen
Zhe Chen
ZFZihan Fang
Zihan Fang
XCXianhao Chen
Xianhao Chen
Yue GaoYue Gao
Yue Gao

3 April 2026 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
ZLZheng Lin
Zheng Lin
YZYuxin Zhang
Yuxin Zhang
ZCZhe Chen
Zhe Chen
ZFZihan Fang
Zihan Fang
Xianhao ChenXianhao Chen
Xianhao Chen
Yue GaoYue Gao
Yue Gao
Recently, large language models (LLMs) have achieved remarkable breakthroughs, revolutionizing the natural language processing domain and beyond. Due to immense parameter sizes, fine-tuning these models with private data for diverse downstream tasks has become mainstream. Though federated learning (FL) offers a promising solution for fine-tuning LLMs without sharing raw data, substantial computing costs hinder its democratization. Moreover, in real-world scenarios, private client devices often possess heterogeneous computing resources, further complicating LLM fine-tuning. To combat these challenges, we propose HSplitLoRA, a heterogeneous parameter-efficient fine-tuning (PEFT) framework built on split learning (SL) and low-rank adaptation (LoRA) fine-tuning, for efficiently fine-tuning LLMs on heterogeneous client devices. HSplitLoRA first identifies important weights based on their contributions to LLM training. It then dynamically configures the decomposition ranks of LoRA adapters for selected weights and determines the model split point according to varying computing budgets of client devices. Finally, a noise-free adapter aggregation mechanism is devised to support heterogeneous adapter aggregation without introducing noise. Extensive experiments demonstrate that HSplitLoRA outperforms state-of-the-art benchmarks in training accuracy and convergence speed.

21 August 2025 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
ZLZheng Lin
Zheng Lin
YZYuxin Zhang
Yuxin Zhang
ZCZhe Chen
Zhe Chen
ZFZihan Fang
Zihan Fang
CWCong Wu
Cong Wu
Jun LuoJun Luo
Jun Luo
Recently, the increasing deployment of LEO satellite systems has enabled various space analytics (e.g., crop and climate monitoring), which heavily relies on the advancements in deep learning (DL). However, the intermittent connectivity between LEO satellites and ground station (GS) significantly hinders the timely transmission of raw data to GS for centralized learning, while the scaled-up DL models hamper distributed learning on resource-constrained LEO satellites. Though split learning (SL) can be a potential solution to these problems by partitioning a model and offloading primary training workload to GS, the labor-intensive labeling process remains an obstacle, with intermittent connectivity and data heterogeneity being other challenges. In this paper, we propose LEO-Split, a semi-supervised (SS) SL design tailored for satellite networks to combat these challenges. Leveraging SS learning to handle (labeled) data scarcity, we construct an auxiliary model to tackle the training failure of the satellite-GS non-contact time. Moreover, we propose a pseudo-labeling algorithm to rectify data imbalances across satellites. Lastly, an adaptive activation interpolation scheme is devised to prevent the overfitting of server-side sub-model training at GS. Extensive experiments with real-world LEO satellite traces (e.g., Starlink) demonstrate that our LEO-Split framework achieves superior performance compared to state-of-the-art benchmarks.

6 November 2025 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
YZYuxin Zhang
Yuxin Zhang
ZCZhe Chen
Zhe Chen
XHXuanjie Hu
Xuanjie Hu
JZJin Zhao
Jin Zhao
Yue GaoYue Gao
Yue Gao
The rapid deployment of low Earth orbit (LEO) satellite systems has propelled various space-based applications (e.g., agricultural monitoring and disaster response), which increasingly rely on advancements in deep learning (DL). However, ground stations (GS) cannot download such massive raw data for centralized training due to intermittent connectivity between satellites and GS, while the scaled-up DL models pose substantial barriers to distributed training on resource-constrained satellites. Although split learning (SL) has emerged as a promising solution to offload major training workloads to GS via model partitioning while retaining raw data on satellites, limited satellite-GS connectivity and heterogeneity of satellite resources remain substantial barriers. In this paper, we propose S-Leon, an SL framework tailored to tackle these challenges within heterogeneous LEO satellite networks. We develop a satellite early-exit model to eliminate training disruptions during non-contact periods and employ online knowledge distillation to incorporate ground knowledge, further enhancing satellite local training. Moreover, we devise a satellite model customization method that simultaneously accommodates the heterogeneous computation and communication capabilities of individual satellites. Lastly, we develop a partial model-agnostic training strategy to optimize the collaborative training effectiveness across customized satellite models. Extensive experiments with real-world LEO satellite networks demonstrate that S-Leon outperforms state-of-the-art benchmarks.

27 October 2025
Verified
Conference Paper
Open access
YZYuxin Zhang
Yuxin Zhang
JYJiahao Yang
Jiahao Yang
ZCZhe Chen
Zhe Chen
WZWenjun Zhu
Wenjun Zhu
JZJin Zhao
Jin Zhao
Yue GaoYue Gao
Yue Gao

12 August 2024
Verified
Conference Paper
Open access
HCHaoyu Chen
Haoyu Chen
YZYuxin Zhang
Yuxin Zhang
JZJin Zhao
Jin Zhao
XWXin Wang
Xin Wang
YXYuedong Xu
Yuedong Xu
Federated Learning, as an emerging edge artificial intelligence paradigm, enables a group of clients to collaboratively train a global model without revealing their local data. The conventional FL algorithms usually depend on the access to exact gradient or Hessian matrix, which may be inaccessible due to resource limitation or application restriction. Meanwhile, Federated Learning intrinsically suffers from data heterogeneity, which restricts the global model from performing well on each clients’ task. To simultaneously tackle these two challenges, we propose a gradient free personalized federated learning framework, namely pFedZO. We utilize infimal convolution to bridging the gap between personal and global knowledge, and exploit zeroth-order gradient estimator to solve the problem. We theoretically show the local approximation can converge sublinearly and the global problem converge to the neighbourhood of the optimal with a same speed. We further propose pFedZO-Heur to accelerate training procedure. Experimentally, we verify that pFedZO excels at test accuracy with the vanilla Zeroth-Order Optimization (ZOO) based FL by Math 1. We also show pFedZO-Heur can achieve the same performance level with lower time consumption.