Hao Sun

Hao Sun

Auto-generated profile, based on publicly available information

Hao Sun

School of Computer Science, University of Science and Technology of China, Hefei, 230026, Anhui, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 November 2023 in Neural Networks
Verified
Journal Article
Closed access
HSHao Sun
Hao Sun
LSLi Shen
Li Shen
QZQihuang Zhong
Qihuang Zhong
LDLiang Ding
Liang Ding
SCShixiang Chen
Shixiang Chen
DTDacheng Tao
Dacheng Tao

1 August 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YSYan Sun
Yan Sun
LSLi Shen
Li Shen
HSHao Sun
Hao Sun
LDLiang Ding
Liang Ding
DTDacheng Tao
Dacheng Tao
Adaptive optimization has achieved notable success for distributed learning while extending adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, including (i) rugged convergence due to inaccurate gradient estimation in global adaptive optimizer; (ii) client drifts exacerbated by local over-fitting with the local adaptive optimizer. In this work, we propose a novel momentum-based algorithm via utilizing the global gradient descent and locally adaptive amended optimizer to tackle these difficulties. Specifically, we incorporate a locally amended technique to the adaptive optimizer, named Federated Local ADaptive Amended optimizer ( FedLADA ), which estimates the global average offset in the previous communication round and corrects the local offset through a momentum-like term to further improve the empirical training speed and mitigate the heterogeneous over-fitting. Theoretically, we establish the convergence rate of FedLADA with a linear speedup property on the non-convex case under the partial participation settings. Moreover, we conduct extensive experiments on the real-world dataset to demonstrate the efficacy of our proposed FedLADA , which could greatly reduce the communication rounds and achieves higher accuracy than several baselines.