Jianhui Sun

Jianhui Sun

Auto-generated profile, based on publicly available information

Jianhui Sun

Meta Platforms, Inc., Menlo Park, California, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 June 2022 in ACM Transactions on Knowledge Discovery From Data
Verified
Journal Article
Open access
JSJianhui Sun
Jianhui Sun
YYYing Yang
Ying Yang
GXGuangxu Xun
Guangxu Xun
AZAidong Zhang
Aidong Zhang
This paper 1 studies how to schedule hyperparameters to improve generalization of both centralized single-machine stochastic gradient descent (SGD) and distributed asynchronous SGD (ASGD). SGD augmented with momentum variants (e.g., heavy ball momentum (SHB) and Nesterov’s accelerated gradient (NAG)) has been the default optimizer for many tasks, in both centralized and distributed environments. However, many advanced momentum variants, despite empirical advantage over classical SHB/NAG, introduce extra hyperparameters to tune. The error-prone tuning is the main barrier for AutoML. Centralized SGD : We first focus on centralized single-machine SGD and show how to efficiently schedule the hyperparameters of a large class of momentum variants to improve generalization. We propose a unified framework called multistage quasi-hyperbolic momentum (Multistage QHM), which covers a large family of momentum variants as its special cases (e.g. vanilla SGD/SHB/NAG). Existing works mainly focus on only scheduling learning rate α ’s decay, while multistage QHM allows additional varying hyperparameters (e.g., momentum factor), and demonstrates better generalization than only tuning α . We show the convergence of multistage QHM for general nonconvex objectives. Distributed SGD : We then extend our theory to distributed asynchronous SGD (ASGD), in which a parameter server distributes data batches to several worker machines and updates parameters via aggregating batch gradients from workers. We quantify the asynchrony between different workers (i.e., gradient staleness), model the dynamics of asynchronous iterations via a stochastic differential equation (SDE), and then derive a PAC-Bayesian generalization bound for ASGD. As a byproduct, we show how a moderately large learning rate helps ASGD to generalize better. Our tuning strategies have rigorous justifications rather than a blind trial-and-error as we theoretically prove why our tuning strategies could decrease our derived generalization errors in both cases. Our strategies simplify the tuning process and beat competitive optimizers in test accuracy empirically. Our codes are publicly available https://github.com/jsycsjh/centralized-asynchronous-tuning.

16 February 2023 in Clinical Psychological Science
Verified
Journal Article
Closed access
JEJeremy W. Eberle
Jeremy W. Eberle
Mehdi BoukhechbaMehdi Boukhechba
Mehdi Boukhechba
JSJianhui Sun
Jianhui Sun
DZDiheng Zhang
Diheng Zhang
DFDaniel H. Funk
Daniel H. Funk
BTBethany A. Teachman
Bethany A. Teachman
Negative future thinking pervades emotional disorders. This hybrid efficacy–effectiveness trial tested a four-session, scalable online cognitive-bias-modification program for training more positive episodic prediction. Nine hundred fifty-eight adults (73.3% female, 86.5% White, 83.4% from United States) were randomly assigned to positive conditions with ambiguous future scenarios that ended positively, 50/50 conditions that ended positively or negatively, or a control condition with neutral scenarios. As hypothesized (preregistration: https://osf.io/jrst6 ), positive-training participants improved more than control participants in negative expectancy bias ( d = −0.58), positive expectancy bias ( d = 0.80), and self-efficacy ( d = 0.29). Positive training was also superior to 50/50 training for expectancy bias and optimism ( d = 0.31). Training gains attenuated yet remained by 1-month follow-up. Unexpectedly, participants across conditions improved comparably in anxiety and depression symptoms and growth mindset. Targeting a transdiagnostic process with a scalable program may improve bias and outlook; however, further validation of outcome measures is required.

4 August 2023
Verified
Conference Paper
Open access
JSJianhui Sun
Jianhui Sun
SSSanchit Sinha
Sanchit Sinha
AZAidong Zhang
Aidong Zhang

8 August 2026
Verified
Conference Paper
Open access
QDQin Ding
Qin Ding
KCKevin Course
Kevin Course
LMLinjian Ma
Linjian Ma
JSJianhui Sun
Jianhui Sun
RLRuochen Liu
Ruochen Liu
RLRui Li
Rui Li

27 September 2026
Verified
Conference Paper
Open access
GLGuo Liang
Guo Liang
GSGe Song
Ge Song
LDLitao Deng
Litao Deng
JSJianhui Sun
Jianhui Sun
CHChufeng Hu
Chufeng Hu
XMXiaoxuan Meng
Xiaoxuan Meng