Xueqiong Yuan

Xueqiong Yuan

Auto-generated profile, based on publicly available information

Xueqiong Yuan

Tsinghua Berkeley Shenzhen Institute, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 September 2024 in Digital Signal Processing
Verified
Journal Article
Closed access
XYXueqiong Yuan
Xueqiong Yuan
JLJipeng Li
Jipeng Li
Ercan Engin KuruogluErcan Engin Kuruoglu
Ercan Engin Kuruoglu

5 June 2024 in IEEE Transactions on Artificial Intelligence
Verified
Journal Article
Closed access
JLJipeng Li
Jipeng Li
XYXueqiong Yuan
Xueqiong Yuan
Ercan Engin KuruogluErcan Engin Kuruoglu
Ercan Engin Kuruoglu
The fundamental use of neural networks is in providing a nonlinear mapping between input and output data with possibly a high number of parameters that can be learned from data directly. Consequently, studying the model’s parameters, particularly the weights, is of paramount importance. The distribution and interdependencies of these weights have a direct impact on the model’s generalizability, compressibility, initialization, and convergence speed. By fitting the weights of pretrained neural networks using the α-stable distributions and conducting statistical tests, we discover widespread heavy-tailed phenomena in neural network weights, with a few layers exhibiting asymmetry. Additionally, we employ a multivariate α-stable distribution to model the weights and explore the relationship between weights within and across layers by calculating the signed symmetric covariation coefficient. The results reveal a strong dependence among certain weights. Our findings indicate that the Gaussian assumption, symmetry assumption, and independence assumption commonly used in neural network research might be inconsistent with reality. In conclusion, our research shows three properties observed in neural network weights: heavy-tailed phenomena, asymmetry and dependence on certain weights.

7 October 2025 in Signal Processing
Verified
Journal Article
Closed access
JLJipeng Li
Jipeng Li
XYXueqiong Yuan
Xueqiong Yuan
EKErcan Engin Kuruoglu
Ercan Engin Kuruoglu