Jianfeng Yao

Jianfeng Yao

Auto-generated profile, based on publicly available information

Jianfeng Yao

School of Data Science, The Chinese University of Hong Kong (Shenzhen), Shenzhen, China

Research Focus & Metrics

Academic Career Length

31Years (1996-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 June 2008 in Annales de l'Institut Henri Poincaré, Probabilités et Statistiques
Verified
Journal Article
Open access
PDF file
ZBZhidong Bai
Zhidong Bai
JYJian-Feng Yao
Jian-Feng Yao
In a spiked population model, the population covariance matrix has all its eigenvalues equal to units except for a few fixed eigenvalues (spikes). This model is proposed by Johnstone to cope with empirical findings on various data sets. The question is to quantify the effect of the perturbation caused by the spike eigenvalues. A recent work by Baik and Silverstein establishes the almost sure limits of the extreme sample eigenvalues associated to the spike eigenvalues when the population and the sample sizes become large. This paper establishes the limiting distributions of these extreme sample eigenvalues. As another important result of the paper, we provide a central limit theorem on random sesquilinear forms. Dans un modèle de variances hétérogènes, les valeurs propres de la matrice de covariance des variables sont toutes égales à l’unité sauf un faible nombre d’entre elles. Ce modèle a été introduit par Johnstone comme une explication possible de la structure des valeurs propres de la matrice de covariance empirique constatée sur plusieurs ensembles de données réelles. Une question importante est de quantifier la perturbation causée par ces valeurs propres différentes de l’unité. Un travail récent de Baik et Silverstein établit la limite presque sûre des valeurs propres empiriques extrêmes lorsque le nombre de variables tend vers l’infini proportionnellement à la taille de l’échantillon. Ce travail établit un théorème limite central pour ces valeurs propres empiriques extrêmes. Il est basé sur un nouveau théorème limite central pour les formes sesquilinéaires aléatoires.

1 December 2009 in The Annals of Statistics
Verified
Journal Article
Open access
ZBZhidong Bai
Zhidong Bai
DJDandan Jiang
Dandan Jiang
JYJian-Feng Yao
Jian-Feng Yao
SZShurong Zheng
Shurong Zheng
In this paper, we give an explanation to the failure of two likelihood ratio procedures for testing about covariance matrices from Gaussian populations when the dimension p is large compared to the sample size n. Next, using recent central limit theorems for linear spectral statistics of sample covariance matrices and of random F-matrices, we propose necessary corrections for these LR tests to cope with high-dimensional effects. The asymptotic distributions of these corrected tests under the null are given. Simulations demonstrate that the corrected LR tests yield a realized size close to nominal level for both moderate p (around 20) and high dimension, while the traditional LR tests with χ2 approximation fails. Another contribution from the paper is that for testing the equality between two covariance matrices, the proposed correction applies equally for non-Gaussian populations yielding a valid pseudo-likelihood ratio test.

26 March 2015
Verified
Book
Closed access
JYJianfeng Yao
Jianfeng Yao
SZShurong Zheng
Shurong Zheng
ZBZhidong Bai
Zhidong Bai
High-dimensional data appear in many fields, and their analysis has become increasingly important in modern statistics. However, it has long been observed that several well-known methods in multivariate analysis become inefficient, or even misleading, when the data dimension p is larger than, say, several tens. A seminal example is the well-known inefficiency of Hotelling's T2-test in such cases. This example shows that classical large sample limits may no longer hold for high-dimensional data; statisticians must seek new limiting theorems in these instances. Thus, the theory of random matrices (RMT) serves as a much-needed and welcome alternative framework. Based on the authors' own research, this book provides a firsthand introduction to new high-dimensional statistical methods derived from RMT. The book begins with a detailed introduction to useful tools from RMT, and then presents a series of high-dimensional problems with solutions provided by RMT methods.

1 April 2012 in Journal of Multivariate Analysis
Verified
Journal Article
Closed access
ZBZhidong Bai
Zhidong Bai
JYJianfeng Yao
Jianfeng Yao

1 December 2005 in Bernoulli
Verified
Journal Article
Open access
PDF file
ZBZ.D. Bai
Z.D. Bai
JYJ. Yao
J. Yao
Project Euclid - mathematics and statistics online

1 April 2015 in The Annals of Statistics
Verified
Journal Article
Open access
PDF file
SZShurong Zheng
Shurong Zheng
ZBZhidong Bai
Zhidong Bai
JYJianfeng Yao
Jianfeng Yao
Sample covariance matrices are widely used in multivariate statistical analysis. The central limit theorems (CLTs) for linear spectral statistics of high-dimensional noncentralized sample covariance matrices have received considerable attention in random matrix theory and have been applied to many high-dimensional statistical problems. However, known population mean vectors are assumed for noncentralized sample covariance matrices, some of which even assume Gaussian-like moment conditions. In fact, there are still another two most frequently used sample covariance matrices: the ME (moment estimator, constructed by subtracting the sample mean vector from each sample vector) and the unbiased sample covariance matrix (by changing the denominator $n$ as $N=n-1$ in the ME) without depending on unknown population mean vectors. In this paper, we not only establish the new CLTs for noncentralized sample covariance matrices when the Gaussian-like moment conditions do not hold but also characterize the nonnegligible differences among the CLTs for the three classes of high-dimensional sample covariance matrices by establishing a substitution principle: by substituting the adjusted sample size $N=n-1$ for the actual sample size $n$ in the centering term of the new CLTs, we obtain the CLT of the unbiased sample covariance matrices. Moreover, it is found that the difference between the CLTs for the ME and unbiased sample covariance matrix is nonnegligible in the centering term although the only difference between two sample covariance matrices is a normalization by $n$ and $n-1$, respectively. The new results are applied to two testing problems for high-dimensional covariance matrices.