Multicollinearity negatively affects the efficiency of the maximum likelihood estimator (MLE) in both the linear and generalized linear models. The Kibria and Lukman estimator (KLE) was developed as an alternative to the MLE to handle multicollinearity for the linear regression model. In this study, we proposed the Logistic Kibria-Lukman estimator (LKLE) to handle multicollinearity for the logistic regression model. We theoretically established the superiority condition of this new estimator over the MLE, the logistic ridge estimator (LRE), the logistic Liu estimator (LLE), the logistic Liu-type estimator (LLTE) and the logistic two-parameter estimator (LTPE) using the mean squared error criteria. The theoretical conditions were validated using a real-life dataset, and the results showed that the conditions were satisfied. Finally, a simulation and the real-life results showed that the new estimator outperformed the other considered estimators. However, the performance of the estimators was contingent on the adopted shrinkage parameter estimators.
20 March 2020 in Iranian Journal of Science and Technology, Transactions A: Science
Wu and Yang [1] proposed an almost unbiased two-parameter estimator as an alternative to the ordinary least squares estimator (OLSE) in a multicollinear regression model. We introduce modified almost unbiased two-parameter estimator by combining two ideas. The mean squared error matrix of the proposed estimator was derived and the performance compared with some existing estimators. The theoretical results were accompanied by a numerical example and a simulation study.
26 June 2024 in Journal of Inverse and Ill-posed Problems
The Bell regression model (BRM), a member of the generalized linear models (GLMs), can be used when the dependent variable consists of overdispersed count data. The maximum likelihood estimator (MLE) is generally used to estimate unknown regression coefficients. The major drawback of the MLE is an inflated variance when multicollinearity problems occur. In this study, we proposed a new biased estimator to cope with the multicollinearity in the BRM. The simulation study is conducted to illustrate the performance of the proposed estimator over the MLE and Bell ridge estimator (BRE). Also, we give real data examples to approve the applicability of the proposed estimator in real data problems.
We address the estimation of regression parameters for the ill-conditioned predictive linear model in this study. Traditional least squares methods often encounter challenges in yielding reliable results when there is multicollinearity. Therefore, we employ a better shrinkage method, average least squares-centered penalized regression (ALPR), as it offers a more efficient approach for handling multicollinearity than ridge regression. Additionally, we integrate ALPR with the principal component (PC) dimension reduction method for enhanced performance. We compared the proposed PCALPR estimation technique with existing ones for ill-conditioned problems through comprehensive simulations and real-life data analyses using the mean squared error. This integration results in superior model performance compared to other methods, highlighting the potential of combining dimensionality reduction techniques with penalized regression for enhanced model predictions.