In the linear regression model, least-squares (LS) estimator is usually used for estimating regression parameters. LS is an unreliable and unfavourable estimator when multicollinearity and outlier problems exist in the model. Therefore, we propose a new robust regression estimator for solving the abovementioned problems simultaneously. We conducted theoretical comparisons and different scenarios of simulation studies, and a real-life dataset was employed to show the performance of the proposed estimator. Results showed that the proposed estimator performs better than other estimators when multicollinearity and outlier problems occur simultaneously in the model.

In a multiple linear regression model, the ordinary least squares estimator is inefficient when the multicollinearity problem exists. Many authors have proposed different estimators to overcome the multicollinearity problem for linear regression models. This paper introduces a new regression estimator, called the Dawoud–Kibria estimator, as an alternative to the ordinary least squares estimator. Theory and simulation results show that this estimator performs better than other regression estimators under some conditions, according to the mean squares error criterion. The real-life datasets are used to illustrate the findings of the paper.

The Poisson maximum likelihood (PML) is used to estimate the coefficients of the Poisson regression model (PRM). Since the resulting estimators are sensitive to outliers, different studies have provided robust Poisson regression estimators to alleviate this problem. Additionally, the PML estimator is sensitive to multicollinearity. Therefore, several biased Poisson estimators have been provided to cope with this problem, such as the Poisson ridge estimator, Poisson Liu estimator, Poisson Kibria–Lukman estimator, and Poisson modified Kibria–Lukman estimator. Despite different Poisson biased regression estimators being proposed, there has been no analysis of the robust version of these estimators to deal with the two above-mentioned problems simultaneously, except for the robust Poisson ridge regression estimator, which we have extended by proposing three new robust Poisson one-parameter regression estimators, namely, the robust Poisson Liu (RPL), the robust Poisson Kibria–Lukman (RPKL), and the robust Poisson modified Kibria–Lukman (RPMKL). Theoretical comparisons and Monte Carlo simulations were conducted to show the proposed performance compared with the other estimators. The simulation results indicated that the proposed RPL, RPKL, and RPMKL estimators outperformed the other estimators in different scenarios, in cases where both problems existed. Finally, we analyzed two real datasets to confirm the results.

The known linear regression model (LRM) is used mostly for modelling the QSAR relationship between the response variable (biological activity) and one or more physiochemical or structural properties which serve as the explanatory variables mainly when the distribution of the response variable is normal. The gamma regression model is employed often for a skewed dependent variable. The parameters in both models are estimated using the maximum likelihood estimator (MLE). However, the MLE becomes unstable in the presence of multicollinearity for both models. In this study, we propose a new estimator and suggest some biasing parameters to estimate the regression parameter for the gamma regression model when there is multicollinearity. A simulation study and a real-life application were performed for evaluating the estimators' performance via the mean squared error criterion. The results from simulation and the real-life application revealed that the proposed gamma estimator produced lower MSE values than other considered estimators.

In this paper, we propose three stochastic restricted biased estimators for the linear regression model. These new estimators generalize the least squares estimator, mixed estimator, and biased estimator. We derive the necessary and sufficient conditions for the superiority of the proposed estimators over existing ones, as well as their relative superiority among each other, using the mean squared error matrix as a criterion. A simulation study is conducted to validate the theoretical findings, and two real-world examples are provided to demonstrate the practical advantages of the proposed estimators.