Wei Zheng

Dr. Wei Zheng

orcid

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 March 2021 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
XWXiaoxue Wu
Xiaoxue Wu
WZWei Zheng
Wei Zheng
XXXin Xia
Xin Xia
DLDavid Lo
David Lo
In the research of mining software repositories, we need to label a large amount of data to construct a predictive model. The correctness of the labels will affect the performance of a model substantially. However, limited studies have been performed to investigate the impact of mislabeled instances on a predictive model. To bridge the gap, in this article, we perform a case study on the security bug report (SBR) prediction. We found five publicly available datasets for SBR prediction contains many mislabeled instances, which lead to the poor performance of SBR prediction models of recent studies (e.g., the work of Peters et al. and Shu et al. ). Furthermore, it might mislead the research direction of SBR prediction. In this article, we first improve the label correctness of these five datasets by manually analyzing each bug report, and we find 749 SBRs, which are originally mislabeled as Non-SBRs (NSBRs). We then evaluate the impacts of datasets label correctness by comparing the performance of the classification models on both the noisy (i.e., before our correction) and the clean (i.e., after our correction) datasets. The results show that the cleaned datasets result in improvement in the performance of classification models. The performance of the approaches proposed by Peters et al. and Shu et al. on the clean datasets is much better than on the noisy datasets. Furthermore, with the clean datasets, the simple text classification models could significantly outperform the security keywords-matrix-based approaches applied by Peters et al. and Shu et al.

1 May 2021 in Information and Software Technology
Verified
Journal Article
Closed access
XWXiaoxue Wu
Xiaoxue Wu
WZWei Zheng
Wei Zheng
XCXiang Chen
Xiang Chen
YZYu Zhao
Yu Zhao
TYTingting Yu
Tingting Yu
DMDejun Mu
Dejun Mu

22 October 2021 in IEEE Transactions on Reliability
Verified
Journal Article
Closed access
WZWei Zheng
Wei Zheng
YXYuxing Xun
Yuxing Xun
XWXiaoxue Wu
Xiaoxue Wu
ZDZhi Deng
Zhi Deng
Xiang ChenXiang Chen
Xiang Chen
YSYulei Sui
Yulei Sui
Identifying security bug reports (SBRs) accurately from a bug repository can reduce a software product’s security risk. However, the class imbalance problem exists for SBR prediction since the number of SBRs is often limited, and this issue has not been thoroughly investigated in previous studies. In our study, we choose six real-world projects of different sizes with over 120 000 bug reports in total as our empirical subjects. We first analyze the impact of the class imbalance issue on SBR prediction and confirm its negative impact on prediction performance. Then we perform a comparative study of six state-of-the-art class rebalancing methods combined with five popular classification algorithms for SBR prediction. By comparing with the baseline method Farsec, using the class rebalancing methods can improve the performance in 78% of cases in the worst case. Moreover, the combination of the Rose and random forest classification algorithm can construct the model with the best performance, which increases the performance by 267% in the best case and 75% on average in terms of F1-score . Finally, we summarize eight main findings based on our empirical studies’ results, which can provide guidelines for choosing appropriate class rebalancing methods and classifiers for SBR prediction in practice.

1 March 2016 in Information Sciences
Verified
Journal Article
Closed access
WZWei Zheng
Wei Zheng
RHRobert M. Hierons
Robert M. Hierons
MLMiqing Li
Miqing Li
XLXiaoHui Liu
XiaoHui Liu
VVVeronica Vinciotti
Veronica Vinciotti

1 February 2020 in Journal of Systems and Software
Verified
Journal Article
Closed access
XWXiaoxue Wu
Xiaoxue Wu
WZWei Zheng
Wei Zheng
Xiang ChenXiang Chen
Xiang Chen
FWFang Wang
Fang Wang
DMDejun Mu
Dejun Mu

8 January 2024 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
WZWei Zheng
Wei Zheng
LLLidan Lin
Lidan Lin
XWXiaoxue Wu
Xiaoxue Wu
Xiang ChenXiang Chen
Xiang Chen
Recently, with the widespread use of deep neural networks (DNNs) in high-stakes decision-making systems (such as fraud detection and prison sentencing), concerns have arisen about the fairness of DNNs in terms of the potential negative impact they may have on individuals and society. Therefore, fairness testing has become an important research topic in DNN testing. At the same time, the neural network coverage criteria (such as criteria based on neuronal activation) is considered as an adequacy test for DNN white-box testing. It is implicitly assumed that improving the coverage can enhance the quality of test suites. Nevertheless, the correlation between DNN fairness (a test property) and coverage criteria (a test method) has not been adequately explored. To address this issue, we conducted a systematic empirical study on seven coverage criteria, six fairness metrics, three fairness testing techniques, and five bias mitigation methods on five DNN models and nine fairness datasets to assess the correlation between coverage criteria and DNN fairness. Our study achieved the following findings: 1) with the increase in the size of the test suite, some of the coverage and fairness metrics changed significantly, as the size of the test suite increased; 2) the statistical correlation between coverage criteria and DNN fairness is limited; and 3) after bias mitigation for improving the fairness of DNN, the change pattern in coverage criteria is different; 4) Models debiased by different bias mitigation methods have a lower correlation between coverage and fairness compared to the original models. Our findings cast doubt on the validity of coverage criteria concerning DNN fairness (i.e., increasing the coverage may even have a negative impact on the fairness of DNNs). Therefore, we warn DNN testers against blindly pursuing higher coverage of coverage criteria at the cost of test properties of DNNs (such as fairness).