Tim Menzies

Tim Menzies

Auto-generated profile, based on publicly available information

Tim Menzies

North Carolina State University

Research Focus & Metrics

Academic Career Length

27Years (2000-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 January 2009 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
BTBurak Turhan
Burak Turhan
TMTim Menzies
Tim Menzies
ABAyşe B. Bener
Ayşe B. Bener
JSJustin Di Stefano
Justin Di Stefano

20 May 2010 in Automated Software Engineering
Verified
Journal Article
Closed access
PDF file
TMTim Menzies
Tim Menzies
ZMZach Milton
Zach Milton
BTBurak Turhan
Burak Turhan
BCBojan Cukic
Bojan Cukic
YJYue Jiang
Yue Jiang
ABAyşe Bener
Ayşe Bener

1 June 2018 in Information and Software Technology
Verified
Journal Article
Closed access
AAAmritanshu Agrawal
Amritanshu Agrawal
WFWei Fu
Wei Fu
TMTim Menzies
Tim Menzies

18 August 2021
Verified
Conference Paper
Open access
JCJoymallya Chakraborty
Joymallya Chakraborty
SMSuvodeep Majumder
Suvodeep Majumder
TMTim Menzies
Tim Menzies
Increasingly, software is making autonomous decisions in case of criminal sentencing, approving credit cards, hiring employees, and so on. Some of these decisions show bias and adversely affect certain social groups (e.g. those defined by sex, race, age, marital status). Many prior works on bias mitigation take the following form: change the data or learners in multiple ways, then see if any of that improves fairness. Perhaps a better approach is to postulate root causes of bias and then applying some resolution strategy. This paper postulates that the root causes of bias are the prior decisions that affect- (a) what data was selected and (b) the labels assigned to those examples. Our Fair-SMOTE algorithm removes biased labels; and rebalances internal distributions such that based on sensitive attribute, examples are equal in both positive and negative classes. On testing, it was seen that this method was just as effective at reducing bias as prior approaches. Further, models generated via Fair-SMOTE achieve higher performance (measured in terms of recall and F1) than other state-of-the-art fairness improvement algorithms. To the best of our knowledge, measured in terms of number of analyzed learners and datasets, this study is one of the largest studies on bias mitigation yet presented in the literature.

20 September 2018 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
VNVivek Nair
Vivek Nair
ZYZhe Yu
Zhe Yu
TMTim Menzies
Tim Menzies
NSNorbert Siegmund
Norbert Siegmund
SASven Apel
Sven Apel
Finding good configurations of a software system is often challenging since the number of configuration options can be large. Software engineers often make poor choices about configuration or, even worse, they usually use a sub-optimal configuration in production, which leads to inadequate performance. To assist engineers in finding the better configuration, this article introduces Flash, a sequential model-based method that sequentially explores the configuration space by reflecting on the configurations evaluated so far to determine the next best configuration to explore. Flash scales up to software systems that defeat the prior state-of-the-art model-based methods in this area. Flash runs much faster than existing methods and can solve both single-objective and multi-objective optimization problems. The central insight of this article is to use the prior knowledge of the configuration space (gained from prior runs) to choose the next promising configuration. This strategy reduces the effort (i.e., number of measurements) required to find the better configuration. We evaluate Flash using 30 scenarios based on 7 software systems to demonstrate that Flash saves effort in 100 and 80 percent of cases in single-objective and multi-objective problems respectively by up to several orders of magnitude compared to state-of-the-art techniques.

27 June 2017 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
JNJaechang Nam
Jaechang Nam
WFWei Fu
Wei Fu
SKSung Hun Kim
Sung Hun Kim
TMTim Menzies
Tim Menzies
LTLin Tan
Lin Tan
Many recent studies have documented the success of cross-project defect prediction (CPDP) to predict defects for new projects lacking in defect data by using prediction models built by other projects. However, most studies share the same limitations: it requires homogeneous data; i.e., different projects must describe themselves using the same metrics. This paper presents methods for heterogeneous defect prediction (HDP) that matches up different metrics in different projects. Metric matching for HDP requires a "large enough" sample of distributions in the source and target projects?which raises the question on how large is "large enough" for effective heterogeneous defect prediction. This paper shows that empirically and theoretically, "large enough" may be very small indeed. For example, using a mathematical model of defect prediction, we identify categories of data sets were as few as 50 instances are enough to build a defect prediction model. Our conclusion for this work is that, even when projects use different metric sets, it is possible to quickly transfer lessons learned about defect prediction.