Doo-Hwan Bae

Doo-Hwan Bae

Auto-generated profile, based on publicly available information

Doo-Hwan Bae

KAIST Seoul South Korea

Research Focus & Metrics

Academic Career Length

25Years (2002-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 December 2018
Verified
Conference Paper
Open access
PDF file
MPMike Papadakis
Mike Papadakis
DSDonghwan Shin
Donghwan Shin
SYShin Yoo
Shin Yoo
DBDoo-Hwan Bae
Doo-Hwan Bae
Empirical validation of software testing studies is increasingly relying on mutants. This practice is motivated by the strong correlation between mutant scores and real fault detection that is reported in the literature. In contrast, our study shows that correlations are the results of the confounding effects of the test suite size. In particular, we investigate the relation between two independent variables, mutation score and test suite size, with one dependent variable the detection of (real) faults. We use two data sets, CoreBench and De-fects4J, with large C and Java programs and real faults and provide evidence that all correlations between mutation scores and real fault detection are weak when controlling for test suite size. We also find that both independent variables significantly influence the dependent one, with significantly better fits, but overall with relative low prediction power. By measuring the fault detection capability of the top ranked, according to mutation score, test suites (opposed to randomly selected test suites of the same size), we find that achieving higher mutation scores improves significantly the fault detection. Taken together, our data suggest that mutants provide good guidance for improving the fault detection of test suites, but their correlation with fault detection are weak.

1 April 2016
Verified
Conference Paper
Open access
DSDonghwan Shin
Donghwan Shin
DBDoo-Hwan Bae
Doo-Hwan Bae
In the field of mutation analysis, mutation is the systematic generation of mutated programs (i.e., mutants) from an original program. The concept of mutation has been widely applied to various testing problems, including test set selection, fault localization, and program repair. However, surprisingly little focus has been given to the theoretical foundation of mutation-based testing methods, making it difficult to understand, organize, and describe various mutation-based testing methods. This paper aims to consider a theoretical framework for understanding mutation-based testing methods. While there is a solid testing framework for general testing, this is incongruent with mutation-based testing methods, because it focuses on the correctness of a program for a test, while the essence of mutation-based testing concerns the differences between programs (including mutants) for a test. In this paper, we begin the construction of our framework by defining a novel testing factor, called a test differentiator, to transform the paradigm of testing from the notion of correctness to the notion of difference. We formally define behavioral differences of programs for a set of tests as a mathematical vector, called a d-vector. We explore the multi-dimensional space represented by d-vectors, and provide a graphical model for describing the space. Based on our framework and formalization, we interpret existing mutation-based fault localization methods and mutant set minimization as applications, and identify novel implications for future work.


30 April 2011 in Journal of Systems and Software
Verified
Journal Article
Closed access
SPSeunghun Park
Seunghun Park
DBDoo-Hwan Bae
Doo-Hwan Bae

31 October 2009 in Journal of Systems and Software
Verified
Journal Article
Closed access
TMTegegne Marew
Tegegne Marew
JLJoon-Sang Lee
Joon-Sang Lee
DBDoo-Hwan Bae
Doo-Hwan Bae

7 May 2016 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
JPJihun Park
Jihun Park
MKMiryung Kim
Miryung Kim
DBDoo-Hwan Bae
Doo-Hwan Bae