Austin Mordahl

Austin Mordahl

Auto-generated profile, based on publicly available information

Austin Mordahl

The University of Texas at Dallas, Richardson, TX, USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 July 2021
Verified
Conference Paper
Open access
AMAustin Mordahl
Austin Mordahl
SWShiyi Wei
Shiyi Wei
The most popular static taint analysis tools for Android allow users to change the underlying analysis algorithms through configuration options. However, the large configuration spaces make it difficult for developers and users alike to understand the full capabilities of these tools, and studies to-date have only focused on individual configurations. In this work, we present the first study that evaluates the configurations in Android taint analysis tools, focusing on the two most popular tools, FlowDroid and DroidSafe. First, we perform a manual code investigation to better understand how configurations are implemented in both tools. We formalize the expected effects of configuration option settings in terms of precision and soundness partial orders which we use to systematically test the configuration space. Second, we create a new dataset of 756 manually classified flows across 18 open-source real-world apps and conduct large-scale experiments on this dataset and micro-benchmarks. We observe that configurations make significant tradeoffs on the performance, precision, and soundness of both tools. The studies to-date would reach different conclusions on the tools' capabilities were they to consider configurations or use real-world datasets. In addition, we study the individual options through a statistical analysis and make actionable recommendations for users to tune the tools to their own ends. Finally, we use the partial orders to test the tool configuration spaces and detect 21 instances where options behaved in unexpected and incorrect ways, demonstrating the need for rigorous testing of configuration spaces.

10 January 2023 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
SYSai Yerramreddy
Sai Yerramreddy
AMAustin Mordahl
Austin Mordahl
UKUgur Koc
Ugur Koc
SWShiyi Wei
Shiyi Wei
JFJeffrey S. Foster
Jeffrey S. Foster
APAdam A. Porter
Adam A. Porter

27 September 2024 in ACM Transactions on Software Engineering and Methodology
Verified
Journal Article
Open access
JLJaeseong Lee
Jaeseong Lee
SCSimin Chen
Simin Chen
AMAustin Mordahl
Austin Mordahl
CLCong Liu
Cong Liu
WYWei Yang
Wei Yang
SWShiyi Wei
Shiyi Wei
Natural language processing (NLP) has gained widespread adoption in the development of real-world applications. However, the black-box nature of neural networks in NLP applications poses a challenge when evaluating their performance, let alone ensuring it. Recent research has proposed testing techniques to enhance the trustworthiness of NLP-based applications. However, most existing works use a single, aggregated metric (i.e., accuracy) which is difficult for users to assess NLP model performance on fine-grained aspects such as linguistic capabilities. To address this limitation, we present ALiCT, an automated testing technique for validating NLP applications based on their linguistic capabilities. ALiCT takes user-specified linguistic capabilities as inputs and produce diverse test suite with test oracles for each of given linguistic capability. We evaluate ALiCT on two widely adopted NLP tasks, sentiment analysis and hate speech detection, in terms of diversity, effectiveness, and consistency. Using Self-BLEU and syntactic diversity metrics, our findings reveal that ALiCT generates test cases that are 190% and 2213% more diverse in semantics and syntax, respectively, compared to those produced by state-of-the-art techniques. In addition, ALiCT is capable of producing a larger number of NLP model failures in 22 out of 25 linguistic capabilities over the two NLP applications.