Yan Liu

Yan Liu

Auto-generated profile, based on publicly available information

Yan Liu

State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu, China

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 January 2024 in IEEE Transactions on Software Engineering
Verified
Journal Article
Closed access
QZQuanjun Zhang
Quanjun Zhang
Chunrong FangChunrong Fang
Chunrong Fang
Weisong SunWeisong Sun
Weisong Sun
YLYan Liu
Yan Liu
THTieke He
Tieke He
Zhenyu ChenZhenyu Chen
Zhenyu Chen
Automated program repair (APR) aims to fix software bugs automatically without human debugging efforts and plays a crucial role in software development and maintenance. Despite the recent significant progress in the number of fixed bugs, APR is still challenged by a long-standing overfitting problem (i.e., the generated patch is plausible but overfitting). Various techniques have thus been proposed to address the overfitting problem. Recently, researchers have employed BERT to extract code features, which are then used to train a classifier for patch correctness prediction, indicating the potential of such pre-trained models in reasoning about patch correctness. However, BERT is restricted to feature extraction for classifier training without benefiting from the training process, potentially generating sub-optimal vector representations for patched code snippets. In this paper, we propose APPT, a pre-trained model-based automated patch correctness assessment technique by both pre-training and fine-tuning. APPT adopts a pre-trained model as the encoder stack, followed by an LSTM stack and a deep learning classifier. More importantly, the pre-trained model is fine-tuned in conjunction with other components as a whole pipeline to fully adapt it specifically for reasoning about patch correctness. Although our idea is general and can be built on various existing pre-trained models, we have implemented APPT based on the BERT model. We conduct an extensive experiment on 1,183 Defects4J patches and the experimental results show that APPT achieves prediction accuracy of 79.7% and recall of 83.2%, outperforming the state-of-the-art technique CACHE by 4.3% and 6.7%. Our additional investigation on 49,694 real-world patches shows that APPT achieves the optimum performance (exceeding 99% in five common metrics for assessing patch classification techniques) compared with existing representation learning techniques. We further investigate the impact of each component and find that they all positively contribute to APPT, e.g., the fine-tuning process and the LSTM stack increase F1-score by 10.22% and 4.11%, respectively. We also prove that adopting advanced pre-trained models can further provide substantial advancement (e.g., GraphCodeBERT-based APPT improves BERT-based APPT by 2.8% and 3.3% in precision and AUC, respectively), highlighting the generalizability of APPT. Overall, our study highlights the promising future of fine-tuning pre-trained models to assess patch correctness and reduce the manual inspection effort of debugging experts when deploying APR tools in practice.

1 December 2011
Verified
Conference Paper
Closed access
SCSimin Cai
Simin Cai
YLYan Liu
Yan Liu
Xiaoping WANGXiaoping WANG
Xiaoping WANG
In service engineering, service identification plays a critical role as it lays the foundation for the later phases. Many existing research focus on creating holistic service oriented engineering process, generating SOA methodologies and frameworks, as well as proposing new service identification methods. Unfortunately, most methods deal with certain business cases and cannot provide universal guidance on service identification. While a few researchers have done surveys on various identification methods, they focus on describing the methods themselves, and the analysis is isolated from either the engineering process or the goals of SOA endeavor. In this paper we present a comprehensive understanding on service identification with software and service engineering process in consideration. We try to answer questions concerning about obtaining a generic service identification method. By examining recent research works we find some shared high-value activities among various methods, which works as a start point to solve the questions we presented. Detailed discussions are studied on these high-value activities. How to apply some frequent used activities under different environments are also covered.