Jiakun Liu

Jiakun Liu

Auto-generated profile, based on publicly available information

Jiakun Liu

Harbin Institute of Technology, Harbin, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
31 July 2025 in ACM Transactions on Software Engineering and Methodology
Verified
Journal Article
Open access
LFLishui Fan
Lishui Fan
JLJiakun Liu
Jiakun Liu
ZLZhongxin Liu
Zhongxin Liu
DLDavid Lo
David Lo
XXXin Xia
Xin Xia
SLShanping Li
Shanping Li
Developers deal with code-change-related tasks daily, e.g., reviewing code. Pre-trained code and code-change-oriented models have been adapted to help developers with such tasks. Recently, large language models (LLMs) have shown their effectiveness in code-related tasks. However, existing LLMs for code focus on general code syntax and semantics rather than the differences between two code versions. Thus, it is an open question how LLMs perform on code-change-related tasks. To answer this question, we conduct an empirical study using \(>\) 1B parameters LLMs on three code-change-related tasks, i.e., code review generation, commit message generation, and just-in-time comment update, with in-context learning (ICL) and parameter-efficient fine-tuning (PEFT, including LoRA and prefix-tuning). We observe that the performance of LLMs is poor without examples and generally improves with examples, but more examples do not always lead to better performance. LLMs tuned with LoRA have comparable performance to the state-of-the-art small pre-trained models. Larger models are not always better, but Llama 2 and Code Llama families are always the best. The best LLMs outperform small pre-trained models on the code changes that only modify comments and perform comparably on other code changes. We suggest future work should focus more on guiding LLMs to learn the knowledge specific to the changes related to code rather than comments for code-change-related tasks.

15 February 2021 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
JLJiakun Liu
Jiakun Liu
QHQiao Huang
Qiao Huang
XXXin Xia
Xin Xia
ESEmad Shihab
Emad Shihab
DLDavid Lo
David Lo
SLShanping Li
Shanping Li

18 August 2021
Verified
Conference Paper
Open access
JLJiakun Liu
Jiakun Liu
SBSebastian Baltes
Sebastian Baltes
CTChristoph Treude
Christoph Treude
DLDavid Lo
David Lo
YZYun Zhang
Yun Zhang
XXXin Xia
Xin Xia
To solve programming issues, developers commonly search on Stack Overflow to seek potential solutions. However, there is a gap between the knowledge developers are interested in and the knowledge they are able to retrieve using search engines. To help developers efficiently retrieve relevant knowledge on Stack Overflow, prior studies proposed several techniques to reformulate queries and generate summarized answers. However, few studies performed a large-scale analysis using real-world search logs. In this paper, we characterize how developers search on Stack Overflow using such logs. By doing so, we identify the challenges developers face when searching on Stack Overflow and seek opportunities for the platform and researchers to help developers efficiently retrieve knowledge. To characterize search activities on Stack Overflow, we use search log data based on requests to Stack Overflow's web servers. We find that the most common search activity is reformulating the immediately preceding queries. Related work looked into query reformulations when using generic search engines and found 13 types of query reformulation strategies. Compared to their results, we observe that 71.78% of the reformulations can be fitted into those reformulation strategies. In terms of how queries are structured, 17.41% of the search sessions only search for fragments of source code artifacts (e.g., class and method names) without specifying the names of programming languages, libraries, or frameworks. Based on our findings, we provide actionable suggestions for Stack Overflow moderators and outline directions for future research. For example, we encourage Stack Overflow to set up a database that includes the relations between all computer programming terminologies shared on Stack Overflow, e.g., method name, data structure name, design pattern, and IDE name. By doing so, Stack Overflow could improve the performance of search engines by considering related programming terminologies at different levels of granularity.

17 October 2025
Verified
Book Chapter
Closed access
PDF file
XCXuemeng Cai
Xuemeng Cai
JLJiakun Liu
Jiakun Liu
XHXiping Huang
Xiping Huang
YYYijun Yu
Yijun Yu
HWHaitao Wu
Haitao Wu
LJLingxiao Jiang
Lingxiao Jiang

20 November 2024 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
JHJunda He
Junda He
BXBowen Xu
Bowen Xu
ZYZhou Yang
Zhou Yang
DHDongGyun Han
DongGyun Han
CYChengran Yang
Chengran Yang
DLDavid Lo
David Lo

3 November 2021 in Empirical Software Engineering
Verified
Journal Article
Closed access
PDF file
JLJiakun Liu
Jiakun Liu
HZHaoxiang Zhang
Haoxiang Zhang
XXXin Xia
Xin Xia
DLDavid Lo
David Lo
YZYing Zou
Ying Zou
SLShanping Li
Shanping Li