Jian Gu

Jian Gu

Auto-generated profile, based on publicly available information

Jian Gu

Monash University, Melbourne, Australia

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 March 2026 in ACM Transactions on Software Engineering and Methodology
Verified
Journal Article
Open access
JGJian Gu
Jian Gu
AAAldeida Aleti
Aldeida Aleti
CCChunyang Chen
Chunyang Chen
Hongyu ZhangHongyu Zhang
Hongyu Zhang
Language Models (LMs) have become widely used in software engineering, especially for tasks such as code generation, where they are referred to as code LMs. These models have proven effective in generating code, making it easier for developers to automate coding activities. However, research has highlighted a significant limitation: despite their effectiveness, LMs often produce code that is incorrect, buggy, or not fully functional. Addressing this limitation is essential to fully realize LMs’ potential in practical applications. Yet, updating LMs, especially with only a small amount of feedback data is highly challenging. In such cases, hot-fix techniques, which facilitate agile model updates with limited data, may be promising to maintain reliability and usefulness. In this paper, we propose M odel I mprovement via N euron T argeting ( MINT ), a novel approach for repairing code LMs. MINT leverages the semantic property of language models to perform neuron-level repairs in a novel way. Furthermore, by analyzing the relationships between the model's latent representations, the incorrect outputs, and the desired outputs, MINT determines which neurons are worth updating. This approach ensures that only the neurons crucial to the model's failure are targeted, avoiding unnecessary changes and allowing for a more efficient and precise repair process. MINT is effective, efficient, and reliable, capable of correcting a neural model by patching a minimum number of neurons (usually one neuron for short code, while two or more neurons for long code). We introduce new measures to evaluate its generalisability and develop a new benchmark which is made available for further study. Our approach is evaluated on three coding tasks: line-level code generation, shellcode generation, and intent-to-bash translation. The experimental results demonstrate that the proposed approach significantly outperforms the state-of-the-art in both effectiveness and efficiency measures. With respect to the ExactMatch score, MINT achieves \(5.7\%-20.8\%\) improvements in StarCoder2-3B , and \(3.9\%-18.5\%\) improvements in CodeLlama-7B concerning the state-of-the-art. Regarding efficiency, MINT is \(32.3\%-74.8\%\) faster than the state-of-the-art. In addition, we analyze and discuss the side effects of model repair techniques, including the balance between generalization and specificity, and the performance after multiple repairs in succession.

30 November 2023
Verified
Conference Paper
Open access
JGJian Gu
Jian Gu
HGHarald C. Gall
Harald C. Gall
Deep code generation is a topic of deep learning for software engineering (DL4SE), which adopts neural models to generate code for the intended functions. Since end-to-end neural methods lack domain knowledge and software hierarchy awareness, they tend to perform poorly w.r.t project-level tasks. To systematically explore the potential improvements of code generation, we let it participate in the whole top-down development from expressibles to executables, which is possible in limited scopes. In the process, it benefits from massive samples, features, and knowledge. As the foundation, we suggest building a taxonomy on code data, namely code taxonomy, leveraging the categorization of code information. Moreover, we introduce a three-layer semantic pyramid (SP) to associate text data and code data. It identifies the information of different abstraction levels, and thus introduces the domain knowledge on development and reveals the hierarchy of software. Furthermore, we propose a semantic pyramid framework (SPF) as the approach, focusing on software of high modularity and low complexity. SPF divides the code generation process into stages and reserves spots for potential interactions. In addition, we conceived preliminary applications in software development to confirm the neuro-symbolic framework.