Tiezhu Sun

Tiezhu Sun

Auto-generated profile, based on publicly available information

Tiezhu Sun

University of Luxembourg

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 September 2023 in IEEE Transactions on Software Engineering
Verified
Journal Article
Open access
TSTiezhu Sun
Tiezhu Sun
KAKevin Allix
Kevin Allix
KKKisub Kim
Kisub Kim
XZXin Zhou
Xin Zhou
DKDongsun Kim
Dongsun Kim
JKJacques Klein
Jacques Klein
The automation of an increasingly large number of software engineering tasks is becoming possible thanks to Machine Learning (ML). One foundational building block in the application of ML to software artifacts is the representation of these artifacts ( e.g. , source code or executable code) into a form that is suitable for learning. Traditionally, researchers and practitioners have relied on manually selected features, based on expert knowledge, for the task at hand. Such knowledge is sometimes imprecise and generally incomplete. To overcome this limitation, many studies have leveraged representation learning, delegating to ML itself the job of automatically devising suitable representations and selections of the most relevant features. Yet, in the context of Android problems, existing models are either limited to coarse-grained whole-app level ( e.g. , apk2vec) or conducted for one specific downstream task ( e.g. , smali2vec). Thus, the produced representation may turn out to be unsuitable for fine-grained tasks or cannot generalize beyond the task that they have been trained on. Our work is part of a new line of research that investigates effective, task-agnostic, and fine-grained universal representations of bytecode to mitigate both of these two limitations. Such representations aim to capture information relevant to various low-level downstream tasks ( e.g. , at the class-level). We are inspired by the field of Natural Language Processing, where the problem of universal representation was addressed by building Universal Language Models, such as BERT, whose goal is to capture abstract semantic information about sentences, in a way that is reusable for a variety of tasks. We propose DexBERT, a BERT-like Language Model dedicated to representing chunks of DEX bytecode, the main binary format used in Android applications. We empirically assess whether DexBERT is able to model the DEX language and evaluate the suitability of our model in three distinct class-level software engineering tasks: Malicious Code Localization, Defect Prediction, and Component Type Classification. We also experiment with strategies to deal with the problem of catering to apps having vastly different sizes, and we demonstrate one example of using our technique to investigate what information is relevant to a given task.

26 April 2025 in ACM Transactions on Software Engineering and Methodology
Verified
Journal Article
Open access
TSTiezhu Sun
Tiezhu Sun
NDNadia Daoudi
Nadia Daoudi
WPWeiguo Pian
Weiguo Pian
KKKisub Kim
Kisub Kim
KAKevin Allix
Kevin Allix
JKJacques Klein
Jacques Klein
Malware classification is a specific and refined task within the broader malware detection problem. Effective classification aids in understanding attack techniques and developing robust defenses, ensuring application security and timely mitigation of software vulnerabilities. The dynamic nature of malware demands adaptive classification techniques that can handle the continuous emergence of new families. Traditionally, this is done by retraining models on all historical samples, which requires significant resources in terms of time and storage. An alternative approach is Class-Incremental Learning (CIL), which focuses on progressively learning new classes (malware families) while preserving knowledge from previous training steps. However, CIL assumes that each class appears only once in training and is not revisited, an assumption that does not hold for malware families, which often persist across multiple time intervals. This leads to shifts in the data distribution for the same family over time, a challenge that is not addressed by traditional CIL methods. We formulate this problem as Temporal-Incremental Malware Learning (TIML), which adapts to these shifts and effectively classifies new variants. To support this, we organize the MalNet dataset, consisting of over a million entries of Android malware data collected over a decade, in chronological order. We first adapt state-of-the-art CIL approaches to meet TIML’s requirements, serving as baseline methods. Then, we propose a novel multimodal TIML approach that leverages multiple malware modalities for improved performance. Extensive evaluations show that our TIML approaches outperform traditional CIL methods and demonstrate the feasibility of periodically updating malware classifiers at a low cost. This process is efficient and requires minimal storage and computational resources, with only a slight dip in performance compared to full retraining with historical data.

5 October 2024 in Journal of Systems and Software
Verified
Journal Article
Closed access
YLYinghua Li
Yinghua Li
XDXueqi Dang
Xueqi Dang
HTHaoye Tian
Haoye Tian
TSTiezhu Sun
Tiezhu Sun
ZWZhijie Wang
Zhijie Wang
Tegawendé F. BissyandéTegawendé F. Bissyandé
Tegawendé F. Bissyandé

24 October 2024
Verified
Conference Paper
Open access
TSTiezhu Sun
Tiezhu Sun
NDNadia Daoudi
Nadia Daoudi
KKKisub Kim
Kisub Kim
KAKevin Allix
Kevin Allix
Tegawendé F. BissyandéTegawendé F. Bissyandé
Tegawendé F. Bissyandé
JKJacques Klein
Jacques Klein
Recent advancements in ML and DL have significantly improved Android malware detection, yet many methodologies still rely on basic static analysis, bytecode, or function call graphs that often fail to capture complex malicious behaviors. DexBERT, a pre-trained BERT-like model tailored for Android representation learning, enriches class-level representations by analyzing Smali code extracted from APKs. However, its functionality is constrained by its inability to process multiple Smali classes simultaneously. This paper introduces DetectBERT, which integrates correlated Multiple Instance Learning (c-MIL) with DexBERT to handle the high dimensionality and variability of Android malware, enabling effective app-level detection. By treating class-level features as instances within MIL bags, DetectBERT aggregates these into a comprehensive app-level representation. Our evaluation demonstrates that DetectBERT not only surpasses existing state-of-the-art detection methods but also adapts to evolving malware threats. Moreover, the versatility of the DetectBERT framework holds promising potential for broader applications in app-level analysis and other software engineering tasks, offering new avenues for research and development.

20 September 2024
Verified
Book Chapter
Closed access
PDF file
TSTiezhu Sun
Tiezhu Sun
WPWeiguo Pian
Weiguo Pian
NDNadia Daoudi
Nadia Daoudi
KAKevin Allix
Kevin Allix
TBTegawendé F. Bissyandé
Tegawendé F. Bissyandé
JKJacques Klein
Jacques Klein

2 July 2025 in ACM Transactions on Software Engineering and Methodology
Verified
Journal Article
Open access
WPWeiguo Pian
Weiguo Pian
YLYinghua Li
Yinghua Li
HTHaoye Tian
Haoye Tian
TSTiezhu Sun
Tiezhu Sun
YSYewei Song
Yewei Song
Tegawendé F. BissyandéTegawendé F. Bissyandé
Tegawendé F. Bissyandé
Learning to edit code automatically is becoming more and more feasible. Thanks to recent advances in Neural Machine Translation (NMT) , various case studies are being investigated where patches are automatically produced and assessed either automatically (using test suites) or by developers themselves. An appealing setting remains when the developer must provide a natural language input of the requirement for the code change. A recent proof of concept in the literature showed that it is indeed feasible to translate these natural language requirements into code changes. A recent advancement, MODIT, has shown promising results in code editing by leveraging natural language, code context, and location information as input. However, it struggles when location information is unavailable. While several studies have demonstrated the ability to edit source code without explicitly specifying the edit location, they still tend to generate edits with less accuracy at the line level. In this work, we address the challenge of generating code edits without precise location information, a scenario we consider crucial for the practical adoption of NMT in code development. To that end, we develop a novel joint training approach for both localization and source code editions. Building a benchmark based on over 70k commits (patches and messages), we demonstrate that our joint Localize and EDit ( jLED) approach is effective. An ablation study further demonstrates the importance of our design choice in joint training.