Aiwei Liu

Aiwei Liu

Auto-generated profile, based on publicly available information

Aiwei Liu

School of Software, Tsinghua University, Beijing, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 November 2024 in ACM Computing Surveys
Verified
Journal Article
Open access
ALAiwei Liu
Aiwei Liu
LPLeyi Pan
Leyi Pan
YLYijian Lu
Yijian Lu
JLJingjing Li
Jingjing Li
XHXuming Hu
Xuming Hu
PYPhilip Yu
Philip Yu
Text watermarking algorithms are crucial for protecting the copyright of textual content. Historically, their capabilities and application scenarios were limited. However, recent advancements in large language models (LLMs) have revolutionized these techniques. LLMs not only enhance text watermarking algorithms with their advanced abilities but also create a need for employing these algorithms to protect their own copyrights or prevent potential misuse. This work conducts a comprehensive survey of the current state of text watermarking technology, covering four main aspects: (1) an overview and comparison of different text watermarking techniques; (2) evaluation methods for text watermarking algorithms, including their detectability, impact on text or LLM quality, and robustness under target or untargeted attacks; (3) potential application scenarios for text watermarking technology; and (4) current challenges and future directions for text watermarking. This survey aims to provide researchers with a thorough understanding of text watermarking technology in the era of LLMs, thereby promoting its further advancement.

9 September 2025 in ACM Computing Surveys
Verified
Journal Article
Open access
LZLingzhe Zhang
Lingzhe Zhang
TJTong Jia
Tong Jia
MJMengxi Jia
Mengxi Jia
YWYifan Wu
Yifan Wu
ALAiwei Liu
Aiwei Liu
YLYing Li
Ying Li
As large language models (LLMs) grow increasingly sophisticated and pervasive, their application to various Artificial Intelligence for IT Operations (AIOps) tasks has garnered significant attention. However, a comprehensive understanding of the impact, potential, and limitations of LLMs in AIOps remains in its infancy. To address this gap, we conducted a detailed survey of LLM4AIOps, focusing on how LLMs can optimize processes and improve outcomes in this domain. We analyzed 183 research articles published between January 2020 and December 2024 to answer four key research questions (RQs). In RQ1, we examine the diverse failure data sources utilized, including advanced LLM-based processing techniques for legacy data and the incorporation of new data sources enabled by LLMs. RQ2 explores the evolution of AIOps tasks, highlighting the emergence of novel tasks and the publication trends across these tasks. RQ3 investigates the various LLM-based methods applied to address AIOps challenges. Finally, RQ4 reviews evaluation methodologies tailored to assess LLM-integrated AIOps approaches. Based on our findings, we discuss the state-of-the-art advancements and trends, identify gaps in existing research, and propose promising directions for future exploration.

26 October 2023
Verified
Conference Paper
Open access
XHXuming Hu
Xuming Hu
JCJunzhe Chen
Junzhe Chen
ALAiwei Liu
Aiwei Liu
SMShiao Meng
Shiao Meng
LWLijie Wen
Lijie Wen
PYPhilip S. Yu
Philip S. Yu
How can we better extract entities and relations from text? Using multimodal extraction with images and text obtains more signals for entities and relations, and aligns them through graphs or hierarchical fusion, aiding in extraction. Despite attempts at various fusions, previous works have overlooked many unlabeled image-caption pairs, such as NewsCLIPing. This paper proposes innovative pre-training objectives for entity-object and relation-image alignment, extracting objects from images and aligning them with entity and relation prompts for soft pseudo-labels. These labels are used as self-supervised signals for pre-training, enhancing the ability to extract entities and relations. Experiments on three datasets show an average 3.41% F1 improvement over prior SOTA. Additionally, our method is orthogonal to previous multimodal fusions, and using it on prior SOTA fusions further improves 5.47% F1.

10 July 2024
Verified
Conference Paper
Open access
ALAiwei Liu
Aiwei Liu
QSQiang Sheng
Qiang Sheng
XHXuming Hu
Xuming Hu
As large language models (LLMs) become increasingly capable and widely deployed, the risk of them generating misinformation poses a critical challenge. Misinformation from LLMs can take various forms, from factual errors due to hallucination to intentionally deceptive content, and can have severe consequences in high-stakes domains.This tutorial covers comprehensive strategies to prevent and detect misinformation generated by LLMs. We first introduce the types of misinformation LLMs can produce and their root causes. We then explore two broad categories: Preventing misinformation generation: a) AI alignment training techniques to reduce LLMs' propensity for misinformation and refuse malicious instructions during model training. b) Training-free mitigation methods like prompt guardrails, retrieval-augmented generation (RAG), and decoding strategies to curb misinformation at inference time. Detecting misinformation after generation, including a) using LLMs themselves to detect misinformation through embedded knowledge or retrieval-enhanced judgments, and b) distinguishing LLM-generated text from human-written text through black-box approaches (e.g., classifiers, probability analysis) and white-box approaches (e.g., watermarking). We also discuss the challenges and limitations of detecting LLM-generated misinformation.

26 March 2026 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
DYDianzhi Yu
Dianzhi Yu
XZXinni Zhang
Xinni Zhang
YCYankai Chen
Yankai Chen
ALAiwei Liu
Aiwei Liu
YZYifei Zhang
Yifei Zhang
IKIrwin King
Irwin King
Continual learning (CL) aims to empower machine learning (ML) models to learn continually from new data, while building upon previously acquired knowledge without forgetting. As models have evolved from small to large pretrained architectures, and from supporting unimodal to multimodal (MM) data, multimodal CL (MMCL) methods have recently emerged. The primary complexity of MMCL is that it extends beyond a simple stacking of unimodal CL methods. Such straightforward approaches often suffer from MM catastrophic forgetting, yielding unsatisfactory performance. In addition, MMCL introduces new challenges that unimodal CL methods fail to adequately address, including modality imbalance, complex modality interaction, high computational costs, and degradation of the pretrained zero-shot capability of MM backbones. In this work, we present the first comprehensive survey on MMCL. We provide essential background knowledge and MMCL settings, as well as a structured taxonomy of MMCL methods. We categorize MMCL methods into four categories, i.e., regularization-based, architecture-based, replay-based, and prompt-based methods, explaining their methodologies and highlighting their key innovations. Additionally, to prompt further research in this field, we summarize open MMCL datasets and benchmarks, provide an in-depth discussion, and discuss several promising future directions. We have also created a GitHub repository for indexing relevant MMCL articles and open resources available at https://github.com/LucyDYu/Awesome-Multimodal-Continual-Learning.

19 September 2023 in IEEE Transactions on Knowledge and Data Engineering
Verified
Journal Article
Closed access
XHXuming Hu
Xuming Hu
ZHZhaochen Hong
Zhaochen Hong
CZChenwei Zhang
Chenwei Zhang
ALAiwei Liu
Aiwei Liu
SMShiao Meng
Shiao Meng
PYPhilip S. Yu
Philip S. Yu
Open relation extraction is the task of extracting open-domain relation facts from natural language sentences. Existing works either utilize distant-supervised annotations to train a supervised classifier over pre-defined relations, or adopt unsupervised methods with additional dependency on external assumptions. However, these works can only obtain information signals from limited existing knowledge bases or datasets. In this work, we propose a self-supervised framework named Web-SelfORE , which exploits self-supervised signals by requiring a large pretrained language model to extensively read real-world relevant documents from the web, and obtain contextualized relational features by mixing contextualized representations of entities from different documents. We perform adaptive clustering on contextualized relational features and bootstrap the self-supervised signals by improving contextualized features in relation classification. We additionally compare the effectiveness of self-supervisions brought by different document sources, and introduce relevance and redundancy evaluation metrics to obtain higher-quality self-supervisions. Experimental results on four public datasets show the effectiveness and robustness of Web-SelfORE on open-domain relation extraction task when comparing with competitive baselines.