Zongru Wu

Zongru Wu

Auto-generated profile, based on publicly available information

Zongru Wu

School of Electronic Information and Electrical Engineering Shanghai Jiao Tong University

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 February 2025 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
Pengzhou ChengPengzhou Cheng
Pengzhou Cheng
ZWZongru Wu
Zongru Wu
WDWei Du
Wei Du
HZHaodong Zhao
Haodong Zhao
WLWei Lu
Wei Lu
GLGongshen Liu
Gongshen Liu
Language models (LMs) are becoming increasingly popular in real-world applications. Outsourcing model training and data hosting to third-party platforms has become a standard method for reducing costs. In such a situation, the attacker can manipulate the training process or data to inject a backdoor into models. Backdoor attacks are a serious threat where malicious behavior is activated when triggers are present; otherwise, the model operates normally. However, there is still no systematic and comprehensive review of LMs from the attacker’s capabilities and purposes on different backdoor attack surfaces. Moreover, there is a shortage of analysis and comparison of the diverse emerging backdoor countermeasures. Therefore, this work aims to provide the natural language processing (NLP) community with a timely review of backdoor attacks and countermeasures. According to the attackers’ capability and affected stage of the LMs, the attack surfaces are formalized into four categorizations: attacking the pretrained model with fine-tuning (APMF) or parameter-efficient fine-tuning (PEFT), attacking the final model with training (AFMT), and attacking large language model (ALLM). Thus, attacks under each categorization are combed. The countermeasures are categorized into two general classes: sample inspection and model inspection. Thus, we review countermeasures and analyze their advantages and disadvantages. Also, we summarize the benchmark datasets and provide comparable evaluations for representative attacks and defenses. Drawing the insights from the review, we point out the crucial areas for future research on the backdoor, especially soliciting more efficient and practical countermeasures.

1 January 2024
Verified
Conference Paper
Open access
PDF file
ZWZongru Wu
Zongru Wu
ZZZhuosheng Zhang
Zhuosheng Zhang
PCPengzhou Cheng
Pengzhou Cheng
GLGongshen Liu
Gongshen Liu
Zongru Wu, Zhuosheng Zhang, Pengzhou Cheng, Gongshen Liu. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

20 January 2025 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
XWXinxin Wang
Xinxin Wang
Jing ChenJing Chen
Jing Chen
ZZZijun Zhang
Zijun Zhang
KHKun He
Kun He
ZWZongru Wu
Zongru Wu
GLGongshen Liu
Gongshen Liu
Object detection models have been widely deployed in physical world applications, and they are vulnerable to adversarial attacks. However, most adversarial attacks are implemented in a white-box setting, and under ideal shooting conditions such as fixed distances and angles, and thus have limited attack success rate (ASR) in practice. In this paper, we present a transferable and robust dynamic adversarial attack where the adversarial patches can be printed on or attached to non-rigid objects such as clothes. We develop a cascade module with a momentum-based technique to optimize adversarial patches against various object detection models, achieving better transferability of the patches in a black-box setting. We also develop a strategy of distance-adaptive patch generation and employ perspective transformation to enhance the robustness of patches. To evaluate the attack performance, we conduct extensive experiments on seven mainstream object detection models at different distances and angles. The results show that our method can achieve an average ASR of 69.85%, which is 3.27 times that of the baseline method at 3 meters.

29 May 2026 in IEEE Transactions on Audio, Speech and Language Processing
Verified
Journal Article
Closed access
ZWZheng Wu
Zheng Wu
Pengzhou ChengPengzhou Cheng
Pengzhou Cheng
ZWZongru Wu
Zongru Wu
YGYuan Guo
Yuan Guo
TJTianjie Ju
Tianjie Ju
ZZZhuosheng Zhang
Zhuosheng Zhang
Recent advancements in multimodal large language models (MLLMs) have shown exceptional potential in enabling mobile-using agents to autonomously execute human instructions. However, fully automated agents often try to execute tasks even when they are unable to resolve them, leading to the problem of over-execution. Previous studies solve it by training a interactive mobile-using agents to let agents request human interaction when agents can not complete user instructions. However, we find that these interactive agents tend to exhibit over-soliciting behavior, relying excessively on human intervention. To mitigate both over-execution and over-soliciting, we propose a universal confidence integration framework that enables confidence-driven proactive and robust interaction in MLLM-based mobile-using agents. The framework consists of two stages: interaction capability empowerment and confidence bias correction. In the interaction capability empowerment stage, agents learn through supervised fine-tuning to output both actions and confidence scores. In the confidence bias correction stage, agents learn to output more accurate confidence scores by combining semantic similarity retrieval with direct preference optimization. Experimental results show Mobile-Aptus achieves state-of-the-art performance on the four popular mobile-using agent benchmarks: OS-Kairos, AITZ, Meta-GUI, and AndroidControl. Mobile-Aptus consistently outperforms all baselines in offline benchmarks, with an average improvement over 17% in task success rate. In real-world dynamic experiments, Mobile-Aptus surpasses the baseline by 26% in task success rate with only 0.64 intervention steps per instruction. Moreover, we find that the salient human interventions can be effectively replaced by a multi-agent system to avoid task interruption. The codes are available at https://github.com/Wuzheng02/Mobile-Aptus.

17 March 2026 in SSRN Electronic Journal
Verified
Preprint
Open access
ZWZongru Wu
Zongru Wu
Pengzhou ChengPengzhou Cheng
Pengzhou Cheng
ZWZheng Wu
Zheng Wu
TJTianjie Ju
Tianjie Ju
ZZZhuosheng Zhang
Zhuosheng Zhang
GLGongshen Liu
Gongshen Liu
Domain adaptation, particularly through grounding techniques, is widely adopted for multimodal large language models (MLLMs) to enhance the perception of graphical user interface (GUI) environments, further improving the reasoning performance of MLLM-powered GUI agents. However, in resource-constrained scenarios, the format discrepancy between coordinate-oriented grounding and goal-oriented reasoning limits the adaptation effectiveness. To investigate a supplementary domain adaptation method that can further improve GUI perception and reasoning, we propose a query-oriented pivot approach called Intended Query Inference (InQuIre). From an information-theoretic perspective, InQuIre serves as a semantic pivot task that maximizes the mutual information between visual representations and user intent. By explicitly deducing the intended queries behind action coordinates, InQuIre provides dense supervision to align coordinate-indicated visual features with functional intent, offering superior data efficiency compared to sparse coordinate supervision. Experimental results focusing on mobile platform show that InQuIre outperforms grounding under the same adaptation data scale. Notably, InQuIre achieves comparable performance to large-scale grounding-adapted OS-Atlas with less than 0.1% of adaptation data. Furthermore, through experiments in cross-platform scenarios, InQuIre demonstrates its generalizability. Additionally, we explore the impact of reasoning formats and highlight that integrating additional semantic information into the input further boosts reasoning performance. Finally, through attention visualization, we validate that InQuIre effectively guides the focus toward functionally relevant GUI elements, ensuring robust comprehension of user intent. The code is publicly available at https://github.com/ZrW00/GUIPivot.

4 March 2025 in arXiv
Verified
Preprint
Open access
PDF file
ZWZongru Wu
Zongru Wu
PCPengzhou Cheng
Pengzhou Cheng
ZWZheng Wu
Zheng Wu
TJTianjie Ju
Tianjie Ju
ZZZhuosheng Zhang
Zhuosheng Zhang
GLGongshen Liu
Gongshen Liu
Perception-enhanced pre-training, particularly through grounding techniques, is widely adopted to enhance the performance of graphical user interface (GUI) agents. However, in resource-constrained scenarios, the format discrepancy between coordinate-oriented grounding and action-oriented reasoning limits the effectiveness of grounding for reasoning tasks. To address this challenge, we propose a query-oriented pivot approach called query inference, which serves as a bridge between GUI grounding and reasoning. By inferring potential user queries from a screenshot and its associated element coordinates, query inference improves the understanding of coordinates while aligning more closely with reasoning tasks. Experimental results show that query inference outperforms previous grounding techniques under the same training data scale. Notably, query inference achieves comparable or even better performance to large-scale grounding-enhanced OS-Atlas with less than 0.1% of training data. Furthermore, we explore the impact of reasoning formats and demonstrate that integrating additional semantic information into the input further boosts reasoning performance. The code is publicly available at https://github.com/ZrW00/GUIPivot.