Zhiwei Zhang

Zhiwei Zhang

Auto-generated profile, based on publicly available information

Zhiwei Zhang

The Pennsylvania State University, University Park, PA, USA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 November 2025 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
FWFali Wang
Fali Wang
ZZZhiwei Zhang
Zhiwei Zhang
XZXianren Zhang
Xianren Zhang
ZWZongyu Wu
Zongyu Wu
TMTzuHao Mo
TzuHao Mo
SWSuhang Wang
Suhang Wang
Large language models (LLMs) have demonstrated emergent abilities in text generation, question answering, and reasoning, facilitating various tasks and domains. Despite their proficiency in various tasks, LLMs like PaLM 540B and Llama-3.1 405B face limitations due to large parameter sizes and computational demands, often requiring cloud API use, which raises privacy concerns, limits real-time applications on edge devices, and increases fine-tuning costs. Additionally, LLMs often underperform in specialized domains such as healthcare and law due to insufficient domain-specific knowledge, necessitating specialized models. Therefore, Small Language Models (SLMs) are increasingly favored for their low inference latency, cost-effectiveness, efficient development, and easy customization and adaptability. These models are particularly well-suited for resource-limited environments and domain knowledge acquisition, addressing LLMs’ challenges and proving ideal for applications that require localized data handling for privacy, minimal inference latency for efficiency, and domain knowledge acquisition through lightweight fine-tuning. The rising demand for SLMs has spurred extensive research and development. However, a comprehensive survey investigating issues related to the definition, acquisition, application, enhancement, and reliability of SLM remains lacking, prompting us to conduct a detailed survey on these topics. The definition of SLMs varies widely; thus, to standardize, we propose defining SLMs by their capability to perform specialized tasks and suitability for resource-constrained settings, setting boundaries based on the minimal size for emergent abilities and the maximum size sustainable under resource constraints. For other aspects, we provide a taxonomy of relevant models/methods and develop general frameworks for each category to enhance and utilize SLMs effectively. We have compiled the collected SLM models and related methods on GitHub: https://github.com/FairyFali/SLMs-Survey .

24 August 2024
Verified
Conference Paper
Open access
ZZZhiwei Zhang
Zhiwei Zhang
MLMinhua Lin
Minhua Lin
EDEnyan Dai
Enyan Dai
SWSuhang Wang
Suhang Wang
Graph Neural Networks (GNNs) have shown remarkable performance in various tasks. However, recent works reveal that GNNs are vulnerable to backdoor attacks. Generally, backdoor attack poisons the graph by attaching backdoor triggers and the target class label to a set of nodes in the training graph. A GNN trained on the poisoned graph will then be misled to predict test nodes attached with trigger to the target class. Despite their effectiveness, our empirical analysis shows that triggers generated by existing methods tend to be out-of-distribution (OOD), which significantly differ from the clean data. Hence, these injected triggers can be easily detected and pruned with widely used outlier detection methods in real-world applications. Therefore, in this paper, we study a novel problem of unnoticeable graph backdoor attacks with in-distribution (ID) triggers. To generate ID triggers, we introduce an OOD detector in conjunction with an adversarial learning strategy to generate the attributes of the triggers within distribution. To ensure a high attack success rate with ID triggers, we introduce novel modules designed to enhance trigger memorization by the victim model trained on poisoned graph. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method in generating in distribution triggers that can bypass various defense strategies while maintaining a high attack success rate.

3 August 2025
Verified
Conference Paper
Open access
MLMinhua Lin
Minhua Lin
ZZZhiwei Zhang
Zhiwei Zhang
EDEnyan Dai
Enyan Dai
ZWZongyu Wu
Zongyu Wu
YWYilong Wang
Yilong Wang
SWSuhang Wang
Suhang Wang

21 February 2026
Verified
Conference Paper
Open access
JZJiahao Zhang
Jiahao Zhang
YWYilong Wang
Yilong Wang
ZZZhiwei Zhang
Zhiwei Zhang
XLXiaorui Liu
Xiaorui Liu
SWSuhang Wang
Suhang Wang