Zihao Cheng

Zihao Cheng

orcid

Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2025
Verified
Conference Paper
Open access
PDF file
ZCZihao Cheng
Zihao Cheng
HWHongru Wang
Hongru Wang
ZLZeming Liu
Zeming Liu
YGYuhang Guo
Yuhang Guo
YGYuanfang Guo
Yuanfang Guo
HWHaifeng Wang
Haifeng Wang
Zihao Cheng, Hongru Wang, Zeming Liu, Yuhang Guo, Yuanfang Guo, Yunhong Wang, Haifeng Wang. Findings of the Association for Computational Linguistics: ACL 2025. 2025.

22 May 2025 in arXiv
Verified
Preprint
Open access
PDF file
ZCZihao Cheng
Zihao Cheng
HWHongru Wang
Hongru Wang
ZLZeming Liu
Zeming Liu
YGYuhang Guo
Yuhang Guo
YGYuanfang Guo
Yuanfang Guo
HWHaifeng Wang
Haifeng Wang
While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user instructions, overlooking the context-aware personalization in tool selection. This oversight leads to suboptimal user satisfaction and inefficient tool utilization, particularly when overlapping toolsets require nuanced selection based on contextual factors. To bridge this gap, we introduce ToolSpectrum, a benchmark designed to evaluate LLMs' capabilities in personalized tool utilization. Specifically, we formalize two key dimensions of personalization, user profile and environmental factors, and analyze their individual and synergistic impacts on tool utilization. Through extensive experiments on ToolSpectrum, we demonstrate that personalized tool utilization significantly improves user experience across diverse scenarios. However, even state-of-the-art LLMs exhibit the limited ability to reason jointly about user profiles and environmental factors, often prioritizing one dimension at the expense of the other. Our findings underscore the necessity of context-aware personalization in tool-augmented LLMs and reveal critical limitations for current models. Our data and code are available at https://github.com/Chengziha0/ToolSpectrum.

3 September 2026 in Preprints.org
Verified
Preprint
Open access
PDF file
ZCZihao Cheng
Zihao Cheng
YLYixia Li
Yixia Li
SYShengbin Yue
Shengbin Yue
YLYuheng Lu
Yuheng Lu
YQYuli Qiu
Yuli Qiu
HWHaifeng Wang
Haifeng Wang
A large language model (LLM) agent is a model coupled to a harness: parametric weights that hold knowledge and reasoning ability, wrapped in an external apparatus of memory, tools, and orchestration through which the model perceives and acts. Progress over the past years has come from pushing on both, with stronger models and richer harnesses, but the design decision that quietly governs an agent’s behavior is where competence should live: which knowledge, skills, and control to internalize into the model’s parameters, and which to externalize onto the surrounding harness. These decisions increasingly determine whether an agent is reliable, efficient, and able to keep improving. We investigate this core problem through the lens of the Theory of Agent (ToA), which views an LLM agent not as a task executor but as an epistemic decision-maker in terms of reasoning or acting at every step. The two means it has for that epistemic uncertainty reduction, namely reasoning over what it already holds and acting on the world to obtain what it does not, are the run-time faces of internalization and externalization: reasoning draws on competence that has been absorbed into the model, while acting exploits competence that remains in the harness. We review this internalization and externalization across five chapters. Foundations sets up the basic picture: an agent that, at each step, decides whether to answer from what it already knows or reach outside for what it does not, and what separates a good version of that decision from a wasteful one. Learning examines how training places competence on either side of the boundary, spanning internalization of memory, reasoning, tool-use policy, and world models, and externalization of memory, skills, and orchestration. Aligning treats calibration as the connecting thread across an agent’s cognitive boundaries, efficiency constraints, human preferences, environment constraints, and other agents. Evolving studies how agents revise both sides of the boundary over time, from model-side and harness-side updates to agent–environment co-evolution. Evaluation reinterprets metrics and benchmarks by the epistemic effort they expose and argues for measuring the boundary decision rather than task completion alone. We conclude with the open problems that follow once internalization and externalization are treated as the governing axis of agent design.