Tianyu Chen

Dr. Tianyu Chen


Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 November 2025 in Mathematics
Verified
Journal Article
Open access
PDF file
SJShan Jiang
Shan Jiang
TCTianyu Chen
Tianyu Chen
YTYufei Tan
Yufei Tan
SGShiqi Gao
Shiqi Gao
LLLanhao Li
Lanhao Li
New AI technologies have empowered e-commerce personalized recommendation systems, many of which now leverage time-series forecasting to capture dynamic user preferences. However, buyers’ algorithm aversion hinders these systems from realizing their full potential in enabling data-driven decisions. Current research focuses heavily on artifact design and algorithm optimization to reduce aversion, with insufficient attention to the temporal dimensions of human–AI interaction (HAII). To address this gap, this study explores how recommendation accuracy, novelty, and diversity—key attributes in time-series recommendation contexts—influence buyers’ algorithm aversion from a temporal HAII perspective. Data from 205 online survey responses were analyzed using partial least squares structural equation modeling (PLS-SEM). Results reveal that accuracy (encompassing sequential prediction consistency), novelty (balanced with temporal relevance), and diversity (covering long-term preferences) negatively impact algorithm aversion, with perceived usefulness as a mediator. Reduced aversion further facilitates data-driven purchasing decisions. This study enriches the algorithm aversion literature by emphasizing temporal HAII in time-series recommendation scenarios, bridging human factors research with data-driven decision-making in e-commerce.

1 September 2025
Verified
Conference Paper
Open access
PDF file
TCTianyu Chen
Tianyu Chen
HZHaoyi Zhou
Haoyi Zhou
YLYing Li
Ying Li
HWHao Wang
Hao Wang
ZZZhenzhe Zhang
Zhenzhe Zhang
JLJianxin Li
Jianxin Li
Fourier Neural Operators (FNO) have emerged as promising solutions for efficiently solving partial differential equations (PDEs) by learning infinite-dimensional function mappings through frequency domain transformations. However, the sparsity of high-frequency signals limits computational efficiency for high-dimensional inputs, and fixed-pattern truncation often causes high-frequency signal loss, reducing performance in scenarios such as high-resolution inputs or long-term predictions. To address these challenges, we propose FreqMoE, an efficient and progressive training framework that exploits the dependency of high-frequency signals on low-frequency components. The model first learns low-frequency weights and then applies a sparse upward-cycling strategy to construct a mixture of experts (MoE) in the frequency domain, effectively extending the learned weights to high-frequency regions. Experiments on both regular and irregular grid PDEs demonstrate that FreqMoE achieves up to 16.6 percent accuracy improvement while using merely 2.1 percent parameters (47.32x reduction) compared to dense FNO. Furthermore, the approach demonstrates remarkable stability in long-term predictions and generalizes seamlessly to various FNO variants and grid structures, establishing a new Low frequency Pretraining, High frequency Fine-tuning'' paradigm for solving PDEs.

25 December 2025 in arXiv
Verified
Preprint
Open access
PDF file
HZHaoyi Zhou
Haoyi Zhou
SLShuo Li
Shuo Li
TCTianyu Chen
Tianyu Chen
QSQi Song
Qi Song
CGChonghan Gao
Chonghan Gao
JLJianxin Li
Jianxin Li
While large vision-language models (VLMs) demonstrate strong long-context understanding, their prevalent small branches fail on linguistics-photography alignment for a limited window size. We discover that knowledge distillation improves students' capability as a complement to Rotary Position Embeddings (RoPE) on window sizes (anchored from large models). Building on this insight, we propose LAid, which directly aims at the transfer of long-range attention mechanisms through two complementary components: (1) a progressive distance-weighted attention matching that dynamically emphasizes longer position differences during training, and (2) a learnable RoPE response gain modulation that selectively amplifies position sensitivity where needed. Extensive experiments across multiple model families demonstrate that LAid-distilled models achieve up to 3.2 times longer effective context windows compared to baseline small models, while maintaining or improving performance on standard VL benchmarks. Spectral analysis also suggests that LAid successfully preserves crucial low-frequency attention components that conventional methods fail to transfer. Our work not only provides practical techniques for building more efficient long-context VLMs but also offers theoretical insights into how positional understanding emerges and transfers during distillation.

29 December 2025 in arXiv
Verified
Preprint
Open access
PDF file
GWGuoan Wan
Guoan Wan
TCTianyu Chen
Tianyu Chen
FFFangzheng Feng
Fangzheng Feng
HZHaoyi Zhou
Haoyi Zhou
RXRunhua Xu
Runhua Xu
Parameter-efficient fine-tuning (PEFT) methods have emerged as a practical solution for adapting large foundation models to downstream tasks, reducing computational and memory costs by updating only a small subset of parameters. Among them, approaches like LoRA aim to strike a balance between efficiency and expressiveness, but often suffer from slow convergence and limited adaptation capacity due to their inherent low-rank constraints. This trade-off hampers the ability of PEFT methods to capture complex patterns needed for diverse tasks. To address these challenges, we propose FRoD, a novel fine-tuning method that combines hierarchical joint decomposition with rotational degrees of freedom. By extracting a globally shared basis across layers and injecting sparse, learnable perturbations into scaling factors for flexible full-rank updates, FRoD enhances expressiveness and efficiency, leading to faster and more robust convergence. On 20 benchmarks spanning vision, reasoning, and language understanding, FRoD matches full model fine-tuning in accuracy, while using only 1.72% of trainable parameters under identical training budgets.

23 March 2025 in arXiv
Verified
Preprint
Open access
PDF file
XXXin Xue
Xin Xue
HZHaoyi Zhou
Haoyi Zhou
TCTianyu Chen
Tianyu Chen
SZShuai Zhang
Shuai Zhang
YLYizhou Long
Yizhou Long
JLJianxin Li
Jianxin Li
Spatial-temporal sequence forecasting (STSF) is a long-standing research problem with widespread real-world applications. Neural architecture search (NAS), which automates the neural network design, has been shown effective in tackling the STSF problem. However, the existing NAS methods for STSF focus on generating architectures in a time-consuming data-driven fashion, which heavily limits their ability to use background knowledge and explore the complicated search trajectory. Large language models (LLMs) have shown remarkable ability in decision-making with comprehensive internal world knowledge, but how it could benefit NAS for STSF remains unexplored. In this paper, we propose a novel NAS method for STSF based on LLM. Instead of directly generate architectures with LLM, We inspire the LLM's capability with a multi-level enhancement mechanism. Specifically, on the step-level, we decompose the generation task into decision steps with powerful prompt engineering and inspire LLM to serve as instructor for architecture search based on its internal knowledge. On the instance-level, we utilize a one-step tuning framework to quickly evaluate the architecture instance and a memory bank to cumulate knowledge to improve LLM's search ability. On the task-level, we propose a two-stage architecture search, balancing the exploration stage and optimization stage, to reduce the possibility of being trapped in local optima. Extensive experimental results demonstrate that our method can achieve competitive effectiveness with superior efficiency against existing NAS methods for STSF.

17 November 2025 in arXiv
Verified
Preprint
Open access
PDF file
ZSZeyu Shi
Zeyu Shi
ZWZiming Wang
Ziming Wang
TCTianyu Chen
Tianyu Chen
SGShiqi Gao
Shiqi Gao
HZHaoyi Zhou
Haoyi Zhou
JLJianxin Li
Jianxin Li
The honesty of Large Language Models (LLMs) is increasingly important for safe deployment in high-stakes domains. However, this crucial trait is severely undermined by supervised fine-tuning (SFT), a common technique for model specialization. Existing recovery methods rely on data-intensive global parameter adjustments, implicitly assuming that SFT deeply corrupts the models' ability to recognize their knowledge boundaries. However, we observe that fine-tuned LLMs still preserve this ability; what is damaged is their capacity to faithfully express that awareness. Building on this, we propose Honesty-Critical Neurons Restoration (HCNR) to surgically repair this suppressed capacity. HCNR identifies and restores key expression-governing neurons to their pre-trained state while harmonizing them with task-oriented neurons via Hessian-guided compensation. Experiments on four QA tasks and five LLM families demonstrate that HCNR effectively recovers 33.25% of the compromised honesty while achieving at least 2.23x speedup with over 10x less data compared to baseline methods, offering a practical solution for trustworthy LLM deployment.