Nanjie Yao

Nanjie Yao


Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

2 June 2026 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
NYNanjie Yao
Nanjie Yao
GZGangjian Zhang
Gangjian Zhang
WSWenhao Shen
Wenhao Shen
JSJian Shu
Jian Shu
YFYu Feng
Yu Feng
HWHao Wang
Hao Wang
Monocular 3D clothed human reconstruction aims to generate a complete and realistic textured 3D avatar from a single image. Existing methods are commonly trained under multi-view supervision with annotated geometric priors, and during inference, these priors are estimated by the pre-trained network from the monocular input. These methods are constrained by three key limitations: texturally by unavailability of training data, geometrically by inaccurate external priors, and systematically by biased single-modality supervision, all leading to suboptimal reconstruction. To address these issues, we propose a novel reconstruction framework, named MultiGO++, which achieves effective systematic geometry-texture collaboration. It consists of three core parts: (1) A multi-source texture synthesis strategy that constructs 15,000+ 3D textured human scans to improve the performance on texture quality estimation in challenge scenarios; (2) A region-aware shape extraction module that extracts and interacts features of each body region to obtain geometry information and a Fourier geometry encoder that mitigates the modality gap to achieve effective geometry learning; (3) A dual reconstruction U-Net that leverages geometry-texture collaborative features to refine and generate high-fidelity textured 3D human meshes. Extensive experiments on two benchmarks and many in-the-wild cases show the superiority of our method over state-of-the-art approaches. Our project page can be seen at: https://3dagentworld.github.io/multigo ++.

15 July 2026 in Preprints.org
Verified
Preprint
Open access
PDF file
ZZZheng Zhang
Zheng Zhang
NYNanjie Yao
Nanjie Yao
YFYu Feng
Yu Feng
QCQi Chai
Qi Chai
LLLiu Liu
Liu Liu
HXHui Xiong
Hui Xiong
Large language models (LLMs) have become a common center for building intelligent agents, yet many real tasks still need abilities that a single LLM cannot provide. A growing line of work therefore connects LLMs with specialized non-LLM models, including object detectors, segmentation models, diffusion generators, and robot policies. We call this emerging paradigm Heterogeneous Multi-Model Agents (HMMAs). This survey provides a systematic review of 572 HMMA papers published at major AI venues between 2023 and 2026. We first define the scope of HMMAs and distinguish them from adjacent paradigms. We then organize existing systems into five interaction patterns according to the roles played by perception, generation, and action models. Building on this taxonomy, we analyze architectural choices across information flow, interface design, feedback structure, uncertainty handling, and model coupling, and review major application domains. Finally, we summarize open challenges and outline future directions for building reliable HMMAs.

1 December 2025 in arXiv
Verified
Preprint
Open access
PDF file
JSJian Shu
Jian Shu
NYNanjie Yao
Nanjie Yao
GZGangjian Zhang
Gangjian Zhang
JRJunlong Ren
Junlong Ren
YFYu Feng
Yu Feng
HWHao Wang
Hao Wang
3D human avatar animation aims at transforming a human avatar from an arbitrary initial pose to a specified target pose using deformation algorithms. Existing approaches typically divide this task into two stages: canonical template construction and target pose deformation. However, current template construction methods demand extensive skeletal rigging and often produce artifacts for specific poses. Moreover, target pose deformation suffers from structural distortions caused by Linear Blend Skinning (LBS), which significantly undermines animation realism. To address these problems, we propose a unified learning-based framework to address both challenges in two phases. For the former phase, to overcome the inefficiencies and artifacts during template construction, we leverage a U-Net architecture that decouples texture and pose information in a feed-forward process, enabling fast generation of a human template. For the latter phase, we propose a data-driven refinement technique that enhances structural integrity. Extensive experiments show that our model delivers consistent performance across diverse poses with an optimal balance between efficiency and quality,surpassing state-of-the-art (SOTA) methods.

12 April 2026
Verified
Conference Paper
Open access
Zhenyu WenZhenyu Wen
Zhenyu Wen
JFJintao Feng
Jintao Feng
NYNanjie Yao
Nanjie Yao
DWDi Wu
Di Wu
CWCong Wang
Cong Wang
Shibo HeShibo He
Shibo He
The deployment of AI-powered applications on resource-constrained edge devices presents a significant software engineering challenge. While Pruning and Neural Architecture Search (NAS) have shown promise in optimizing model efficiency, their application in edge device deployment is often limited by low levels of automation. In this paper, we introduce LLM-based Adaptive Model Generation (LAMDA), a novel framework that tackle the challenge of adaptive AI deployment as an automated model generation problem. LAMDA empowers an LLM to perform end-to-end design, refinement, and optimization of DNNs to meet the specific hardware constraints. Our approach makes two primary contributions. First, we introduce a serialization technique that transforms complex DNN computation graphs into a structured textual representation that makes model architectures comprehensible and manipulable by an LLM. Further, to ground the generation process in real-world hardware constraints, we integrate a feedback-driven optimization loop. This loop leverages an empirical performance model, trained to correlate architectural patterns with on-device latency, enabling the LLM to reason about and optimize for non-functional requirements. To mitigate architectural “hallucinations”, we incorporate context management and validation to ensure valid generation. We evaluate LAMDA through extensive experiments on public benchmarks and real-world edge devices. The results demonstrate that our framework can autonomously generate and adapt DNNs that satisfy deployment-specific accuracy and latency constraints, significantly advancing the state-of-the-art in automated software adaptation for the AI-enabled edge devices.

11 September 2026 in Preprints.org
Verified
Preprint
Open access
PDF file
NYNanjie Yao
Nanjie Yao
HWHao Wang
Hao Wang
CCChong Cheng
Chong Cheng
ZCZhikang Chen
Zhikang Chen
WLWenzhe Li
Wenzhe Li
DYDeheng Ye
Deheng Ye
World models are emerging as a key interface between perception and decision making in embodied intelligence, enabling agents to preserve hidden state, anticipate consequences, compare interventions, and adapt when execution departs from expectation. Much of this progress has been measured by visual fidelity. For an embodied agent, however, the purpose of a world model is to improve behavior by predicting futures that inform intervention and decision making. Before reaching for a cup, a person anticipates its weight and how it will resist the grasp, and the hand shapes itself before contact. That anticipation is coarse and rarely pictorial, yet it guides the movement. The key question is therefore which properties of a prediction let it improve behavior. Existing surveys organize this literature by architecture, output modality, or application domain, which leaves this question implicit. We accordingly characterize world model capability through three progressively stronger levels: A Plausible world model preserves task-relevant temporal, geometric, or physical structure; a Controllable model additionally predicts how interventions change that structure; and an Actionable model uses prediction to produce measurable improvements in planning, action, learning, evaluation, verification, recovery, or data selection. We complement this capability ladder with a 3x4 analysis matrix that crosses geometry, physics, and action grounding with data, reward, policy, and model-self improvement loops. Using this framework, we survey research across manipulation, navigation, locomotion, autonomous driving, and general embodied learning. We organize methods as technical progressions, clarify the capability required at each level, and examine datasets, benchmarks, and evaluation protocols. Finally, we identify open challenges in long-horizon consistency, uncertainty calibration, causal intervention testing, latency, verification and recovery, and cross-embodiment transfer. This perspective motivates a shift in evaluation from whether a model can generate a convincing future to whether it represents the right state, responds correctly to action, and improves the closed-loop behavior of an embodied agent.