Yichen Zhu

Yichen Zhu

Auto-generated profile, based on publicly available information

Yichen Zhu

Midea Group, Guangdong, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 February 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JWJunjie Wen
Junjie Wen
YZYichen Zhu
Yichen Zhu
JLJinming Li
Jinming Li
MZMinjie Zhu
Minjie Zhu
ZTZhibin Tang
Zhibin Tang
JTJian Tang
Jian Tang
Vision-Language-Action (VLA) models have shown remarkable potential in visuomotor control and instruction comprehension through end-to-end learning processes. However, current VLA models face significant challenges: they are slow during inference and require extensive pre-training on large amounts of robotic data, making real-world deployment difficult. In this letter, we introduce a new family of compact vision-language-action models, called TinyVLA, which offers two key advantages over existing VLA models: (1) faster inference speeds, and (2) improved data efficiency, eliminating the need for pre-training stage. Our framework incorporates two essential components to build TinyVLA: (1) initializing the policy backbone with robust, high-speed multimodal models, and (2) integrating a diffusion policy decoder during fine-tuning to enable precise robot actions. We conducted extensive evaluations of TinyVLA in both simulation and on real robots, demonstrating that our approach significantly outperforms the state-of-the-art VLA model, OpenVLA, in terms of speed and data efficiency, while delivering comparable or superior performance. Additionally, TinyVLA exhibits strong generalization capabilities across various dimensions, including language instructions, novel objects, unseen positions, changes in object appearance, background variations, and environmental shifts, often matching or exceeding the performance of OpenVLA. We believe that TinyVLA offers an interesting perspective on utilizing pre-trained multimodal models for policy learning.

28 October 2024
Verified
Conference Paper
Open access
YZYichen Zhu
Yichen Zhu
MZMinjie Zhu
Minjie Zhu
WZWill Zhang
Will Zhang
ZXZhiyuan Xu
Zhiyuan Xu
YPYaxin Peng
Yaxin Peng
In this paper, we introduce LLaVA-φ (LLaVA-Phi), an efficient multi-modal assistant that harnesses the power of the recently advanced small language model, Phi-2, to facilitate multi-modal dialogues. LLaVA-Phi marks a notable advancement in the realm of compact multi-modal models. It demonstrates that even smaller language models, with as few as 2.7B parameters, can effectively engage in intricate dialogues that integrate both textual and visual elements, provided they are trained with high-quality corpora. Our model delivers commendable performance on publicly available benchmarks that encompass visual comprehension, reasoning, and knowledge-based perception. Beyond its remarkable performance in multi-modal dialogue tasks, our model opens new avenues for applications in time-sensitive environments and systems that require real-time interaction, such as embodied agents. It highlights the potential of smaller language models to achieve sophisticated levels of understanding and interaction, while maintaining greater resource efficiency. The project is available at https://github.com/zhuyiche/llava-phi **REMOVE 2nd URL**://github.com/zhuyiche/llava-phi.

12 January 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
CLChengmeng Li
Chengmeng Li
JWJunjie Wen
Junjie Wen
YPYaxin Peng
Yaxin Peng
YPYan Peng
Yan Peng
YZYichen Zhu
Yichen Zhu
Vision-Language-Action (VLA) models excel at robotic tasks by leveraging large-scale 2D vision-language pretraining, but their reliance on RGB images limits spatial reasoning critical for real-world interaction. Retraining these models with 3D data is computationally prohibitive, while discarding existing 2D datasets wastes valuable resources. To bridge this gap, we propose PointVLA, a framework that enhances pre-trained VLAs with point cloud inputs without requiring retraining. Our method freezes the vanilla action expert and injects 3D features via a lightweight modular block. To identify the most effective way of integrating point cloud representations, we conduct a skip-block analysis to pinpoint less useful blocks in the vanilla action expert, ensuring that 3D features are injected only into these blocks—minimizing disruption to pre-trained representations. Extensive experiments demonstrate that PointVLA outperforms state-of-the-art 2D imitation learning methods, such as OpenVLA, Diffusion Policy and DexVLA, across both simulated and real-world robotic tasks. Specifically, we highlight several key advantages of PointVLA enabled by point cloud integration: (1) Few-shot multi-tasking, where PointVLA successfully performs four different tasks using only 20 demonstrations each; (2) Real-vs-photo discrimination, where PointVLA distinguishes real objects from their images, leveraging 3D world knowledge to improve safety and reliability; (3) Height adaptability, where unlike conventional 2D imitation learning methods, PointVLA enables robots to adapt to objects at varying table heights that were unseen in training data. Furthermore, PointVLA achieves strong performance in long-horizon tasks, such as picking and packing objects from a moving conveyor belt, showcasing its ability to generalize across complex, dynamic environments.

6 November 2022
Verified
Book Chapter
Closed access
PDF file
YHYaomin Huang
Yaomin Huang
XLXinmei Liu
Xinmei Liu
YZYichen Zhu
Yichen Zhu
ZXZhiyuan Xu
Zhiyuan Xu
CSChaomin Shen
Chaomin Shen
JTJian Tang
Jian Tang


6 June 2025 in Neural Networks
Verified
Journal Article
Closed access
YLYantao Lu
Yantao Lu
SSShiqi Sun
Shiqi Sun
WZWill Zhang
Will Zhang
BJBo Jiang
Bo Jiang
YLYilan Li
Yilan Li
SVSenem Velipasalar
Senem Velipasalar