Kun Wu

Kun Wu

Auto-generated profile, based on publicly available information

Kun Wu

Syracuse University, New York, NY, USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 February 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JWJunjie Wen
Junjie Wen
YZYichen Zhu
Yichen Zhu
JLJinming Li
Jinming Li
MZMinjie Zhu
Minjie Zhu
ZTZhibin Tang
Zhibin Tang
JTJian Tang
Jian Tang
Vision-Language-Action (VLA) models have shown remarkable potential in visuomotor control and instruction comprehension through end-to-end learning processes. However, current VLA models face significant challenges: they are slow during inference and require extensive pre-training on large amounts of robotic data, making real-world deployment difficult. In this letter, we introduce a new family of compact vision-language-action models, called TinyVLA, which offers two key advantages over existing VLA models: (1) faster inference speeds, and (2) improved data efficiency, eliminating the need for pre-training stage. Our framework incorporates two essential components to build TinyVLA: (1) initializing the policy backbone with robust, high-speed multimodal models, and (2) integrating a diffusion policy decoder during fine-tuning to enable precise robot actions. We conducted extensive evaluations of TinyVLA in both simulation and on real robots, demonstrating that our approach significantly outperforms the state-of-the-art VLA model, OpenVLA, in terms of speed and data efficiency, while delivering comparable or superior performance. Additionally, TinyVLA exhibits strong generalization capabilities across various dimensions, including language instructions, novel objects, unseen positions, changes in object appearance, background variations, and environmental shifts, often matching or exceeding the performance of OpenVLA. We believe that TinyVLA offers an interesting perspective on utilizing pre-trained multimodal models for policy learning.

28 November 2024 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
KWKun Wu
Kun Wu
YZYinuo Zhao
Yinuo Zhao
ZXZhiyuan Xu
Zhiyuan Xu
ZCZhengping Che
Zhengping Che
CYChengxiang Yin
Chengxiang Yin
JTJian Tang
Jian Tang
Offline reinforcement learning (RL), which operates solely on static datasets without further interactions with the environment, provides an appealing alternative to learning a safe and promising control policy. The prevailing methods typically learn a conservative policy to mitigate the problem of $Q$ -value overestimation, but it is prone to overdo it, leading to an overly conservative policy. Moreover, they optimize all samples equally with fixed constraints, lacking the nuanced ability to control conservative levels in a fine-grained manner. Consequently, this limitation results in a performance decline. To address the above two challenges in a united way, we propose a framework, adaptive conservative level in $Q$ -learning (ACL-QL), which limits the $Q$ -values in a mild range and enables adaptive control on the conservative level over each state–action pair, i.e., lifting the $Q$ -values more for good transitions and less for bad transitions. We theoretically analyze the conditions under which the conservative level of the learned $Q$ -function can be limited in a mild range and how to optimize each transition adaptively. Motivated by the theoretical analysis, we propose a novel algorithm, ACL-QL, which uses two learnable adaptive weight functions to control the conservative level over each transition. Subsequently, we design a monotonicity loss and surrogate losses to train the adaptive weight functions, $Q$ -function, and policy network alternatively. We evaluate ACL-QL on the commonly used datasets for deep data-driven reinforcement learning (D4RL) benchmark and conduct extensive ablation studies to illustrate the effectiveness and state-of-the-art performance compared with existing offline DRL baselines.

9 October 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
SFShichao Fan
Shichao Fan
QYQuantao Yang
Quantao Yang
YLYajie Liu
Yajie Liu
KWKun Wu
Kun Wu
ZCZhengping Che
Zhengping Che
MWMin Wan
Min Wan
Recently, Vision-Language-Action models (VLA) have advanced robot imitation learning, but high data collection costs and limited demonstrations hinder generalization and current imitation learning methods struggle in out-of-distribution scenarios, especially for long-horizon tasks. A key challenge is how to mitigate compounding errors in imitation learning, which lead to cascading failures over extended trajectories. To address these challenges, we propose the Diffusion Trajectory-guided Policy (DTP) framework, which generates 2D trajectories through a diffusion model to guide policy learning for long-horizon tasks. By leveraging task-relevant trajectories, DTP provides trajectory-level guidance to reduce error accumulation. Our two-stage approach first trains a generative vision-language model to create diffusion-based trajectories, then refines the imitation policy using them. Experiments on the CALVIN benchmark show that DTP outperforms state-of-the-art baselines by 25% in success rate, starting from scratch without external pretraining. Moreover, DTP significantly improves real-world robot performance.

14 June 2021 in IEEE Journal on Selected Areas in Communications
Verified
Journal Article
Closed access
ZXZhiyuan Xu
Zhiyuan Xu
KWKun Wu
Kun Wu
WZWeiyi Zhang
Weiyi Zhang
JTJian Tang
Jian Tang
YWYanzhi Wang
Yanzhi Wang
GXGuoliang Xue
Guoliang Xue
While Deep Reinforcement Learning has emerged as a de facto approach to many complex experience-driven networking problems, it remains challenging to deploy DRL into real systems. Due to the random exploration or half-trained deep neural networks during the online training process, the DRL agent may make unexpected decisions, which may lead to system performance degradation or even system crash. In this paper, we propose PnP-DRL, an offline-trained, plug and play DRL solution, to leverage the batch reinforcement learning approach to learn the best control policy from pre-collected transition samples without interacting with the system. After being trained without interaction with systems, our Plug and Play DRL agent will start working seamlessly, without additional exploration or possible disruption of the running systems. We implement and evaluate our PnP-DRL solution on a prevalent experience-driven networking problem, Dynamic Adaptive Streaming over HTTP (DASH). Extensive experimental results manifest that 1) The existing batch reinforcement learning method has its limits; 2) Our approach PnP-DRL significantly outperforms classical adaptive bitrate algorithms in average user Quality of Experience (QoE); 3) PnP-DRL, unlike the state-of-the-art online DRL methods, can be off and running without learning gaps, while achieving comparable performances.

19 December 2023 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
KWKun Wu
Kun Wu
CYChengxiang Yin
Chengxiang Yin
ZCZhengping Che
Zhengping Che
BJBo Jiang
Bo Jiang
JTJian Tang
Jian Tang
GDGangyi Ding
Gangyi Ding
Deep generative models have made great progress in synthesizing images with arbitrary human poses and transferring the poses of one person to others. Though many different methods have been proposed to generate images with high visual fidelity, the main challenge remains and comes from two fundamental issues: pose ambiguity and appearance inconsistency. To alleviate the current limitations and improve the quality of the synthesized images, we propose a pose transfer network with augmented D isentangled F eature C onsistency (DFC-Net) to facilitate human pose transfer. Given a pair of images containing the source and target person, DFC-Net extracts pose and static information from the source and target respectively, then synthesizes an image of the target person with the desired pose from the source. Moreover, DFC-Net leverages disentangled feature consistency losses in the adversarial training to strengthen the transfer coherence and integrates a keypoint amplifier to enhance the pose feature extraction. With the help of the disentangled feature consistency losses, we further propose a novel data augmentation scheme that introduces unpaired support data with the augmented consistency constraints to improve the generality and robustness of DFC-Net. Extensive experimental results on Mixamo-Pose and EDN-10k have demonstrated DFC-Net achieves state-of-the-art performance on pose transfer.

30 August 2022 in Proceedings of the Nutrition Society
Verified
Journal Article
Open access
PDF file
JWJ. Wirth
J. Wirth
KWK. Wu
K. Wu
LBLorraine Brennan
Lorraine Brennan