Zhenjun Yu

Zhenjun Yu

Auto-generated profile, based on publicly available information

Zhenjun Yu

School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 November 2024 in Nature Communications
Verified
Journal Article
Open access
PDF file
CJChunpeng Jiang
Chunpeng Jiang
WXWenqiang Xu
Wenqiang Xu
YLYutong Li
Yutong Li
ZYZhenjun Yu
Zhenjun Yu
LWLongchun Wang
Longchun Wang
JLJing-Quan Liu
Jing-Quan Liu
Capturing forceful interaction with deformable objects during manipulation benefits applications like virtual reality, telemedicine, and robotics. Replicating full hand-object states with complete geometry is challenging because of the occluded object deformations. Here, we report a visual-tactile recording and tracking system for manipulation featuring a stretchable tactile glove with 1152 force-sensing channels and a visual-tactile joint learning framework to estimate dynamic hand-object states during manipulation. To overcome the strain interference caused by contact with deformable objects, an active suppression method based on symmetric response detection and adaptive calibration is proposed and achieves 97.6% accuracy in force measurement, contributing to an improvement of 45.3%. The learning framework processes the visual-tactile sequence and reconstructs hand-object states. We experiment on 24 objects from 6 categories including both deformable and rigid ones with an average reconstruction error of 1.8 cm for all sequences, demonstrating a universal ability to replicate human knowledge in manipulating objects with varying degrees of deformability.

22 January 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
WDWenxin Du
Wenxin Du
WXWenqiang Xu
Wenqiang Xu
JRJieji Ren
Jieji Ren
ZYZhenjun Yu
Zhenjun Yu
CLCewu Lu
Cewu Lu
Tactile perception stands as a critical sensory modality for human interaction with the environment. Among various tactile sensor techniques, optical sensor-based approaches have gained traction, notably for producing high-resolution tactile images. This letter explores gel elastomer deformation simulation through a physics-based approach. While previous works in this direction usually adopt the explicit material point method (MPM), which has certain limitations in force simulation and rendering, we adopt the finite element method (FEM) and address the challenges in mesh penetration and element inversion with incremental potential contact (IPC) method. As a result, we present a simulator named TacIPC, which can ensure numerically stable simulations while accommodating direct rendering and friction modeling. To evaluate TacIPC, we conduct four tasks: pseudo-image quality assessment, marker displacement prediction, slip-induced rotation prediction, and deformed geometry estimation. These tasks show its superior efficacy in reducing the sim-to-real gap. Our method can also seamlessly integrate with existing simulators.

16 December 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JZJieyi Zhang
Jieyi Zhang
WXWenqiang Xu
Wenqiang Xu
ZYZhenjun Yu
Zhenjun Yu
PXPengfei Xie
Pengfei Xie
TTTutian Tang
Tutian Tang
CLCewu Lu
Cewu Lu
This study introduces a novel language-guided diffusion-based learning framework, DexTOG, aimed at advancing the field of task-oriented grasping (TOG) with dexterous hands. Unlike existing methods that mainly focus on 2-finger grippers, this research addresses the complexities of dexterous manipulation, where the system must identify non-unique optimal grasp poses under specific task constraints, cater to multiple valid grasps, and search in a high degree-of-freedom configuration space in grasp planning. The proposed DexTOG includes a diffusion-based grasp pose generation model, DexDiffu, and a data engine to support the DexDiffu. By leveraging DexTOG, we also proposed a new dataset, DexTOG-80K, which was developed using a shadow robot hand to perform various tasks on 80 objects from 5 categories, showcasing the dexterity and multitasking capabilities of the robotic hand. This research not only presents a significant leap in dexterous TOG but also provides a comprehensive dataset and simulation validation, setting a new benchmark in robotic manipulation research.

16 August 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
WXWenqiang Xu
Wenqiang Xu
JZJieyi Zhang
Jieyi Zhang
TTTutian Tang
Tutian Tang
ZYZhenjun Yu
Zhenjun Yu
YLYutong Li
Yutong Li
CLCewu Lu
Cewu Lu
Grasp planning is an important task for robotic manipulation. Though it is a richly studied area, a standalone, fast, and differentiable grasp planner that can work with robot grippers of different DOFs has not been reported. In this work, we present DiPGrasp, a grasp planner that satisfies all these goals. DiPGrasp takes a force-closure geometric surface matching grasp quality metric. It adopts a gradient-based optimization scheme on the metric, which also considers parallel sampling and collision handling. This not only drastically accelerates the grasp search process over the object surface but also makes it differentiable. We apply DiPGrasp to three applications, namely grasp dataset construction, mask-conditioned planning, and pose refinement. For dataset generation, as a standalone planner, DiPGrasp has clear advantages over speed and quality compared with several classic planners. For mask-conditioned planning, it can turn a 3D perception model into a 3D grasp detection model instantly. As a pose refiner, it can optimize the coarse grasp prediction from the neural network, as well as the neural network parameters. Finally, we conduct real-world experiments with the Barrett hand and Schunk SVH 5-finger hand.