Lijun Han

Lijun Han

Auto-generated profile, based on publicly available information

Lijun Han

School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 December 2022 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Closed access
WMWanyu Ma
Wanyu Ma
BZBin Zhang
Bin Zhang
LHLijun Han
Lijun Han
SHShengzeng Huo
Shengzeng Huo
Hesheng WangHesheng Wang
Hesheng Wang
David Navarro-AlarconDavid Navarro-Alarcon
David Navarro-Alarcon
In this article, we propose a new action planning approach to automatically pack long linear elastic objects into common-size boxes with a bimanual robotic system. For that, we developed a hybrid geometric model to handle large-scale occlusions combining an online vision-based method and an offline reference template. Then, a reference point generator is introduced to automatically plan the reference poses for the predesigned action primitives. Finally, an action planner integrates these components enabling the execution of high-level behaviors and the accomplishment of packing manipulation tasks. To validate the proposed approach, we conducted a detailed experimental study with multiple types and lengths of objects and packing boxes.

23 January 2025 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
LHLijun Han
Lijun Han
JZJinyu Zhang
Jinyu Zhang
Hesheng WangHesheng Wang
Hesheng Wang
In this paper, we propose a two-stage shared control framework for physical human-robot interaction (pHRI), that addresses the inconsistency of human-robot commands and consider the influence of environmental information. In the human-robot-environment system, based on the human intention measured by the interaction force, autonomy will actively initiate the replanning when the human control intention is strong, generating a feasible local desired trajectory of the robot. At the same time, we define an index called predicted safety index (PSI) to measure the safety of the system status. When the human has control intention but does not reach the threshold, we propose a shared controller based on cooperative-game theory and PSI. Specially, it is designed within the model predictive control (MPC) framework, utilizing cooperative game theory to analyze human-robot interaction behavior and treating the Pareto optimal solution as the control input. We conduct comparative experiments to evaluate the assistive performance of the proposed shared control algorithm through a waypoint tracking task with naive human users. User study with objective and subjective measures demonstrate that the algorithm effectively reduces human effort while maintaining tracking accuracy, thus enhancing both performance and safety.

14 June 2022 in IEEE Transactions on Control Systems Technology
Verified
Journal Article
Closed access
LHLijun Han
Lijun Han
YZYuyou Zhang
Yuyou Zhang
Hesheng WangHesheng Wang
Hesheng Wang
This study proposes new hybrid vision/force control schemes for interaction with the inner surface of the bottle-like mold under the bottleneck (BN) constraint. First, to guarantee the BN constraint, the transformed error with the prescribed performance function is introduced, and the corresponding kinematic formulation is derived. Then, an adaptive kinematic-based static visual servoing controller and a dynamics-based visual tracking controller are proposed with the uncalibrated camera, the unknown 3-D position of the feature point, and the unknown surface. Both controllers can complete the corresponding tasks in the image space while ensuring that the interaction force reaches the desired value without violating the BN constraint. Through the combination of the designed two controllers, we can accomplish different tasks. For the task of cleaning a bottle, first, the servo controller is employed to guide the tooltip to the specified position on the interactive surface. Then, the tracking controller is used to control the trajectory and interactive force during the motion. Finally, the stability of proposed algorithms is rigorously proved by the Lyapunov theory, and the effectiveness is tested by experiments.

23 January 2025 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
LHLijun Han
Lijun Han
YLYiming Liu
Yiming Liu
Hesheng WangHesheng Wang
Hesheng Wang
Pushing is an essential non-prehensile manipulation for robots to achieve complex tasks. Until now, object rigidity remains one of the common assumptions in robotic pushing. To endow robots with the advanced capability of pushing deformable objects, we propose a mathematical model and control method for the planar pushing of deformable objects. Given the robotic end-effector velocity or position input, the model predicts the motion and deformation of the pushed object, which is developed based on the quasi-static finite element analysis with reasonable simplification, considering the contact conditions of nodes with both the operator and the contact surface. By combining the designed model to estimate the state of the object and interactions with the environment, we further propose a method based on model predictive control (MPC) to realize the pushing control. With a specialized simplified model to accelerate prediction, the controller is solved by iterative Linear Quadratic Regulator (iLQR) with a dynamic weight, which balances the object motion and pushing area adjustment. The accuracy and efficiency of the proposed deformable model are validated by comparing the theoretical results with the experimental ones under different conditions, and the controller is verified by simulation and experiments.

30 June 2025 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
XKXiangjun Kang
Xiangjun Kang
FXFan Xu
Fan Xu
LHLijun Han
Lijun Han
Hesheng WangHesheng Wang
Hesheng Wang
Soft robots face significant control challenges due to the coupling effects of strain and external forces, particularly with external interactions that change their original model. This paper proposes a vision-based controller integrated with an adaptive algorithm to estimate and compensate for external contact disturbances in such environments. Specifically, the adaptive law can online estimate unknown camera parameters, eliminating the need for costly and environment-specific calibration procedures. In parallel, a contact disturbance estimation strategy is introduced to model and compensate for real-time interaction effects without the foreknowledge of the constitutive equation of the soft mechanism. The adaptive algorithm is seamlessly integrated into the adaptive image-based visual servo (IBVS) controller, allowing simultaneous calibration and contact compensation during task execution. We validated the algorithm on a tendon-driven, octoarticular soft robotic manipulator prototype. The experimental results demonstrated the algorithm’s ability to position the end-effector even under external interactions, with the adaptive parameters converging, thereby validating the effectiveness of the online estimation in assessing the impacts of interactions.

12 December 2024 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
Bo LuBo Lu
Bo Lu
CHChao He
Chao He
WHWenjie Hou
Wenjie Hou
LHLijun Han
Lijun Han
Hesheng WangHesheng Wang
Hesheng Wang
PQPeng Qi
Peng Qi
Monocular endoscope-based reconstruction of dynamic 3D surgical fields is beneficial for both intraoperative manual/robotic manipulation and post-operative surgical skills training. However, the natural characteristics of tissue deformations with instruments and blood obscuration bring great challenges to 3D scene awareness, especially under sparse viewpoints limited by laparoscopic movements. In this work, we propose Endo-4 S RF, an effective Neural Radiance Field (NeRF)-based method that can reconstruct deformable tissues with instruments stealth by solely relying on monocular endoscopic image flows from a single viewpoint. Specifically, to enhance the 3D reconstruction accuracy under the deficiency of depth ground truth, we devised a dynamic Gaussian-based neural sampling strategy, leveraging the depth inherently obtained from NeRF and the conjunction information inferred by a prior learning-based depth estimation network. Besides, we integrated the Signed Distance Function (SDF) and resolved its singularity problem by furnishing additional geometric constraints for the neural radiance field, thereby achieving precise reconstruction of dynamic scenes devoid of depth ground truth supervision. Furthermore, adopting spherical harmonic functions for color fitting has significantly improved our model's computational efficiency and rendering quality. We extensively performed cross-validation experiments to verify the performance using public and in-house datasets. Our quantitative and qualitative results demonstrate remarkable superiority over the state-of-the-art (SOTA) approaches concerning depth prediction accuracy, image rendering quality, model training efficiency, and 3D reconstruction outcomes.