Since four in-wheel-motor drive electric vehicles (4IDEVs) are over-actuated systems, the torque distribution strategy is crucial for improving system efficiency, lateral stability and safety. Hence, this paper proposes a multi-objective optimal torque distribution strategy for 4IDEVs to improve the vehicle yaw stability performance and the energy efficiency. Firstly, a motor energy loss model is built to describe the motor power loss characteristics, and an energy efficiency control allocation (EECA) method over the NEDC is proposed to analyze the model accuracy. Then, a hybrid model predictive control (hMPC)-based nonlinear yaw stability controller is employed to calculate the reference yaw moment and active steering angle. Finally, a multi-objective controller is designed to minimize the drivetrain power loss while ensuring the vehicle stability, in which the four wheels torques are allocated to tracking the reference yaw moment. The proposed strategy is evaluated on the dSPACE-based platform over the single lane change test and fishhook steering test. The results indicate that the suggested torque distribution strategy can improve the vehicle stability on different conditions and the energy consumption is significantly reduced compared to an electric stability control (ESC) method.
29 January 2024 in IEEE Robotics and Automation Letters
Robot-assisted minimally invasive surgery (MIS) using flexible endoscopy has emerged as a groundbreaking technology for improving traditional surgical approaches. However, a major challenge in advancing this technology is the lack of shape sensing, which leads to inaccurate navigation and control of ultra-long flexible endoscopy within the narrow and tortuous lumen environment. The unique characteristics of flexible endoscopy, including large slenderness ratio, high bending angles, and non-symmetric, multi-channel configurations, pose significant challenges to accurate shape sensing. To address this challenge, we propose a novel shape-sensing scheme based on distributed fiber optic strain measurement, which incorporates a complete and applicable multi-interface strain transfer model adapted to large deformation and multiple sensing points. To validate the theoretical model, a shape sensor with a diameter of 2.84 mm and a length of 500 mm is fabricated. Both 2D and 3D shape sensing experiments are conducted on predefined templates, and the results highlight a significant improvement in the precision of sensor measurements through the utilization of the proposed model. Specifically, the 3D experiment results show a mean absolute error (MAE) of 5.38 mm for complex geometrical shapes and the proposed model reduces the MAE by approximately 52.9% compared to the unmodified case.
7 November 2024 in IEEE Transactions on Medical Imaging
Localizing the bronchoscope in real time is essential for ensuring intervention quality. However, most existing vision-based methods struggle to balance between speed and generalization. To address these challenges, we present BronchoTrack, an innovative real-time framework for accurate branch-level localization, encompassing lumen detection, tracking, and airway association. To achieve real-time performance, we employ benchmark light weight detector for efficient lumen detection. We firstly introduce multi-object tracking to bronchoscopic localization, mitigating temporal confusion in lumen identification caused by rapid bronchoscope movement and complex airway structures. To ensure generalization across patient cases, we propose a training-free detection-airway association method based on a semantic airway graph that encodes the hierarchy of bronchial tree structures. Experiments on 11 patient datasets demonstrate BronchoTrack’s localization accuracy of 81.72%, while accessing up to the 6th generation of airways. Furthermore, we tested BronchoTrack in an in-vivo animal study using a porcine model, where it localized the bronchoscope into the 8th generation airway successfully. Experimental evaluation underscores BronchoTrack’s real-time performance in both satisfying accuracy and generalization, demonstrating its potential for clinical applications.
Quickly and accurately completing endoscopic submucosal dissection (ESD) operations within narrow lumens is currently challenging because of the environment’s high flexibility, invisible collision, and natural tissue motion. This paper proposes a novel stereo visual servoing control for a dual-segment robotic endoscope (DSRE) for ESD surgery. Departing from conventional monocular-based methods, our DSRE leverages stereoscopic imaging to rapidly extract precise depth data, enabling quicker controller convergence and enhanced surgical accuracy. The system’s dual-segment configuration enables agile maneuverability around lesions, while its compliant structure ensures adaptability within the surgical environment. The implemented stereo visual servo controller uses image features for real-time feedback and dynamically updates gain coefficients, facilitating rapid convergence to the target. In visual servoing experiments, the controller demonstrated strong performance across various tasks. Even when subjected to unknown external forces, the controller maintained robust performance in target tracking. The feasibility and effectiveness of the DSRE were further verified through ex vivo experiments. We posit that this novel system holds significant potential for clinical application in ESD surgeries.
4 December 2025 in IEEE Robotics and Automation Letters
Continuum robots exhibit exceptional flexibility and multi-degree-of-freedom maneuverability, offering significant advantages for navigating confined luminal spaces. However, rapid simulation of their contact-influenced behavior remains challenging. This paper presents RLFEM, an innovative finite element method (FEM) featuring a reinforcement learning-enhanced quadratic programming solver, specifically designed for efficient continuum robot simulation updates. To address complex robot dynamics, we employ a quasi-static FEM formulation. Our core contribution integrates an accelerated solver scheme within this framework, leveraging reinforcement learning to rapidly resolve FEM contact problems without accuracy compromise. RLFEM exhibits significant gains in runtime performance for continuum robot simulations, as evidenced by numerical experiments showing a 16.20-fold acceleration compared to the baseline at the 150-node discretization level.
Continuum robots offer high flexibility and multiple degrees of freedom, making them ideal for navigating narrow lumens. However, accurately modeling their behavior under large deformations and frequent environmental contacts remains challenging. Current methods for solving the deformation of these robots, such as the Model Order Reduction and Gauss-Seidel (GS) methods, suffer from significant drawbacks. They experience reduced computational speed as the number of contact points increases and struggle to balance speed with model accuracy. To overcome these limitations, we introduce a novel finite element method (FEM) named Acc-FEM. Acc-FEM employs a large deformation quasi-static finite element model and integrates an accelerated solver scheme to handle multi-contact simulations efficiently. Additionally, it utilizes parallel computing with Graphics Processing Units (GPU) for real-time updates of the finite element models and collision detection. Extensive numerical experiments demonstrate that Acc-FEM significantly improves computational efficiency in modeling continuum robots with multiple contacts while achieving satisfactory accuracy, addressing the deficiencies of existing methods.