Yisen Huang

Dr. Yisen Huang

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 July 2023 in IEEE/ASME Transactions on Mechatronics
Verified
Journal Article
Closed access
Yisen HuangYisen Huang
Yisen Huang
WLWeibin Li
Weibin Li
XZXue Zhang
Xue Zhang
JLJixiu Li
Jixiu Li
YLYehui Li
Yehui Li
RTRaymond Kai-yu Tong
Raymond Kai-yu Tong
Endoscopes provide views inside the patient's body during minimally invasive surgery. Although various robotic endoscopes have been developed to reduce surgeons' workload in manual endoscope operations, autonomous endoscope manipulation remains challenging due to the misorientation effect and different disturbances. In this work, we developed an intelligent endoscope system to steer the surgical view automatically. To keep the target (i.e., the tip of an instrument) at the center of the camera view with a suitable size and orientation, an image moment-based 4-degree-of-freedom (DOF) visual servoing method is implemented. We propose an error learning-based sliding mode controller to realize fast and smooth error convergence. It is specially constructed to improve convergence rate without causing undesirable system chattering. Moreover, the kinematic modeling of the endoscope results in a quadratic programming problem, which is solved by a novel adaptive noise-immune zeroing neural network accelerated to predefined-time convergence by a newly constructed activation function. The experiments show that the proposed control strategy guarantees a superior convergence rate and robustness compared with existing methods. Lab tests show the application potential of the proposed endoscope system in clinical practice.

14 January 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
Yisen HuangYisen Huang
Yisen Huang
JLJian Li
Jian Li
XZXue Zhang
Xue Zhang
KXKe Xie
Ke Xie
JLJixiu Li
Jixiu Li
RTRaymond Kai-yu Tong
Raymond Kai-yu Tong
In minimally invasive surgery, endoscopes serve as the eyes of surgeon. To avoid fatigue in manual endoscope steering, robotic endoscope holders have been developed. Unfortunately, existing robotic endoscope holders are not widely adopted due to the poor surgeon-robot cooperation. In this work, we developed an intelligent flexible endoscope system based on the da Vinci Research Kit. In the system, surgical instruments are detected and classified in real time with an oriented bounding box-based object detection method. A custom dataset of 6243 images is established to train the detection neural network. Then, a surgeon’s preference guided visual servoing control method is proposed for automatically tracking the detected instruments during minimally invasive surgery. In order to realize 3-degree of freedom control on the image plane, an image moment-based visual servoing control method is adopted. To improve the dynamic performance of the system control, a modified genetic algorithm is developed to select the optimal gains of the robot controller. Both simulation and experimental results show the feasibility of the proposed intelligent flexible endoscope system.

1 May 2023 in IEEE Transactions on Industrial Electronics
Verified
Journal Article
Closed access
ZCZhiwei Cui
Zhiwei Cui
Yisen HuangYisen Huang
Yisen Huang
WLWeibin Li
Weibin Li
PCPhilip Wai Yan Chiu
Philip Wai Yan Chiu
RTRaymond Kai-yu Tong
Raymond Kai-yu Tong
Redundant systems are highly favored due to their superior performance. However, rapid real-time solutions, state variable constraints, and noise-resistance of redundant systems are still challenging issues to be solved. Therefore, a novel noise-resistant adaptive gain zeroing neural network (NRAG-ZNN) is designed to handle time-varying redundant system problems with state variable constraints, and it is successfully applied to redundant flexible endoscope robot (RFER) visual tracking. First, a tracking control scheme with tracking error, joint position, and velocity constraints is designed based on RFER's motion vision coupling model, whose inequality constraints are transformed into equality constraints by introducing a nonlinear complementary problem function. Then, a novel NRAG-ZNN is designed to handle the above time-varying redundant control scheme with state variable constraints. Next, the fast convergence of the designed NRAG-ZNN under noise interference and noise-free is rigorously proved by using the Lyapunov theory. Finally, the universality and practicability of the proposed methods are checked by using the arbitrary time-varying redundancy numerical test example and RFER. The experimental results indicate that the designed methods can effectively address the time-varying redundancy problems with state variable constraints, and have the ability to resist noise interference and better practicability. Compared with the existing works, the designed methods have higher convergence precision, faster convergence velocity, and stronger noise-resistant interference ability.

5 July 2023 in IEEE Transactions on Biomedical Engineering
Verified
Journal Article
Closed access
YLYehui Li
Yehui Li
WNWing Yin Ng
Wing Yin Ng
WLWeibin Li
Weibin Li
Yisen HuangYisen Huang
Yisen Huang
HZHeng Zhang
Heng Zhang
RTRaymond Kai-yu Tong
Raymond Kai-yu Tong
Objective: Conventional colonoscopy using a flexible colonoscope remains two major limitations, including patient discomfort and difficult manipulations for surgeons. Robotic colonoscopes have been developed to conduct colonoscopy in a patient-friendly manner. However, most robotic colonoscopes still maintain nonintuitive and difficult manipulations, which limits their clinical applications. In this paper, we demonstrated visual servo-based semi-autonomous manipulations of an electromagnetic actuated soft-tethered (EAST) colonoscope, which aims to lower difficulties of robotic colonoscope manipulations. Methods: Kinematic modeling of EAST colonoscope is conducted, with an adaptive visual servo controller established. Template matching method and a lumen and polyp detection model are developed to enable semi-autonomous manipulations, including region-of-interest automatic tracking and autonomous navigation with automatic polyp detection. Results: The EAST colonoscope demonstrates visual servoing with an average convergence time of around 2.5 s and performs disturbance rejection within 3.0 s. Semi-autonomous manipulations were conducted in both a commercialized colonoscopy simulator and an ex-vivo porcine colon to show the efficacy of reducing the user workload compared to manual control. Conclusion: The EAST colonoscope can perform visual servoing and semi-autonomous manipulations with the developed methods in both laboratory and ex-vivo environments. Significance: The proposed solutions and techniques improve the autonomy level of robotic colonoscopes and reduce user workloads, which promotes the development and clinical translation of robotic colonoscopy.

22 November 2024 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Open access
Yisen HuangYisen Huang
Yisen Huang
JLJian Li
Jian Li
WLWeibin Li
Weibin Li
XZXue Zhang
Xue Zhang
YSYichong Sun
Yichong Sun
RTRaymond Kai-yu Tong
Raymond Kai-yu Tong
In minimally invasive surgery (MIS), the field of view (FOV) control is crucial. Autonomous endoscope robots have been developed to facilitate MIS procedures by enabling autonomous surgical target tracking, thus reducing the workload on surgeons. However, existing visual servoing-based target tracking methods for autonomous endoscopes often overlook the insecurity stemming from restricted workspace conditions. Instances, such as collisions between the endoscope robot’s tip and the patient’s chest or abdominal wall pose risks to patient tissue, while extensive motion of the endoscope shaft may damage incision port tissue. Addressing these security concerns, this article proposes a novel approach called virtual fixture-based restricted workspace constraint (RWSC) to reconstruct the endoscope robot’s movement range. A quadratic programming (QP) optimization framework is employed to govern the robot’s motion, ensuring autonomous target tracking while adhering to RWSCs. To solve the QP problem, we propose an adaptive zeroing neural network (ZNN) featuring a newly designed activation function (AF). This AF enhances the ZNN with predefined-time convergence and noise rejection capabilities, making it especially suitable for time-sensitive and noise-prone surgical applications. Theoretical analysis and experimental results demonstrate that our adaptive ZNN achieves shorter convergence times than existing neural dynamic-based QP solvers. Physical validations show the efficacy of the proposed RWSCs in limiting the workspace of the endoscope robot, while the FOV control strategy enables autonomous target tracking of flexible endoscopes under diverse constraints and objectives.

1 June 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JLJian Li
Jian Li
Yisen HuangYisen Huang
Yisen Huang
XZXue Zhang
Xue Zhang
KXKe Xie
Ke Xie
YXYitian Xian
Yitian Xian
RTRaymond Kai-yu Tong
Raymond Kai-yu Tong
In minimally invasive surgery (MIS), the field of view (FOV) plays a vital role. To enhance the stability of FOV and lighten the burden on surgeons, robot-assisted laparoscope systems have been developed and introduced into surgery. However, most of the existing automatic surgical tool tracking schemes with robotic laparoscopes either do not consider tracking of the depth direction or the remote center of motion (RCM) constraints. To tackle these problems, this article presents an autonomous three-dimensional surgical instrument tracking framework for a robotic laparoscope based on a binocular camera. A 3-degree-of-freedom visual tracking scheme is derived from the kinematics of the binocular robotic laparoscope. A programmable RCM constraint is introduced due to the MIS requirement. To precisely locate the surgical instruments in FOV, a surgical instrument tip segmentation dataset with 5471 images is built and a modified real-time instance segmentation network is trained based on the dataset. Then, a semi-global matching (SGM) algorithm is utilized with the binocular camera to estimate the depth in FOV. To meet the joint limit constraint and maintain the dexterity of the robotic system, a task-priority-based control method is adopted. The simulation and experiment results demonstrate the feasibility of the proposed framework for instrument tracking with the robotic laparoscope.