Jingyu Zhang

Dr. Jingyu Zhang

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2022 in Cyborg and Bionic Systems
Verified
Journal Article
Open access
PDF file
JZJingyu Zhang
Jingyu Zhang
QFQin Fang
Qin Fang
PXPingyu Xiang
Pingyu Xiang
DSDanying Sun
Danying Sun
YXYanan Xue
Yanan Xue
Haojian LUHaojian LU
Haojian LU
In this paper, we describe the advances in the design, actuation, modeling, and control field of continuum robots. After decades of pioneering research, many innovative structural design and actuation methods have arisen. Untethered magnetic robots are a good example; its external actuation characteristic allows for miniaturization, and they have gotten a lot of interest from academics. Furthermore, continuum robots with proprioceptive abilities are also studied. In modeling, modeling approaches based on continuum mechanics and geometric shaping hypothesis have made significant progress after years of research. Geometric exact continuum mechanics yields apparent computing efficiency via discrete modeling when combined with numerical analytic methods such that many effective model-based control methods have been realized. In the control, closed-loop and hybrid control methods offer great accuracy and resilience of motion control when combined with sensor feedback information. On the other hand, the advancement of machine learning has made modeling and control of continuum robots easier. The data-driven modeling technique simplifies modeling and improves anti-interference and generalization abilities. This paper discusses the current development and challenges of continuum robots in the above fields and provides prospects for the future.

4 January 2024 in Nature Communications
Verified
Journal Article
Open access
PDF file
JZJingyu Zhang
Jingyu Zhang
LLLilu Liu
Lilu Liu
PXPingyu Xiang
Pingyu Xiang
QFQin Fang
Qin Fang
XNXiuping Nie
Xiuping Nie
Haojian LUHaojian LU
Haojian LU
The unequal distribution of medical resources and scarcity of experienced practitioners confine access to bronchoscopy primarily to well-equipped hospitals in developed regions, contributing to the unavailability of bronchoscopic services in underdeveloped areas. Here, we present an artificial intelligence (AI) co-pilot bronchoscope robot that empowers novice doctors to conduct lung examinations as safely and adeptly as experienced colleagues. The system features a user-friendly, plug-and-play catheter, devised for robot-assisted steering, facilitating access to bronchi beyond the fifth generation in average adult patients. Drawing upon historical bronchoscopic videos and expert imitation, our AI–human shared control algorithm enables novice doctors to achieve safe steering in the lung, mitigating misoperations. Both in vitro and in vivo results underscore that our system equips novice doctors with the skills to perform lung examinations as expertly as seasoned practitioners. This study offers innovative strategies to address the pressing issue of medical resource disparities through AI assistance.

6 September 2023 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
PXPingyu Xiang
Pingyu Xiang
JZJingyu Zhang
Jingyu Zhang
DSDanying Sun
Danying Sun
KQKe Qiu
Ke Qiu
QFQin Fang
Qin Fang
Haojian LUHaojian LU
Haojian LU
Small-scale continuum robot-assisted minimally invasive surgery has received crucial attention due to its smaller incisions and high dexterity. In medical scenarios such as radiofrequency ablation and nasal/throat swab sampling, monitoring and controlling the forces applied to human tissue can help improve the safety and comfort level of the procedure. However, the tip-sensor-based force detection method can barely be deployed due to the miniature size of the continuum robot; meanwhile, the mechanical modeling-based high-precision force estimation cannot be realized on account of the continuum robots’ complex structure with high nonlinear properties. To address the high-precision force estimation challenge for further compliant control during minimally invasive interventions, a learning-based high-precision force estimation method via long short-term memory (LSTM) is proposed in this paper. On this basis, compliance control and high-precision force tracking can be further realized for small-scale continuum robot. The compliance control ensures a smooth and stable transition during the interaction between the robot and the environment, and force tracking can be utilized for maintaining or precisely controlling the force applied to the human tissue. Finally, the contact force sensing and control experiments are carried out on a small-scale continuum robot system prototype, and a demonstration using a human nasal cavity model is conducted. The results validate that the proposed LSTM neural network fits the mechanical model of the continuum robot well with the root mean square error of 3.44mN, and the control method can significantly compensate for the instantaneous impact during contact with an attenuation of 59.3 $\%$ and rapidly respond to keep the force accurately at the expected value with the mean absolute error of 2.41mN Note to Practitioners —This research is motivated by the increasing number of applications for small-scale continuum robot-assisted minimally invasive interventional surgery, such as radiofrequency ablation, biopsy, and endoscopic submucosal dissection. These surgeries require high-precision contact force sensing and control. However, due to the small size and complex structure of the continuum robot, traditional methods such as installing force sensors and mechanical modeling are not effective. Therefore, this paper utilizes a neural network to infer contact force through more accessible information about the robot, such as the tension of the actuators. This method allows for compliant force control during the dynamic contact between the small-scale continuum robot and human tissue. Experiments conducted on a human nasal cavity model demonstrate that the proposed method can improve the safety and reliability of small-scale continuum robot-assisted minimally invasive surgery.

1 July 2024 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
JZJingyu Zhang
Jingyu Zhang
QFQin Fang
Qin Fang
LLLilu Liu
Lilu Liu
RJRui Jin
Rui Jin
PXPingyu Xiang
Pingyu Xiang
Haojian LUHaojian LU
Haojian LU
Continuum robots, owing to their inherent compliance, have become essential in endoscopic surgical procedures, such as mucosal ablation. However, the prevalent design of endoscopic manipulators, which typically features only a single active bending segment, often results in limited dexterity and accessibility. Additionally, the incorporation of variable stiffness in these robots has attracted significant interest, with the aim to improve manipulation capabilities in confined spaces. In the paper, we propose a novel variable-length continuum robot with variable stiffness for endoscopic surgery. The robot’s stiffness can be altered either by modifying the catheter’s length or solid-liquid transition of low-melting-point alloy (LMPA). The design and fabrication methods of the robot are meticulously detailed. Additionally, a quasi-static stiffness model along with a learning-based stiffness compensation approach for accurate stiffness estimation are proposed. Leveraging this model, a contact force controller is designed for ablation procedure. The experimental results show that our robot possesses good flexibility and accessibility, making it highly adept at manipulating in confined spaces. Its variable stiffness feature significantly enhances its ability to counteract external disturbance and prevent tip deformation (with a average position change of 1.1mm). Finally, through force control experiments and a surgical demonstration in a gastrointestinal model, we have further validated the robot’s applicability in surgical contexts. Note to Practitioners —This paper proposed a variable-length continuum robot with variable stiffness for endoscopic surgery. The robot can achieve axial elongation and omnidirectional bending motion, having better dexterity and accessibility than traditional medical continuum robots with one active bending segment. The robot’s stiffness can be adjusted by the length changes or solid-liquid transition of low-melting-point alloy (LMPA). Besides, an accurate stiffness model and a contact force controller are proposed for endoscopic ablation surgery. By experimental results, the robot shows high flexibility and accessibility, allowing access to confined spaces for manipulation, and good control accuracy and variable stiffness capability for endoscopic surgery.

1 January 2024 in Research
Verified
Journal Article
Open access
QFQin Fang
Qin Fang
JZJingyu Zhang
Jingyu Zhang
YHYinhui He
Yinhui He
NZNenggan Zheng
Nenggan Zheng
YWYue Wang
Yue Wang
Haojian LUHaojian LU
Haojian LU
Soft crawling robots have been widely studied and applied because of their excellent environmental adaptability and flexible movement. However, most existing soft crawling robots typically exhibit a single-motion mode and lack diverse capabilities. Inspired byDrosophilalarvae, this paper proposes a compact soft crawling robot (weight, 13 g; length, 165 mm; diameter, 35 mm) with multimodal locomotion (forward, turning, rolling, and twisting). Each robot module uses 4 sets of high-power-density shape memory alloy actuators, endowing it with 4 degrees of motion freedom. We analyze the mechanical characteristics of the robot modules through experiments and simulation analysis. The plug-and-play modules can be quickly assembled to meet different motion and task requirements. The soft crawling robot can be remotely operated with an external controller, showcasing multimodal motion on various material surfaces. In a narrow maze, the robot demonstrates agile movement and effective maneuvering around obstacles. In addition, leveraging the inherent bistable characteristics of the robot modules, we used the robot modules as anchoring units and installed a microcamera on the robot’s head for pipeline detection. The robot completed the inspection in horizontal, vertical, curved, and branched pipelines, adjusted the camera view, and twisted a valve in the pipeline for the first time. Our research highlights the robot’s superior locomotion and application capabilities, providing an innovative strategy for the development of lightweight, compact, and multifunctional soft crawling robots.

14 January 2021 in IEEE Transactions on Industrial Electronics
Verified
Journal Article
Closed access
JZJingyu Zhang
Jingyu Zhang
TLTianjian Liu
Tianjian Liu
YWYunjiang Wang
Yunjiang Wang
WJWeiwei Jiang
Weiwei Jiang
KYKeji Yang
Keji Yang
YZYongjian Zhu
Yongjian Zhu
Ultrasound imaging as a user-friendly and radiation-free navigation scheme has been gradually applied to minimally invasive spinal surgeries. However, acquiring an interpretable ultrasound image always requires experienced sonographers, which dramatically restricts its applications. To this end, in this article, a self-adaptive ultrasound scanning system (SAUSS) is proposed to image the human spine. This system automatically scans human back and real-time displays the spine structure. During scanning, our self-adaptive attitude-adjusting mechanism ensures the scan posture of the ultrasound probe, and guarantees human comfort and ultrasound coupling at the same time. According to the phantom experiments, our proposed system can maintain the resultant force in an appropriate region from 14 to 16 N on different segments of the spine and under different respiratory rates. Meanwhile, the automatically scanned image achieves higher quality and better repeatability than freehand one. In human trials, the image provided from SAUSS keeps clear image textures that are almost on par with computed tomography (CT) images, and its stability is also demonstrated from the comparisons of force fluctuations. In all, it has a great potential on navigation of spine surgery.