Xiang Fu

Xiang Fu

Auto-generated profile, based on publicly available information

Xiang Fu

School of Information Science and Technology, ShanghaiTech University, Shanghai, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 June 2024 in IEEE Transactions on Biomedical Engineering
Verified
Journal Article
Closed access
TLTeng Li
Teng Li
YJYujie Jiang
Yujie Jiang
XFXiang Fu
Xiang Fu
ZSZhenhuan Sun
Zhenhuan Sun
YYYiheng Yan
Yiheng Yan
SLSong Liu
Song Liu
Brain-Computer Interface (BCI) has gained remarkable prominence in biomedical community. While BCI holds vast potential across diverse domains, the implantation of neural electrodes poses multifaceted challenges to fully explore the power of BCI. Conventional rigid electrodes face the problem of foreign body reaction induced by mechanical mismatch to biological tissue, while flexible electrodes, though more preferential, lack controllability during implantation. Researchers have explored various strategies, from assistive shuttle to biodegradable coatings, to strike a balance between implantation rigidity and post-implantation flexibility. Yet, these approaches may introduce complications, including immune response, inflammations, and raising intracranial pressure. To this end, this paper proposes a novel nanorobot-based technique for direct implantation of flexible neural electrodes, leveraging the high controllability and repeatability of robotics to enhance the implantation quality. This approach features a dual-arm nanorobotic system equipped with stereo microscope, by which a flexible electrode is first visually aligned to the target neural tissue to establish contact and thereafter implanted into brain with well controlled insertion direction and depth. The key innovation is, through dual-arm coordination, the flexible electrode maintains straight along the implantation direction. With this approach, we implanted CNTf electrodes into cerebral cortex of mouse, and captured standard spiking neural signals.

5 June 2023 in IEEE Transactions on Automation Science and Engineering
Verified
Journal Article
Closed access
TLTeng Li
Teng Li
YYYuting Yang
Yuting Yang
XFXiang Fu
Xiang Fu
ZSZhenhuan Sun
Zhenhuan Sun
YLYou Fu Li
You Fu Li
SLSong Liu
Song Liu
Despite of the promising advancements in the last decade, the majority of scanning electron microscope (SEM)-based nanomanipulation tasks remain manually performed. Even in automated tasks, human intervention is required, at least during the task preparatory stage, where both the object of interest and robot end-effector are adequately enclosed in the field of view (FOV) of SEM at moderate magnification. This paper proposes a fully automated visual servo control method for workspace navigation of nanorobot end-effector that actively maintains the end-effector position offset from the center of FOV during passive working scene zooming and translation operations. We also propose using the scaling image Jacobian matrix theory to adaptively establish the hand-eye relationship of the nanorobotic system at uncalibrated magnifications, without the need for hardware regulation. This proposed method for workspace navigation is applicable to almost all commercial nanomanipulation systems. To the authors’ best knowledge, there has been no dedicated research on this problem in the literature. Experiments show that the proposed method significantly improves workspace navigation efficiency by about two-thirds, even for a skilled operator. Note to Practitioners —Workspace navigation refers to the process of moving the FOV to visually enclose the object or feature of interest at a moderate magnification, which is prerequisite for initializing either an automated or manual nanomanipulation task. This process involves consecutive zooming of the SEM in and out, as well as translating the sample stage, which can cause the end-effector to move out of the FOV. Therefore, it is necessary to move the robot end-effector with visual assistance along workspace navigation to avoid unexpected collisions. Typically, skilled operators perform this process manually in almost all nanomanipulation tasks, which is tedious and time-consuming. Therefore, developing an automated visual servo control method for workspace navigation of end-effector will significantly contribute to the nanomanipulation community.

13 June 2023 in IEEE Transactions on Nanotechnology
Verified
Journal Article
Closed access
YYYuting Yang
Yuting Yang
TLTeng Li
Teng Li
XFXiang Fu
Xiang Fu
ZSZhenhuan Sun
Zhenhuan Sun
YLYou Fu Li
You Fu Li
SLSong Liu
Song Liu
Nanorobotic manipulation inside Scanning Electron Microscope (SEM) is widely used in nanomaterial characterization and assembly tasks. However, tedious and time-consuming hardware regulations, like axis alignment, are still critical and mandatory to keep the functionality of nanorobot systems. This paper proposes a novel zooming-free hand-eye self-calibration method for nanorobotic manipulation inside SEM to circumvent the hardware regulation problem, which is applicable to a wide range of system configurations. The hand-eye relationship calibration method is based on the active incremental motion of the nanorobot without referring to expensive and complicated calibration patterns. Both perspective projection at low magnification and affine projection at high magnification are modelled, and unified by the image Jacobian matrix technique. With several times active calibration at different magnification factors in advance, the hand-eye relationship can be, thereafter, determined from the model at arbitrary status. The calibration model can be applied to both accurate SEM visual measurement and precision visual servo control. The corresponding methods regarding two-dimensional (2D) measurement, in-plane positioning, and constrained three-dimension (3D) positioning based on the proposed hand-eye relationship model are also presented in this paper. Experiments show that practical contact between robot end-effector and silicon nanowire under 1500× is well established with standard deviation less than one pixel.

25 September 2023 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
XFXiang Fu
Xiang Fu
YYYuting Yang
Yuting Yang
ZSZhenhuan Sun
Zhenhuan Sun
HSHu Su
Hu Su
YLYoufu Li
Youfu Li
SLSong Liu
Song Liu
The paper investigates the problem of visual tracking on moving object in nanomanipulation inside scanning electron microscope (SEM). Image noise is a primary concern when dealing with the problem, which includes the inherent statistical noise and that induced by the motion distortion. A visual tracking method with SEM image denoising algorithm is proposed. The denoising algorithm is well incorporated with robot motion by innovatively leveraging the image Jacobian matrix technique. The denosing algorithm removes image noise and provides more realistic image. On the basis, template matching is utilized to achieve visual tracking on image plane. Experimental results show that the visual tracking performance on image plane was well improved by 31.4% for point feature, 60.6% for line feature, and 52.1% for area feature in terms of root mean square (RMSE) compared to that without motion distortion removal. Comparison experiments validate the state-of-the-art performance achieved by the proposed method and thus the superiority.

24 November 2023 in IEEE Control Systems Letters
Verified
Journal Article
Closed access
HZHeng Zhang
Heng Zhang
XFXiang Fu
Xiang Fu
SLSong Liu
Song Liu
YWYang Wang
Yang Wang
Realizing dexterous rotation under the microscope has been a great and yet not-well-addressed challenge in micro/nano-robotics. The limited field of view (FOV) of a microscope necessitates point-wise in-situ rotation, which refers to manipulating objects within their existing or natural environment. Though on-axis in-situ rotation has been investigated, off-axis in-situ rotation, which is more suitable to classical nano-robot setups, remains unexplored. The main difficulty facing here is the model uncertainties and visual disturbances that fail traditional control methods. In this paper, we propose a novel control scheme, namely the iterative learning embedded composite model reference adaptive control (IL-CMRAC), for efficient visual servo to solve the problem of in-situ off-axis rotation, by fully leveraging the repetitiveness nature of rotational motion. IL-CMRAC takes advantage of both offline learning and online adaptation to tackle the difficulties brought by uncertainties. Experiments demonstrated that the proposed method is capable of realizing high-precision off-axis in-situ rotation by average error within several microns.

4 February 2026 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
YJYujie Jiang
Yujie Jiang
CQChao Qin
Chao Qin
CZChengxi Zhong
Chengxi Zhong
XFXiang Fu
Xiang Fu
YLYou-Fu Li
You-Fu Li
SLSong Liu
Song Liu
Miniature adhesive patches (MAPs) are widely used in medicine for tissue repair, wound healing, and biosensing applications. Despite considerable advances in medical robotics, the automated in vivo delivery of MAPs remains a formidable challenge due to the intricate nature of biological environments, the delicate mechanical properties of MAPs, and the need for precise positioning on soft, often curved or dynamic tissue surfaces. This work presents a stereo microscope-guided dual-arm nanorobotic system capable of navigating intricate anatomical structures, enabling high-precision MAP delivery, and minimizing the internal stress on soft MAPs. The system employs adaptive bio-surface fitting and MAP delivery trajectory optimization based on the target tissue’s topography and MAP mechanical properties, followed by dual-arm execution under stereo microscope visual feedback. By automating MAP delivery onto complex in vivo surfaces, the system prevents internal stress imbalance (which often leads to significant and undesirable scar formation). Experimental validation demonstrated successful in vivo MAP delivery (Young’s modulus: 200 to 1000 Pa) onto mice nerve at vastus lateralis wound. The experiments also confirmed the system’s precision, dexterity, and uniform stress distribution during delivery process, underscoring its prospective utility in medical and clinical settings.