20 June 2023 in Nature Communications
Untethered magnetic miniature soft robots capable of accessing hard-to-reach regions can enable safe, disruptive, and minimally invasive medical procedures. However, the soft body limits the integration of non-magnetic external stimuli sources on the robot, thereby restricting the functionalities of such robots. One such functionality is localised heat generation, which requires solid metallic materials for increased efficiency. Yet, using these materials compromises the compliance and safety of using soft robots. To overcome these competing requirements, we propose a pangolin-inspired bi-layered soft robot design. We show that the reported design achieves heating > 70 °C at large distances > 5 cm within a short period of time <30 s, allowing users to realise on-demand localised heating in tandem with shape-morphing capabilities. We demonstrate advanced robotic functionalities, such as selective cargo release, in situ demagnetisation, hyperthermia and mitigation of bleeding, on tissue phantoms and ex vivo tissues.
28 April 2023 in Science Advances
YEYiğit Günsür Elmacıoğlu
With remote magnetic steering capabilities, magnetically actuated guidewires have proven their potential in minimally invasive medical procedures. Existing magnetic steering strategies, however, have been limited to low magnetic fields, which prevents the integration into medical systems operating at ultrahigh fields (UHF), such as magnetic resonance imaging (MRI) scanners. Here, we present magnetic guidewire design and steering strategies by elucidating the magnetic actuation principles of permanent magnets at UHF. By modeling the uniaxial magnetization behavior of permanent magnets, we outline the magnetic torque and force and demonstrate unique magnetic actuation opportunities at UHF, such as in situ remagnetization. Last, we illustrate the proposed steering principles using a magnetic guidewire composed of neodymium magnets and a fiber optic rod in a 7-Tesla preclinical MRI scanner. The developed UHF magnetic actuation framework would enable next-generation magnetic robots to operate inside MRI scanners.
1 June 2022 in IEEE Robotics and Automation Letters
Magnetic resonance imaging (MRI)-guided robots emerged as a promising tool for minimally invasive medical operations. Recently, MRI scanners have been proposed for actuating and localizing magnetic microrobots in the patient’s body using two-dimensional (2D) MR images. However, three-dimensional (3D) magnetic microrobots tracking during motion is still an untackled issue in MRI-powered microrobotics. Here, we present a deep learning-based 3D magnetic microrobot tracking method using 2D MR images during microrobot motion. The proposed method comprises a convolutional neural network (CNN) and complementary particle filter for 3D microrobot tracking. The CNN localizes the microrobot position relative to the 2D MRI slice and classifies the microrobot visibility in the MR images. First, we create an ultrasound (US) imaging-mentored MRI-based microrobot imaging and actuation system to train the CNN. Then, we trained the CNN using the MRI data generated by automated experiments using US image-based visual servoing of a microrobot with a $500\,{\mu }$ m-diameter magnetic core. We showed that the proposed CNN can localize the microrobot and classified its visibility in an in vitro environment with $\pm \mathbf {0.56}$ mm and $\mathbf {87.5}$ % accuracy in 2D MR images, respectively. Furthermore, we demonstrated ex-vivo 3D microrobot tracking with $\pm \mathbf {1.43}$ mm accuracy, improving tracking accuracy by 60% compared to the previous studies. The presented tracking strategy will enable MRI-powered microrobots to be used in high-precision targeted medical applications in the future.
15 June 2020 in IEEE Robotics and Automation Letters
Dual-use of magnetic resonance imaging (MRI) devices for robot tracking and actuation has transformed them into potential medical robotics platforms for targeted therapies and minimally invasive surgeries. In this letter, we present the dynamic simulations of an MRI-based tracking and actuation scheme, which performs intra-operational imaging while controlling untethered magnetic robots. In our realistic rigid-body simulation, we show that the robot could be controlled with a 1D projection-based position feedback while performing intra-operational echo-planar imaging (EPI). From the simulations, we observe that the velocity estimation error is the main source of the controller instability for low MRI sequence frequencies. To minimize the velocity estimation errors, we constrain the controller gains according to maximum closed-loop rates achievable for different sequence durations. Using the constrained controller in simulations, we confirm that EPI imaging could be introduced to the sequence as an intra-operational imaging method. Although the intro-operational imaging increases the position estimation error to 2.0 mm for a simulated MRI-based position sensing with a 0.6 mm Gaussian noise, it does not cause controller instability up to 128 k-space lines. With the presented approach, continuous physiological images could be acquired during medical operations while a magnetic robot is actuated and tracked inside an MRI device.
18 June 2024 in Advanced Science
With wireless multimodal locomotion capabilities, magnetic soft millirobots have emerged as potential minimally invasive medical robotic platforms. Due to their diverse shape programming capability, they can generate various locomotion modes, and their locomotion can be adapted to different environments by controlling the external magnetic field signal. Existing adaptation methods, however, are based on hand‐tuned signals. Here, a learning‐based adaptive magnetic soft millirobot multimodal locomotion framework empowered by sim‐to‐real transfer is presented. Developing a data‐driven magnetic soft millirobot simulation environment, the periodic magnetic actuation signal is learned for a given soft millirobot in simulation. Then, the learned locomotion strategy is deployed to the real world using Bayesian optimization and Gaussian processes. Finally, automated domain recognition and locomotion adaptation for unknown environments using a Kullback‐Leibler divergence‐based probabilistic method are illustrated. This method can enable soft millirobot locomotion to quickly and continuously adapt to environmental changes and explore the actuation space for unanticipated solutions with minimum experimental cost.