6 May 2024 in Nature Biomedical Engineering
Myocardial microvasculature and haemodynamics are indicative of potential microvascular diseases for patients with symptoms of coronary heart disease in the absence of obstructive coronary arteries. However, imaging microvascular structure and flow within the myocardium is challenging owing to the small size of the vessels and the constant movement of the patient’s heart. Here we show the feasibility of transthoracic ultrasound localization microscopy for imaging myocardial microvasculature and haemodynamics in explanted pig hearts and in patients in vivo. Through a customized data-acquisition and processing pipeline with a cardiac phased-array probe, we leveraged motion correction and tracking to reconstruct the dynamics of microcirculation. For four patients, two of whom had impaired myocardial function, we obtained super-resolution images of myocardial vascular structure and flow using data acquired within a breath hold. Myocardial ultrasound localization microscopy may facilitate the understanding of myocardial microcirculation and the management of patients with cardiac microvascular diseases.
16 February 2022 in IEEE Transactions on Medical Imaging
Ultrasound super-resolution imaging through localisation and tracking of microbubbles can achieve sub-wave-diffraction resolution in mapping both micro-vascular structure and flow dynamics in deep tissue in vivo . Currently, it is still challenging to achieve high accuracy in localisation and tracking particularly with limited imaging frame rates and in the presence of high bubble concentrations. This study introduces microbubble image features into a Kalman tracking framework, and makes the framework compatible with sparsity-based deconvolution to address these key challenges. The performance of the method is evaluated on both simulations using individual bubble signals segmented from in vivo data and experiments on a mouse brain and a human lymph node. The simulation results show that the deconvolution not only significantly improves the accuracy of isolating overlapping bubbles, but also preserves some image features of the bubbles. The combination of such features with Kalman motion model can achieve a significant improvement in tracking precision at a low frame rate over that using the distance measure, while the improvement is not significant at the highest frame rate. The in vivo results show that the proposed framework generates SR images that are significantly different from the current methods with visual improvement, and is more robust to high bubble concentrations and low frame rates.
27 December 2019 in IEEE Transactions on Biomedical Engineering
Objective: While surface electromyography (sEMG) is still dominant in the field of muscle-computer interface, ultrasound (US) sensing has been regarded as a promising alternative to sEMG, owing to its ability to precisely monitor muscle deformations. Among different US modalities, A-mode US is more compact and cost-effective for wearable applications against its cumbersome B-mode counterpart. In this work, we conduct a comprehensive comparison of wearable A-mode US and sEMG on gesture recognition and isometric muscle contraction force estimation. Methods: We experimented with eight types of gesture, with a range of 0-60% maximum voluntary contraction for each motion. Results: Results show that A-mode US outperforms sEMG on gesture recognition accuracy, robustness, and discrete force estimation accuracy, while sEMG is superior to US on continuous force estimation accuracy and ease of use in force estimation. Moreover, an extended online experiment demonstrates that the complementary advantages of US and sEMG on gesture recognition and continuous force estimation can be combined for the achievement of multi-class proportional gesture control. Significance: This study demonstrates the potential of A-mode US in automated gesture recognition, and the prospect of sEMG/US fusion for proportional gesture interaction.
27 February 2019 in IEEE Transactions on Industrial Electronics
It is evident that the prevailing solution, myoelectric pattern recognition for prosthetic manipulation, constrains gesture-based interaction due to the lack of proportional control information such as exerted force. This paper reports an attempt, named simultaneous gesture recognition and muscle contraction force estimation, to realize proportional pattern recognition (PPR) control taking advantage of arm muscle deformation via wearable ultrasound sensing. We experiment with eight types of predefined hand motions, with a range of 0 - 60% maximum voluntary contraction (MVC) using a wearable multi-channel Amode ultrasound system. The experimental result demonstrates that above 93.7% of gestures are correctly recognized during dynamic muscle contraction forces (0 - 60% MVC), albeit only training at a slight force level (<6% MVC). Besides, the adopted non-parametric Gaussian process regression estimates the muscle contraction forces accurately synchronously, with average coefficient of determination ( $\mathbf{R}^2$ ) and normalized root-mean-square error (nRMSE) of 0.927 and 0.102, respectively. These research outcomes demonstrate the feasibility of ultrasound-based PPR control, paving the way for musculature-driven applications including finer prosthetic control, remote manipulation and rehabilitation treatment.
26 October 2021 in IEEE Journal of Biomedical and Health Informatics
Though physiological signal based human-machine interfaces (HMIs) have recently developed rapidly, their practical use is restricted by many real-world environmental factors, one of which is muscle fatigue. This paper explores the sensitivities between surface electromyography (sEMG) and A-mode ultrasound (AUS) sensing modalities subject to muscle fatigue in the context of hand gesture recognition tasks. Two metrics, mean classification accuracy ( $mCA$ ) and decline rate ( $DR$ ), are proposed to evaluate the accuracy and muscle fatigue sensitivity between sEMG and AUS based HMIs. Muscle fatigue inducing experiment was designed and eight subjects were recruited to participate in the experiment. The gesture recognition accuracies of sEMG and AUS under non-fatigue state and fatigue state are compared through Mahalanobis distance based classifier linear discriminant analysis (LDA). In addition, Mahalanobis distance based metrics, repeatability index ( $RI$ ) and separability index ( $SI$ ), are introduced to evaluate the changes in the feature distribution during muscle fatigue and reveal the cause of the fatigue sensitivity difference between sEMG and AUS signals. The experimental results demonstrate that the fatigue robustness of AUS signal is better than that of sEMG signal. Specifically, with the employment of the LDA classifier trained under non-fatigue state, the testing accuracy of the sEMG signal on the non-fatigue state is 94.96%, while reduce to 68.26% on the fatigue state. The testing accuracy of the AUS signal on the corresponding states is 99.68% and 91.24% respectively. AUS signal attains higher $mCA$ and lower $DR$ , indicating that it has advantages over sEMG signal in terms of both accuracy and muscle fatigue sensitivity. In addition, the $RI$ and $RI/SI$ analysis reveal that before and after muscle fatigue, the consistency of AUS feature distribution is better than that of sEMG. These research outcomes validate that AUS is more tolerant to feature migration caused by muscle fatigue than sEMG.
12 April 2024 in IEEE Transactions on Medical Imaging
With the widespread interest and uptake of super-resolution ultrasound (SRUS) through localization and tracking of microbubbles, also known as ultrasound localization microscopy (ULM), many localization and tracking algorithms have been developed. ULM can image many centimeters into tissue in-vivo and track microvascular flow non-invasively with sub-diffraction resolution. In a significant community effort, we organized a challenge, Ultrasound Localization and TRacking Algorithms for Super-Resolution (ULTRA-SR). The aims of this paper are threefold: to describe the challenge organization, data generation, and winning algorithms; to present the metrics and methods for evaluating challenge entrants; and to report results and findings of the evaluation. Realistic ultrasound datasets containing microvascular flow for different clinical ultrasound frequencies were simulated, using vascular flow physics, acoustic field simulation and nonlinear bubble dynamics simulation. Based on these datasets, 38 submissions from 24 research groups were evaluated against ground truth using an evaluation framework with six metrics, three for localization and three for tracking. In-vivo mouse brain and human lymph node data were also provided, and performance assessed by an expert panel. Winning algorithms are described and discussed. The publicly available data with ground truth and the defined metrics for both localization and tracking present a valuable resource for researchers to benchmark algorithms and software, identify optimized methods/software for their data, and provide insight into the current limits of the field. In conclusion, Ultra-SR challenge has provided benchmarking data and tools as well as direct comparison and insights for a number of the state-of-the art localization and tracking algorithms.