This article presents an assist-as-needed (AAN) control framework for exoskeleton assistance based on human volitional effort prediction via a Hill-type neuromuscular model. A sequential processing algorithm-based multirate observer is applied to continuously estimate muscle activation levels by fusing surface electromyography (sEMG) and ultrasound (US) echogenicity signals from the ankle muscles. An adaptive impedance controller manipulates the exoskeleton's impedance for a more natural behavior by following a desired intrinsic impedance model. Two neural networks provide robustness to uncertainties in the overall ankle joint-exoskeleton model and the prediction error in the volitional ankle joint torque. A rigorous Lyapunov-based stability analysis proves that the AAN control framework achieves uniformly ultimately bounded tracking for the overall system. Experimental studies on five participants with no neurological disabilities walking on a treadmill validate the effectiveness of the designed ankle exoskeleton and the proposed AAN approach. Results illustrate that the AAN control approach with fused sEMG and US echogenicity signals maintained a higher human volitional effort prediction accuracy, less ankle joint trajectory tracking error, and less robotic assistance torque than the AAN approach with the sEMG-based volitional effort prediction alone. The findings support our hypotheses that the proposed controller increases human motion intent prediction accuracy, improves the exoskeleton's control performance, and boosts voluntary participation from human subjects. The new framework potentially paves a foundation for using multimodal biological signals to control rehabilitative or assistive robots.
Functional electrical stimulation (FES) is a potential neurorehabilitative intervention to enable functional movements in persons with neurological conditions that cause mobility impairments. However, the quick onset of muscle fatigue during FES is a significant challenge for sustaining the desired functional movements for more extended periods. Therefore, a considerable interest still exists in the development of sensing techniques that reliably measure FES-induced muscle fatigue. This study proposes to use ultrasound (US) imaging-derived echogenicity signal as an indicator of FES-induced muscle fatigue. We hypothesized that the US-derived echogenicity signal is sensitive to FES-induced muscle fatigue under isometric and dynamic muscle contraction conditions. Eight non-disabled participants participated in the experiments, where FES electrodes were applied on their tibialis anterior (TA) muscles. During a fatigue protocol under either isometric and dynamic ankle dorsiflexion conditions, we synchronously collected the isometric dorsiflexion torque or dynamic dorsiflexion angle on the ankle joint, US echogenicity signals from TA muscle, and the applied stimulation intensity. The experimental results showed an exponential reduction in the US echogenicity relative change (ERC) as the fatigue progressed under the isometric () and dynamic () conditions. The experimental results also implied a strong linear relationship between US ERC and TA muscle fatigue benchmark (dorsiflexion torque or angle amplitude), with values of and under isometric and dynamic conditions, respectively. The findings in this study indicate that the US echogenicity signal is a computationally efficient signal that strongly represents FES-induced muscle fatigue. Its potential real-time implementation to detect fatigue can facilitate an FES closed-loop controller design that considers the FES-induced muscle fatigue.
30 September 2022 in IEEE Transactions on Control Systems Technology
Open- or closed-loop functional electrical stimulation (FES) has been widely investigated to treat drop foot syndrome, which is typically caused by weakness or paralysis of ankle dorsiflexors. However, conventional closed-loop FES control mainly uses kinematic feedback, which does not directly capture time-varying changes in muscle activation. In this study, we explored the use of ultrasound (US) echogenicity as an indicator of FES-evoked muscle activation and hypothesized that including US-derived muscle activation, in addition to kinematic feedback, would improve the closed-loop FES control performance compared to the closed-loop control that relies only on the kinematic feedback. A sampled-data observer (SDO) was derived to continuously estimate FES-evoked muscle activations from low-sampled US echogenicity signals. In addition, a dynamic surface controller (DSC) and a delay compensation (DC) term were incorporated with the SDO, denoted as the US-based DSC-DC, to drive the actual ankle dorsiflexion trajectory to the desired profile. The trajectory tracking error convergence of the closed-loop system was proven to be uniformly ultimately bounded based on the Lyapunov–Krasovskii stability analysis. The US-based DSC-DC controller was validated on five participants with no disabilities to control their ankle dorsiflexion during walking on a treadmill. The US-based DSC-DC controller significantly reduced the root-mean-square error of the ankle joint trajectory tracking by 46.52% ± 7.99% ( $p < 0.001$ ) compared to the traditional DSC-DC controller with only kinematic feedback but no US measurements. The results also verified the disturbance rejection performance of the US-based DSC-DC controller when a plantarflexion disturbance was added. Our control design, for the first time, provides a methodology to integrate US in an FES control framework, which will likely benefit persons with drop foot and those with other mobility disorders.
A hybrid exoskeleton is a class of wearable robotic technology that simultaneously uses a powered exoskeleton and functional electrical stimulation (FES) to generate assistive joint torques for people with impaired mobility due to neurological disorders such as spinal cord injury (SCI). The hybrid assistive technology benefits from FES that actively elicits force from paralyzed muscles via their neural excitation, leading to muscle strengthening. The main technical barrier to realizing the hybrid technology is to attain stable coordination between FES and the exoskeleton despite the quick onset of FES-induced muscle fatigue, which causes a rapid decline in the muscle force. Current methods to measure the induced fatigue lack direct muscle state measurements and may be ineffective at capturing the muscle force decay due to FES. Instead, ultrasound (US) imaging accurately quantifies FES-related muscle contractility and fatigue due to the direct visualization of muscle fibers. In this paper, we use real-time US imaging-derived muscle strain changes as biomarkers of FES-induced fatigue in an optimal controller that modulates exoskeleton assistance and FES dosage. To demonstrate that real-time US imaging is a promising muscle-machine interface technology that can optimize shared control in a hybrid exoskeleton, we perform experiments involving continuous seated knee extension and over-ground walking tasks on two participants with SCI and four participants without disabilities. Furthermore, this work helps design a novel and unprecedented robotic gait technology with the capability to impart FES-associated therapeutic benefits while assisting the gait of neurologically impaired individuals, including those with SCI, stroke, multiple sclerosis, etc.
In this letter, we analyze dynamic optimization problem for robotic systems utilizing dynamic active subspaces (DyAS) to obtain a lower-dimensional control input space by performing a global sensitivity analysis. In doing so, we set up a Model Predictive Control Allocation (MPCA) problem wherein the actuators are dynamically allocated to track a desired stabilizing torque while satisfying state and control constraints. To improve computational efficiency of the MPCA, we develop Koopman operator-based linear prediction dynamics of an over-actuated nonlinear robotic system. We demonstrate the derived results on a hybrid neuroprosthesis model for a trajectory tracking task wherein we show a muscle fatigue-based joint torque allocation among motor and functional electrical stimulation (FES) actuators.
About Me
Biomedical Engineering PhD student at North Carolina State University
Biomedical Engineering PhD student at North Carolina State University