6 February 2026 in IEEE Internet of Things Journal
Rehabilitation training plays a vital role in helping individuals regain motor function after injury or neurological conditions. This article presents two novel multimodal deep learning models, CLAP-Net and its interpretable extension FoCLAP-Net, for the detection and classification of abnormal postures during rehabilitation. These models are evaluated on the MovePort dataset, which contains synchronized signals from surface electromyography (EMG) sensors, inertial measurement units (IMUs), insole pressure sensors (IPSs), and an optical motion capture system (MoCap). The dataset includes 25 sessions recorded from 25 participants, covering a range of postures such as normal standing, forward leaning, backward leaning, and half squats. CLAP-Net employs convolutional and recurrent layers combined with an attention mechanism to capture relevant spatiotemporal features. FoCLAP-Net further incorporates a focal modulation (FM) mechanism to enhance model interpretability by identifying key sensor modalities influencing classification decisions. FoCLAP-Net achieves a classification accuracy of 98.66% and supports real-time detection, enabling dynamic adaptation of rehabilitation strategies such as functional or epidural electrical stimulation (FES/EES) and gravity-assist systems. The insights offered by FoCLAP-Net enhance clinical trust by making model outputs more transparent and understandable to practitioners. These findings highlight the promise of multimodal deep learning in building intelligent, personalized rehabilitation platforms capable of optimizing movement therapy based on data-driven posture analysis.