The quantitative assessment of Parkinson’s disease (PD) is critical for guiding diagnosis, treatment, and rehabilitation. Conventional clinical evaluations—heavily dependent on manual rating scales such as the Unified Parkinson’s Disease Rating Scale (UPDRS)—are time-consuming and prone to inter-rater variability. In this study, we propose a fully automated UPDRS gait-scoring framework. Our method combines (a) surface electromyography (EMG) signals and (b) inertial measurement unit (IMU) data into a single deep learning model. Our end-to-end network comprises three specialized branches—a diagnosis head, an evaluation head, and a balance head—whose outputs are integrated via a customized fusion-detection module to emulate the multidimensional assessments performed by clinicians. We validated our system on 21 PD patients and healthy controls performing a simple walking task while wearing a four-channel EMG array on the lower limbs and 2 shank-mounted IMUs. It achieved a mean classification accuracy of 92.8% across UPDRS levels 0–2. This approach requires minimal subject effort and sensor setup, significantly cutting clinician workload associated with traditional UPDRS evaluations while improving objectivity. The results demonstrate the potential of wearable sensor-driven deep learning methods to deliver rapid, reliable PD gait assessment in both clinical and home settings.

Visual speech recognition is a technology that relies on visual information, offering unique advantages in noisy environments or when communicating with individuals with speech impairments. However, this technology still faces challenges, such as limited generalization ability due to different speech habits, high recognition error rates caused by confusable phonemes, and difficulties adapting to complex lighting conditions and facial occlusions. This paper proposes a lip reading data augmentation method—Partition-Time Masking (PTM)—to address these challenges and improve lip reading models’ performance and generalization ability. Applying nonlinear transformations to the training data enhances the model’s generalization ability when handling diverse speakers and environmental conditions. A lip-reading recognition model architecture, Swin Transformer and 3D Convolution (ST3D), was designed to overcome the limitations of traditional lip-reading models that use ResNet-based front-end feature extraction networks. By adopting a strategy that combines Swin Transformer and 3D convolution, the proposed model enhances performance. To validate the effectiveness of the Partition-Time Masking data augmentation method, experiments were conducted on the LRW video dataset using the DC-TCN model, achieving a peak accuracy of 92.15%. The ST3D model was validated on the LRW and LRW1000 video datasets, achieving a maximum accuracy of 56.1% on the LRW1000 dataset and 91.8% on the LRW dataset, outperforming current mainstream lip reading models and demonstrating superior performance on challenging easily confused samples.

Parkinson’s disease (PD) is one of the fastest-growing neurodegenerative disorders; its cardinal motor signs—tremor, bradykinesia, and rigidity—substantially impair quality of life. Conventional clinician-rated scales can be subjective and exhibit limited interrater reliability, underscoring the need for objective and reliable quantification. We present an integrated evaluation framework that leverages surface electromyography (sEMG) with multimodal sensing. For representation learning, we combine time–frequency descriptors with Mini-ROCKET features. Grading is performed by an sEMG-based Unified Parkinson’s Disease Rating Scale (UPDRS) model (LDA-SV) that produces per-segment probabilities for ordinal scores (0–3) and aggregates them via soft voting to assign item-level ratings. Participants completed a standardized protocol spanning gait, seated rest, and upper-limb tasks (forearm pronation–supination, finger-to-nose, fist clench, and thumb–index pinch). Using the aforementioned dataset, we report task-wise performance with 95% confidence intervals and compare the proposed model against CNN, LSTM, and InceptionTime using McNemar tests and log-odds ratios. The results indicate that the proposed model outperforms the three baseline models overall. These findings demonstrate the effectiveness and feasibility of the proposed approach, suggesting a viable pathway for the objective quantification of PD motor symptoms and facilitating broader clinical adoption of sEMG in diagnosis and treatment.

The target in an augmented reality (AR) interface is often located in the distance and outside the initial AR viewport, requiring the user to rotate the AR device, instead of translating it, to complete the search and selection of the target. In order to quantitatively analyze rotating the AR device in the AR interface in the selection of a target located outside the initial visual window, we propose and experimentally verify a quantitative model based on angle measurement under two selection techniques: with and without cursor. The results show that the model proposed in this paper can accurately describe the interactive process when a rotating AR device completes the target selection task. With cursor angle measurement achieves a model fitting value of R2=0.937, and without cursor angle measurement achieves a model fitting value of R2=0.915; hence, good modeling of user performance in AR selection tasks is achieved.