Evelyn Xiaoxiao Ma

Evelyn Xiaoxiao Ma

Auto-generated profile, based on publicly available information

Evelyn Xiaoxiao Ma

Department of Computer Science, University of Rochester, Rochester, NY, United States

Research Focus & Metrics

Academic Career Length

1Year (2026-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 January 2026 in JMIR Preprints
Verified
Preprint
Open access
SISaiful Islam
Saiful Islam
SPSooyong Park
Sooyong Park
EMEvelyn Ma
Evelyn Ma
TATariq Adnan
Tariq Adnan
EHEhsan Hoque
Ehsan Hoque
BACKGROUND Movement disorders affect millions globally, yet access to specialists remains limited. Automated multimedia analysis offers a scalable path for screening and remote monitoring, but unsupervised recordings often suffer from quality issues that compromise model reliability. OBJECTIVE This study presents NeuroSift, a machine learning framework designed to automatically assess recording quality and task compliance in home-based multimedia data collected for movement disorder assessment. METHODS Three experts annotated 2,516 recordings corresponding to three common movement disorder tasks: finger tapping, facial expression, and speech. Based on these annotations, we developed task-specific quality guidelines, designed interpretable features, and trained quality classification models. Inter-rater agreement was evaluated before and after guideline implementation. Interpretable, task-specific features were extracted from each modality, and ordinal classification models were trained to categorize recordings as poor, borderline, or good quality. Model performance was evaluated against expert consensus, and feature importance analyses were conducted to identify common sources of quality degradation. RESULTS The quality guidelines significantly improved inter-rater agreement among experts (???? < 0.001). Across tasks, the quality classification models achieved 77–90% ordinal accuracy against expert consensus when classifying recordings as poor, borderline, or good quality. Feature importance analysis further identifies task-specific failures such as hand visibility, camera angle, or background noise. CONCLUSIONS NeuroSift is intended to strengthen trust in predictive models and support reliable deployment of multimedia-based neurological assessment tools at scale. By identifying low-quality or noncompliant recordings prior to downstream analysis, the framework would enhance the robustness, trustworthiness, and scalability of machine learning-based neurological assessment tools. CLINICALTRIAL None.

18 August 2026 in Journal of Medical Internet Research
Verified
Journal Article
Open access
MIMd Saiful Islam
Md Saiful Islam
SPSooyong Park
Sooyong Park
EMEvelyn Xiaoxiao Ma
Evelyn Xiaoxiao Ma
TATariq Adnan
Tariq Adnan
EHEhsan Hoque
Ehsan Hoque
Background: Automated multimedia analysis of remotely recorded tasks offers a scalable approach to screening and remote monitoring of movement disorders such as Parkinson disease (PD). However, unsupervised recordings often suffer from quality issues that compromise model reliability. General multimedia quality checks may not detect task-specific failures, such as poor hand visibility during finger-tapping, inadequate facial framing during smile tasks, or background noise during speech tasks. Objective: This study aimed to develop and evaluate NeuroSift, a task-aware, interpretable machine learning framework for assessing recording quality and task compliance in home-recorded multimedia data collected for remote PD assessment. Methods: We analyzed 2516 home-recorded audio and video segments from 3 tasks: finger-tapping, facial expression (smile), and speech (pangram utterance). Three experts rated recordings as poor, borderline, or good quality. Task-specific annotation guidelines were developed through iterative review and discussion. We extracted interpretable features aligned with observable quality and compliance criteria and trained task-specific quality classification models. Interrater reliability was evaluated before and after guideline implementation using quadratic weighted Cohen κ (QWK), pairwise agreement, complete agreement, and intraclass correlation. Model performance was evaluated on a held-out test set (labeled using expert consensus) using accuracy, QWK, and ordinal classification accuracy (OCA, an accuracy metric that accounts for the ordered relationship among poor, borderline, and good labels). Feature importance was examined using Shapley additive explanations (SHAP), a method for estimating how individual features contribute to model predictions. Results: The task-specific guidelines significantly improved interrater reliability across all tasks (P<.001)—QWK increased from 0.46 to 0.89 for finger-tapping, from 0.61 to 0.84 for smile, and from 0.64 to 0.90 for speech. For 3-class quality classification, the best-performing models achieved QWK values of 0.71 for finger-tapping, 0.56 for smile, and 0.72 for speech. OCA was 82.1% for finger-tapping, 76.9% for smile, and 89.9% for speech. Most errors were adjacent-class errors, such as classifying poor recordings as borderline, whereas severe errors, such as classifying good recordings as poor, were rare. SHAP analyses identified task-specific sources of quality degradation that aligned with the annotation guidelines. Conclusions: NeuroSift was evaluated as a task-aware quality-classification framework for identifying low-quality or noncompliant multimedia data prior to downstream PD assessment. By combining structured quality guidelines, interpretable features, and explainable machine learning models, NeuroSift supports more transparent and user-correctable remote data collection. Although this study did not test downstream clinical impact, the framework offers a practical approach for quality-aware workflows that rely on user-recorded audio or video. This approach may extend beyond PD assessment to other remote settings, including telehealth, rehabilitation, and digital recruitment. Future studies should evaluate NeuroSift on independent datasets and examine its effects on downstream model performance, fairness, user experience, and workflow integration.