Elizabeth Schumann

Elizabeth Schumann

Auto-generated profile, based on publicly available information

Elizabeth Schumann

Stanford University, Stanford, USA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 December 2024
Verified
Conference Paper
Open access
RWRuocheng Wang
Ruocheng Wang
PXPei Xu
Pei Xu
HSHaochen Shi
Haochen Shi
ESElizabeth Schumann
Elizabeth Schumann
CLC. Karen Liu
C. Karen Liu

3 July 2026 in ACM Transactions on Graphics
Verified
Journal Article
Open access
PXPei Xu
Pei Xu
YYYufei Ye
Yufei Ye
SSShuchu Sun
Shuchu Sun
YDYu Ding
Yu Ding
ESElizabeth Schumann
Elizabeth Schumann
CLC. Karen Liu
C. Karen Liu
We present a data-driven approach for physics-based, muscle-driven dexterous control that enables musculoskeletal hands to perform precise piano playing for novel pieces of music outside the reference dataset. Our approach combines high-frequency muscle-level control with low-frequency latent-space coordination in a hierarchical architecture. At the low level, general single-hand policies are trained via reinforcement learning to generate dynamic muscle-tendon activations while tracking trajectories from a large reference motion dataset. The resulting tracking policies are then distilled into variational autoencoder (VAE) models, yielding smooth and structured latent spaces that abstract away low-level muscle dynamics. For the high level, we train piece-specific policies to operate in this latent space, coordinating bimanual motions based on specific goals, denoted by note events extracted from given musical scores, to synthesize performances beyond the reference data. High-level control is formulated as a decentralized multiagent reinforcement learning problem combined with adversarial learning for motion imitation. In addition, we present an enhanced musculoskeletal hand model that supports fine control of fingers for accurate low-level motion tracking and diverse high-level motion synthesis. We evaluate the control pipeline of our approach on a diverse piano repertoire spanning multiple musical styles and technical demands. Results demonstrate that our approach can synthesize coordinated bimanual motions with accurate key presses, and achieve the state-of-the-art performance of piano playing in physics-based dexterous control, while generalizing to sheet music that is not presented in the reference dataset. We also show that our musculoskeletal hand model demonstrates superior biomechanical stability and tracking precision compared to the existing model, and validate that our musculoskeletal hand model and muscle-driven controller can generate physiologically plausible activation patterns that align with human electromyography (EMG) recordings when subjects perform multiple tasks.