25 January 2024 in bioRxiv
Efficient musculoskeletal simulators and powerful learning algorithms provide computational tools to tackle the grand challenge of understanding biological motor control. Our winning solution for the inaugural NeurIPS MyoChallenge leverages an approach mirroring human skill learning. Using a novel curriculum learning approach, we trained a recurrent neural network to control a realistic model of the human hand with 39 muscles to rotate two Baoding balls in the palm of the hand. In agreement with data from human subjects, the policy uncovers a small number of kinematic synergies even though it is not explicitly biased towards low-dimensional solutions. However, by selectively inactivating parts of the control signal, we found that more dimensions contribute to the task performance than suggested by traditional synergy analysis. Overall, our work illustrates the emerging possibilities at the interface of musculoskeletal physics engines, reinforcement learning and neuroscience to advance our understanding of biological motor control.
4 March 2026 in Research Square
Animals exhibit a remarkable capacity to adapt to novel challenges on their first attempt. We propose that this zero-shot adaptability requires keeping behavioral outcomes highly predictable and controllable, which is achieved by structuring behavior as short compositions of simple primitives. Continuously across environments, the agent learns to predict the outcomes of primitive sequences in an unsupervised manner. When solving a new task, it optimizes short primitive compositions using differentiable model-predictive control. Constraining behavior to short compositions keeps gradient-based planning tractable, yielding efficiency orders of magnitude beyond traditional methods. Applied to mouse homing-escape behavior, our model explains the emergence of subgoals across arena configurations where conventional models fail. Ablations confirm that the components enabling rapid learning in our model (world models, planning models, primitives, and compositionality) are necessary to reproduce escape trajectories. Our results suggest that optimizing predictable primitive compositions is a core mechanism driving zero-shot adaptability and explaining mouse behavioral phenomena.
18 June 2021 in Behavior Research Methods
When people seek to understand concepts from an incomplete set of examples and counterexamples, there is usually an exponentially large number of classification rules that can correctly classify the observed data, depending on which features of the examples are used to construct these rules. A mechanistic approximation of human concept-learning should help to explain how humans prefer some rules over others when there are many that can be used to correctly classify the observed data. Here, we exploit the tools of propositional logic to develop an experimental framework that controls the minimal rules that aresimultaneouslyconsistent with the presented examples. For example, our framework allows us to present participants with concepts consistent with a disjunctionand alsowith a conjunction, depending on which features are used to build the rule. Similarly, it allows us to present concepts that are simultaneously consistent with two or more rules of different complexity and using different features. Importantly, our framework fully controls which minimal rules compete to explain the examples and is able to recover the features used by the participant to build the classification rule, without relying on supplementary attention-tracking mechanisms (e.g. eye-tracking). We exploit our framework in an experiment with a sequence of such competitive trials, illustrating the emergence of various transfer effects that bias participants’ prior attention to specific sets of features during learning.