A fundamental challenge for the nervous system is to encode signals spanning many orders of magnitude with neurons of limited bandwidth. To meet this challenge, perceptual systems use gain control. However, whether the motor system uses an analogous mechanism is essentially unknown. Neuromodulators, such as serotonin, are prime candidates for gain control signals during force production. Serotonergic neurons project diffusely to motor pools, and, therefore, force production by one muscle should change the gain of others. Here we present behavioral and pharmaceutical evidence that serotonin modulates the input–output gain of motoneurons in humans. By selectively changing the efficacy of serotonin with drugs, we systematically modulated the amplitude of spinal reflexes. More importantly, force production in different limbs interacts systematically, as predicted by a spinal gain control mechanism. Psychophysics and pharmacology suggest that the motor system adopts gain control mechanisms, and serotonin is a primary driver for their implementation in force production.
It has recently been suggested that movement variability directly increases the speed of motor learning. Here we use computational modeling of motor adaptation to show that variability can have a broad range of effects on learning, both negative and positive. Experimentally, we also find contributing and decelerating effects. Lastly, through a meta-analysis of published papers, we verify that across a wide range of experiments, movement variability has no statistical relation with learning rate. While motor learning is a complex process that can be modeled, further research is needed to understand the relative importance of the involved factors. Variability is a fundamental component of our motor behaviors. It is caused by numerous factors, including sensory, planning, neuromuscular noise, as well as random external perturbations. Investigation of its underpinnings has been a driving force for numerous theoretical advances in motor control. Recently, it has been suggested that initial motor variability can promote the speed of motor learning. We first demonstrate with a series of simulations of a common learning model that different factors leading to increased variability can affect learning rate in completely different directions, instead of merely the positive trend as claimed. Second, we present experimental evidence that sensory uncertainty, which affects motor variability, instead of variability per se, determines learning speed during trial-by-trial random perturbations. Third, we present results from a meta-analysis of published studies that show the same lack of positive correlation. We conclude that motor learning is not generally facilitated by initial motor variability. Instead, their relationship should be investigated by considering the factors that affect variability in a task-specific manner.
We often need to learn how to move based on a single performance measure that reflects the overall success of our movements. However, movements have many properties, such as their trajectories, speeds and timing of end-points, thus the brain needs to decide which properties of movements should be improved; it needs to solve the credit assignment problem. Currently, little is known about how humans solve credit assignment problems in the context of reinforcement learning. Here we tested how human participants solve such problems during a trajectory-learning task. Without an explicitly-defined target movement, participants made hand reaches and received monetary rewards as feedback on a trial-by-trial basis. The curvature and direction of the attempted reach trajectories determined the monetary rewards received in a manner that can be manipulated experimentally. Based on the history of action-reward pairs, participants quickly solved the credit assignment problem and learned the implicit payoff function. A Bayesian credit-assignment model with built-in forgetting accurately predicts their trial-by-trial learning.
We constantly make small errors during movement and use them to adapt our future movements. Movement experiments often probe this error-driven learning by perturbing movements and analyzing the after-effects. Past studies have applied perturbations of varying nature such as visual disturbances, position- or velocity-dependent forces and modified inertia properties of the limb. However, little is known about how the specific nature of a perturbation influences subsequent movements. For a single perturbation trial, the nature of a perturbation may be highly uncertain to the nervous system, given that it receives only noisy information. One hypothesis is that the nervous system can use this rough estimate to partially correct for the perturbation on the next trial. Alternatively, the nervous system could ignore uncertain information about the nature of the perturbation and resort to a nonspecific adaptation. To study how the brain estimates and responds to incomplete sensory information, we test these two hypotheses using a trial-by-trial adaptation experiment. On each trial, the nature of the perturbation was chosen from six distinct types, including a visuomotor rotation and different force fields. We observed that corrective forces aiming to oppose the perturbation in the following trial were independent of the nature of the perturbation. Our results suggest that the nervous system uses a nonspecific strategy when it has high uncertainty about the nature of perturbations during trial-by-trial learning.