Practice makes perfect — or does it?: How do we learn from past errors? Herzfeld et al. found that when we practice a movement, the human brain has a memory for errors that is then used to learn faster in new conditions. This memory for error exists in parallel with motor memory's two traditional forms: memory of actions and memory of external perturbations. They also proposed a mathematical model for learning from errors. This model explained previous experimental results and predicted other major findings that they later verified experimentally. Science , this issue p. 1349
If we assume that the purpose of a movement is to acquire a rewarding state, the duration of the movement carries a cost because it delays acquisition of reward. For some people, passage of time carries a greater cost, as evidenced by how long they are willing to wait for a rewarding outcome. These steep discounters are considered impulsive. Is there a relationship between cost of time in decision making and cost of time in control of movements? Our theory predicts that people who are more impulsive should in general move faster than subjects who are less impulsive. To test our idea, we considered elementary voluntary movements: saccades of the eye. We found that in humans, saccadic vigor, assessed using velocity as a function of amplitude, was as much as 50% greater in one subject than another; that is, some people consistently moved their eyes with high vigor. We measured the cost of time in a decision-making task in which the same subjects were given a choice between smaller odds of success immediately and better odds if they waited. We measured how long they were willing to wait to obtain the better odds and how much they increased their wait period after they failed. We found that people that exhibited greater vigor in their movements tended to have a steep temporal discount function, as evidenced by their waiting patterns in the decision-making task. The cost of time may be shared between decision making and motor control.
When movements are perturbed in adaptation tasks, humans and other animals show incomplete compensation, tolerating small but sustained residual errors that persist despite repeated trials. State-space models explain this residual asymptotic error as interplay between learning from error and reversion to baseline, a form of forgetting. Previous work using zero-error-clamp trials has shown that reversion to baseline is not obligatory and can be overcome by manipulating feedback. We posited that novel error-clamp trials, in which feedback is constrained but has nonzero error and variance, might serve as a contextual cue for recruitment of other learning mechanisms that would then close the residual error. When error clamps were nonzero and had zero variance, human subjects changed their learning policy, using exploration in response to the residual error, despite their willingness to sustain such an error during the training block. In contrast, when the distribution of feedback in clamp trials was naturalistic, with persistent mean error but also with variance, a state-space model accounted for behavior in clamps, even in the absence of task success. Therefore, when the distribution of errors matched those during training, state-space models captured behavior during both adaptation and error-clamp trials because error-based learning dominated; when the distribution of feedback was altered, other forms of learning were triggered that did not follow the state-space model dynamics exhibited during training. The residual error during adaptation appears attributable to an error-dependent learning process that has the property of reversion toward baseline and that can suppress other forms of learning.
When motor commands are accompanied by an unexpected outcome, the resulting error induces changes in subsequent commands. However, when errors are artificially eliminated, changes in motor commands are not sustained but show decay. Why does the adaptation-induced change in motor output decay in the absence of error? A prominent idea is that decay reflects the stability of the memory. We show results that challenge this idea and instead suggest that motor output decays because the brain actively disengages a component of the memory. Humans adapted their reaching movements to a perturbation and were then introduced to a long period of trials in which errors were absent (error-clamp). We found that, in some subjects, motor output did not decay at the onset of the error-clamp block but a few trials later. We manipulated the kinematics of movements in the error-clamp block and found that, as movements became more similar to subjects9 natural movements in the perturbation block, the lag to decay onset became longer and eventually reached hundreds of trials. Furthermore, when there was decay in the motor output, the endpoint of decay was not zero but a fraction of the motor memory that was last acquired. Therefore, adaptation to a perturbation installed two distinct kinds of memories: (1) one that was disengaged when the brain detected a change in the task and (2) one that persisted despite it. Motor memories showed little decay in the absence of error if the brain was prevented from detecting a change in task conditions.
Ice-thickness measurements are needed to calculate fluxes through fast-flowing outlet glaciers in Greenland, Alaska, Patagonia and Antarctica. However, relatively high attenuation of radio waves by dielectric absorption and volume scattering from englacial water hampers detection of the bed through warm deep ice. In the past we have had success measuring ice thickness of temperate glaciers using a ground-based monopulse radar system operating at low frequencies (2 MHz). Here we adapt the same system to operate from an airplane. Test flights over Bering Glacier, Alaska, USA, detected the bed through ice up to 1250m thick. Flights across the Seward–Malaspina Glacier system, Alaska, resolved the ice thickness of Malaspina Glacier, but strong hyperbolic-shaped returns obscured the bed echo through the Seward throat. It is likely that this clutter in the signal was caused by off-nadir returns from chaotic surface crevasses that are ubiquitous in the throat region.