Eye movements serve to accumulate information from the visual world, contributing to the formation of coherent memory representations that support cognition and behavior. The hippocampus and the oculomotor network are well connected anatomically through an extensive set of polysynaptic pathways. However, the extent to which visual sampling behavior is related to functional responses in the hippocampus during encoding has not been studied directly in human neuroimaging. In the current study, participants engaged in a face processing task while brain responses were recorded with fMRI and eye movements were monitored simultaneously. The number of gaze fixations that a participant made on a given trial was correlated significantly with hippocampal activation such that more fixations were associated with stronger hippocampal activation. Similar results were also found in the fusiform face area, a face-selective perceptual processing region. Notably, the number of fixations was associated with stronger hippocampal activation when the presented faces were novel, but not when the faces were repeated. Increases in fixations during viewing of novel faces also led to larger repetition-related suppression in the hippocampus, indicating that this fixation–hippocampal relationship may reflect the ongoing development of lasting representations. Together, these results provide novel empirical support for the idea that visual exploration and hippocampal binding processes are inherently linked.SIGNIFICANCE STATEMENTThe hippocampal and oculomotor networks have each been studied extensively for their roles in the binding of information and gaze function, respectively. Despite the evidence that individuals with amnesia whose damage includes the hippocampus show alterations in their eye movement patterns and recent findings that the two systems are anatomically connected, it has not been demonstrated whether visual exploration is related to hippocampal activity in neurologically intact adults. In this combined fMRI–eye-tracking study, we show how hippocampal responses scale with the number of gaze fixations made during viewing of novel, but not repeated, faces. These findings provide new evidence suggesting that the hippocampus plays an important role in the binding of information, as sampled by gaze fixations, during visual exploration.
Eye movements support memory encoding by binding distinct elements of the visual world into coherent representations. However, the role of eye movements in memory retrieval is less clear. We propose that eye movements play a functional role in retrieval by reinstating the encoding context. By overtly shifting attention in a manner that broadly recapitulates the spatial locations and temporal order of encoded content, eye movements facilitate access to, and reactivation of, associated details. Such mnemonic gaze reinstatement may be obligatorily recruited when task demands exceed cognitive resources, as is often observed in older adults. We review research linking gaze reinstatement to retrieval, describe the neural integration between the oculomotor and memory systems, and discuss implications for models of oculomotor control, memory, and aging.
16 October 2019 in Annals of the New York Academy of Sciences
Decades of cognitive neuroscience research has shown that where we look is intimately connected to what we remember. In this article, we review findings from human and nonhuman animals, using behavioral, neuropsychological, neuroimaging, and computational modeling methods, to show that the oculomotor and hippocampal memory systems interact in a reciprocal manner, on a moment‐to‐moment basis, mediated by a vast structural and functional network. Visual exploration serves to efficiently gather information from the environment for the purpose of creating new memories, updating existing memories, and reconstructing the rich, vivid details from memory. Conversely, memory increases the efficiency of visual exploration. We call for models of oculomotor control to consider the influence of the hippocampal memory system on the cognitive control of eye movements, and for models of hippocampal and broader medial temporal lobe function to consider the influence of the oculomotor system on the development and expression of memory. We describe eye movement–based applications for the detection of neurodegeneration and delivery of therapeutic interventions for mental health disorders for which the hippocampus is implicated and memory dysfunctions are at the forefront.
Recent functional imaging studies have proposed that the human entorhinal cortex (ERC) is subdivided into functionally distinct anterolateral (alERC) and posteromedial (pmERC) subregions. The alERC overlaps with regions that are affected earliest by Alzheimer's disease pathology, yet its cognitive function remains poorly understood. Previous human fMRI studies have focused on its role in object memory, but rodent studies on the putatively homologous lateral entorhinal cortex suggest that it also plays an important role in representing spatial properties of objects. To investigate the cognitive effects of human alERC volume differences, we developed an eye-tracking-based task to evaluate intra-item configural processing (i.e., processing the arrangement of an object's features) and used manual segmentation based on a recently developed protocol to delineate the alERC/pmERC and other medial temporal lobe (MTL) subregions. In a group of older adult men and women at varying stages of brain atrophy and cognitive decline, we found that intra-item configural processing, regardless of an object's novelty, was strongly predicted by alERC volume, but not by the volume of any other MTL subregion. These results provide the first evidence that the human alERC plays a role in supporting a distinct aspect of object processing, namely attending to the arrangement of an object's component features.SIGNIFICANCE STATEMENTAlzheimer's disease pathology appears earliest in brain regions that overlap with the anterolateral entorhinal cortex (alERC). However, the cognitive role of the alERC is poorly understood. Previous human studies treat the alERC as an extension of the neighboring perirhinal cortex, supporting object memory. Animal studies suggest that the alERC may support the spatial properties of objects. In a group of older adult humans at the earliest stages of cognitive decline, we show here that alERC volume selectively predicted configural processing (attention to the spatial arrangement of an object's parts). This is the first study to demonstrate a cognitive role related to alERC volume in humans. This task can be adapted to serve as an early detection method for Alzheimer's disease pathology.
Current theories state that the hippocampus is responsible for the formation of memory representations regarding relations, whereas extrahippocampal cortical regions support representations for single items. However, findings of impaired item memory in hippocampal amnesics suggest a more nuanced role for the hippocampus in item memory. The hippocampus may be necessary when the item elements need to be bound within and across episodes to form a lasting representation that can be used flexibly. The current investigation was designed to test this hypothesis in face recognition. H.C., an individual who developed with a compromised hippocampal system, and control participants incidentally studied individual faces that either varied in presentation viewpoint across study repetitions or remained in a fixed viewpoint across the study repetitions. Eye movements were recorded during encoding and participants then completed a surprise recognition memory test. H.C. demonstrated altered face viewing during encoding. Although the overall number of fixations made by H.C. was not significantly different from that of controls, the distribution of her viewing was primarily directed to the eye region. Critically, H.C. was significantly impaired in her ability to subsequently recognize faces studied from variable viewpoints, but demonstrated spared performance in recognizing faces she encoded from a fixed viewpoint, implicating a relationship between eye movement behavior in the service of a hippocampal binding function. These findings suggest that a compromised hippocampal system disrupts the ability to bind item features within and across study repetitions, ultimately disrupting recognition when it requires access to flexible relational representations.
Hippocampal amnesia is defined by deficits in the binding of relations among items-a deficit captured by the transverse patterning (TP) task. Unitization is a processing mechanism that may allow amnesic patients to compensate for relational memory deficits. Amnesic patient D.A. demonstrated intact TP, and performance was maintained 1 month following training. Successful acquisition of relations occurred only when D.A. fused or integrated objects into a unified representation. D.A. did not acquire relations when he did not generate such integrated scenarios, and acquisition of relations was slowed when integration had to occur for novel stimuli. Amnesic patients K.C. and R.F.R. were tested to provide comparative data; K.C. and R.F.R. did not benefit from unitization, perhaps due to additional cortical damage. We propose that unitization requires visual imagery of multiple items that are fused/integrated; through the benefit of extended on-line maintenance, this fused representation is anchored to existing representations in semantic memory.