The very limited capacity of short-term or working memory is one of the most prominent features of human cognition. Most studies have stressed delimiting the upper bounds of this memory in memorization tasks rather than the performance of everyday tasks. We designed a series of experiments to test the use of short-term memory in the course of a natural hand-eye task where subjects have the freedom to choose their own task parameters. In this case subjects choose not to operate at the maximum capacity of short-term memory but instead seek to minimize its use. In particular, reducing the instantaneous memory required to perform the task can be done by serializing the task with eye movements. These eye movements allow subjects to postpone the gathering of task-relevant information until just before it is required. The reluctance to use short-term memory can be explained if such memory is expensive to use with respect to the cost of the serializing strategy.
This paper investigates the temporal dependencies of natural vision by measuring eye and hand movements while subjects made a sandwich. The phenomenon of change blindness suggests these temporal dependencies might be limited. Our observations are largely consistent with this, suggesting that much natural vision can be accomplished with “just-in-time” representations. However, we also observe several aspects of performance that point to the need for some representation of the spatial structure of the scene that is built up over different fixations. Patterns of eye-hand coordination and fixation sequences suggest the need for planning and coordinating movements over a period of a few seconds. This planning must be in a coordinate frame that is independent of eye position, and thus requires a representation of the spatial structure in a scene that is built up over different fixations.
Alfred Yarbus ( 1967 Yarbus, A. L. 1967. Eye movements and vision (B. Haigh, Trans.), New York: Plenum Press. [Google Scholar] ) reported that an observer's eye movement record varied based on high-level task. He found that an observer's eye movement patterns during freeview were dramatically different than when given tasks such as “Remember the clothes worn by the people.” Although Yarbus’ work is often cited to demonstrate the task-dependence of eye movements, it is often misrepresented; Yarbus reported results for only one observer, but authors commonly refer to Yarbus’ “observers”. Additionally, his observer viewed the painting for 21 minutes with optical stalks attached to the sclera and with his head severely restricted. Although eye movements are undoubtedly influenced by high-level tasks, it is not clear how Yarbus’ results reflect his unique experimental conditions. Because of Yarbus’ role in the literature, it is important to determine the extent to which his results represent a sample of naïve observers under more natural conditions. We replicated Yarbus’ experiment using a head-free eyetracker with 17 naïve observers. The presentations were self-paced; viewing times were typically an order of magnitude shorter than the times Yarbus imposed. Eye movement patterns were clearly task dependent, but some of the differences were much less dramatic than those shown in Yarbus’ now-classic observations.