We typically think of intuitive physics in terms of high-level cognition, but might aspects of physics also be extracted during lower-level visual processing? Might we not only think about physics, but also see it? We explored this using multiple tasks in online adult samples with objects covered by soft materials—as when you see a chair with a blanket draped over it—where you must account for the physical interactions between cloth, gravity, and object. In multiple change-detection experiments ( n = 200), observers from an online testing marketplace were better at detecting image changes involving underlying object structure versus those involving only the superficial folds of cloths—even when the latter were more extreme along several dimensions. And in probe-comparison experiments ( n = 100), performance was worse when both probes (vs. only one) appeared on image regions reflective of underlying object structure (equating visual properties). This work collectively shows how vision uses intuitive physics to recover the deeper underlying structure of scenes.
1 September 2018 in Journal of Experimental Psychology: Human Perception and Performance
Knowledge of letter shapes is central to reading. In experiments focusing primarily on a single letter shape-the "looptail" lowercase print G-we found surprising gaps in skilled readers' knowledge. In Experiment 1 most participants failed to recall the existence of looptail g when asked if G has two lowercase print forms, and almost none were able to write looptail g accurately. In Experiment 2 participants searched for Gs in text with multiple looptail gs. Asked immediately thereafter to write the g form they had seen, half the participants produced an "opentail" g (the typical handwritten form), and only one wrote looptail g accurately. In Experiment 3 participants performed poorly in discriminating looptail g from distractors with important features mislocated or misoriented. These results have implications for understanding types of knowledge about letters, and how this knowledge is acquired. For example, our findings speak to hypotheses concerning the role of writing in learning letter shapes. More generally, our findings raise questions about the conditions under which massive exposure does, and does not, yield detailed, accurate, accessible knowledge. In this context we relate our findings to studies showing poor knowledge or memory for various types of stimuli despite extensive exposure. (PsycINFO Database Record
Computational explorations of human cognition have been especially successful when applied to visual perception. Existing models have primarily focused on rigid objects, emphasizing shape-preserving invariance to changes in viewpoint, lighting, object size, and scene context. Yet many objects in our everyday environments, such as cloths, are soft. This poses both quantitatively greater and qualitatively different challenges for models of perception, due to soft objects’ dynamic and high-dimensional internal structure, as in the changing folds and wrinkles of a cloth waving in the wind. Soft object perception is also correspondingly rich, involving distinct properties such as stiffness. Here we explore the ability of different kinds of computational models to capture visual perception of the physical properties of cloths (e.g., their degrees of stiffness) undergoing different naturalistic transformations (e.g., falling vs. waving in the wind). Across visual matching tasks, both the successes and failures of human performance are well explained by Woven: a new model that incorporates physics-based simulations to infer probabilistic representations of cloths. Woven outperforms powerful, performance-equated alternatives, including its ablations and a deep neural network, and suggests that humanlike machine vision may also require representations that transcend image statistics, and involve intuitive physics.