11 January 2023 in ACM Transactions on Applied Perception
Computer graphics seeks to deliver compelling images, generated within a computing budget, targeted at a specific display device, and ultimately viewed by an individual user. The foveated nature of human vision offers an opportunity to efficiently allocate computation and compression to appropriate areas of the viewer’s visual field, of particular importance with the rise of high-resolution and wide field-of-view display devices. However, while variations in acuity and contrast sensitivity across the field of view have been well-studied and modeled, a more consequential variation concerns peripheral vision’s degradation in the face of clutter, known as crowding. Understanding of peripheral crowding has greatly advanced in recent years, in terms of both phenomenology and modeling. Accurately leveraging this knowledge is critical for many applications, as peripheral vision covers a majority of pixels in the image. We advance computational models for peripheral vision aimed toward their eventual use in computer graphics. In particular, researchers have recently developed high-performing models of peripheral crowding, known as “pooling” models, which predict a wide range of phenomena but are computationally inefficient. We reformulate the problem as a dataflow computation, which enables faster processing and operating on larger images. Further, we account for the explicit encoding of “end stopped” features in the image, which was missing from previous methods. We evaluate our model in the context of perception of textures in the periphery, including a novel texture dataset and updated textural descriptors. Our improved computational framework may simplify development and testing of more sophisticated, complete models in more robust and realistic settings relevant to computer graphics.
6 September 2019 in Journal of Vision
Gaze-contingent rendering (also called foveated rendering) is a technique for increasing rendering efficiency by displaying reduced-fidelity content outside the fixation region. It has the potential to lower computational costs as well as reduce bandwidth and latency for cloud-based rendering. Color discrimination is known to be degraded in the periphery due to photoreceptor distribution (Curcio & Allen, 1990) and cortical magnification (Abramov et al., 1991), suggesting a potential for significant savings. However, an eccentricity-dependent color discrimination model is required to reduce peripheral color accuracy without detection. We built a model describing peripheral color difference tolerances, adapted from the CIEDE2000 color difference model. We used eccentricity-dependent parameters for hue and chroma based on measured peripheral chromatic discrimination thresholds from Hansen et al., 2009. We conducted two experiments to test our model. First, we compared the predicted versus actual thresholds by testing multiple levels of CIELAB chroma and direction (increased or decreased chroma) on three image types (simple, vector, and natural). Second, we validated the utility of the model as a visual difference predictor (VDP) for per-channel bit reduction of natural images (peripheral images were rendered at lower bit depth). In both experiments, subjects were asked to freely view high-resolution static images with real-time eye tracking and peripheral color degradation, responding whether they noticed any artifacts. Results indicate the model slightly overestimates color difference thresholds for some subjects and image types. There is a strong trend of content dependency, with more complex images producing higher and more consistent thresholds across subjects. No difference was found between chroma directions. Our simple model shows some predictive power as a VDP for gaze-contingent color degradation. However, additional perceptual effects such as chromatic crowding and peripheral spatial frequency characteristics would likely produce more accurate results. Further study is required for practical applications.