Alexandre Chapiro

Alexandre Chapiro

Auto-generated profile, based on publicly available information

Alexandre Chapiro

Meta Platforms Inc., Menlo Park, CA, USA

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 July 2022 in ACM Transactions on Graphics
Verified
Journal Article
Open access
RMRafał K. Mantiuk
Rafał K. Mantiuk
MAMaliha Ashraf
Maliha Ashraf
ACAlexandre Chapiro
Alexandre Chapiro
A contrast sensitivity function, or CSF, is a cornerstone of many visual models. It explains whether a contrast pattern is visible to the human eye. The existing CSFs typically account for a subset of relevant dimensions describing a stimulus, limiting the use of such functions to either static or foveal content but not both. In this paper, we propose a unified CSF, stelaCSF, which accounts for all major dimensions of the stimulus: spatial and temporal frequency, eccentricity, luminance, and area. To model the 5-dimensional space of contrast sensitivity, we combined data from 11 papers, each of which studied a subset of this space. While previously proposed CSFs were fitted to a single dataset, stelaCSF can predict the data from all these studies using the same set of parameters. The predictions are accurate in the entire domain, including low frequencies. In addition, stelaCSF relies on psychophysical models and experimental evidence to explain the major interactions between the 5 dimensions of the CSF. We demonstrate the utility of our new CSF in a flicker detection metric and in foveated rendering.

19 July 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
RMRafal K. Mantiuk
Rafal K. Mantiuk
PHParam Hanji
Param Hanji
MAMaliha Ashraf
Maliha Ashraf
YAYuta Asano
Yuta Asano
ACAlexandre Chapiro
Alexandre Chapiro
ColorVideoVDP is a video and image quality metric that models spatial and temporal aspects of vision for both luminance and color. The metric is built on novel psychophysical models of chromatic spatiotemporal contrast sensitivity and cross-channel contrast masking. It accounts for the viewing conditions, geometric, and photometric characteristics of the display. It was trained to predict common video-streaming distortions (e.g., video compression, rescaling, and transmission errors) and also 8 new distortion types related to AR/VR displays (e.g., light source and waveguide non-uniformities). To address the latter application, we collected our novel XR-Display-Artifact-Video quality dataset (XR-DAVID), comprised of 336 distorted videos. Extensive testing on XR-DAVID, as well as several datasets from the literature, indicate a significant gain in prediction performance compared to existing metrics. ColorVideoVDP opens the doors to many novel applications that require the joint automated spatiotemporal assessment of luminance and color distortions, including video streaming, display specification, and design, visual comparison of results, and perceptually-guided quality optimization. The code for the metric can be found at https://github.com/gfxdisp/ColorVideoVDP.

1 April 2024 in Journal of Vision
Verified
Journal Article
Open access
PDF file
MAMaliha Ashraf
Maliha Ashraf
RMRafał K. Mantiuk
Rafał K. Mantiuk
ACAlexandre Chapiro
Alexandre Chapiro
SWSophie Wuerger
Sophie Wuerger
The contrast sensitivity function (CSF) is a fundamental visual model explaining our ability to detect small contrast patterns. CSFs found many applications in engineering, where they can be used to optimize a design for perceptual limits. To serve such a purpose, CSFs must explain possibly a complete set of stimulus parameters, such as spatial and temporal frequency, luminance, and others. Although numerous contrast sensitivity measurements can be found in the literature, none fully explains the complete space of stimulus parameters. Therefore, in this work, we first collect and consolidate contrast sensitivity measurements from 18 studies, which explain the sensitivity variation across the parameters of interest. Then, we build an analytical contrast sensitivity model that explains the data from all those studies. The proposed castleCSF model explains the sensitivity as the function of spatial and temporal frequencies, an arbitrary contrast modulation direction in the color space, mean luminance, and chromaticity of the background, eccentricity, and stimulus area. The proposed model uses the same set of parameters to explain the data from 18 studies with an error of 3.59 dB. The consolidated contrast sensitivity data and the code for the model are publicly available at https://github.com/gfxdisp/castleCSF/.

19 July 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
KCKenneth Chen
Kenneth Chen
TWThomas Wan
Thomas Wan
NMNathan Matsuda
Nathan Matsuda
ANAjit Ninan
Ajit Ninan
ACAlexandre Chapiro
Alexandre Chapiro
Qi SunQi Sun
Qi Sun
Display power consumption is an emerging concern for untethered devices. This goes double for augmented and virtual extended reality (XR) displays, which target high refresh rates and high resolutions while conforming to an ergonomically light form factor. A number of image mapping techniques have been proposed to extend battery usage. However, there is currently no comprehensive quantitative understanding of how the power savings provided by these methods compare to their impact on visual quality. We set out to answer this question. To this end, we present a perceptual evaluation of algorithms (PEA) for power optimization in XR displays (PODs). Consolidating a portfolio of six power-saving display mapping approaches, we begin by performing a large-scale perceptual study to understand the impact of each method on perceived quality in the wild. This results in a unified quality score for each technique, scaled in just-objectionable-difference (JOD) units. In parallel, each technique is analyzed using hardware-accurate power models. The resulting JOD-to-Milliwatt transfer function provides a first-of-its-kind look into tradeoffs offered by display mapping techniques, and can be directly employed to make architectural decisions for power budgets on XR displays. Finally, we leverage our study data and power models to address important display power applications like the choice of display primary, power implications of eye tracking, and more 1 .

27 October 2025 in Nature Communications
Verified
Journal Article
Open access
PDF file
MAMaliha Ashraf
Maliha Ashraf
ACAlexandre Chapiro
Alexandre Chapiro
RMRafał K. Mantiuk
Rafał K. Mantiuk
As large engineering efforts go towards improving the resolution of mobile, augmented reality (AR), and virtual reality (VR) displays, it is important to know the maximum resolution at which further improvements bring no noticeable benefit. This limit is often referred to as the retinal resolution, although the limiting factor may not necessarily be attributed to the retina. To determine the ultimate resolution at which an image appears sharp to our eyes with no perceivable blur, we created an experimental setup with a sliding display, which allows for continuous control of the resolution. The lack of such control was the main limitation of the previous studies. We measure achromatic (black-white) and chromatic (red-green and yellow-violet) resolution limits for foveal vision, and at two eccentricities (10° and 20°). Our results demonstrate that the resolution limit is higher than what was previously believed, reaching 94 pixels per degree (ppd) for foveal achromatic vision, 89 ppd for red-green patterns, and 53 ppd for yellow-violet patterns. We also observe a much larger drop in the resolution limit for chromatic patterns (red-green and yellow-violet) than for achromatic patterns. Our results provide quantitative benchmarks for display development, with implications for future imaging, rendering, and video coding technologies.

19 November 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
ACAlexandre Chapiro
Alexandre Chapiro
DKDongyeon Kim
Dongyeon Kim
YAYuta Asano
Yuta Asano
RMRafał K. Mantiuk
Rafał K. Mantiuk
The perception of visual content in optical-see-through augmented reality (AR) devices is affected by the light coming from the environment. This additional light interacts with the content in a non-trivial manner because of the illusion of transparency, different focal depths, and motion parallax. To investigate the impact of environment light on display artifact visibility (such as blur or color fringes), we created the first subjective quality dataset targeted toward augmented reality displays. Our study consisted of 6 scenes, each affected by one of 6 distortions at two strength levels, seen against one of 3 background patterns shown at 2 luminance levels: 432 conditions in total. Our dataset shows that environment light has a much smaller masking effect than expected. Further, we show that this effect cannot be explained by compositing of the AR-content with the background using optical blending models. As a consequence, we demonstrate that existing video quality metrics perform worse than expected when predicting the perceived magnitude of degradation in AR displays, motivating further research.