19 July 2024 in ACM Transactions on Graphics
Holographic near-eye displays are a promising technology to solve long-standing challenges in virtual and augmented reality display systems. Over the last few years, many different computer-generated holography (CGH) algorithms have been proposed that are supervised by different types of target content, such as 2.5D RGB-depth maps, 3D focal stacks, and 4D light fields. It is unclear, however, what the perceptual implications are of the choice of algorithm and target content type. In this work, we build a perceptual testbed of a full-color, high-quality holographic near-eye display. Under natural viewing conditions, we examine the effects of various CGH supervision formats and conduct user studies to assess their perceptual impacts on 3D realism. Our results indicate that CGH algorithms designed for specific viewpoints exhibit noticeable deficiencies in achieving 3D realism. In contrast, holograms incorporating parallax cues consistently outperform other formats across different viewing conditions, including the center of the eyebox. This finding is particularly interesting and suggests that the inclusion of parallax cues in CGH rendering plays a crucial role in enhancing the overall quality of the holographic experience. This work represents an initial stride towards delivering a perceptually realistic 3D experience with holographic near-eye displays.
22 July 2022 in ACM Transactions on Graphics
Holographic displays have gained unprecedented attention as next-generation virtual and augmented reality applications with recent achievements in the realization of a high-contrast image through computer-generated holograms (CGHs). However, these holograms show a high energy concentration in a limited angular spectrum, whereas the holograms with uniformly distributed angular spectrum suffer from a severe speckle noise in the reconstructed images. In this study, we claim that these two physical phenomena attributed to the existing CGHs significantly limit the support of accommodation cues, which is known as one of the biggest advantages of holographic displays. To support the statement, we analyze and evaluate various CGH algorithms with contrast gradients - a change of contrast over the change of the focal diopter of the eye - simulated based on the optical configuration of the display system and human visual perception models. We first introduce two approaches to improve monocular accommodation response in holographic viewing experience; optical and computational approaches to provide holographic images with sufficient contrast gradients. We design and conduct user experiments with our prototype of holographic near-eye displays, validating the deficient support of accommodation cues in the existing CGH algorithms and demonstrating the feasibility of the proposed solutions with significant improvements on accommodative gains.
27 March 2019 in IEEE Transactions on Industrial Informatics
Since the 1960s, digital holography has been developed significantly as an exquisite optical sensing technique with its computational interpretation. Recent advances in the image sensor and the coherent light source have suggested the possibility of using digital holography in portable form which can be utilized in industrial fields. Field of view should be sufficiently wide and the system be simple for successful landing of digital holography on the industrial market. To embody the possibility, in this paper, we present a method for implementing off-axis reflective digital holography using a single diffraction grating. Beam splitter and mirror in the conventional off-axis digital holography are replaced with a single diffraction grating. This replacement enables the implementation of simple interferometer while maintaining the performance of the holography. In addition, we apply the multiplexed illumination method to enhance space-bandwidth product of off-axis hologram. Using the wavelength dependence of the diffraction grating, field of view can be doubled without additional optical element. We demonstrate the proposed method by three holographic imaging experiments with two laser diodes. The prototype provides lateral resolution of 19.69 um with field of view of 6.85 mm × 8.72 mm. The field of view is 1.9 times wider than the image sensor area of 6.85 mm × 4.59 mm. Overall size of the prototype is 12 cm × 17 cm x 5 cm, showing the suitability of implementation to the various industrial fields.
19 November 2024 in ACM Transactions on Graphics
The perception of visual content in optical-see-through augmented reality (AR) devices is affected by the light coming from the environment. This additional light interacts with the content in a non-trivial manner because of the illusion of transparency, different focal depths, and motion parallax. To investigate the impact of environment light on display artifact visibility (such as blur or color fringes), we created the first subjective quality dataset targeted toward augmented reality displays. Our study consisted of 6 scenes, each affected by one of 6 distortions at two strength levels, seen against one of 3 background patterns shown at 2 luminance levels: 432 conditions in total. Our dataset shows that environment light has a much smaller masking effect than expected. Further, we show that this effect cannot be explained by compositing of the AR-content with the background using optical blending models. As a consequence, we demonstrate that existing video quality metrics perform worse than expected when predicting the perceived magnitude of degradation in AR displays, motivating further research.
17 June 2024 in Optics Express
Light field (LF) displays can offer a quasi-natural three-dimensional (3D) viewing experience by tailoring the four-dimensional light information. However, the primary drawback of conventional LF displays is their limited image quality due to restricted information. To address this limitation, time-multiplexing techniques are employed, but the resulting system configurations are often impractical for achieving compact systems. Here, we present a compact time-sequential super multi-view LF near-eye display integrated with a front-lit, multi-directional illumination module for virtual reality application. This illumination module consists of an RGB light-emitting diode array and a waveguide, allowing us to exploit a high-speed reflective-type spatial light modulator and provide high-bit depth, full-color 3D scenes with quasi-continuous parallax in a compact form factor display. The prototype is implemented for a live demo and evaluated with both simulation and experiment. Our work provides a viable path towards the wide adoption of 3D virtual reality head-mounted displays.