A real-time computer-generated integral imaging (CGII) display rendering method based on depth-image-based multiple reference viewpoints (MDIBR) is presented, and good three-dimensional (3D) image quality with the high frame rate can be achieved. The traditional rasterization pipeline and 3D image warping are used to accelerate CGII, and the proposed method is suitable for dynamic and complex 3D content generation for the 3D display. Qualitative and quantitative experiments are carried out to evaluate the feasibility of the proposed method. Experimental results show that the MDIBR method can achieve real-time integral imaging display with 80W80 viewpoints based on large-scale 3D data with a million points.
6 January 2022 in Journal of the Society for Information Display
With the development of three-dimensional (3D) light-field display technology, 3D scenes with correct location information and depth information can be perceived without wearing any external device. Only 2D stylized portrait images can be generated with traditional portrait stylization methods and it is difficult to produce high-quality stylized portrait content for 3D light-field displays. 3D light-field displays require the generation of content with accurate depth and spatial information, which is not achievable with 2D images alone. New and innovative portrait stylization techniques methods should be presented to meet the requirements of 3D light-field displays. A portrait stylization method for 3D light-field displays is proposed, which maintain the consistency of dense views in light-field display when the 3D stylized portrait is generated. Example-based portrait stylization method is used to migrate the designated style image to the portrait image, which can prevent the loss of contour information in 3D light-field portraits. To minimize the diversity in color information and further constrain the contour details of portraits, the Laplacian loss function is introduced in the pre-trained deep learning model. The three-dimensional representation of the stylized portrait scene is reconstructed, and the stylized 3D light field image of the portrait is generated the mask guide based light-field coding method. Experimental results demonstrate the effectiveness of the proposed method, which can use the real portrait photos to generate high quality 3D light-field portrait content.
Super multiview (SMV) 3D displays with a directional diffuser can provide dense viewpoints, wide viewing angles and high image quality. However, traditional SMV 3D rendering pipelines have many disadvantages, such as high time costs, low image quality, incorrect lighting effects and limited viewing angles. To overcome the abovementioned drawbacks, we propose a new SMV 3D rendering pipeline based on a hybrid rendering technique (HRT) that effectively combines and improves the Turing multiview rendering technique, the multiple view plus depth (MVD) technique and the deferred shading technique, introducing additional normal information, diffuseness information and shininess information into the SMV 3D rendering pipeline. The SMV HRT pipeline can generate SMV 3D images with accurate lighting in real time when the viewpoint number of an SMV 3D display is greater than 50, the viewing angle is greater than 100 degrees, the resolution of a single viewpoint image is more than 512*512 and the resolution of the LCD panel is 7680*4320; in particular, complex scenes can be generated in real time. The proposed HRT pipeline is the only viable real-time rendering pipeline with accurate lighting effects for super multiview 3D displays with wide viewing angle and high resolution that runs on a common PC with standard graphics hardware. An 8k SMV 3D display with an 80° viewing angle and 100 viewpoints is applied to demonstrate the validity of the HRT method in experiments. When the number of reference views is four, the experimental results show that the rendering frame rate is more than 35 fps on average for complex virtual scenes, and the peak signal-to-noise ratio (PSNR) value of the HRT is greater than 36 dB, illustrating its high image quality and accurate lighting. Compared with state-of-the-art MVD methods, HRT processes more lighting information and is more suitable for virtual scene rendering. Therefore, the HRT method has advantages regarding the image quality of the reconstructed 3D image and can easily achieve real-time rendering for SMV 3D displays with wide viewing angles.
Aiming at the problem that the browser loads large-scale three-dimensional(3D) scenes slowly and easily crashes, a method of embedding the third-party graphics engine in the browser by using plug-in is proposed to realize the rapid loading of large-scale 3D scenes. This paper embeds the browser as a User Interface(UI) into OpenSceneGraph(OSG) through the Chromium Embedded Framework(CEF), and embeds OSG into the browser based on Netscape Plugin Application Programming Interface(NPAPI) plug-in technology, so as to realize the efficient and fast loading of largescale 3D scenes in the browser. For the rendering of large-scale 3D scenes, compared with the traditional Web Graphics Library(WebGL) technology, this method can support larger resolution scenes and has better stability.