In recent years, many studies have discussed whether virtual reality (VR) can enhance the sensory experience of the audience via a controllable virtual environment. Most of the researches focus on comparing the difference of perceptual immersion between LCD screen and VR, or the impact on the narrative of the two media. The goal of this study is to investigate the affective state in VR head-mounted display (HMD) when the user watches videos displayed in different formats, i.e., 2D video, panoramic video and 360 video. In order to conduct this study, we designed an experiment procedure as well as an emotion annotation and monitoring system, which can not only obtain affective states of users but also collect physiological signals and behavior movements when the user watches videos in different formats. Furthermore, we used post-questionnaire to investigate the sense of presence, emotional induction and dominance of users. Some findings in the current study are summarized in the experimental results to give an insight for VR application developers so that they can use videos in suitable formats to evoke emotions in accordance with their requirements.
We propose a real-time shot spot analysis system specifically designed for basketball videos captured from a court view perspective, even in the presence of camera movements such as panning, zooming-in, and zooming-out. Our method consists of two stages: the first stage focuses on identifying the precise frame of the shot, while the second stage predicts the shot event category (i.e., 3-point shot, 2-point shot, or free-throw) and localizes the shot spot from a top-view perspective. Compared to existing end-to-end methods for shot event prediction, our method offers significant advantages. It effectively mitigates the overfitting problem and demonstrates superior performance in predicting 3-point shot and free-throw events. To the best of our knowledge, this work is the first real-time system capable of accurately localizing shot spots in basketball games captured by a moving camera with a court view.
We propose ImmerseSketch, a framework designed to transform creative prompts into vivid and detailed 3D content within a Virtual Reality (VR) environment. Our aim is to inspire creative ideation and to provide creators with 3D reference content for painting. However, the computational demands of diffusion models for 3D model generation and the scarcity of high-quality 3D datasets limit the diversity and intricacy of the generated environments. To overcome these obstacles, we focus on generating initial panoramic images through diffusion models and then converting these images into rich 3D environments with the aid of depth estimation. The pilot study shows that the proposed ImmerseSketch can provide an immersive environment and assist the process of creation.