Xuemei Zhou

Xuemei Zhou

Auto-generated profile, based on publicly available information

Xuemei Zhou

Centrum Wiskunde & Informatica, TU Delft, The Netherlands

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 February 2021 in IEEE Transactions on Broadcasting
Verified
Journal Article
Closed access
XZXuemei Zhou
Xuemei Zhou
Yun ZhangYun Zhang
Yun Zhang
NLNa Li
Na Li
XWXu Wang
Xu Wang
YZYang Zhou
Yang Zhou
YHYo-Sung Ho
Yo-Sung Ho
In this article, we propose a quality assessment model-based on the projection invariant feature and the visual saliency for Stereoscopic Omnidirectional Images (SOIs). Firstly, the projection invariant monocular and binocular features of SOI are derived from the Scale-Invariant Feature Transform (SIFT) points to tackle the inconsistency between the stretched projection formats and the viewports. Secondly, the visual saliency model, which combines the chrominance and contrast perceptual factors, is used to facilitate the prediction accuracy. Thirdly, according to the characteristics of the panoramic image, we generate the weight map and utilize it as a location prior, which can be adapted to different projection formats. Finally, the proposed SOI quality assessment model fuses the projection invariant features, visual saliency, and location prior. Experimental results on both the NingBo University SOI Database (NBU-SOID) and Stereoscopic OmnidirectionaL Image quality assessment Database (SOLID) demonstrate the proposed metric on equi-rectangular projection format outperforms the state-of-the-art schemes, the pearson linear correlation coefficient and spearman rank order correlation coefficient performance are 0.933 and 0.933 on SOLID, and 0.907 and 0.910 on NBU-SOID, respectively. Meanwhile, the proposed algorithm is extended to another five representative projection formats and achieves superior performance.

15 April 2024
Verified
Conference Paper
Open access
MNMinh Nguyen
Minh Nguyen
SVShivi Vats
Shivi Vats
XZXuemei Zhou
Xuemei Zhou
IVIrene Viola
Irene Viola
PCPablo Cesar
Pablo Cesar
HHHermann Hellwagner
Hermann Hellwagner
Point clouds (PCs) have attracted researchers and developers due to their ability to provide immersive experiences with six degrees of freedom (6DoF). However, there are still several open issues in understanding the Quality of Experience (QoE) and visual attention of end users while experiencing 6DoF volumetric videos. First, encoding and decoding point clouds require a significant amount of both time and computational resources. Second, QoE prediction models for dynamic point clouds in 6DoF have not yet been developed due to the lack of visual quality databases. Third, visual attention in 6DoF is hardly explored, which impedes research into more sophisticated approaches for adaptive streaming of dynamic point clouds. In this work, we provide an open-source Compressed Point cloud dataset with Eye-tracking and Quality assessment in Mixed Reality (ComPEQ--MR). The dataset comprises four compressed dynamic point clouds processed by Moving Picture Experts Group (MPEG) reference tools (i.e., VPCC and GPCC), each with 12 distortion levels. We also conducted subjective tests to assess the quality of the compressed point clouds with different levels of distortion. The rating scores are attached to ComPEQ--MR so that they can be used to develop QoE prediction models in the context of MR environments. Additionally, eye-tracking data for visual saliency is included in this dataset, which is necessary to predict where people look when watching 3D videos in MR experiences. We collected opinion scores and eye-tracking data from 41 participants, resulting in 2132 responses and 164 visual attention maps in total. The dataset is available at https://ftp.itec.aau.at/datasets/ComPEQ-MR/.

11 March 2025 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
XZXuemei Zhou
Xuemei Zhou
IVIrene Viola
Irene Viola
SRSilvia Rossi
Silvia Rossi
PCPablo Cesar
Pablo Cesar
This paper presents a Task-Free eye-tracking dataset for Dynamic Point Clouds (TF-DPC) aimed at investigating visual attention. The dataset is composed of eye gaze and head movements collected from 24 participants observing 19 scanned dynamic point clouds in a Virtual Reality (VR) environment with 6 degrees of freedom. We compare the visual saliency maps generated from this dataset with those from a prior task-dependent experiment (focused on quality assessment) to explore how high-level tasks influence human visual attention. To measure the similarity between these visual saliency maps, we apply the well-known Pearson correlation coefficient and an adapted version of the Earth Mover's Distance metric, which takes into account both spatial information and the degrees of saliency. Our experimental results provide both qualitative and quantitative insights, revealing significant differences in visual attention due to task influence. This work enhances our understanding of the visual attention for dynamic point cloud (specifically human figures) in VR from gaze and human movement trajectories, and highlights the impact of task-dependent factors, offering valuable guidance for advancing visual saliency models and improving VR perception.

28 October 2024
Verified
Conference Paper
Open access
XZXuemei Zhou
Xuemei Zhou
IVIrene Viola
Irene Viola
YCYunlu Chen
Yunlu Chen
JPJiahuan Pei
Jiahuan Pei
PCPablo Cesar
Pablo Cesar
Point clouds represent one of the prevalent formats for 3D content. Distortions introduced at various stages in the point cloud processing pipeline affect the visual quality, altering their geometric composition, texture information, or both. Understanding and quantifying the impact of the distortion domain on visual quality is vital to driving rate optimization and guiding post-processing steps to improve the quality of experience. In this paper, we propose a multi-task guided multi-modality no reference metric (M3-Unity), which utilizes 4 types of modalities across attributes and dimensionalities to represent point clouds. An attention mechanism establishes inter/intra associations among 3D/2D patches, which can complement each other, yielding local and global features, to fit the highly nonlinear property of the human vision system. A multi-task decoder involving distortion type classification selects the best association among 4 modalities, aiding the regression task and enabling the in-depth analysis of the interplay between geometrical and textural distortions. Furthermore, our framework design and attention strategy enable us to measure the impact of individual attributes and their combinations, providing insights into how these associations contribute particularly in relation to distortion type. Extensive experimental results on 4 datasets consistently outperform the state-of-the-art metrics by a large margin. The code is available at https://github.com/cwi-dis/ACMMM2024-Oral.

17 January 2025 in Signal Processing: Image Communication
Verified
Journal Article
Closed access
XZXuemei Zhou
Xuemei Zhou
EAEvangelos Alexiou
Evangelos Alexiou
IVIrene Viola
Irene Viola
PCPablo Cesar
Pablo Cesar

24 April 2025 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
XZXuemei Zhou
Xuemei Zhou
IVIrene Viola
Irene Viola
EAEvangelos Alexiou
Evangelos Alexiou
JJJack Jansen
Jack Jansen
PCPablo Cesar
Pablo Cesar
Perceptual quality assessment of Dynamic Point Cloud (DPC) contents plays an important role in various Virtual Reality (VR) applications that involve human beings as the end user. Understanding and modeling perceptual quality assessment is greatly enriched by insights from visual attention. However, incorporating aspects of visual attention in DPC quality models is largely unexplored, as ground-truth visual attention data is scarcely available. Besides, testing methods and procedures for collecting visual attention data are still to be agreed on. This paper presents a dataset containing subjective opinion scores and visual attention maps of DPCs, collected in a VR environment using eye-tracking technology. Both the quality score and eye-tracking data were collected during a subjective quality assessment experiment, in which subjects were instructed to watch and rate DPCs at various degradation levels under 6 Degrees-of-Freedom (DoF) inspection, using a head-mounted display. Qualitative interview analysis was also conducted after the experiment. The dataset consists of 50 DPCs, including 5 reference DPCs, with each reference encoded at 3 distortion levels using 3 different codecs (namely G-PCC, V-PCC, CWI-PCL), amounting to a total of 9 degraded version per reference. Additionally, it incorporates 1,000 gaze trials from 40 participants, yielding a total of 15,000 visual attention maps across all the DPCs. We additionally benchmark objective quality metrics originally designed for static point clouds, evaluating their performance in our dataset using two temporal pooling strategies. Furthermore, we employ the visual attention data that are retrieved during our experiment to evaluate whether the performance of widely used objective quality metrics is improved by considering subjective measurements of visual attention. This dataset establishes a link between quality assessment and visual attention within the context of DPC. Moreover, thematic analysis of the interviews helps uncover user behavior and factors impacting perceptual quality for DPC in 6 DoF. This work deepens our understanding of DPC quality assessment and visual attention, driving progress in the realm of VR experiences and perception.