8 March 2024 in ACM Transactions on Multimedia Computing, Communications, and Applications
Nowadays, most three-dimensional model quality assessment (3DQA) methods have been aimed at improving accuracy. However, little attention has been paid to the computational cost and inference time required for practical applications. Model-based 3DQA methods extract features directly from the 3D models, which are characterized by their high degree of complexity. As a result, many researchers are inclined towards utilizing projection-based 3DQA methods. Nevertheless, previous projection-based 3DQA methods directly extract features from multi-projections to ensure quality prediction accuracy, which calls for more resource consumption and inevitably leads to inefficiency. Thus, in this article, we address this challenge by proposing a no-reference (NR) projection-based
G
rid
M
ini-patch
S
ampling
3D
Model
Q
uality
A
ssessment (GMS-3DQA)
method. The projection images are rendered from six perpendicular viewpoints of the 3D model to cover sufficient quality information. To reduce redundancy and inference resources, we propose a multi-projection grid mini-patch sampling strategy (MP-GMS), which samples grid mini-patches from the multi-projections and forms the sampled grid mini-patches into one quality mini-patch map (QMM). The Swin-Transformer tiny backbone is then used to extract quality-aware features from the QMMs. The experimental results show that the proposed GMS-3DQA outperforms existing state-of-the-art NR-3DQA methods on the point cloud quality assessment databases for both accuracy and efficiency. The efficiency analysis reveals that the proposed GMS-3DQA requires far less computational resources and inference time than other 3DQA competitors. The code is available at https://github.com/zzc-1998/GMS-3DQA .
5 January 2024 in IEEE Transactions on Broadcasting
As wireless technology continues its rapid evolution, the sixth-generation (6G) networks are capable of offering exceptionally high data transmission rates as well as low latency, which is promisingly able to meet the high-demand needs for digital twins (DTs). Quality-of-experience (QoE) in this situation, which refers to the users’ overall satisfaction and perception of the provided DT service in 6G networks, is significant to optimize the service and help improve the users’ experience. Despite progress in developing theories and systems for digital twin transmission under 6G networks, the assessment of QoE for users falls behind. To address this gap, our paper introduces the first QoE evaluation database for human digital twins (HDTs) in 6G network environments, aiming to systematically analyze and quantify the related quality factors. We utilize a mmWave network model for channel capacity simulation and employ high-quality digital humans as source models, which are further animated, encoded, and distorted for final QoE evaluation. Subjective quality ratings are collected from a well-controlled subjective experiment for the 400 generated HDT sequences. Additionally, we propose a novel QoE evaluation metric that considers both quality-of-service (QoS) and content-quality features. Experimental results indicate that our model outperforms existing state-of-the-art QoE evaluation models and other competitive quality assessment models, thus making significant contributions to the domain of 6G network applications for HDTs.
19 July 2025 in ACM Transactions on Multimedia Computing, Communications, and Applications
Quality assessment, which evaluates the visual quality level of multimedia experiences, has garnered significant attention from researchers and has evolved substantially through dedicated efforts. Before the advent of large models, quality assessment typically relied on small expert models tailored for specific tasks. While these smaller models are effective at handling their designated tasks and predicting quality levels, they often lack explainability and robustness. With the advancement of large models, which align more closely with human cognitive and perceptual processes, many researchers are now leveraging the prior knowledge embedded in these large models for quality assessment tasks. This emergence of quality assessment within the context of large models motivates us to provide a comprehensive review focusing on two key aspects: (1) the assessment of large models and (2) the role of large models in assessment tasks. We begin by reflecting on the historical development of quality assessment. Subsequently, we move to detailed discussions of related works concerning quality assessment in the era of large models. Finally, we offer insights into the future progression and potential pathways for quality assessment in this new era. We hope that this survey will enable a rapid understanding of the development of quality assessment in the era of large models and inspire further advancements in the field.
11 December 2023 in ACM Transactions on Multimedia Computing, Communications, and Applications
Computer graphics images (CGIs) are artificially generated by means of computer programs and are widely perceived under various scenarios, such as games, streaming media, etc. In practice, the quality of CGIs consistently suffers from poor rendering during production, inevitable compression artifacts during the transmission of multimedia applications, and low aesthetic quality resulting from poor composition and design. However, few works have been dedicated to dealing with the challenge of computer graphics image quality assessment (CGIQA). Most image quality assessment (IQA) metrics are developed for natural scene images (NSIs) and validated on databases consisting of NSIs with synthetic distortions, which are not suitable for in-the-wild CGIs. To bridge the gap between evaluating the quality of NSIs and CGIs, we construct a large-scale in-the-wild CGIQA database consisting of 6,000 CGIs (CGIQA-6k) and carry out the subjective experiment in a well-controlled laboratory environment to obtain the accurate perceptual ratings of the CGIs. Then, we propose an effective deep learning–based no-reference (NR) IQA model by utilizing both distortion and aesthetic quality representation. Experimental results show that the proposed method outperforms all other state-of-the-art NR IQA methods on the constructed CGIQA-6k database and other CGIQA-related databases. The database is released athttps://github.com/zzc-1998/CGIQA6K.
12 August 2025 in Information Processing & Management