Yiwen Xu

Prof. Yiwen Xu

orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 August 2021 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
TZTiesong Zhao
Tiesong Zhao
YLYuting Lin
Yuting Lin
YXYiwen Xu
Yiwen Xu
WCWeiling Chen
Weiling Chen
ZWZhou Wang
Zhou Wang
Image Super-Resolution (SR) techniques improve visual quality by enhancing the spatial resolution of images. Quality evaluation metrics play a critical role in comparing and optimizing SR algorithms, but current metrics achieve only limited success, largely due to the lack of large-scale quality databases, which are essential for learning accurate and robust SR quality metrics. In this work, we first build a large-scale SR image database using a novel semi-automatic labeling approach, which allows us to label a large number of images with manageable human workload. The resulting SR Image quality database with Semi-Automatic Ratings (SISAR), so far the largest of SR-IQA database, contains 12 600 images of 100 natural scenes. We train an end-to-end Deep Image SR Quality (DISQ) model by employing two-stream Deep Neural Networks (DNNs) for feature extraction, followed by a feature fusion network for quality prediction. Experimental results demonstrate that the proposed method outperforms state-of-the-art metrics and achieves promising generalization performance in cross-database tests. The SISAR database and DISQ model will be made publicly available to facilitate reproducible research.

21 September 2022 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
Tiesong ZhaoTiesong Zhao
Tiesong Zhao
YHYuhang Huang
Yuhang Huang
WFWeize Feng
Weize Feng
YXYiwen Xu
Yiwen Xu
KWONG Tak Wu SamKWONG Tak Wu Sam
KWONG Tak Wu Sam
The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs. Among them, the up-to-date lossy video coding standard, Versatile Video Coding (VVC), has been attracting attentions of video coding community. However, the gain of VVC is achieved at the cost of significant encoding complexity, which brings the need to realize fast encoder with comparable Rate Distortion (RD) performance. In this paper, we propose to optimize the VVC complexity at intra-frame prediction, with a two-stage framework of deep feature fusion and probability estimation. At the first stage, we employ the deep convolutional network to extract the spatial-temporal neighboring coding features. Then we fuse all reference features obtained by different convolutional kernels to determine an optimal intra coding depth. At the second stage, we employ a probability-based model and the spatial-temporal coherence to select the candidate partition modes within the optimal coding depth. Finally, these selected depths and partitions are executed whilst unnecessary computations are excluded. Experimental results on standard database demonstrate the superiority of proposed method, especially for High Definition (HD) and Ultra-HD (UHD) video sequences.

6 December 2022 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
LLliqun lin
liqun lin
ZWZheng Wang
Zheng Wang
JHJiachen He
Jiachen He
WCWeiling Chen
Weiling Chen
YXYiwen Xu
Yiwen Xu
TZTiesong Zhao
Tiesong Zhao
Video quality assessment is critical in optimizing video coding techniques. However, the state-of-the-art methods have limited performance, which is largely due to the lack of large-scale subjective databases for training. In this work, a semi-automatic labeling method is adopted to build a large-scale compressed video quality database, which allows us to label a large number of compressed videos with manageable human workload. The resulting Compressed Video quality database with Semi-Automatic Ratings (CVSAR), so far the largest of compressed video quality database. We train a no-reference compressed video quality assessment model with a 3D CNN for SpatioTemporal Feature Extraction and Evaluation (STFEE). Experimental results demonstrate that the proposed method outperforms state-of-the-art metrics and achieves promising generalization performance in cross-database tests. The CVSAR database has been made publicly available. It can be accessed at https://github.com/Rocknroll194/CVSAR.

19 May 2022 in IEEE Transactions on Broadcasting
Verified
Journal Article
Closed access
JLJielian Lin
Jielian Lin
LLliqun lin
liqun lin
WLWeimeng Li
Weimeng Li
YXYiwen Xu
Yiwen Xu
TZTiesong Zhao
Tiesong Zhao
The emerging 360-degree video has a good practical prospect in video broadcasting due to its more immersive experience than traditional videos. To maintain a high fidelity with panoramic vision, 360-degree video adopts a significantly increased resolution than planar videos, which also inevitably leads to higher encoding complexity. In this paper, we propose a flexible complexity optimization method for 360-degree video coding, in which the encoder is capable of adapting to different complexity constraints in diversified broadcasting scenarios. In particular, the proposed method is realized with a latitude-based computation complexity allocation. Firstly, it investigates the Coding Unit (CU) partition variation along the latitude (i.e., vertical axis) and divides each video frame into Largest CU (LCU)-based latitude regions. Then, it formulates the complexity allocation problem from the global complexity target to all latitude regions, by considering the intraframe dependencies and Rate-Distortion (RD) models. Finally, it calculates the solution to this complexity allocation problem and further employs it in 360-degree video coding. Comprehensive experiments on the standard dataset reveal the superiority of our method, which achieves a flexible computational time reduction from 14.53% to 68.36% whilst maintaining a high visual quality of compressed videos.

8 December 2022 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
JLJielian Lin
Jielian Lin
HLHongbin Lin
Hongbin Lin
ZZZhichen Zhang
Zhichen Zhang
YXYiwen Xu
Yiwen Xu
TZTiesong Zhao
Tiesong Zhao
Hitherto, Versatile Video Coding (VVC) has a more magnificent overall performance than High Efficiency Video Coding (HEVC). The Quadtree with Nested Multi-Type Tree (QTMT) coding block structure can substantially enhance video coding quality in VVC. However, the coding gain also leads to a greater coding complexity. Therefore, this letter proposes a Fast Decision Scheme Based on Structural Similarity Index Metric Variation (FDS-SSIMV) to solve this problem. Firstly, the Structural Similarity Index Metric Variation (SSIMV) characteristic among the sub coding units of the spit mode is illustrated. Next, to evaluate the SSIMV value, SSIMV measure strategies are designed for different split modes in this letter. Then, the desired split modes are selected by the SSIMV values. Experimental results show that the proposed method achieves an average encoding Time Saving (TS) and Bjøntegaard Delta Bit Rate (BDBR) with 64.74% and 2.79%, respectively, outperforming the benchmarks

26 September 2021 in Sensors
Verified
Journal Article
Open access
PDF file
LLliqun lin
liqun lin
JYJing Yang
Jing Yang
ZWZheng Wang
Zheng Wang
LZLiping Zhou
Liping Zhou
WCWeiling Chen
Weiling Chen
YXYiwen Xu
Yiwen Xu
Video coding technology makes the required storage and transmission bandwidth of video services decrease by reducing the bitrate of the video stream. However, the compressed video signals may involve perceivable information loss, especially when the video is overcompressed. In such cases, the viewers can observe visually annoying artifacts, namely, Perceivable Encoding Artifacts (PEAs), which degrade their perceived video quality. To monitor and measure these PEAs (including blurring, blocking, ringing and color bleeding), we propose an objective video quality metric named Saliency-Aware Artifact Measurement (SAAM) without any reference information. The SAAM metric first introduces video saliency detection to extract interested regions and further splits these regions into a finite number of image patches. For each image patch, the data-driven model is utilized to evaluate intensities of PEAs. Finally, these intensities are fused into an overall metric using Support Vector Regression (SVR). In experiment section, we compared the SAAM metric with other popular video quality metrics on four publicly available databases: LIVE, CSIQ, IVP and FERIT-RTRK. The results reveal the promising quality prediction performance of the SAAM metric, which is superior to most of the popular compressed video quality evaluation models.