The upcoming Versatile Video Coding (VVC) Standard includes various new intra prediction tools that were not present in its predecessor High Efficiency Video Coding (HEVC), such as the wide angle intra prediction, the position dependent prediction combination or the multiple reference line intra prediction. In order to improve the intra prediction coding efficiency, this paper proposes the usage of the Intra Subpartition (ISP) algorithm. ISP is an updated version of the Line-Based Intra Prediction (LIP) mode that improves the trade-off between coding gain and complexity of the original method. The basic principle of ISP consists in subdividing an intra-predicted block into 2 or 4 subpartitions of at least 16 samples according to the original block dimensions. The method has been implemented on top of the VVC Test Model 3.0 (VTM-3.0), with the result of obtaining a gain of 0.57% with encoding and decoding run-times of 112% and 102% respectively for the All Intra configuration and a gain of 0.29% with encoding and decoding run-times of 102% and 101% respectively for the Random Access configuration.
7 October 2019 in IEEE Transactions on Circuits and Systems for Video Technology
In this paper, we describe a video coding design that enables a higher coding efficiency than the HEVC standard. The proposed video codec follows the design of block-based hybrid video coding, but includes a number of advanced coding tools. A part of the incorporated advanced concepts was developed by the Joint Video Exploration Team, while others are newly proposed. The key aspects of these newly proposed tools are the following. A video frame is subdivided into rectangles of variable size using a binary partitioning with variable split ratios. Three new approaches for generating spatial intra prediction signals are supported: A line-wise application of conventional intra prediction modes, coupled with a mode-dependent processing order, a region-based template matching prediction method and intra prediction modes based on neural networks. For motioncompensated prediction, a multi-hypothesis mode with more than two motion hypotheses can be used. In transform coding, mode dependent combinations of primary and secondary transforms are applied. Moreover, scalar quantization is replaced by trelliscoded quantization and the entropy coding of the quantized transform coefficients is improved. The intra and inter prediction signals can be filtered using an edge-preserving diffusion filter or a non-linear DCT-based thresholding operation. The video codec includes an adaptive in-loop filter for which one of three classifiers can be chosen on a picture basis. We also incorporated an optional encoder control, which adjusts the quantization parameters based on a perceptually motivated distortion measure. In a random access scenario, our proposed video codec achieves luma BD-rate savings between 32.5% for HDR HLG UHD and 39.6% for SDR UHD over the HEVC (HM software) anchor for different categories of test sequences.
Intra prediction in modern block-based hybrid video coding standards like H.265/High Efficiency Video Coding (HEVC) extrapolates the reconstructed values of neighboring reference samples of a block to generate the prediction signal. Due to the loss of correlation between samples with increasing distance, this procedure may lead to residual signals with high levels of energy concentrated in the most distant regions of the block relative to the neighboring reference samples. To circumvent this loss in prediction quality with increasing distance and improve the coding efficiency of intra prediction, this publication proposes an algorithm that divides blocks into line-based sub-partitions that are processed individually. This approach has been implemented in the context of HEVC and the new Joint Exploration Test Model (JEM), with the result of obtaining average bit-rate savings of 2.77% and 1.62% for a whole test set of video sequences according to the All Intra and Random Access configurations, respectively.
Intra prediction plays a very important role in current video coding technologies like the H.265/High Efficiency Video Coding (HEVC) standard, the Joint Exploration Test Model (JEM) and the upcoming Versatile Video Coding (VVC) standard. In previous work we proposed a Line-Based Intra Prediction algorithm to improve the state-of-art coding performance of HEVC and JEM. This method divides (horizontally or vertically) a block into lines and then it codes each of them individually in a sequential manner. At the encoder side, however, it is necessary to select an optimal combination of intra mode and 1-D split type in a Rate-Distortion sense. Since testing for every block all possible combinations of these two parameters would imply a very significant increase in the encoder complexity, this paper proposes several fast algorithms to reduce the number of tests and improve the overall trade-off between complexity and gain. The experimental results show a reduction of the encoder run-time from 322% to 166% in exchange for a loss of 0.34% for the All Intra configuration and from 151% to 116% for a loss of 0.15% in the case of Random Access.
Versatile Video Coding (VVC) is going to be the successor of High Efficiency Video Coding (HEVC). The new standard (currently under development) requires the adoption of tools that provide a good trade-off between gain and implementation complexity. In previous work we proposed a Line-Based Intra Prediction (LIP) algorithm to improve the coding performance of the upcoming standard. However, that contribution did not sufficiently take into account the hardware-related complexity of the method. For this reason, this publication addresses these problems and proposes several modifications of the algorithm to solve them. Experimental results show an average gain of 1.0% and 0.5% for the All Intra (AI) and Random Access (RA) configurations, respectively.
Transform coding tools in video coding have traditionally relied on the Discrete Cosine Transform Type II (DCT-II) to map residual signals to a new domain where quantization and entropy coding tools achieve a better coding efficiency than in the spatial domain. However, the DCT-II is not sufficient to model all different types of residual signals efficiently, especially in the intra-predicted blocks case. For this reason, the DST-VII was introduced in H.265/High Efficiency Video Coding (HEVC) in order to improve the compression performance of 4 × 4 intra-predicted blocks. In this paper we propose a multiple core transform approach, in which each transform is separable and generated by combining two one-dimensional transforms for the vertical and horizontal directions. The pair of 1-D transforms is selected from a set of three different types of Discrete Trigonometric Transforms and the Identity Transformation. Test results show that the proposed algorithm achieves bit rate reductions of 3% on average with respect to HEVC for intra-predicted residuals.