25 September 2019 in IEEE Transactions on Image Processing
The recent advances of hardware technology have made the intelligent analysis equipped at the front-end with deep learning more prevailing and practical. To better enable the intelligent sensing at the front-end, instead of compressing and transmitting visual signals or the ultimately utilized top-layer deep learning features, we propose to compactly represent and convey the intermediate-layer deep learning features with high generalization capability, to facilitate the collaborating approach between front and cloud ends. This strategy enables a good balance among the computational load, transmission load and the generalization ability for cloud servers when deploying the deep neural networks for large scale cloud based visual analysis. Moreover, the presented strategy also makes the standardization of deep feature coding more feasible and promising, as a series of tasks can simultaneously benefit from the transmitted intermediate layer features. We also present the results for evaluations of both lossless and lossy deep feature compression, which provide meaningful investigations and baselines for future research and standardization activities.
5 December 2018 in IEEE Transactions on Circuits and Systems for Video Technology
The state-of-the-art high efficiency video coding (HEVC) standard provides a significant improvement relative to H.264/AVC, with almost 50% bitrate reduction. However, there are still requirements to further improve the coding performance of HEVC. In this paper, we reveal some problems in both intra and inter prediction by giving detailed observations, and solve them by further exploring spatial and temporal correlations. First, it is noteworthy that large boundary distortions in intra prediction blocks arise from the simplistic extrapolation operation with partial reference samples. To reduce these boundary distortions, we propose an enhanced prediction boundary filtering method based on generalized Gaussian distribution functions, and extend this method to merge prediction. Second, we combine intra and inter prediction to create a novel prediction method, in which spatial and temporal correlations are simultaneously considered. In addition, the existing merge mode can only provide accurate prediction results for simple movements, owing to the lack of motion estimation. To improve the flexibility, we optimize the existing merge mode by intensifying the temporal correlation with a simple motion search process. The experimental results show that the proposed methods achieve consistent bitrate savings, 1.3% for all intra, 1.5% for random access, 2.5% (up to 4.2%) for low delay P, and 1.2% for low delay B configuration. The encoding time only rises by 70% - 80%, and the decoding time increases negligibly.
8 March 2019 in IEEE Access