9 October 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
This paper addresses the problem of lossy image compression, a fundamental problem in image processing and information theory that is involved in many real-world applications. We start by reviewing the framework of variational autoencoders (VAEs), a powerful class of generative probabilistic models that has a deep connection to lossy compression. Based on VAEs, we develop a new scheme for lossy image compression, which we name quantization-aware ResNet VAE (QARV). Our method incorporates a hierarchical VAE architecture integrated with test-time quantization and quantization-aware training, without which efficient entropy coding would not be possible. In addition, we design the neural network architecture of QARV specifically for fast decoding and propose an adaptive normalization operation for variable-rate compression. Extensive experiments are conducted, and results show that QARV achieves variable-rate compression, high-speed decoding, and better rate-distortion performance than existing baseline methods.
14 August 2024 in Computers and Electronics in Agriculture
21 January 2026 in IEEE Transactions on Circuits and Systems for Video Technology
Hierarchical Variational Autoencoder (HVAE)-based Learned Image Compression (LIC) has shown great promise, but its performance still lags behind autoregressive models due to three key limitations identified: (1) shared latent mappings that lead to accumulated posterior collapse; (2) reliance on static convolutions, limiting adaptability; and (3) gradient imbalance during variable-rate optimization, causing unbalanced performance across different bit rates. To overcome these challenges, we propose QARV++, an improved HVAE-based LIC method. First, we introduce a disentangled latent mapping mechanism, assigning separate transformations to each latent variable to prevent posterior collapse propagation. Second, we integrate deformable convolutions into the network, introducing the DCNNeXt block, which enables dynamic feature adaptation while maintaining computational efficiency. Third, we reformulate variable-rate optimization to ensure balanced gradient updates across different λ values, stabilizing variable-rate training. Extensive experiments demonstrate that QARV++ achieves superior rate-distortion (R-D) performance among HVAE-based LIC models, exhibiting -12.20% -16.34% -15.23% BD-Rate against VVC Intra mode on the Kodak, Tecnick, and CLIC2020 test datasets, respectively. Our approach also generalizes effectively to existing LICs, delivering substantial improvements.