Coded aperture snapshot spectral imager (CASSI) can recover three-dimensional hyperspectral images (HSIs) from two-dimensional compressive measurements. Recently, deep unfolding approaches were shown impressive reconstruction performance among various algorithms. Existing deep unfolding methods usually employ linear projection methods to guide the iterative learning process. However, the linear projections do not include trainable parameters and ignore the essential characteristics of HSI. This paper proposes a novel learning-based deep estimation-enhancement unfolding (DEEU) framework to improve the HSI reconstruction. The deep estimation-enhancement (DEE) module is used to guide the iterative learning process of the network based on the prior information of the CASSI system, and then exploits the intrinsic features of the reconstructed HSI in both spectral and spatial dimensions. In addition, a multi-prior ensemble learning module is proposed to further improve the reconstruction performance without increasing runtime. As with most of deep unfolding methods, we plug a convolutional neural network as a denoiser in each stage of the DEEU framework, which finally forms the proposed DEEU-Net. Comprehensive experiments on both simulation and real datasets demonstrate that the effectiveness of our DEEU framework, and our DEEU-Net can achieve both high reconstruction quality and speed, outperforming the state-of-the-art methods.
Recently, artificial neural networks (ANNs) have shown impressive performance in the compressive hyperspectral imaging (CHI) reconstruction task, but the high energy consumption limits their deployment on energy-constrained devices. This paper develops a novel spiking neural network (SNN), termed spiking spectral-weighting reconstruction network (SSWR-Net), to significantly improve the energy–efficiency ratio in CHI reconstruction. Firstly, a spiking spectral-weighting convolution block is proposed to adaptively modulate the spiking signals, enabling the SNN to fit continuous spectral correlation curves. Secondly, a residual feature reuse module with more direct connections is designed to achieve efficient and lightweight spatial–spectral feature extraction. Thirdly, customized feature scaling architectures are introduced to resolve the dimensional mismatch issue and enhance information flow. Finally, we propose a novel temporal-wise progressive training method to optimize the multi-timestep SSWR-Net, which can significantly improve both training efficiency and reconstruction quality. Both simulation and real experiments demonstrate the superiority of the proposed method in both CHI reconstruction performance and energy efficiency. Specifically, SSWR-Net outperforms its ANN-based counterpart by 0.87 dB at a 19.74% energy cost.