3 September 2015 in Journal of the Optical Society of America A
Traditional spectral imaging approaches require sensing all the voxels of a scene. Colored mosaic FPA detector-based architectures can acquire sets of the scene’s spectral components, but the number of spectral planes depends directly on the number of available filters used on the FPA, which leads to reduced spatiospectral resolutions. Instead of sensing all the voxels of the scene, compressive spectral imaging (CSI) captures coded and dispersed projections of the spatiospectral source. This approach mitigates the resolution issues by exploiting optical phenomena in lenses and other elements, which, in turn, compromise the portability of the devices. This paper presents a compact snapshot colored compressive spectral imager (SCCSI) that exploits the benefits of the colored mosaic FPA detectors and the compression capabilities of CSI sensing techniques. The proposed optical architecture has no moving parts and can capture the spatiospectral information of a scene in a single snapshot by using a dispersive element and a color-patterned detector. The optical and the mathematical models of SCCSI are presented along with a testbed implementation of the system. Simulations and real experiments show the accuracy of SCCSI and compare the reconstructions with those of similar CSI optical architectures, such as the CASSI and SSCSI systems, resulting in improvements of up to 6 dB and 1 dB of PSNR, respectively.
9 November 2016 in Journal of the Optical Society of America A
Multi-shot coded aperture snapshot spectral imaging (CASSI) systems capture the spectral information of a scene using a small set of coded focal plane array (FPA) compressive measurements. Compressed sensing (CS) reconstruction algorithms are then used to reconstruct the underlying spectral 3D data cube from an underdetermined system of linear equations. Multiple snapshots result in a less ill-posed inverse problem and improved reconstructions. The only varying components in CASSI are the coded apertures, whose structure is crucial inasmuch as they determine the minimum number of FPA measurements needed for correct image reconstruction and the corresponding attainable quality. Traditionally, the spatial structures of the coded aperture entries are selected at random, leading to suboptimal reconstruction solutions. This work presents an optimal structure design of a set of coded apertures by optimizing the concentration of measure of the multi-shot CASSI sensing matrix and its incoherence with respect to the sparse representation basis. First, the CASSI matrix system representation in terms of the ensemble of random projections is established. Then, the restricted isometry property (RIP) of the CASSI projections is determined as a function of the coded aperture entries. The optimal coded aperture structures are designed under the criterion of satisfying the RIP with high probability, coined spatiotemporal blue noise (BN) coded apertures. Furthermore, an algorithm that implements the BN ensembles is presented. Extensive simulations and a testbed implementation are developed to illustrate the improvements of the BN coded apertures over the traditionally used coded aperture structures, in terms of spectral image reconstruction PSNR and SSIM.
20 March 2013 in Applied Optics
The coded aperture snapshot spectral imager (CASSI) senses the spatial and spectral information of a scene using a set of random projections of the scene onto focal plane array measurements. The reconstruction of the underlying three-dimensional (3D) scene is then obtained by norm-based inverse optimization algorithms such as the gradient projections for sparse reconstruction (GPSR). The computational complexity of the inverse problem in this case grows with order per iteration, where and are the spatial and spectral dimensions of the scene, respectively. In some applications the computational complexity becomes overwhelming since reconstructions can take up to several hours in desktop architectures. This paper presents a mathematical model for lapped block reconstructions in CASSI with complexity per GPSR iteration where is the block size. The approach takes advantage of the structure of the sensing matrix thus allowing the independent recovery of smaller overlapping blocks spanning the measurement set. The reconstructed 3D lapped parallelepipeds are then merged to reduce the block-artifacts in the reconstructed scenes. The full data cube is reconstructed with complexity , per iteration, where . Simulations show the benefits of the new model as data cube reconstruction can be accelerated by an order of magnitude. Furthermore, the lapped block reconstructions lead to comparable or higher image reconstruction quality.
20 March 2019 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
21 December 2016 in Optical Engineering
The snapshot colored compressive spectral imager (SCCSI) is a recent compressive spectral imaging (CSI) architecture that senses the spatial and spectral information of a scene in a single snapshot by means of a colored mosaic FPA detector and a dispersive element. Commonly, CSI architectures allow multiple snapshot acquisition, yielding improved reconstructions of spatially detailed and spectrally rich scenes. Each snapshot is captured employing a different coding pattern. In principle, SCCSI does not admit multiple snapshots since the pixelated tiling of optical filters is directly attached to the detector. This paper extends the concept of SCCSI to a system admitting multiple snapshot acquisition by rotating the dispersive element, so the dispersed spatio-spectral source is coded and integrated at different detector pixels in each rotation. Thus, a different set of coded projections is captured using the same optical components of the original architecture. The mathematical model of the multishot SCCSI system is presented along with several simulations. Results show that a gain up to 7 dB of peak signal-to-noise ratio is achieved when four SCCSI snapshots are compared to a single snapshot reconstruction. Furthermore, a gain up to 5 dB is obtained with respect to state-of-the-art architecture, the multishot CASSI.
3 September 2018 in IEEE Transactions on Image Processing
Massive amounts of data in spectral imagery increase acquisition, storing, and processing costs. Compressive spectral imaging (CSI) methods allow the reconstruction of spatial and spectral information from a small set of random projections. The single pixel camera is a low-cost optical architecture, which enables the compressive acquisition of spectral images. Traditional CSI reconstruction methods obtain a sparse approximation of the underlying spatial and spectral information; however, the complexity of these algorithms increases in proportion to the dimensionality of the data. This paper proposes a multi-resolution (MR) CSI reconstruction approach from single-pixel camera measurements that exploits spectral similarities between the pixels to group them in super-pixels, such that the total number of unknowns in the inverse problem is reduced. Specifically, two different types of super-pixels are considered: rectangular and irregular structures. Simulation and experimental results show that the proposed MR scheme improves the reconstruction quality in up to 6 dB of peak signal-to-noise ratio and reconstruction time in up to 90% with respect to the traditional full resolution reconstructions.