A coupled deep learning approach for coded aperture design and single-pixel measurements classification is proposed. A whole neural network is trained to simultaneously optimize the binary sensing matrix of a single-pixel camera (SPC) and the parameters of a classification network, considering the constraints imposed by the compressive architecture. Then, new single-pixel measurements can be acquired and classified with the learned parameters. This method avoids the reconstruction process while maintaining classification reliability. In particular, two network architectures were proposed, one learns re-projected measurements to the image size, and the other extracts small features directly from the compressive measurements. They were simulated using two image data sets and a test-bed implementation. The first network beats in around 10% the accuracy reached by the state-of-the-art methods. A 2x increase in computing time is achieved with the second proposed net.
Coded aperture compressive spectral imagers (CSI) sense a three-dimensional data cube by using two-dimensional projections of the coded and spectrally dispersed input image. Recently, it has been shown that by combining spectral images acquired from a CSI sensor and a complementary sensor leads to substantial improvement in the quality of the fused image. To maximally exploit the benefits of the complementary information, the spatial structure of the coded apertures must be optimized inasmuch as these structures determine the sensing matrix properties and, accordingly, the quality of the reconstructed images. This paper proposes a method to use side information from a red-green-blue sensor to design the coded aperture patterns of a CSI imager, such that more detailed spatial images and wavelength profiles can be reconstructed. The side information is used as the input of an edge detection algorithm to approximate a version of the edges of the spectral images. The coded apertures are designed to follow the spatial structure determined by the estimated spectral edges, such that the high frequencies are promoted, leading to more detailed reconstructed spectral images. Simulations and experimental results indicate that when compared with random coded aperture structures, the designed coded apertures based on side information obtain up to 3 dB improvement in the quality of the reconstructed images.
Compressive spectral imaging (CSI) systems sense 3D spatio-spectral data cubes with just a few two-dimensional (2D) projections by using a coded aperture, a dispersive element, and a focal plane array (FPA). The coded apertures in these systems, whose main function is the modulation of the data cube, are often implemented through photomasks attached to piezoelectric devices. A remarkable improvement on this configuration has been recently proposed, the replacement of the block-unblock coded apertures by patterned optical filter arrays, referred to as “colored” coded apertures, which allow spatial and spectral modulation. When using these colored coded apertures, its real implementation in terms of cost and complexity directly depends on the number of filters to be used, as well as the number of shots to be captured. A shifting colored coded aperture optimization featuring these observations is proposed, with the aim to improve the imaging quality reconstruction and to generate an achievable optical implementation with a limited number of filters requiring only one mask to acquire any number of shots. The mathematical model of the computational imaging strategy to overcome the practical limitations of actual CSI systems is presented along with a testbed implementation. Simulations, as well as experimental results, will prove the accuracy and performance of the proposed shifting colored coded aperture design over the current literature designs.
Los levantamientos sísmicos usualmente se ven afectados por obstáculos o restricciones ambientales que impiden el muestreo regular en la adquisición sísmica. Por lo tanto, se han desarrollado diversos métodos para reconstruir estos datos faltantes, incluidos los métodos de aprendizaje profundo, los cuales permiten extraer características de información compleja, con la limitante de bases de datos sísmicos externos. Aunque otros trabajos se han enfocado principalmente en la reconstrucción de trazas, los disparos que no se pueden adquirir impactan directamente el flujo del procesamiento sísmico y representa un reto mayor en la regularización de datos sísmicos. En este trabajo proponemos DIPsgr, un método de reconstrucción de disparos sísmicos que usa solamente las medidas de las adquisiciones sísmicas incompletas para estimar la información faltante usando aprendizaje profundo no supervisado. Los experimentos numéricos con tres bases de datos muestran que DIPsgr recupera el conjunto completo de trazas en cada shot-gather, donde la información y los eventos sísmicos se conservan correctamente. Seismic surveys are often affected by environmental obstacles or restrictions that prevent regular sampling in seismic acquisition. To address missing data, various methods, including deep learning techniques, have been developed to extract features from complex information, albeit with the limitation of requiring external seismic databases. While previous works have primarily focused on trace reconstruction, missing shot-gathers directly impact the seismic processing flow and represent a major challenge in seismic data regularization. In this paper, we propose DIPsgr, a seismic shot-gather reconstruction method that uses only the incomplete seismic acquisition measurements to estimate their missing information employing unsupervised deep learning. Numerical experiments on three databases demonstrate that DIPsgr recovers the complete set of traces in each shot-gather, with preserved information and seismic events.