In recent years, several pioneering works were dedicated to imaging systems based on simple diffractive structures like Fresnel lenses or phase zone plates. Such systems are much lighter and cheaper than classical refractive optical systems. However, the quality of images obtained by diffractive optics suffers from stronger distortions of various types. In this paper, we show that a combination of the high-precision lens design with post-capture computational reconstruction allows one to attain a much higher image quality. The proposed reconstruction procedure uses a sequence of color correction, deconvolution, and a feedforward deep learning neural network. An improvement both in lens manufacturing and in image processing may contribute to the emergence of ultra-lightweight imaging systems varying from cameras for nano- and picosatellites to surveillance systems.
2 August 2018 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
In this paper, we describe our advances in manufacturing a 256-layer 7-μm thick harmonic lens with 150 and 300 mm focal distances combined with color correction, deconvolution, and a feedforwarding deep learning neural network capable of producing images approaching photographic visual quality. While reconstruction of images taken with diffractive optics was presented in previous works, this paper is the first to use deep neural networks during the restoration step. The level of imaging quality we achieved with our imaging system can facilitate the emergence of ultralightweight remote sensing cameras for nano- and pico-satellites, and for aerial remote sensing systems onboard small UAVs and solar-powered airplanes.
Launched in March 2021, the 3U CubeSat nanosatellite was the first ever to use an ultra-lightweight harmonic diffractive lens for Earth remote sensing. We describe the CubeSat platform we used; our 10 mm diameter and 70 mm focal length lens synthesis, design, and manufacturing; a custom 3D-printed camera housing built from a zero-thermal-expansion metal alloy; and the on-Earth image post-processing with a convolutional neural network resulting in images comparable in quality to classical refractive optics used for remote sensing before.
In this paper, we present a hybrid refractive-diffractive lens that, when paired with a deep neural network-based image reconstruction, produces high-quality, real-world images with minimal artifacts, reaching a PSNR of 28 dB on the test set. Our diffractive element compensates for the off-axis aberrations of a single refractive element and has reduced chromatic aberrations across the visible light spectrum. We also describe our training set augmentation and novel quality criteria called “false edge level” (FEL), which validates that the neural network produces visually appealing images without artifacts under a wide range of ISO and exposure settings. Our quality criteria (FEL) enabled us to include real scene images without a corresponding ground truth in the training process.
This paper presents findings from a spaceborne Earth observation experiment utilizing a novel, ultra-compact hyperspectral imaging camera aboard a 3U CubeSat. Leveraging the Offner optical scheme, the camera’s hyperspectrometer captures hyperspectral images of terrestrial regions with a 200 m spatial resolution and 12 nanometer spectral resolution across a 400 to 1000 nanometer wavelength range, covering 150 channels in the visible and near-infrared spectrums. The hyperspectrometer is specifically designed for deployment on a 3U CubeSat nanosatellite platform, featuring a robust all-metal cylindrical body of the hyperspectrometer, and a coaxial arrangement of the optical elements ensures optimal compactness and vibration stability. The performance of the imaging hyperspectrometer was rigorously evaluated through numerical simulations prior to construction. Analysis of hyperspectral data acquired over a year-long orbital operation demonstrates the 3U CubeSat’s ability to produce various vegetation indices, including the normalized difference vegetation index (NDVI). A comparative study with the European Space Agency’s Sentinel-2 L2A data shows a strong agreement at critical points, confirming the 3U CubeSat’s suitability for hyperspectral imaging in the visible and near-infrared spectrums. Notably, the ISOI 3U CubeSat can generate unique index images beyond the reach of Sentinel-2 L2A, underscoring its potential for advancing remote sensing applications.
A hyperspectrometer based on the Offner scheme was investigated. Spectral characteristics were studied and calibrated using a standard spectrometer. As a result of estimating the deviations of the spectra of the imaging hyperspectrometer and the reference spectrometer, calibration coefficients were obtained. The reflectance spectra of beets, onions and potatoes under natural solar illumination were experimentally obtained. Based on the analysis of hyperspectral imaging data, an analysis of the distribution of vegetative indices and, in particular, moisture content, was carried out. Analysis of histograms of moisture content index distribution was carried out.