Deep convolutional neural networks (CNNs) have been widely used and achieved state-of-the-art performance in many image or video processing and analysis tasks. In particular, for image super-resolution (SR) processing, previous CNN-based methods have led to significant improvements, when compared with shallow learning-based methods. However, previous CNN-based algorithms with simple direct or skip connections are of poor performance when applied to remote sensing satellite images SR. In this study, a simple but effective CNN framework, namely deep distillation recursive network (DDRN), is presented for video satellite image SR. DDRN includes a group of ultra-dense residual blocks (UDB), a multi-scale purification unit (MSPU), and a reconstruction module. In particular, through the addition of rich interactive links in and between multiple-path units in each UDB, features extracted from multiple parallel convolution layers can be shared effectively. Compared with classical dense-connection-based models, DDRN possesses the following main properties. (1) DDRN contains more linking nodes with the same convolution layers. (2) A distillation and compensation mechanism, which performs feature distillation and compensation in different stages of the network, is also constructed. In particular, the high-frequency components lost during information propagation can be compensated in MSPU. (3) The final SR image can benefit from the feature maps extracted from UDB and the compensated components obtained from MSPU. Experiments on Kaggle Open Source Dataset and Jilin-1 video satellite images illustrate that DDRN outperforms the conventional CNN-based baselines and some state-of-the-art feature extraction approaches.
Because of the limitations of hardware devices, such as the sensors, processing capacity, and high accuracy altitude control equipment, traditional optical remote sensing (RS) imageries capture information regarding the same scene from mostly one single angle or a very small number of angles. Nowadays, with video satellites coming into service, obtaining imageries of the same scene from a more-or-less continuous array of angles has become a reality. In this paper, we analyze the differences between the traditional RS data and continuous multi-angle remote sensing (CMARS) data, and unravel the characteristics of the CMARS data. We study the advantages of using CMARS data for classification and try to capitalize on the complementarity of multi-angle information and, at the same time, to reduce the embedded redundancy. Our arguments are substantiated by real-life experiments on the employment of CMARS data in order to classify urban land covers while using a support vector machine (SVM) classifier. They show the superiority of CMARS data over the traditional data for classification. The overall accuracy may increase up to about 9% with CMARS data. Furthermore, we investigate the advantages and disadvantages of directly using the CMARS data, and how such data can be better utilized through the extraction of key features that characterize the variations of spectral reflectance along the entire angular array. This research lay the foundation for the use of CMARS data in future research and applications.