At present, with the advance of satellite image processing technology, remote sensing images are becoming more widely used in real scenes. However, due to the limitations of current remote sensing imaging technology and the influence of the external environment, the resolution of remote sensing images often struggles to meet application requirements. In order to obtain high-resolution remote sensing images, image super-resolution methods are gradually being applied to the recovery and reconstruction of remote sensing images. The use of image super-resolution methods can overcome the current limitations of remote sensing image acquisition systems and acquisition environments, solving the problems of poor-quality remote sensing images, blurred regions of interest, and the requirement for high-efficiency image reconstruction, a research topic that is of significant relevance to image processing. In recent years, there has been tremendous progress made in image super-resolution methods, driven by the continuous development of deep learning algorithms. In this paper, we provide a comprehensive overview and analysis of deep-learning-based image super-resolution methods. Specifically, we first introduce the research background and details of image super-resolution techniques. Second, we present some important works on remote sensing image super-resolution, such as training and testing datasets, image quality and model performance evaluation methods, model design principles, related applications, etc. Finally, we point out some existing problems and future directions in the field of remote sensing image super-resolution.

Improper handling of on-ramp merging may cause severe decrease of traffic efficiency and contribute to lower fuel economy, even increasing the collision risk. Cooperative control for connected and automated vehicles (CAVs) has the potential to significantly reduce the negative impact and improve safety and traffic efficiency. Implementation of cooperative on-ramp merging requires the assistance of the vehicle to vehicle (V2V) and vehicle to infrastructure (V2I) communication, wherein the communication delay may cause negative impact on CAV cooperative control. In this paper, scenario of on-ramp merging for CAVs considering the V2I communication delay are studied. Statistical characteristics of the V2I communication delay are explored from both literature and real field test, and a communication delay estimation model based on statistical techniques are proposed. Specifically, we firstly model the CAV on-ramp merging scenario using optimal control in ideal situation. Then, several statistical characteristics of the V2I communication are investigated especially the probability density function of the V2I communication delay in several application scenarios. Further, we proposed a communication delay estimation model and used the modified vehicle state to compute the corresponding control law. Real field test of V2I communication delay indicated that distribution of V2I communication delay could correlate with the application scenario and normal distribution can be generally adopted to approximate the probability density function (PDF) when the number of samples is large enough. Numerical simulation of the CAV on-ramp merging scenario considering the V2I communication delay revealed that dynamic performance of the control process would be deteriorated impacted by the V2I communication delay and it might further impact the final control effect and lead to potential lateral collision in the merging area.

Real-time, precise and low-cost vehicular positioning systems associated with global continuous coordinates are needed for path planning and motion control in autonomous vehicles. However, existing positioning systems do not perform well in urban canyons, tunnels and indoor parking lots. To address this issue, this paper proposes a multi-sensor positioning system that combines a global positioning system (GPS), a camera and in-vehicle sensors assisted by kinematic and dynamic vehicle models. First, the system eliminates image blurring and removes false feature correspondences to ensure the local accuracy and stability of the visual simultaneous localisation and mapping (SLAM) algorithm. Next, the global GPS coordinates are transferred to a local coordinate system that is consistent with the visual SLAM process, and the GPS and visual SLAM tracks are calibrated with the improved weighted iterative closest point and least absolute deviation methods. Finally, an inverse coordinate system conversion is conducted to obtain the position in the global coordinate system. To improve the positioning accuracy, information from the in-vehicle sensors is fused with the interacting multiple-model extended Kalman filter based on kinematic and dynamic vehicle models. The developed algorithm was verified via intensive simulations and evaluated through experiments using KITTI benchmarks (A project of Karlsruhe Institute of Technology and Toyota Technological Institute at Chicago) and data captured using our autonomous vehicle platform. The results show that the proposed positioning system improves the accuracy and reliability of positioning in environments in which the Global Navigation Satellite System is not available. The developed system is suitable for the positioning and navigation of autonomous vehicles.

An accurate fault detection and diagnosis system is of great importance for autonomous vehicles to prevent the potential hazardous situations. In this paper, we propose a fault detection and diagnosis system based on hybrid approaches. First, to detect the state faults of the autonomous vehicle, One-Class Support Vector Machine (SVM) method is adopted to train the boundary curve which separates the safe domain and unsafe domain. Meanwhile, a Kalman filter observer is designed based on the linear kinematic vehicle bicycle model to predict the current position of the vehicle, and after obtaining the residuals between prediction and measurement, Jarque-Bera test is applied to check the normality of the residuals probability distribution to monitor whether the trajectory deviates. Furthermore, we design a fuzzy system to distinguish the types of the detected faults based on a modified neutral network, in which a membership function layer is added after the input layer. With the strong self-learning ability of neutral network, the initial membership function of the fuzzy system is updated through black box test and can indicate the probability of each fault type. Experiments on the real autonomous vehicle platform ‘Xinda’ and performance comparison with other fault detectors validate the effectiveness of these methods and the usability of the fault detection and diagnosis system.