Cross-view image matching has attracted extensive attention due to its huge potential applications, such as localization and navigation. Unmanned aerial vehicle (UAV) technology has been developed rapidly in recent years, and people have more opportunities to obtain and use UAV-view images than ever before. However, the algorithms of cross-view image matching between the UAV view (oblique view) and the satellite view (vertical view) are still in their beginning stage, and the matching accuracy is expected to be further improved when applied in real situations. Within this context, in this study, we proposed a cross-view matching method based on location classification (hereinafter referred to LCM), in which the similarity between UAV and satellite views is considered, and we implemented the method with the newest UAV-based geo-localization dataset (University-1652). LCM is able to solve the imbalance of the input sample number between the satellite images and the UAV images. In the training stage, LCM can simplify the retrieval problem into a classification problem and consider the influence of the feature vector size on the matching accuracy. Compared with one study, LCM shows higher accuracies, and Recall@K (K ∈ {1, 5, 10}) and the average precision (AP) were improved by 5–10%. The expansion of satellite-view images and multiple queries proposed by the LCM are capable of improving the matching accuracy during the experiment. In addition, the influences of different feature sizes on the LCM’s accuracy are determined, and we found that 512 is the optimal feature size. Finally, the LCM model trained based on synthetic UAV-view images was evaluated in real-world situations, and the evaluation result shows that it still has satisfactory matching accuracy. The LCM can realize the bidirectional matching between the UAV-view image and the satellite-view image and can contribute to two applications: (i) UAV-view image localization (i.e., predicting the geographic location of UAV-view images based on satellite-view images with geo-tags) and (ii) UAV navigation (i.e., driving the UAV to the region of interest in the satellite-view image based on the flight record).
Reliable near-real-time precipitation estimation is crucial for scientific research and resistance to natural disasters such as floods. Compared with ground-based precipitation measurements, satellite-based precipitation measurements have great advantages, but precipitation estimation based on satellite is still a challenging issue. In this paper, we propose a deep learning model named Attention-Unet for precipitation estimation. The model utilizes the high temporal, spatial and spectral resolution data of the FY4A satellite to improve the accuracy of precipitation estimation. To evaluate the effectiveness of the proposed model, we compare it with operational near-real-time satellite-based precipitation products and deep learning models which proved to be effective in precipitation estimation. We use classification metrics such as Probability of detection (POD), False Alarm Ratio (FAR), Critical success index (CSI), and regression metrics including Root Mean Square Error (RMSE) and Pearson correlation coefficient (CC) to evaluate the performance of precipitation identification and precipitation amounts estimation, respectively. Furthermore, we select an extreme precipitation event to validate the generalization ability of our proposed model. Statistics and visualizations of the experimental results show the proposed model has better performance than operational precipitation products and baseline deep learning models in both precipitation identification and precipitation amounts estimation. Therefore, the proposed model has the potential to serve as a more accurate and reliable satellite-based precipitation estimation product. This study suggests that applying an appropriate deep learning algorithm may provide an opportunity to improve the quality of satellite-based precipitation products.
16 August 2023 in Science of The Total Environment
Efficient night-time vessel detection is of significant importance for maritime traffic management, fishery activity monitoring, and environmental protection. With the advancement in object-detection approaches, the method of night-time vessel detection has gradually shifted from traditional threshold segmentation to deep learning that balances efficiency and accuracy. However, the restricted spatial resolution of night-time light (NTL) remote sensing data (e.g., VIIRS/DNB images) results in fewer discernible features and insufficient training performance when detecting vessels that are considered small targets. To address this, we establish an Enhanced Dense Nested-Attention Network (DNA-net) to improve the detection of small vessel targets under low-light conditions. This approach effectively integrates the original VIIRS/DNB, spike median index (SMI), and spike height index (SHI) images to maintain deep-level features and enhance feature extraction. On this basis, we performed vessel detection based on the Enhanced DNA-net using VIIRS/DNB images of the Japan Sea, the South China Sea, and the Java Sea. It is noteworthy that the VIIRS Boat Detection (VBD) observations and the Automatic Identification System (AIS) data were cross-matched as the actual status of the vessels (VBD-AIS). The results show that the proposed Enhanced DNA-net achieves significant improvements in the evaluation metrics (e.g., IOU, Pd, Fa, and MPD) compared to the original DNA-net, achieving performance of 87.81%, 96.72%, 5.42%, and 0.36 Wpx, respectively. Meanwhile, we validated the detection performance of Enhanced DNA-net and strong VBD detection against VBD-AIS, showing that the Enhanced DNA-net achieves 1% better accuracy than strong VBD detection.
20 March 2024 in IEEE Transactions on Geoscience and Remote Sensing
Sea surface temperature (SST) is an important parameter for assessing sea-atmosphere energy interaction and understanding climate change. One of the primary approaches for obtaining global-scale SST is retrieving from satellite thermal infrared remote sensing data. However, it is challenging to accurately retrieve large-scale SST due to the complexity of retrieving the key intermediate parameter, i.e., sea surface emissivity (SSE), using the standard theoretical model. In this study, we proposed a simplified SSE estimation model based on the satellite view zenith angle (VZA) and wind speed and compared it with three commonly used SSE estimation models. Then, the retrieved SSTs based on those SSEs were validated against in-situ SSTs. Results show that the SSE from the proposed estimation model shows the highest consistency and the lowest biases with the theoretical values compared to the other three estimation models, especially in large VZAs. In-situ observation-based SST validation results show that the SST retrieved using the proposed SSE estimation model also achieves the highest accuracy compared to the other three SSTs, with a mean bias error of 0.08 K, and a root-mean-square error of 0.30 K, which is close to the official SST products. In conclusion, the proposed SSE estimation model shows good performance both in SSE estimating and SST retrieving. Furthermore, the proposed model has the potential to estimate SSE on large scales that can serve as a reference for obtaining SST from other similar sensors to promote the development of marine remote sensing.
Aerosol Optical Depth (AOD) is a crucial physical parameter used to measure the radiative and scattering properties of the atmosphere. Obtaining full-coverage AOD measurements is essential for a thorough understanding of its impact on climate and air quality. However, satellite-based AOD products can be affected by abnormal weather conditions and high reflectance surfaces, leading to gaps in spatial coverage. To address this issue, we propose a satellite-based AOD filling method based on hourly level-3 Himawari-8 AOD products. In this study, the optimal model with a mean bias error (MBE) less than 0.01 and a root-mean-square error (RMSE) less than 0.1 in most land cover types was selected to generate the full-coverage AOD. The generated full-coverage AOD was validated against in situ measurements from the AERONET sites and compared with the performance of Himawari-8 AOD and MERRA-2 AOD over the AERONET sites. The validation results indicate that the accuracy of full-coverage AOD is comparable to that of the Advanced Himawari Imager (AHI) AOD, and for other land cover types (excluding barren land), the accuracy of full-coverage AOD is superior to that of MERRA-2 AOD. To investigate the practical application of full-coverage AOD, we utilized it as an input parameter to perform radiative transfer simulations in northwestern and southern China. The validation results showed that the simulated at-sensor radiance based on full-coverage AOD was in good agreement with the at-sensor radiance observations from MODIS. These results indicate that complete and accurate measurements of AOD have considerable potential for application in the simulation of at-sensor radiance and other related topics.