5 March 2024 in GIScience & Remote Sensing
20 November 2023 in IEEE Transactions on Geoscience and Remote Sensing
Image registration is the most basic preprocessing method used to unify coordinates among multitemporal very-high-resolution (VHR) satellite images, thus allowing the acquisition of reliable data of the Earth’s surface. Although image registration requires multiple matching points (MP), false matching points (FMP) are included because of the similar spectral patterns and noise. However, removing FMPs from VHR satellite image pairs is challenging, especially when the images are directly affected by complex factors, such as shadow, relief displacement, and terrain shielding. Therefore, we propose a false matching point removal network (FMPR-net) based on deep learning to eliminate effectively the FMPs to improve registration accuracy. The training dataset is produced by a semi-automatic method. It involves the generation of image patch pairs based on a matching process of scale-invariant feature transform and the assignment of labels referring to the characteristics of true matching points (TMP) and FMPs. The FMPR-net is designed in a Siamese format consisting of two matching point deep feature extractors (MDFE). The architecture of the MDFE consists of one main network and three branch networks to achieve robust extraction of meaningful deep features describing the characteristics of MPs. The FMPR-net removes the FMPs using a true matching probability calculated based on the similarity between deep features. Experiments conducted on four pairs of VHR satellite images have demonstrated that the FMPR-net can effectively remove the FMPs. Consequently, accurate VHR satellite image registration is possible by reducing uncertainty caused by the FMPs.
3 August 2023 in Remote Sensing Letters