Fourier-based image correlation is a powerful area-based image registration technique, which involves aligning images based on a translation model or similarity model by means of the image information and operation in the frequency domain. In recent years, Fourier-based image correlation has made significant progress and attracted extensive research interest in a variety of applications, especially in the field of photogrammetry and remote sensing, leading to the development of a number of subpixel methods that have improved the accuracy and robustness. However, to date, a detailed review of the literature related to Fourier-based image correlation is still lacking. In this review, we aim at providing a comprehensive overview of the fundamentals, developments, and applications of image registration with Fourier-based image correlation methods. Specifically, this review introduces the principal laws underlying these methods, presents a survey of the existing subpixel methods calculated both in the spatial domain and in the frequency domain, summarizes the major applications from three aspects, and discusses the challenges and possible directions of future research. This review is expected to be beneficial for researchers working in the relevant fields to obtain an insight into the current state of the art, to develop new variants, to explore potential applications, and to suggest promising future trends of image registration with Fourier-based image correlation.

This paper presents a practical framework for the integration of unmanned aerial vehicle (UAV) based photogrammetry and terrestrial laser scanning (TLS) with application to open-pit mine areas, which includes UAV image and TLS point cloud acquisition, image and cloud point processing and integration, object-oriented classification and three-dimensional (3D) mapping and monitoring of open-pit mine areas. The proposed framework was tested in three open-pit mine areas in southwestern China. (1) With respect to extracting the conjugate points of the stereo pair of UAV images and those points between TLS point clouds and UAV images, some feature points were first extracted by the scale-invariant feature transform (SIFT) operator and the outliers were identified and therefore eliminated by the RANdom SAmple Consensus (RANSAC) approach; (2) With respect to improving the accuracy of geo-positioning based on UAV imagery, the ground control points (GCPs) surveyed from global positioning systems (GPS) and the feature points extracted from TLS were integrated in the bundle adjustment, and three scenarios were designed and compared; (3) With respect to monitoring and mapping the mine areas for land reclamation, an object-based image analysis approach was used for the classification of the accuracy improved UAV ortho-image. The experimental results show that by introduction of TLS derived point clouds as GCPs, the accuracy of geo-positioning based on UAV imagery can be improved. At the same time, the accuracy of geo-positioning based on GCPs form the TLS derived point clouds is close to that based on GCPs from the GPS survey. The results also show that the TLS derived point clouds can be used as GCPs in areas such as in mountainous or high-risk environments where it is difficult to conduct a GPS survey. The proposed framework achieved a decimeter-level accuracy for the generated digital surface model (DSM) and digital orthophoto map (DOM), and an overall accuracy of 90.67% for classification of the land covers in the open-pit mine.

Water bodies are a fundamental element of urban ecosystems, and water mapping is critical for urban and landscape planning and management. Remote sensing has increasingly been used for water mapping in rural areas; however, when applied to urban areas, this spatially- explicit approach is a challenging task due to the fact that the water bodies are often of a small size and spectral confusion is common between water and the complex features in the urban environment. Water indexes are the most common method of water extraction at the pixel level. More recently, spectral mixture analysis (SMA) has been widely employed in analyzing the urban environment at the subpixel level. The objective of this study is to develop an automatic subpixel water mapping method (ASWM) which can achieve a high accuracy in urban areas. Specifically, we first apply a water index for the automatic extraction of mixed land-water pixels, and the pure water pixels that are generated in this process are exported as the final result. Secondly, the SMA technique is applied to the mixed land-water pixels for water abundance estimation. As for obtaining the most representative endmembers, we propose an adaptive iterative endmember selection method based on the spatial similarity of adjacent ground surfaces. One classical water index method (the modified normalized difference water index (MNDWI)), a pixel-level target detection method (constrained energy minimization (CEM)), and two widely used SMA methods (fully constrained least squares (FCLS) and multiple endmember spectral mixture analysis (MESMA)) were chosen for the water mapping comparison in the experiments. The results indicate that the proposed ASWM was able to detect water pixels more efficiency than other unsupervised water extraction methods, and the water fractions estimated by the proposed ASWM method correspond closely to the reference fractions with the slopes of 0.97, 1.02, 1.04, and 0.98 and the R-squared values of 0.9454, 0.9486, 0.9665, and 0.9607 in regression analysis corresponding to different test regions. In the quantitative accuracy assessment, the ASWM method shows the best performance in water mapping with the mean kappa coefficient of 0.862, mean producer’s accuracy of 82.8%, and mean user’s accuracy of 91.8% for test regions.

The successful launch of the Landsat 8 satellite continues the Earth observation of the Landsat series, which has been taking place for nearly 40 years. With the increase in the band number and the improved spectral range compared with the previous Landsat imagery, it will be possible to expand the application of the new Landsat 8 imagery. The purpose of this study is to explore water extraction based on the new Landsat 8 Operational Land Imager (OLI) imagery. According to the specific inland water conditions (clear water, turbid water, and eutrophic water), a number of highly adaptable water indices are assessed for water extraction using Landsat OLI imagery. The results show that clear water is the easiest to extract among the different types of waterbodies, with the highest average accuracy of 97%. The highest-accuracy methods are the automated water extraction index for shadow pixels (AWEI_sh), the normalized difference water index using bands 4 and 7 (NDWI₄₇), and the normalized difference water index using bands 3 and 7 (NDWI₃₇), with accuracies of 98.55%, 95.50%, and 96.61%, corresponding to clear water, turbid water, and eutrophic water, respectively. Through the analysis of the different methods for optimal band selection, the seventh band OLI7 (shortwave infrared 2, SWIR-2) of Landsat OLI shows the best performance in water identification. When applying the water indices to water extraction, Otsu’s algorithm has been used to automatically select the water threshold. Using extensive experiments with Otsu’s algorithm and a manual method, it was found that Otsu’s algorithm can replace manual selection and has the ability to select an accurate threshold for water extraction.

During the Orbital B Phase mission of the Origins, Spectral Interpretation, Resource Identification, and Security-Regolith Explorer (OSIRIS-REx), the OSIRIS-REx’s Laser Altimeter (OLA) instrument scanned asteroid Bennu and obtained hundreds of point cloud frames, making a meticulous 3D surface modeling of Bennu realizable. However, these acquired point clouds suffer from problems like inaccurate pose information, low overlap ratios, uneven densities, and outliers. To create a precise 3D shape model via topographical mapping using OLA data, we present an optimized connection graph guided global bundle block adjustment method with variable weights capable of constructing a complete 3D model of the asteroid via a straightforward global adjustment of offsets. Specifically, by using an improved Fast Double-channel Aggregated Feature Transform, 3D keypoint extraction and their correspondences can be determined with a sub-pixel level of matching accuracy. Then, a graph of the shortest path algorithm is constructed to establish the optimized connections of all the OLA point clouds. Afterward, the global bundle block adjustment method with variable weights is introduced to minimize the keypoint matches simultaneously, reducing the offsets between the overlapping point clouds. Finally, the shape model of asteroid Bennu was constructed using the finely adjusted point clouds, with RMSE as small as 0.0743 m compared with the reference shape model, reaching approximately the limit of the instrument range errors (i.e., 3 cm ) of observation data. Results of the case study on asteroid Bennu demonstrated that the proposed method could improve the accuracy of point cloud registration and meet the application requirements.

Attitude jitter is a common phenomenon in the application of high resolution satellites, which may result in large errors of geo-positioning and mapping accuracy. Therefore, it is critical to detect and compensate attitude jitter to explore the full geometric potential of high resolution satellites. In this paper, a framework of jitter detection and compensation for high resolution satellites is proposed and some preliminary investigation is performed. Three methods for jitter detection are presented as follows. (1) The first one is based on multispectral images using parallax between two different bands in the image; (2) The second is based on stereo images using rational polynomial coefficients (RPCs); (3) The third is based on panchromatic images employing orthorectification processing. Based on the calculated parallax maps, the frequency and amplitude of the detected jitter are obtained. Subsequently, two approaches for jitter compensation are conducted. (1) The first one is to conduct the compensation on image, which uses the derived parallax observations for resampling; (2) The second is to conduct the compensation on attitude data, which treats the influence of jitter on attitude as correction of charge-coupled device (CCD) viewing angles. Experiments with images from several satellites, such as ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiaometer), LRO (Lunar Reconnaissance Orbiter) and ZY-3 (ZiYuan-3) demonstrate the promising performance and feasibility of the proposed framework.