Fourier-based image correlation is a powerful area-based image registration technique, which involves aligning images based on a translation model or similarity model by means of the image information and operation in the frequency domain. In recent years, Fourier-based image correlation has made significant progress and attracted extensive research interest in a variety of applications, especially in the field of photogrammetry and remote sensing, leading to the development of a number of subpixel methods that have improved the accuracy and robustness. However, to date, a detailed review of the literature related to Fourier-based image correlation is still lacking. In this review, we aim at providing a comprehensive overview of the fundamentals, developments, and applications of image registration with Fourier-based image correlation methods. Specifically, this review introduces the principal laws underlying these methods, presents a survey of the existing subpixel methods calculated both in the spatial domain and in the frequency domain, summarizes the major applications from three aspects, and discusses the challenges and possible directions of future research. This review is expected to be beneficial for researchers working in the relevant fields to obtain an insight into the current state of the art, to develop new variants, to explore potential applications, and to suggest promising future trends of image registration with Fourier-based image correlation.

Cellular automata (CA) models are in growing use for land-use change simulation and future scenario prediction. It is necessary to conduct model assessment that reports the quality of simulation results and how well the models reproduce reliable spatial patterns. Here, we review 347 CA articles published during 1999–2018 identified by a Scholar Google search using ‘cellular automata’, ‘land’ and ‘urban’ as keywords. Our review demonstrates that, during the past two decades, 89% of the publications include model assessment related to dataset, procedure and result using more than ten different methods. Among all methods, cell-by-cell comparison and landscape analysis were most frequently applied in the CA model assessment; specifically, overall accuracy and standard Kappa coefficient respectively rank first and second among all metrics. The end-state assessment is often criticized by modelers because it cannot adequately reflect the modeling ability of CA models. We provide five suggestions to the method selection, aiming to offer a background framework for future method choices as well as urging to focus on the assessment of input data and error propagation, procedure, quantitative and spatial change, and the impact of driving factors.

This paper presents a practical framework for the integration of unmanned aerial vehicle (UAV) based photogrammetry and terrestrial laser scanning (TLS) with application to open-pit mine areas, which includes UAV image and TLS point cloud acquisition, image and cloud point processing and integration, object-oriented classification and three-dimensional (3D) mapping and monitoring of open-pit mine areas. The proposed framework was tested in three open-pit mine areas in southwestern China. (1) With respect to extracting the conjugate points of the stereo pair of UAV images and those points between TLS point clouds and UAV images, some feature points were first extracted by the scale-invariant feature transform (SIFT) operator and the outliers were identified and therefore eliminated by the RANdom SAmple Consensus (RANSAC) approach; (2) With respect to improving the accuracy of geo-positioning based on UAV imagery, the ground control points (GCPs) surveyed from global positioning systems (GPS) and the feature points extracted from TLS were integrated in the bundle adjustment, and three scenarios were designed and compared; (3) With respect to monitoring and mapping the mine areas for land reclamation, an object-based image analysis approach was used for the classification of the accuracy improved UAV ortho-image. The experimental results show that by introduction of TLS derived point clouds as GCPs, the accuracy of geo-positioning based on UAV imagery can be improved. At the same time, the accuracy of geo-positioning based on GCPs form the TLS derived point clouds is close to that based on GCPs from the GPS survey. The results also show that the TLS derived point clouds can be used as GCPs in areas such as in mountainous or high-risk environments where it is difficult to conduct a GPS survey. The proposed framework achieved a decimeter-level accuracy for the generated digital surface model (DSM) and digital orthophoto map (DOM), and an overall accuracy of 90.67% for classification of the land covers in the open-pit mine.

Deep learning detection methods use in ship detection remains a challenge, owing to the small scale of the objects and interference from complex sea surfaces. In addition, existing ship detection methods rarely verify the robustness of their algorithms on multisensor images. Thus, we propose a new improvement on the “you only look once” version 3 (YOLOv3) framework for ship detection in marine surveillance, based on synthetic aperture radar (SAR) and optical imagery. First, improved choices are obtained for the anchor boxes by using linear scaling based on the k-means++ algorithm. This addresses the difficulty in reflecting the advantages of YOLOv3's multiscale detection, as the anchor boxes of a single detection target type between different detection scales have small differences. Second, we add uncertainty estimators for the positioning of the bounding boxes by introducing a Gaussian parameter for ship detection into the YOLOv3 framework. Finally, four anchor boxes are allocated to each detection scale in the Gaussian-YOLO layer instead of three as in the default YOLOv3 settings, as there are wide disparities in an object's size and direction in remote sensing images with different resolutions. Applying the proposed strategy to "YOLOv3-spp” and "YOLOv3-tiny,” the results are enhanced by 2%-3%. Compared with other models, the improved-YOLOv3 has the highest average precision on both the optical (93.56%) and SAR (95.52%) datasets. The improved-YOLOv3 is robust, even in the context of a mixed dataset of SAR and optical images comprising images from different satellites and with different scales.

The semantic labeling of the urban area is an essential but challenging task for a wide variety of applications such as mapping, navigation, and monitoring. The rapid advance in Light Detection and Ranging (LiDAR) systems provides this task with a possible solution using 3D point clouds, which are accessible, affordable, accurate, and applicable. Among all types of platforms, the airborne platform with LiDAR can serve as an efficient and effective tool for large-scale 3D mapping in the urban area. Against this background, a large number of algorithms and methods have been developed to fully explore the potential of 3D point clouds. However, the creation of publicly accessible large-scale annotated datasets, which are critical for assessing the performance of the developed algorithms and methods, is still at an early age. In this work, we present a large-scale aerial LiDAR point cloud dataset acquired in a highly-dense and complex urban area for the evaluation of semantic labeling methods. This dataset covers an urban area with highly-dense buildings of approximately 1 km² and includes more than three million points with five classes of objects labeled. Moreover, experiments are carried out with the results from several baseline methods, demonstrating the feasibility and capability of the dataset serving as a benchmark for assessing semantic labeling methods.