Road extraction from high-resolution remote sensing images (HRSI) is a challenging but hot research topic in the past decades. A large number of methods are invented to deal with this problem. This article provides a comprehensive review of these existing approaches. We classified the methods into heuristic and data-driven. The heuristic methods are the mainstream in the early years, and the data-driven methods based on deep learning have been quickly developed recently. With regard to the heuristic methods, the road feature model is firstly introduced, then, the classic extraction methods are reviewed in two sub-categories: semi-automatic and automatic. The principles, inspirations, advantages and disadvantages of these methods are described. In terms of the data-driven methods, the road extraction methods based on deep neural network, particularly those based on patched convolutional neural network, fully convolutional network and generative adversarial network are reviewed. We perform subjective comparisons between the methods inner each type. Furthermore, the quantity performances achieved on the same dataset are compared between the heuristic and data-driven methods to show the strengthening of the data-driven methods. Finally, the conclusion and prospects are summarized.

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and improves the efficacy of cardiovascular interventions and clinical outcomes. Fully-automated processing and quantitative analysis of multi-modality cardiac images could have a direct impact on clinical research and evidence-based patient management. However, these require overcoming significant challenges including inter-modality misalignment and finding optimal methods to integrate information from different modalities. This paper aims to provide a comprehensive review of multi-modality imaging in cardiology, the computing methods, the validation strategies, the related clinical workflows and future perspectives. For the computing methodologies, we have a favored focus on the three tasks, i.e., registration, fusion and segmentation, which generally involve multi-modality imaging data, either combining information from different modalities or transferring information across modalities. The review highlights that multi-modality cardiac imaging data has the potential of wide applicability in the clinic, such as trans-aortic valve implantation guidance, myocardial viability assessment, and catheter ablation therapy and its patient selection. Nevertheless, many challenges remain unsolved, such as missing modality, modality selection, combination of imaging and non-imaging data, and uniform analysis and representation of different modalities. There is also work to do in defining how the well-developed techniques fit in clinical workflows and how much additional and relevant information they introduce. These problems are likely to continue to be an active field of research and the questions to be answered in the future.

The road center-line extraction is the key step of the road network extraction and modeling. The hand-craft feature engineering in the traditional road extraction methods is unstable which makes the extracted road center-line deviated from the road center in complex cases and even results in overall extracting errors. Recently, the road center-line extraction methods based on semantic segmentation employing deep neural network greatly outperformed the traditional methods. Nevertheless, the pixel-wise labels for training deep learning models are expensive and the post-process of road segmentation is error-prone. Inspired by the work of human pose estimation, we propose DeepWindow, a novel method to automatically extract the road network from remote sensing images. DeepWindow uses a sliding window guided by a CNN-based decision function to track the road network directly from the images without the prior of road segmentation. First of all, we design and train a CNN model to estimate the road center points inside a patch. Then, the road seeds are automatically searched patch by patch employing the CNN model. Finally, starting from seeds, our method firstly estimates the road direction using a Fourier spectrum analysis algorithm and then iteratively tracking the road center-line along the road direction guided by the CNN model. In our method, the CNN model is trained by point annotations, which greatly reduces the training costs comparing to those in semantic model training. Our method achieves comparable performance with the state-of-the-art road extraction methods, extensive experiments indicate that our method is robust to the point deviation.