Regular inspection of transmission lines is an essential work, which has been implemented by either labor intensive or very expensive approaches. 3D reconstruction could be an alternative solution to satisfy the need for accurate and low cost inspection. This paper exploits the use of an unmanned aerial vehicle (UAV) for outdoor data acquisition and conducts accuracy assessment tests to explore potential usage for offsite inspection of transmission lines. Firstly, an oblique photogrammetric system, integrating with a cheap double-camera imaging system, an onboard dual-frequency GNSS (Global Navigation Satellite System) receiver and a ground master GNSS station in fixed position, is designed to acquire images with ground resolutions better than 3 cm. Secondly, an image orientation method, considering oblique imaging geometry of the dual-camera system, is applied to detect enough tie-points to construct stable image connection in both along-track and across-track directions. To achieve the best geo-referencing accuracy and evaluate model measurement precision, signalized ground control points (GCPs) and model key points have been surveyed. Finally, accuracy assessment tests, including absolute orientation precision and relative model precision, have been conducted with different GCP configurations. Experiments show that images captured by the designed photogrammetric system contain enough information of power pylons from different viewpoints. Quantitative assessment demonstrates that, with fewer GCPs for image orientation, the absolute and relative accuracies of image orientation and model measurement are better than 0.3 and 0.2 m, respectively. For regular inspection of transmission lines, the proposed solution can to some extent be an alternative method with competitive accuracy, lower operational complexity and considerable gains in economic cost.

3D semantic labeling is a fundamental task in airborne laser scanning (ALS) point clouds processing. The complexity of observed scenes and the irregularity of point distributions make this task quite challenging. Existing methods rely on a large number of features for the LiDAR points and the interaction of neighboring points, but cannot exploit the potential of them. In this paper, a convolutional neural network (CNN) based method that extracts the high-level representation of features is used. A point-based feature image-generation method is proposed that transforms the 3D neighborhood features of a point into a 2D image. First, for each point in the ALS data, the local geometric features, global geometric features and full-waveform features of its neighboring points within a window are extracted and transformed into an image. Then, the feature images are treated as the input of a CNN model for a 3D semantic labeling task. Finally, to allow performance comparisons with existing approaches, we evaluate our framework on the publicly available datasets provided by the International Society for Photogrammetry and Remote Sensing Working Groups II/4 (ISPRS WG II/4) benchmark tests on 3D labeling. The experiment results achieve 82.3% overall accuracy, which is the best among all considered methods.

Object reconstruction from airborne LiDAR data is a hot topic in photogrammetry and remote sensing. Power fundamental infrastructure monitoring plays a vital role in power transmission safety. This paper proposes a heuristic reconstruction method for power pylons widely used in high voltage transmission systems from airborne LiDAR point cloud, which combines both data-driven and model-driven strategies. Structurally, a power pylon can be decomposed into two parts: the pylon body and head. The reconstruction procedure assembles two parts sequentially: firstly, the pylon body is reconstructed by a data-driven strategy, where a RANSAC-based algorithm is adopted to fit four principal legs; secondly, a model-driven strategy is used to reconstruct the pylon head with the aid of a predefined 3D head model library, where the pylon head’s type is recognized by a shape context algorithm, and their parameters are estimated by a Metropolis–Hastings sampler coupled with a Simulated annealing algorithm. The proposed method has two advantages: (1) optimal strategies are adopted to reconstruct different pylon parts, which are robust to noise and partially missing data; and (2) both the number of parameters and their search space are greatly reduced when estimating the head model’s parameters, as the body reconstruction results information about the original point cloud, and relationships between parameters are used in the pylon head reconstruction process. Experimental results show that the proposed method can efficiently reconstruct power pylons, and the average residual between the reconstructed models and the raw data was smaller than 0.3 m.

Outlier removal is a crucial step in local feature-based unmanned aerial vehicle (UAV) image matching. Inspired by our previous work, this paper proposes a method for reliable and efficient outlier removal in UAV image matching. The inputs of the method are only two images without any other auxiliary data. The core idea is to design local geometric constraints within the neighboring structure via the Delaunay triangulation and use a two-stage method for outlier removal and match refinement. In the filter stage, initial matches are first organized as the Delaunay triangulation (DT) and its corresponding graph, and their dissimilarity scores are computed from the affine-invariant spatial angular order (SAO), which is used to achieve hierarchical outlier removal. In addition, by using the triangle constraint between the refined Delaunay triangulation and its corresponding graph, missed inliers are resumed from match expansion. In the verification stage, retained matches are refined using the RANSAC-based global geometric constraint. Therefore, the two-stage algorithm is termed DTSAO-RANSAC. Finally, using four datasets, DTSAO-RANSAC is comprehensively analyzed and compared with other methods in feature matching and image orientation tests. The experimental results demonstrate that compared with the LO-RANSAC algorithm, DTSAO-RANSAC can achieve efficient outlier removal with speedup ratios ranging from 4 to 16 and, it can provide reliable matching results for image orientation of UAV datasets.

Camera self-calibration determines the precision and robustness of AT (aerial triangulation) for UAV (unmanned aerial vehicle) images. The UAV images collected from long transmission line corridors are critical configurations, which may lead to the “bowl effect” with camera self-calibration. To solve such problems, traditional methods rely on more than three GCPs (ground control points), while this study designs a new self-calibration method with only one GCP. First, existing camera distortion models are grouped into two categories, i.e., physical and mathematical models, and their mathematical formulas are exploited in detail. Second, within an incremental SfM (Structure from Motion) framework, a camera self-calibration method is designed, which combines the strategies for initializing camera distortion parameters and fusing high-precision GNSS (Global Navigation Satellite System) observations. The former is achieved by using an iterative optimization algorithm that progressively optimizes camera parameters; the latter is implemented through inequality constrained BA (bundle adjustment). Finally, by using four UAV datasets collected from two sites with two data acquisition modes, the proposed algorithm is comprehensively analyzed and verified, and the experimental results demonstrate that the proposed method can dramatically alleviate the “bowl effect” of self-calibration for weakly structured long corridor UAV images, and the horizontal and vertical accuracy can reach 0.04 m and 0.05 m, respectively, when using one GCP. In addition, compared with open-source and commercial software, the proposed method achieves competitive or better performance.

Pylons play an important role in the safe operation of power transmission grids. Directly reconstructing pylons from UAV images is still a great challenge due to problems of weak texture, hollow-carved structure, and self-occlusion. This paper presents an automatic model-driven method for pylon reconstruction from oblique UAV images. The pylons are reconstructed with the aid of the 3D parametric model library, which is represented by connected key points based on symmetry and coplanarity. First, an efficient pylon detection method is applied to detect the pylons in the proposed region, which are obtained by clustering the line segment intersection points. Second, the pylon model library is designed to assist in pylon reconstruction. In the predefined pylon model library, a pylon is divided into two parts: pylon body and pylon head. Before pylon reconstruction, the pylon type is identified by the inner distance shape context (IDSC) algorithm, which matches the shape contours of pylon extracted from UAV images and the projected pylon model. With the a priori shape and coplanar constraint, the line segments on pylon body are matched and the pylon body is modeled by fitting four principle legs and four side planes. Then a Markov Chain Monte Carlo (MCMC) sampler is used to estimate the parameters of the pylon head by computing the maximum probability between the projected model and the extracted line segments in images. Experimental results on several UAV image datasets show that the proposed method is a feasible way of automatically reconstructing the pylon.