Insulator detection is an essential task for the safety and reliable operation of intelligent grids. Owing to insulator images including various background interferences, most traditional image-processing methods cannot achieve good performance. Some You Only Look Once (YOLO) networks are employed to meet the requirements of actual applications for insulator detection. To achieve a good trade-off among accuracy, running time, and memory storage, this work proposes the modified YOLO-tiny for insulator (MTI-YOLO) network for insulator detection in complex aerial images. First of all, composite insulator images are collected in common scenes and the “CCIN_detection” (Chinese Composite INsulator) dataset is constructed. Secondly, to improve the detection accuracy of different sizes of insulator, multi-scale feature detection headers, a structure of multi-scale feature fusion, and the spatial pyramid pooling (SPP) model are adopted to the MTI-YOLO network. Finally, the proposed MTI-YOLO network and the compared networks are trained and tested on the “CCIN_detection” dataset. The average precision (AP) of our proposed network is 17% and 9% higher than YOLO-tiny and YOLO-v2. Compared with YOLO-tiny and YOLO-v2, the running time of the proposed network is slightly higher. Furthermore, the memory usage of the proposed network is 25.6% and 38.9% lower than YOLO-v2 and YOLO-v3, respectively. Experimental results and analysis validate that the proposed network achieves good performance in both complex backgrounds and bright illumination conditions.
Insulator faults detection is an important task for high-voltage transmission line inspection. However, current methods often suffer from the lack of accuracy and robustness. Moreover, these methods can only detect one fault in the insulator string, but cannot detect a multi-fault. In this paper, a novel method is proposed for insulator one fault and multi-fault detection in UAV-based aerial images, the backgrounds of which usually contain much complex interference. The shapes of the insulators also vary obviously due to the changes in filming angle and distance. To reduce the impact of complex interference on insulator faults detection, we make full use of the deep neural network to distinguish between insulators and background interference. First of all, plenty of insulator aerial images with manually labelled ground-truth are collected to construct a standard insulator detection dataset ‘InST_detection’. Secondly, a new convolutional network is proposed to obtain accurate insulator string positions in the aerial image. Finally, a novel fault detection method is proposed that can detect both insulator one fault and multi-fault in aerial images. Experimental results on a large number of aerial images show that our proposed method is more effective and efficient than the state-of-the-art insulator fault detection methods.
17 April 2018 in Journal of Intelligent & Robotic Systems
Purpose: This paper aims to propose a robust and efficient method for vanishing point detection in unstructured road scenes. Design/methodology/approach: The proposed method includes two main stages: drivable region estimation and vanishing point detection. In drivable region estimation stage, the road image is segmented into a set of patches; then the drivable region is estimated by the patch-wise manifold ranking. In vanishing point detection stage, the LSD method is used to extract the straight lines; then a series of principles are proposed to remove the noise lines. Finally, the vanishing point is detected by a novel voting strategy. Findings: The proposed method is validated on various unstructured road images collected from the real world. It is more robust and more efficient than the state-of-the-art method and the other three recent methods. Experimental results demonstrate that the detected vanishing point is practical for vision-sensor-based navigation in complex unstructured road scenes. Originality/value: This paper proposes a patch-wise manifold ranking method to estimate the drivable region that contains most of the informative clues for vanishing point detection. Based on the removal of the noise lines through a series of principles, a novel voting strategy is proposed to detect the vanishing point.
With the development of unmanned aerial vehicle (UAV) control technology, one of the recent trends in this research domain is to utilize UAVs to perform non-contact transmission line inspection. The RGB camera mounted on UAVs collects large numbers of images during the transmission line inspection, but most of them contain no critical components of transmission lines. Hence, it is a momentous task to adopt image classification algorithms to distinguish key images from all aerial images. In this work, we propose a novel classification method to remove redundant data and retain informative images. A novel transmission line scene dataset, namely TLS_dataset, is built to evaluate the classification performance of networks. Then, we propose a novel convolutional neural network (CNN), namely TL-Net, to classify transmission line scenes. In comparison to other typical deep learning networks, TL-Nets gain better classification accuracy and less memory consumption. The experimental results show that TL-Net101 gains 99.68% test accuracy on the TLS_dataset.
Obstacles of some trees within the electric power transmission line channel are of great threat to the electricity supply. Nowadays, the tasks of clearing threatening tree branches are still mostly operated by hand and simple tools. In this article, an aerial tree‐pruning robot with a novel structure is designed to improve the pruning operation efficiency and enhance the safety of the staff. However, the long arm of the pruning tool results in much higher rotational inertia of the robot, which brings difficulties for the robot to remain stable. Therefore, a control scheme based on model predictive control is proposed for the aerial tree‐pruning robot and to deal with an uncertain system during the pruning operation period. One of the main contributions is that an ADMM (alternating direction method of multipliers) algorithm that solves the constrained QP (quadratic programming) is adopted to implement the model predictive control on embedded computers with limited computational power. The dynamic model of the pruning robot is firstly presented. Then, the control scheme of MPC for the pruning robot is presented. Moreover, the QP problem of robot control is addressed with ADMM. Finally, simulation experiments of attitude tracking as well as the antidisturbances capability verification have been conducted. Results for the system of aerial tree‐pruning robot are given to demonstrate the effectiveness of the developed attitude tracking control scheme using ADMM‐based MPC.