Severe weather and long-term driving of vehicles lead to various cracks on asphalt pavement. If these cracks cannot be found and repaired in time, it will have a negative impact on the safe driving of vehicles. Traditional artificial detection has some problems, such as low efficiency and missing detection. The detection model based on machine learning needs artificial design of pavement crack characteristics. According to the pavement distress identification manual proposed by the Federal Highway Administration (FHWA), these categories have three different types of cracks, such as fatigue, longitudinal crack, and transverse cracks. In the face of many types of pavement cracks, it is difficult to design a general feature extraction model to extract pavement crack features, which leads to the poor effect of the automatic detection model based on machine learning. Object detection based on the deep learning model has achieved good results in many fields. As a result, those models have become possible for pavement crack detection. This paper discusses the latest YOLOv5 series detection model for pavement crack detection and is to find out an effective training and detection method. Firstly, the 3001 asphalt crack pavement images with the original size of pixels are collected using a digital camera and are randomly divided into three types according to the severity levels of low, medium, and high. Then, for the dataset of crack pavement, YOLOv5 series models are used for training and testing. The experimental results show that the detection accuracy of the YOLOv5l model is the highest, reaching 88.1%, and the detection time of the YOLOv5s model is the shortest, only 11.1 ms for each image.
Insulator faults detection is an important task for high-voltage transmission line inspection. However, current methods often suffer from the lack of accuracy and robustness. Moreover, these methods can only detect one fault in the insulator string, but cannot detect a multi-fault. In this paper, a novel method is proposed for insulator one fault and multi-fault detection in UAV-based aerial images, the backgrounds of which usually contain much complex interference. The shapes of the insulators also vary obviously due to the changes in filming angle and distance. To reduce the impact of complex interference on insulator faults detection, we make full use of the deep neural network to distinguish between insulators and background interference. First of all, plenty of insulator aerial images with manually labelled ground-truth are collected to construct a standard insulator detection dataset ‘InST_detection’. Secondly, a new convolutional network is proposed to obtain accurate insulator string positions in the aerial image. Finally, a novel fault detection method is proposed that can detect both insulator one fault and multi-fault in aerial images. Experimental results on a large number of aerial images show that our proposed method is more effective and efficient than the state-of-the-art insulator fault detection methods.
30 September 2018 in International Journal of Digital Multimedia Broadcasting
The existing object detection algorithm based on the deep convolution neural network needs to carry out multilevel convolution and pooling operations to the entire image in order to extract a deep semantic features of the image. The detection models can get better results for big object. However, those models fail to detect small objects that have low resolution and are greatly influenced by noise because the features after repeated convolution operations of existing models do not fully represent the essential characteristics of the small objects. In this paper, we can achieve good detection accuracy by extracting the features at different convolution levels of the object and using the multiscale features to detect small objects. For our detection model, we extract the features of the image from their third, fourth, and 5th convolutions, respectively, and then these three scales features are concatenated into a one-dimensional vector. The vector is used to classify objects by classifiers and locate position information of objects by regression of bounding box. Through testing, the detection accuracy of our model for small objects is 11% higher than the state-of-the-art models. In addition, we also used the model to detect aircraft in remote sensing images and achieved good results.
Insulator missing fault is a serious accident of high-voltage transmission lines, which can cause abnormal energy supply. Recently, a lot of vision-based methods are proposed for detecting an insulator missing fault in aerial images. However, these methods usually lack efficiency and robustness due to the effect of the complex background interferences in the aerial images. More importantly, most of these methods cannot address the insulator multi-fault detection. This paper proposes an unprecedented cascaded model to detect insulator multi-fault in the aerial images to solve the existing challenges. Firstly, a total of 764 images are adopted to create a novel insulator missing faults dataset ‘IMF-detection’. Secondly, a new network is proposed to locate the insulator string from the complex background. Then, the located region that contains the insulator string is set to be an RoI (region of interest) region. Finally, the YOLO-v3 tiny network is trained and then used to detect the insulator missing faults in the RoI region. Experimental results and analysis validate that the proposed method is more efficient and robust than some previous works. Most importantly, the average running time of the proposed method is about 30ms, which demonstrates that it has the potential to be adopted for the on-line detection of insulator missing faults.
1 February 2018 in EURASIP Journal on Wireless Communications and Networking
New algorithms and architectures for the current industrial wireless sensor networks shall be explored to ensure the efficiency, robustness, and consistence in variable application environments which concern different issues, such as the smart grid, water supply, and gas monitoring. Object detection automatic in remote sensing images has always been a hot topic. Using the conventional deep convolution network based on region proposal for detection, there are many negative samples in the generated region proposal, which will affect the model detection precision and efficiency. Saliency uses the human visual attention mechanism to achieve the bottom-up object detection. Since replacing the selective search with saliency can greatly reduce the number of proposal areas, we will get some region of interests (RoIs) and their position information by using the saliency algorithm based on the background priori for the remote sensing image. And then, the position information is mapped to the feature vector of the whole image obtained by deep convolution neural network. Finally, the each RoI will be classified and fine-tuned bounding box. In this paper, our model is compared with Fast-RCNN that is the current state-of-the-art detection model. The mAP of our model reaches 99%, which is 12.4% higher than that of Fast-RCNN. In addition, we also study the effect of different iterations on model and find the model of 10,000 iterations already has a higher accuracy. Finally, we compare the results of different number of negative samples and find the detection accuracy is highest when the number of negative samples reaches 400.
22 November 2020 in Transactions of the Institute of Measurement and Control
A quadrotor with tiltable rotors is a kind of omnidirectional multirotor aerial vehicle (MAV) that has demonstrated advantages of decoupling control of position from the control of orientation. However, quadrotors with tiltable rotors usually suffer from Coriolis term, modeling error and external disturbance. To this end, the extended state observer (ESO)-based controller is designed to estimate and compensate for the above adverse effects. Especially, the controller involves position and attitude controller in parallel. The attitude controller is made up of cascade control-loops: an outer quaternion-based attitude control-loop and an inner ESO-based Proportional derivative angular velocity control-loop. Similarly, the position controller consists of an outer proportional position control-loop and an inner ESO-based PD velocity control-loop. Besides, a linear control allocation strategy, which allocates the controller outputs to tilting angles and motor speed directly, is proposed to avoid the nonlinear allocation matrix. Extensive simulations and flight tests are carried out to illustrate the effectiveness and robustness of the proposed ESO-based controller.
About Me
Zhong Yang is a
Professor at Nanjing University of Aeronautics and Astronautics. He received an
MS and a PhD from Nanjing University of Aeronautics and Astronautics in 1994
and 1998 respectively. He has won the first prize of the Science and Technology
Progress Award of the Civil Aviation Administration of China, the second prize
of the National Defense Science and Technology Award, and the third prize of
the Jiangsu Science and Technology Progress Award. He holds more than 20
national invention patents and utility model patents and more than 10 of them have been authorized. He is a member of the Chinese Society of Aeronautics and
Astronautics. His research interests are intelligent flight control, robot
bionic control, deep machine vision, and intelligent measurement and control
and fault diagnosis.
Zhong Yang is a
Professor at Nanjing University of Aeronautics and Astronautics. He received an
MS and a PhD from Nanjing University of Aeronautics and Astronautics in 1994
and 1998 respectively. He has won the first prize of the Science and Technology
Progress Award of the Civil Aviation Administration of China, the second prize
of the National Defense Science and Technology Award, and the third prize of
the Jiangsu Science and Technology Progress Award. He holds more than 20
national invention patents and utility model patents and more than 10 of them have been authorized. He is a member of the Chinese Society of Aeronautics and
Astronautics. His research interests are intelligent flight control, robot
bionic control, deep machine vision, and intelligent measurement and control
and fault diagnosis.