By detecting the defect location in high-resolution insulator images collected by unmanned aerial vehicle (UAV) in various environments, the occurrence of power failure can be timely detected and the caused economic loss can be reduced. However, the accuracies of existing detection methods are greatly limited by the complex background interference and small target detection. To solve this problem, two deep learning methods based on Faster R-CNN (faster region-based convolutional neural network) are proposed in this paper, namely Exact R-CNN (exact region-based convolutional neural network) and CME-CNN (cascade the mask extraction and exact region-based convolutional neural network). Firstly, we proposed an Exact R-CNN based on a series of advanced techniques including FPN (feature pyramid network), cascade regression, and GIoU (generalized intersection over union). RoI Align (region of interest align) is introduced to replace RoI pooling (region of interest pooling) to address the misalignment problem, and the depthwise separable convolution and linear bottleneck are introduced to reduce the computational burden. Secondly, a new pipeline is innovatively proposed to improve the performance of insulator defect detection, namely CME-CNN. In our proposed CME-CNN, an insulator mask image is firstly generated to eliminate the complex background by using an encoder-decoder mask extraction network, and then the Exact R-CNN is used to detect the insulator defects. The experimental results show that our proposed method can effectively detect insulator defects, and its accuracy is better than the examined mainstream target detection algorithms.
28 October 2024 in IEEE Internet of Things Journal
Uploading videos from low-cost cameras to the cloud for retrospective analysis presents challenges in privacy, network, and computation. To address these issues and achieve low latency, we propose READY, a novel client-cloud collaborative system. READY aims to enhance the quality of uploaded frames by selectively uploading only the frames relevant to queries. To achieve this, READY establishes an index during video capture, recording object categories and probabilities for each frame. READY adopts an innovative semi-supervised approach for frame indexing, wherein frames are indexed through a continuously updated feature distribution space constructed by k-nearest neighbors (KNN). This enables resource-constrained low-cost cameras to independently establish long-term frame indexes. Additionally, READY utilizes progressively improving operators (lightweight classification models) dispatched by the cloud to optimize the upload order of frames, prioritizing positive frames. By sharing the backbone of low-performance operators, high-performance operators can be efficiently executed, significantly enhancing the camera’s frame processing capability. The established frame index also enables efficient multiple consecutive queries on different classes. Over 110 h of diverse queries across 11 videos, READY outperformed competing alternative designs by achieving an average response time of 67.8% and reducing the proportion of uploaded videos by an average of 79.8% (compared to CloudOnly).