Power line inspection is an important part of the smart grid. Efficient real-time detection of power devices on the power line is a challenging problem for power line inspection. In recent years, deep learning methods have achieved remarkable results in image classification and object detection. However, in the power line inspection based on computer vision, datasets have a significant impact on deep learning. The lack of public high-quality power scene data hinders the application of deep learning. To address this problem, we built a dataset for power line inspection scenes, named RSIn-Dataset. RSIn-Dataset contains 4 categories and 1887 images, with abundant backgrounds. Then, we used mainstream object detection methods to build a benchmark, providing reference for insulator detection. In addition, to address the problem of detection inefficiency caused by large model parameters, an improved YoloV4 is proposed, named YoloV4++. It uses a lightweight network, i.e., MobileNetv1, as the backbone, and employs the depthwise separable convolution to replace the standard convolution. Meanwhile, the focal loss is implemented in the loss function to solve the impact of sample imbalance. The experimental results show the effectiveness of YoloV4++. The mAP and FPS can reach 94.24% and 53.82 FPS, respectively.
26 March 2025 in IEEE Transactions on Geoscience and Remote Sensing
The fusion of hyperspectral and LiDAR data could significantly improve land cover classification performance. Most existing feature fusion methods focus on "Late Fusion" or "Halfway Feature Interaction Fusion" methods, which treat light detection and ranging (LiDAR) and hyperspectral data as model inputs while overlooking the redundancy between hyperspectral imagery (HSI) and LiDAR features. Additionally, the unique characteristics of HSI and LiDAR data, combined with the complexity of land cover backgrounds, make it challenging to accurately describe their properties. High-order deep features, as a deep statistical representation, could effectively capture the statistical characteristics of these land covers. Based on this, this paper focuses on the unique characteristics of HSI and LiDAR data, as well as the distinguishability of features, and designs a progressive hyperspectral and LiDAR collaborative classification method, named Coarse-to-Fine High-Order Network (CHNet). In the coarse stage, HSI data redundancy reduction and LiDAR feature reconstruction are performed in either the frequency domain or the spatial domain to ensure the effectiveness of subsequent feature fusion. The fine stage focuses primarily on selective feature fusion and discriminability enhancement, introducing gating mechanisms, deep expert systems, and high-order feature statistics. This approach enhances the discriminability of the fused features while simultaneously reducing their dimensionality. The proposed method, based on a "redundancy removal-feature learning" mechanism, captures more effective deep features by accounting for the different imaging mechanisms of multi-source data and the complex background of land covers, ultimately improving the effectiveness of land cover classification. Experimental results on three public datasets and one self-constructed dataset demonstrate that CHNet achieves superior performance. The code is available at https://github.com/RSIP-NJUPT/CHNet.
7 August 2023 in IEEE Transactions on Instrumentation and Measurement
Sea-land segmentation of optical remote sensing images holds great importance for military and civilian applications, such as coastal monitoring, target detection, and resource management. Although convolutional neural networks (CNNs) have achieved significant improvements in semantic segmentation, the challenges of efficient feature extraction, representation, fusion, and information transmission remain unsolved, which especially impacts the segmentation effectiveness of existing CNN-based models in extracting irregular and refined sea-land boundaries. In this paper, a novel Dual-Branch Ensemble Network (DBENet) is proposed for pixel-level sea-land segmentation. The salient properties of the DBENet are: 1) A novel dual-branch network architecture is developed to achieve sufficient feature extraction and representation. 2) An efficient ensemble attention learning strategy suitable for the DBENet is designed to strengthen the correlation between dual branches to further facilitate feature fusion and information transmission. The comparative study with state-of-the-art methods reveals the superior performance of our approach, and the ablation study demonstrates the effectiveness of each component in the proposed network. The source code is available at https://github.com/RobertTang0/DBENet.
Temporal modeling is the key for action recognition in videos, but traditional 2D CNNs do not capture temporal relationships well. 3D CNNs can achieve good performance, but are computationally intensive and not well practiced on existing devices. Based on these problems, we design a generic and effective module called spatio-temporal motion network (SMNet). SMNet maintains the complexity of 2D and reduces the computational effort of the algorithm while achieving performance comparable to 3D CNNs. SMNet contains a spatio-temporal excitation module (SE) and a motion excitation module (ME). The SE module uses group convolution to fuse temporal information to reduce the number of parameters in the network, and uses spatial attention to extract spatial information. The ME module uses the difference between adjacent frames to extract feature-level motion patterns between adjacent frames, which can effectively encode motion features and help identify actions efficiently. We use ResNet-50 as the backbone network and insert SMNet into the residual blocks to form a simple and effective action network. The experiment results on three datasets, namely Something-Something V1, Something-Something V2, and Kinetics-400, show that it out performs state-of-the-arts motion recognition networks.
Impulse noise is regarded as an outlier in the local window of an image. To detect noise, many proposed methods are based on aggregated distance, including spatially weighted aggregated distance, n nearest neighbour distance, local density, and angle‐weighted quaternion aggregated distance. However, these methods ignore the weight of each pixel or have limited adaptability. This study introduces the concept of degree of aggregation and proposes a weighting method to obtain the weight vector of the pixels by minimizing the degree of aggregation. The weight vector obtained gives larger components on the signal pixels than on the noisy pixels. Then it is fused with the aggregated distance to form a weighted aggregated distance that can reasonably characterise the noise and signal. The weighted aggregated distance, along with an adaptive segmentation method, can effectively detect the noise. To further enhance the effect of noise detection and removal, an adaptive selection strategy is incorporated to reduce the noise density in the local window. At last, noisy pixels detected are replaced with the weighted channel combination optimization values. The experimental results exhibit the validity of the proposed method by showing better performance in terms of both objective criteria and visual effects.
With the development of the Internet, services such as catering, beauty, accommodation, and entertainment can be reserved or consumed online. Therefore, consumers increasingly rely on online information to choose merchants, products, and services, with reviews becoming a crucial factor in their decision making. However, the authenticity of reviews is highly debated in the field of Internet-based process-of-life service consumption. In recent years, due to the rapid growth of these industries, the detection of fake reviews has gained increasing attention. Fake reviews seriously mislead customers and damage the authenticity of online reviews. Various fake review classifiers have been developed, taking into account the content of the reviews and the behavior involved in the reviews, such as rating, time, etc. However, there has been no research considering the credibility of reviewers and merchants as part of identifying fake reviews. In order to improve the accuracy of existing fake review classification and detection methods, this study utilizes a comment text processing module to model the content of reviews, utilizes a reviewer behavior processing module and a reviewed merchant behavior processing module to model consumer review behavior sequences that imply reviewer credibility and merchant review behavior sequences that imply merchant credibility, respectively, and finally merges the two features for fake review classification. The experimental results show that, compared to other models, the model proposed in this paper improves the classification performance by simultaneously modeling the content of reviews and the credibility of reviewers and merchants.