In high-voltage power systems, insulators are essential components in transmission lines for increasing shooting distance and securing wires. Unmanned aerial vehicle imaging becomes a common way of inspecting the state of the insulators. However, the automatic detection of insulators with complex backgrounds is still a challenging task. Most of the existing object detection methods are based on anchors, which do not have sufficient ability to describe objects that have a string-like structure. To tackle it, inspired by the keypoints-based object detection method, we propose a novel chain structure framework to detect insulators. First, we model the string-like object as a chain structure consisting of keypoints and their linkage, by which the insulator strings features are efficiently encoded and trained in the proposed ChainNet. Then, an assembling algorithm is proposed to assemble the estimated keypoints and linkages into chains, by which the insulator strings can be tightly enclosed in rotational bounding boxes. We evaluate the proposed approach on our collected large-scale rigorous dataset under the Directed Intersection over Union metric. The extensive experimental results show that the proposed method achieves 75.7% mAP, which yields 3.4, 15, and 10.6 improvements to the state-of-the-art rotational anchor, axial-aligned anchor, and anchor-free detection methods, respectively. Moreover, the proposed framework can easily be extended to detect other string-like manmade objects in the industrial area.
Due to the wide availability of the tools used to produce manipulated images, a large number of digital images have been tampered with in various media, such as newspapers and social networks, which makes the detection of tampered images particularly important. Therefore, an image manipulation detection algorithm leveraged by the Faster Region-based Convolutional Neural Network (Faster R-CNN) model combined with edge detection was proposed in this paper. In our algorithm, first, original tampered images and their detected edges were sent into symmetrical ResNet101 networks to extract tampering features. Then, these features were put into the Region of Interest (RoI) pooling layer. Instead of the RoI max pooling approach, the bilinear interpolation method was adopted to obtain the RoI region. After the RoI features of original input images and edge feature images were sent into bilinear pooling layer for feature fusion, tampering classification was performed in fully connection layer. Finally, Region Proposal Network (RPN) was used to locate forgery regions. Experimental results on three different image manipulation datasets show that our proposed algorithm can detect tampered images more effectively than other existing image manipulation detection algorithms.
2 August 2021 in Neural Computing and Applications
Social media has become more popular these days due to widely used instant messaging. Nevertheless, rumor propagation on social media has become an increasingly important issue. The purpose of this study is to investigate the impact of various features in social media on rumor detection, propose a dual co-attention-based multi-feature fusion method for rumor detection, and explore the detection capability of the proposed method in early rumor detection tasks. The proposed BERT-based Dual Co-attention Neural Network (BDCoNN) method for rumor detection, which uses BERT for word embedding. It simultaneously integrates features from three sources: publishing user profiles, source tweets, and comments. In the BDCoNN method, user discrete features and identity descriptors in user profiles are extracted using a one-dimensional convolutional neural network (CNN) and TextCNN, respectively. The bidirectional gate recurrent unit network (BiGRU) with a hierarchical attention mechanism is used to learn the hidden layer representation of tweet sequence and comment sequence. A dual collaborative attention mechanism is used to explore the correlation among publishing user profiles, tweet content, and comments. Then the feature vector is fed into classifier to identify the implicit differences between rumor spreaders and non-rumor spreaders. In this study, we conducted several experiments on the Weibo and CED datasets collected from microblog. The results show that the proposed method achieves the state-of-the-art performance compared with baseline methods, which is 5.2% and 5% higher than the dEFEND. The F1 value is increased by 4.4% and 4%, respectively. In addition, this paper conducts research on early rumor detection tasks, which verifies the proposed method detects rumors more quickly and accurately than competitors.
Social media makes it easy for individuals to publish and consume news, but it also facilitates the spread of rumors. This paper proposes a novel deep recurrent neural model with a symmetrical network architecture for automatic rumor detection in social media such as Sina Weibo, which shows better performance than the existing methods. In the data preparing phase, we filter the posts according to the followers of the user. We then use sequential encoding for the posts and multiple embedding layers to get better feature representation, and multiple recurrent neural network layers to capture the dynamic temporal signals characteristic. The experimental results on the Sina Weibo dataset show that: 1. the sequential encoding performs better than the term frequency-inverse document frequency (TF-IDF) or the doc2vec encoding scheme; 2. the model is more accurate when trained on the posts from the users with more followers; and 3. the model achieves superior improvements over the existing works on the accuracy of detection, including the early detection.
28 January 2025 in IEEE Transactions on Emerging Topics in Computational Intelligence
Change detection (CD) is a crucial task in various real-world applications, aiming to identify regions of change between two images captured at different times. However, existing approaches mainly focus on designing advanced network architectures that map feature differences to change maps, overlooking the impact of feature difference quality. In this paper, we approach CD from a different perspective by exploring how to optimize feature differences to effectively highlight changes and suppress background regions. To achieve this, we propose a novel module called the iterative difference-enhanced transformers (IDET). IDET consists of three transformers: two for extracting long-range information from the bi-temporal images, and one for enhancing the feature difference. Unlike previous transformers, the third transformer utilizes the outputs of the first two transformers to guide iterative and dynamic enhancement of the feature difference. To further enhance refinement, we introduce the multi-scale IDET-based change detection approach, which utilizes multi-scale representations of the images to refine the feature difference at multiple scales. Additionally, we propose a coarse-to-fine fusion strategy to combine all refinements. Our final CD method surpasses nine state-of-the-art methods on six large-scale datasets across different application scenarios. This highlights the significance of feature difference enhancement and demonstrates the effectiveness of IDET. Furthermore, we demonstrate that our IDET can be seamlessly integrated into other existing CD methods, resulting in a substantial improvement in detection accuracy.