Defect detection is an indispensable part of the industrial intelligence process. The introduction of the DETR model marked the successful application of a transformer for defect detection, achieving true end-to-end detection. However, due to the complexity of defective backgrounds, low resolutions can lead to a lack of image detail control and slow convergence of the DETR model. To address these issues, we proposed a defect detection method based on an improved DETR model, called the GM-DETR. We optimized the DETR model by integrating GAM global attention with CNN feature extraction and matching features. This optimization process reduces the defect information diffusion and enhances the global feature interaction, improving the neural network’s performance and ability to recognize target defects in complex backgrounds. Next, to filter out unnecessary model parameters, we proposed a layer pruning strategy to optimize the decoding layer, thereby reducing the model’s parameter count. In addition, to address the issue of poor sensitivity of the original loss function to small differences in defect targets, we replaced the L1 loss in the original loss function with MSE loss to accelerate the network’s convergence speed and improve the model’s recognition accuracy. We conducted experiments on a dataset of road pothole defects to further validate the effectiveness of the GM-DETR model. The results demonstrate that the improved model exhibits better performance, with an increase in average precision of 4.9% (mAP@0.5), while reducing the parameter count by 12.9%.
Sentiment analysis aims to study, analyse and identify the sentiment polarity contained in subjective documents. In the realm of natural language processing (NLP), the study of sentiment analysis and its subtask research is a hot topic, which has very important significance. The existing sentiment analysis methods based on sentiment lexicon and machine learning take into account contextual semantic information, but these methods still lack the ability to utilize context information, so they cannot effectively encode context information. Inspired by the concept of density matrix in quantum mechanics, we propose a sentiment analysis method, named Complex-valued Quantum-enhanced Long Short-term Memory Neural Network (CQLSTM). It leverages complex-valued embedding to incorporate more semantic information and utilizes the Complex-valued Quantum-enhanced Long Short-term Memory Neural Network for feature extraction. Specifically, a complex-valued neural network based on density matrix is used to capture interactions between words (i.e., the correlation between words). Additionally, the Complex-valued Quantum-enhanced Long Short-term Memory Neural Network, which is inspired by the quantum measurement theory and quantum long short-term memory neural network, is developed to learn interactions between sentences (i.e., contextual semantic information). This approach effectively encodes semantic dependencies, which reflects the dispersion of words in the embedded space of sentences and comprehensively captures interactive information and long-term dependencies among the emotional features between words. Comparative experiments were performed on four sentiment analysis datasets using five traditional models, showcasing the effectiveness of the CQLSTM model.
Kidney cancer is a malignant tumor with a high mortality rate. The accurate segmentation of tumors from computed tomography (CT) scans can assist physicians in clinical diagnosis. We introduced a new segmentation network called DWR-SegFormer to address the challenge of accurately segmenting kidney tumors in CT images. The method involved binarizing the label maps of clear cell renal cell carcinoma and papillary renal cell carcinoma CT images for identification, and the cancer lesion area was obtained by the label so that the model could accurately identify the area and enhance the feature extraction ability. Secondly, an optimized segmentation model combining a DWR attention mechanism and SegFormer network was constructed. MiT-B0 was used as the encoder of the model to establish long-distance feature dependencies and effectively extract feature information at different resolutions. The decoder with a multi-branch DWR module was implemented to utilize multi-scale feature information effectively and enhance segmentation accuracy. Comparing the experimental results with other existing models shows that the model significantly outperformed the comparison methods in all evaluation metrics on the CT image dataset of clear cell renal cancer. Furthermore, the experimental findings highlight the robustness of the proposed model across other datasets.
To address the issues of missed and false detections caused by small object sizes, dense object distribution, and complex scenes in drone aerial images, this study proposes a drone-view object-detection algorithm based on YOLOv7-tiny with a Partial_C_Detect detection head. The algorithm’s performance in handling object occlusion and multi-scale detection is enhanced by introducing the VarifocalLoss loss function and improving the feature fusion network to BiFPN. Furthermore, incorporating the novel Partial_C_Detect detection head and Adaptive Kernel Convolution (AKConv) improves the detection capabilities for small and dynamically changing objects. In addition, introducing the Dilated Weighted Residual (DWR) attention module optimizes the information processing flow, enhancing the algorithm’s ability to capture key information, especially in complex backgrounds. These enhancements collectively enable the model to balance high detection accuracy and computational efficiency, making it well-suited for resource-constrained UAV platforms. Experiments conducted on the VisDrone2019 dataset show that the improved algorithm achieves a mAP@0.5 of 38.2%, with a model size of 29.01 MB and a computational complexity of 16.2 G. Compared to the original YOLOv7-tiny algorithm, the mAP@0.5 improves by 2.9%, and the algorithm performs better in other key performance metrics, demonstrating its adaptability and robustness in drone aerial image object-detection tasks.
Aspect-Based Sentiment Analysis (ABSA) has gained significant popularity in recent years, which emphasizes the aspect-level sentiment representation of sentences. Current methods for ABSA often use pre-trained models and graph convolution to represent word dependencies. However, they struggle with long-range dependency issues in lengthy texts, resulting in averaging and loss of contextual semantic information. In this paper, we explore how richer semantic relationships can be encoded more efficiently. Inspired by quantum theory, we construct superposition states from text sequences and utilize them with quantum measurements to explicitly capture complex semantic relationships within word sequences. Specifically, we propose an attention-based semantic dependency fusion method for ABSA, which employs a quantum embedding module to create a superposition state of real-valued word sequence features in a complex-valued Hilbert space. This approach yields a word sequence density matrix representation that enhances the handling of long-range dependencies. Furthermore, we introduce a quantum cross-attention mechanism to integrate sequence features with dependency relationships between specific word pairs, aiming to capture the associations between particular aspects and comments more comprehensively. Our experiments on the SemEval-2014 and Twitter datasets demonstrate the effectiveness of the quantum-inspired attention-based semantic dependency fusion model for the ABSA task.