Industrial equipment failure diagnosis is a crucial issue that impacts the national industrial manufacturing level, economic cycle development, and sustainable technological advancement. A multimodal knowledge graph (MMKG) based intelligent diagnostic model for industrial equipment fault is proposed to address the issues of insufficient and inadequate fault data samples encountered when using a single-mode model for fault diagnosis in existing industrial equipment. This model does not require extensive data learning for equipment fault diagnosis in complex industrial scenarios. The model utilizes an improved Faster Regions with CNN features (Faster RCNN) object detection module to extract visual information feature vectors of semi-ordered main and non-main objects. These feature vectors are then mapped to entity, attribute, and relationship vectors in a knowledge graph using cosine similarity for feature correspondence mapping. The semantic matching inference is performed based on this mapping, resulting in a set of fault triplets. Finally, the Bidirectional and Auto-Regressive Transformers (BART) text generation model processes this triplet set to generate fault diagnosis texts. Experimental results demonstrate that the improved Faster RCNN object detection model achieves a 1.2% increase in confidence when trained with small training data sets. The accuracy of generated fault description texts reaches approximately 98% compared to standard texts. The model presented in this paper addresses the challenge of diagnosing faults in industrial equipment, particularly in complex scenarios with limited data, such as substations. It enhances the target detection model to effectively extract visual features even when data is scarce. Additionally, it utilizes an MMKG to enable interpretable intelligent decision-making.
The development of artificial intelligence technology provides a new model for substation inspection in the power industry, and effective defect diagnosis can avoid the impact of substation equipment defects on the power grid and improve the reliability and stability of power grid operation. Aiming to combat the problem of poor recognition of small targets due to large differences in equipment morphology in complex substation scenarios, a visual fault detection algorithm of substation equipment based on improved YOLOv5 is proposed. Firstly, a deformable convolution module is introduced into the backbone network to achieve adaptive learning of scale and receptive field size. Secondly, in the neck of the network, a simple and effective BiFPN structure is used instead of PANet. The multi-level feature combination of the network is adjusted by a floating adaptive weighted fusion strategy. Lastly, an additional small object detection layer is added to detect shallower feature maps. Experimental results demonstrate that the improved algorithm effectively enhances the performance of power equipment and defect recognition. The overall recall rate has increased by 7.7%, precision rate has increased by nearly 6.3%, and mAP@0.5 has improved by 4.6%. The improved model exhibits superior performance.