Risk management and control of on-site power operations is an important link in the power production process. Traditional methods that rely on manual execution of safety rules lack proactive prevention and control capabilities, and insufficient efficiency leads to an increasing frequency of safety issues in power production. Therefore, it is urgent to adopt intelligent methods to improve the level of safety risk management and control. In response to this issue, this paper proposes a multimodal causal knowledge graph based auxiliary decision-making method for safety risk management in power field operations. Based on the characteristics and requirements of safety risk management for on-site power operations, first obtain multimodal data related to safety risk management for on-site power operations, including video, photo, and text information collected by end devices, as well as historical archive data in various system databases. Then, based on historical risk management rules, the causal relationships of the core elements of on-site work safety issues are sorted out, and the data involved in the multiple types of antecedent influencing factors of historical faults and safety accidents are taken as the causes, and the faults and safety issues are taken as the results, forming a complete causal knowledge sample and constructing a causal effect estimation learning model. This model can output the safety risks of on-site power operations, forming a causal knowledge graph to provide auxiliary support for early warning and pre control decision-making of safety risks in on-site power operations.
With the rapid improvement of the performance of large models, pre-training a large-scale model and fine-tuning on downstream has become a trend. However, previous knowledge distillation methods mainly concentrates on a specific downstream task. This paper proposes a novel distillation framework Mutual Distillation for Masked Autoencoder Model(MMIM) which transfers knowledge from large-scale pre-trained visual models to provide smaller backbones for downstream tasks, thereby saving time. In our model MMIM, to maintain the advantages of mutual learning, two different student models learn collaboratively to boost both feature representation capabilities simultaneously. At the same time, in order to utilize powerful feature representation capability of pre-trained teacher model, we use the intermediate features of the teacher model to supervise the learning of the student models. Experiments on ImageNet demonstrates the compressed model obtained by our framework possesses powerful feature representation comparable to teacher model. In addition, MMIM also outperforms state-of-the-art knowledge distillation methods which directly distills fine-tuned models. Keywords: Masked Image Modeling; pre-trained Model; Knowledge Distillation; Vision Transformers