The converter is an indispensable key equipment in the steel manufacturing industry. With the increasing demand for high-quality steel, there is an increasing demand for monitoring and controlling the status of the converter during the smelting process. Compared to other manufacturing industries, such as food processing and textile, converter steelmaking requires a larger keep-out zone due to its ultra-high temperatures and harsh smelting environment. This makes it difficult for personnel to fully understand, analyze, and manage the smelting process, resulting in low production efficiency and the inability to achieve consistently high-quality results. Aiming at the low virtual visualization level and insufficient monitoring ability of the converter steelmaking process, a process management method based on digital twin technology is proposed. Firstly, a digital twin system framework for full-process monitoring of converter steelmaking is proposed based on the analysis of the process characteristics of converter steelmaking. The proposed framework provides critical enabling technologies such as point cloud-based digital twin model construction, visual display, and steel endpoint analysis and prediction, to support full-process, high-fidelity intelligent monitoring. After conducting experiments, a digital twin-driven smelting process management system was developed to manage the entire smelting process. The system has proven to be effective as it increased the monthly production capacity by 77.7%. The waste of smelting materials has also been greatly reduced from 34% without the system to 7.8% with the system. Based on these results, it is evident that this system significantly enhances smelting efficiency and reduces both the costs and waste associated with the process.
11 July 2024 in Frontiers of Engineering Management
In the steelmaking industry, enhancing production cost-effectiveness and operational efficiency requires the integration of intelligent systems to support production activities. Thus, effectively integrating various production modules is crucial to enable collaborative operations throughout the entire production chain, reducing management costs and complexities. This paper proposes, for the first time, the integration of Vision-Language Model (VLM) and Large Language Model (LLM) technologies in the steel manufacturing domain, creating a novel steelmaking process management system. The system facilitates data collection, analysis, visualization, and intelligent dialogue for the steelmaking process. The VLM module provides textual descriptions for slab defect detection, while LLM technology supports the analysis of production data and intelligent question-answering. The feasibility, superiority, and effectiveness of the system are demonstrated through production data and comparative experiments. The system has significantly lowered costs and enhanced operational understanding, marking a critical step toward intelligent and cost-effective management in the steelmaking domain.
27 February 2024 in Expert Systems with Applications
Human–robot collaborative assembly is required to comprehensively perceive the working scenarios for the most possible assembly collaborations. Nevertheless, existing works have paid much attention to physical entities (i.e., object detection, pose estimation), while ignores the weight of interactive relationships. This research gap makes it difficult to become aware of the cues for decision-making, especially in a complicated assembly task. Furthermore, inadequate relative position characteristics and indescribable object influence remain quite challenging for visual relationship representation. To overcome these abovementioned gaps, a multimodality scene graph generation approach is proposed to more robustly describe the abstract visual relationships. A novel heat modality is presented to better represent the relative spatial characteristic. Three strategies are developed for adapting different baselines in the multimodality feature encoder module. Experimental results show the generality and superb performance for multimodality scene graph generation tasks in human–robot collaborative assembly scenarios.