Welding is a major manufacturing process that joins two or more pieces of materials together through heating/mixing them followed by cooling/solidification. The goal of welding manufacturing is to join materials together to meet service requirements at lowest costs. Advanced welding manufacturing is to use scientific methods to realize this goal. This paper views advanced welding manufacturing as a three step approach: (1) pre-design that selects process and joint design based on available processes (properties, capabilities, and costs); (2) design that uses models to predict the result from a given set of welding parameters and minimizes a cost function for optimizing the welding parameters; and (3) real-time sensing and control that overcome the deviations of welding conditions from their nominal ones used in optimizing the welding parameters by adjusting the welding parameters based on such real-time sensing and feedback control. The paper analyzes how these three steps depend on process properties/capabilities, process innovations, predictive models, numerical models for fluid dynamics, numerical models for structures, real-time sensing, and dynamic control. The paper also identifies the challenges in obtaining ideal solutions and reviews/analyzes the existing efforts toward better solutions. Special attention and analysis have been given to (1) gas tungsten arc welding (GTAW) and gas metal arc welding (GMAW) as benchmark processes for penetration and materials filling; (2) keyhole plasma arc welding (PAW), keyhole-tungsten inert gas (K-TIG), and keyhole laser welding as improved/capable penetrative processes; (3) friction stir welding (FSW) as a special penetrative low heat input process; (4) alternating current (AC) GMAW and double-electrode GMAW as improved materials filling processes; (5) efforts in numerical modeling for fluid dynamics; (6) efforts in numerical modeling for structures; (7) challenges and efforts in seam tracking and weld pool monitoring; (8) challenges and efforts in monitoring of keyhole laser welding and FSW; and (9) efforts in advanced sensing, data fusion/sensor fusion, and process control using machine learning/deep learning, model predictive control (MPC), and adaptive control.
1 December 2019 in Journal of Manufacturing Processes
This letter illustrates how a challenging problem be solved by assuring the adequacy of the raw information and using an appropriate deep learning network to extract the relevant information. The problem concerned is accurate monitoring of the penetration, in a fully penetrated weld pool, as quantified by the width of the weld on the back-side of the workpiece. This is challenging as the penetration occurs below the workpiece surface and is not visible. A popular method is to use a weld pool image to derive it. Analysis of the physical process suggests that a single weld pool does not contain adequate information but most recent serial weld pools may. As such, although a deep learning model may extract information that is already there, the raw information may not be sufficient. Hence, a model that is capable of extracting information from dynamic serial weld pool images is needed. To this end, a CNN-LSTM (convolutional neural network combined with long-short term memory one) model is proposed. Dynamic weld pools are experimentally generated by changing the welding current and welding speed randomly. The weld pools are imaged using an HDR camera during experiments. Images are also captured from the back-side surface of the workpiece to provide the ground truth for training, validation, and testing. It is found that the highly dynamically changing weld pool can be accurately predicted using serial weld pool images at 0.3 mm for its back-side bead width. Comparison has been made with results from comparative studies to verify the effectiveness of and the contribution from the information adequacy (by using serial images) and the feature extracting capability (by using deep learning).
11 November 2019 in IEEE Transactions on Automation Science and Engineering
We propose an innovative approach to enhance welding operations by using a cyber-physical system (CPS) with layered architecture and enabling a robot to be effectively operated by its commanding human. This article focuses on the recognition of the commanding human's intention that should be executed by the robot. To this end, a virtual reality (VR) system based on the HTC Vive is used to create a remote virtual welding environment. Human hand movement speed data is collected and used to train a hidden Markov model (HMM) using the Baum-Welch algorithm. The Bayesian information criterion (BIC) is applied to determine the number of hidden states. The state occupancy probability distribution (the probability of each state at a given time) is estimated based on the human hand movement speed sequence using the forward algorithm. The human intention, defined as the intended movement in this article, is then estimated as the statistical expectation of the observable variables. Using the proposed human intention estimation algorithm, the intended movement recognized from the raw movement data is smoother, which is preferable in welding tasks. A 6-DoF industrial robot, UR-5 with a custom gas tungsten arc welding (GTAW) torch installed, works as the final performer of the welding jobs. The robot receives the intended movement data from the HMM and uses this to assist the human welding operators. Welding experiments have been conducted both with and without the proposed human intention recognition (IR) algorithm. The results show that the robot can help the operators complete welding tasks with better performance using the proposed IR system, supporting the effectiveness of the proposed VR robot-assisted welding system.