20 October 2023 in Reliability Engineering & System Safety
24 April 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Domain generalization (DG) is a challenging task that aims to train a robust model with only labeled source data and can generalize well on unseen target data. The domain gap between the source and target data may degrade the performance. A plethora of methods resort to obtaining domain-invariant features to overcome the difficulties. However, these methods require sophisticated network designs or training strategies, causing inefficiency and complexity. In this paper, we first analyze and reclassify the features into two categories, i.e., implicitly disentangled ones and explicitly disentangled counterparts. Since we aim to design a generic algorithm for DG to alleviate the problems mentioned above, we focus more on the explicitly disentangled features due to their simplicity and interpretability. We find out that the shape features of images are simple and elegant choices based on our analysis. We extract the shape features from two aspects. In the aspect of networks, we propose Multi-Scale Amplitude Mixing (MSAM) to strengthen shape features at different layers of the network by Fourier transform. In the aspect of inputs, we propose a new data augmentation method called Random Shape Warping (RSW) to facilitate the model to concentrate more on the global structures of the objects. RSW randomly distorts the local parts of the images and keeps the global structures unchanged, which can further improve the robustness of the model. Our methods are simple yet efficient and can be conveniently used as plug-and-play modules. They can outperform state-of-the-art (SOTA) methods without bells and whistles.
4 November 2022 in IEEE Transactions on Instrumentation and Measurement
Online dynamic prediction of the hot metal silicon content in the blast furnace ironmaking process is crucial for stabilizing the furnace condition and improving the molten iron quality. However, due to the complex nonlinear correlations and time-varying time lags between silicon content and process variables, silicon content prediction is a challenging task. To tackle the problem, we propose a novel silicon content prediction method, called temporal hypergraph attention network (T-HyperGAT), which is combined the hypergraph attention network (HyperGAT) and the gated recurrent unit (GRU) network. Specifically, the Hyper-GAT is used to capture the high-order correlations of input features and perform equal-dimensional feature transformation to maintain the temporality of input features, and the GRU network is used to capture the time-series characteristics of transformed input features to overcome the time-varying time lags of process variables. Then the T-HyperGAT model can capture high-order correlations and time-series characteristics from complex industrial data. The effectiveness of the proposed T-HyperGAT method is verified by actual blast furnace ironmaking process data from a blast furnace in China.
1 January 2022 in Neural Networks
20 September 2024 in IEEE Transactions on Neural Networks and Learning Systems
Given the crucial role of the gas utilization ratio (GUR) in reflecting blast furnace operation and energy consumption, accurately predicting its development trend holds significant value for blast furnace operators. However, in the harsh ironmaking environment, GUR-affecting variables are prone to significant nonstationary noise. Moreover, these variables are coupled and correlated, meaning that improper regulation of one variable can destabilize the furnace and lead to substantial GUR fluctuations. This poses a major challenge for achieving accurate GUR prediction. To tackle this issue, this article proposes a denoising multiscale spectral graph wavelet neural network (DMSGWNN) for online dynamic forecasting of the GUR, which is an end-to-end learning method that removes variable noise and captures complex variable correlations simultaneously. First, a regularized self-representation (RSR) model is constructed to eliminate nonstationary noise in blast furnace process variables. Then, a novel multiscale spectral graph wavelet neural network (MSGWNN) is proposed to capture the complex correlations among input variables and extract their multiscale representations through spectral graph wavelet (SGW) transform with the heat kernel scaling function and Gaussian kernel wavelet functions. Finally, the effectiveness of the proposed DMSGWNN method is verified using actual blast furnace ironmaking process data from a blast furnace in China, achieving an average predictive hit rate (HR) as high as 98.06% for GUR prediction.
2 January 2024 in Neural Networks