23 December 2022 in IEEE Transactions on Industrial Informatics
Domain adaptation technology has been intensively studied in machine fault diagnosis for more reliable diagnosis performance. Nonetheless, most approaches rely on the availability of source data, which is always unattainable in many practical industrial scenarios due to the costs of expensive data storage and transmission, as well as privacy protection. As a consequence, there is an urgent need to design an adaptation method that is independent of source data. This technology is also more in line with the requirements for lightweight and timely diagnosis. Given this, we develop a novel source-free adaptation diagnosis (SFAD) method in this work. In SFAD, a robust self-training mechanism and a target prediction matrix constraint are presented, achieving model adaption with only unlabeled target data. Extensive experiments on our own and public datasets demonstrate the effectiveness and superiority of the proposed method.
1 April 2022 in ISA Transactions
10 May 2024 in IEEE Transactions on Industrial Informatics
Despite the remarkable success of end-to-end intelligent diagnosis methods, the shortage of available training data remains one of the most challenging issues in real industrial scenarios. In light of this, a wide variety of deep generative models are developed for data volume expansion. Notably, the denoising diffusion probabilistic model (DDPM) has recently shown impressive sample quality and diversity in various tasks. However, DDPM typically operates in the original pixel space, resulting in an expensive computational cost and restricting its applicability in industrial applications. In tackling the above issues, we develop an interpretable vector quantization-guided latent denoising diffusion probability model (IVQ-LDM) in this work. In IVQ-LDM, the vector quantized-variational autoencoder is introduced to compress the data to a lower dimensional space, where the kernels with physical meaning are then designed in the first layer to enhance the density of latent information and improve model interpretability. After that, a conditional DDPM is built in this latent space to learn the low-dimensional representation for data augmentation. Compared with existing methods, the IVQ-LDM achieves enhancements in sample quality, computational efficiency, and interpretability. Extensive experiments on three mechanical systems corroborate the effectiveness and superiority of the proposed method.
13 November 2024 in Reliability Engineering & System Safety
10 August 2022 in Knowledge-Based Systems
23 January 2025 in IEEE Transactions on Industrial Informatics
Despite the impressive process of current domain adaptation-based fault diagnosis approaches, access to source data and source model parameters is a sine qua non, resulting in obvious limitations when deploying to real industry, particularly considering the data storage, transmission, and privacy issues. In light of this, an interesting and challenging diagnosis scenario is studied in this article, i.e., source-free black-box adaptation diagnosis (SBAD), where only the model output information from the source domain is available for target tasks. To address this issue, a novel diagnosis framework named knowledge transfer from distillation to adaptation (KTDA) is proposed accordingly. Without source data and source model details, KTDA first develops a decoupled self-distillation mechanism to distill source domain knowledge from the black-box model's outputs to the target model, in which the noisy knowledge is simultaneously dealt with by the global and local self-regularization. In addition, a self-adaptation strategy is presented to further adjust the model, where the unlabeled target data is treated differently to reduce the intradomain divergence for improving the fit to the target task. Note that, the target model is not restricted to be the same as the source model in KTDA, thus having more flexibility and versatility in realistic industrial applications. We conduct a variety of fault diagnosis tasks for performance verification, empirical evidence shows the effectiveness and prospect of our method.