16 February 2024 in Measurement Science and Technology
For bearing fault diagnosis problems in extremely noisy environments, this paper proposes an innovative universal adversarial training method. This method dynamically introduces noise into the training data, adaptively optimizing the model’s robustness. It applies to any neural network without incurring additional computational overhead in the reasoning process. Additionally, we introduce the multi-scale channel attention network (MSCAN). This network employs stacked convolutional kernels of varying sizes to extract features at different scales from the input signal. The incorporation of the channel attention mechanism allocates distinct weights to features of different scales, further enhancing the network’s representational capacity. Moreover, an automated machine learning-based automated tuning approach is employed to optimize the model training process, aiding in improving inference accuracy. Compared to existing designs, MSCAN exhibits exceptional accuracy. Through adversarial training, it maintains a 99.44% accuracy rate on the Case Western Reserve University dataset under strong −3 dB noise conditions. On the Paderborn University dataset at 0 dB, this adversarial training significantly improves the testing accuracy of various models by an average of 36.42%.
3 March 2025 in IEEE Transactions on Reliability
The application of multiple sensors significantly enhances the accuracy of industrial fault diagnosis, but existing algorithms are structurally complex and rely heavily on extensive training data. To optimize the efficiency of diagnosis, this article proposes a lightweight time-frequency-statistical domain fusion network. The model comprises three data streams that analyze the time-domain, frequency-domain, and statistical features of vibration signals, employing an improved channel attention mechanism for weighted fusion. In addition, two model-agnostic few-shot enhancement strategies are introduced, aiming to improve accuracy where training samples are scarce by reducing signal sample variations and optimizing the distribution of signals in the feature space. By combining these techniques, the proposed method exhibits superior performance in few-shot learning on two datasets compared to other multisensor fusion methods, while also achieving higher computational speed. The results of this research are of significant importance in enhancing the fault diagnostic capabilities of multisensor systems in practical industrial applications.
14 March 2025 in IEEE Transactions on Instrumentation and Measurement
Robots equipped with 2D laser profile scanners are widely utilized in industrial manufacturing processes. The hand-eye calibration is a critical aspect of robot 3D measurement and significantly influences the accuracy of the measured point cloud. This paper introduces a robust hand-eye calibration method that employing a single planar artifact in three steps. Firstly, the normal vector of the calibration plane is determined by utilizing points gathered through translation motions. Secondly, the rotation part is determined by the fact that the regression line of a single scan taken on a planar surface is orthogonal to the normal vector of the calibration plane. The translation vector is ultimately determined by leveraging the property that the line connecting the centers of two scans is perpendicular to the plane’s normal vector. The objective function is formulated using the Principal Component Analysis (PCA) technique and the Kronecker product. We propose a dual-constraint rotation objective function to enhance the robustness of the method against measurement noise. A closed-form solution is derived by employing the least squares method. The proposed methodology can directly calculate the accurate hand-eye matrix and exhibits a favorable tolerance for measurement noise originating from the scanner and deviations in robot pose. The effectiveness of the proposed algorithm has been confirmed through validation using both simulated data and real-world experiments.
13 February 2026 in IEEE Transactions on Instrumentation and Measurement
The utilization of 3D robot measurement systems, which integrate 2D profile scanners with industrial robots, is prevalent in manufacturing industries. Nonetheless, the measurement precision of such devices is often compromised due to inaccuracies in the robot kinematic parameters and the handeye matrix. This paper presents a novel simultaneous calibration methodology that concurrently resolves the issues related to robot kinematic parameters and the hand-eye relationship through the application of radius constraint. By integrating the hand-eye matrix into the robotic kinematic chain, an integrated model of the robot measurement system is formulated. Combining the spherical equation with the integrated kinematic model, a radius error model is established. The Jacobian matrix associated with the radius error is approximated using Taylor expansion. An iterative approach is proposed to identify the values of system parameters, which include both joint twists and hand-eye twist. Simulation results validate the effectiveness of the proposed algorithm, demonstrating its robustness to measurement noise. In practical applications, the maximum radius error was reduced from 4.480 mm to 1.721 mm, representing an accuracy improvement of 61.58%. Additionally, the average radius error decreased from 2.680 mm to 0.092 mm, indicating a substantial accuracy enhancement of 95.56%.
29 August 2025 in IEEE Transactions on Circuits and Systems for Video Technology
Co-Speech Gesture Video Generation aims to generate vivid speech videos from audio-driven still images, which is challenging due to the diversity of body parts in terms of motion amplitude, audio relevance, and detailed features. Relying solely on audio as the control signal often fails to capture large gesture movements in videos, resulting in more noticeable artifacts and distortions. Existing approaches typically address this issue by adding extra prior inputs, but this can limit the practical application of the task. Specifically, we propose a Motion Mask-Guided Two-Stage Network (MMGT) that uses audio, along with motion masks and pose videos generated from the audio signal, to jointly generate synchronized speech gesture videos. In the first stage, the Spatial Mask-Guided Audio2Pose Generation (SMGA) Network generates high-quality pose videos and motion masks from audio, effectively capturing large movements in key regions such as the face and gestures. In the second stage, we integrate Motion Masked Hierarchical Audio Attention (MM-HAA) into the Stabilized Diffusion Video Generation model, addressing limitations in fine-grained motion generation and region-specific detail control found in traditional methods. This ensures high-quality, detailed upper-body videos with accurate textures and motion. Evaluations demonstrate improvements in video quality, lip-sync, and hand gestures. The model and code are available at (https://github.com/SIA-IDE/MMGT).