4 September 2024 in IEEE/CAA Journal of Automatica Sinica
Intelligent machinery fault diagnosis methods have been popularly and successfully developed in the past decades, and the vibration acceleration data collected by contact accelerometers have been widely investigated. In many industrial scenarios, contactless sensors are more preferred. The event camera is an emerging bio-inspired technology for vision sensing, which asynchronously records per-pixel brightness change polarity with high temporal resolution and low latency. It offers a promising tool for contactless machine vibration sensing and fault diagnosis. However, the dynamic vision-based methods suffer from variations of practical factors such as camera position, machine operating condition, etc. Furthermore, as a new sensing technology, the labeled dynamic vision data are limited, which generally cannot cover a wide range of machine fault modes. Aiming at these challenges, a novel dynamic vision-based machinery fault diagnosis method is proposed in this paper. It is motivated to explore the abundant vibration acceleration data for enhancing the dynamic vision-based model performance. A cross-modality feature alignment method is thus proposed with deep adversarial neural networks to achieve fault diagnosis knowledge transfer. An event erasing method is further proposed for improving model robustness against variations. The proposed method can effectively identify unseen fault mode with dynamic vision data. Experiments on two rotating machine monitoring datasets are carried out for validations, and the results suggest the proposed method is promising for generalized contactless machinery fault diagnosis.
12 February 2024 in IEEE/CAA Journal of Automatica Sinica
Dear Editor, This letter presents a novel dynamic vision enabled contactless cross-domain fault diagnosis method with neuromorphic computing. The event-based camera is adopted to capture the machine vibration states in the perspective of vision. A specially designed bio-inspired deep transfer spiking neural network (SNN) model is proposed for processing the event streams of visionary data, feature extraction and fault diagnosis. The proposed method can also extract domain-invariant features from different machine operating conditions without target-domain machine faulty data. Experiments on rotating machines are carried out for validations of the proposed method, and the proposed method is verified to be effective in contactless fault diagnosis.
9 January 2026 in Journal of Industrial Information Integration
28 November 2025 in IEEE/CAA Journal of Automatica Sinica
Dear Editor, This letter proposes a novel dynamic vision-enabled intelligent micro-vibration estimation method with spatiotemporal pattern consistency. Inspired by biological vision, dynamic vision data are collected by the event camera, which is able to capture the micro-vibration information of mechanical equipment, due to the significant advantage of extremely high temporal sampling frequency. A specially designed vibration information extraction module is proposed for processing the dynamic vision data and extracting the hidden micro-vibration information. The proposed method can also simultaneously fuse vibration information extracted from multiple areas of interest and improve the vibration estimation performance. Experiments on rotating machinery test rigs are conducted to demonstrate the effectiveness of the proposed method. The experimental results validate that the proposed method can accurately estimate micro-vibration from dynamic visual signals, thus enabling non-contact vibration monitoring from the perspective of vision.
15 November 2026 in Chinese Journal of Mechanical Engineering
1 June 2026 in IEEE/CAA Journal of Automatica Sinica