This paper presents a comparative analysis of bearing and rotating component fault classification based on different time–frequency representations using vision transformer (ViT). Four different time–frequency transformation techniques—short-time Fourier transform (STFT), continuous wavelet transform (CWT), Hilbert–Huang transform (HHT), and Wigner–Ville distribution (WVD)—were applied to convert the signals into 2D images. A pretrained ViT-Base architecture was fine-tuned on the resulting images for classification tasks. The model was evaluated on two separate scenarios: (i) eight-class rotating component fault classification and (ii) four-class bearing fault classification. Importantly, in each task, the samples were collected under varying conditions of the other component (i.e., different rotating conditions in bearing classification and vice versa). This design allowed for an independent assessment of the model’s ability to generalize across fault domains. The experimental results demonstrate that the ViT-based approach achieves high classification performance across various time–frequency representations, highlighting its potential for mechanical fault diagnosis in rotating machinery. Notably, the model achieved higher accuracy in bearing fault classification compared to rotating component faults, suggesting higher sensitivity to bearing-related anomalies.
This study presents a comparative analysis of bearing and rotating component fault classification based on different time–frequency representations using ViT-base model. Four different time–frequency transformation techniques—Short-Time Fourier Transform (STFT), Continuous Wavelet Transform (CWT), Hilbert-Huang Transform (HHT), and Wigner-Ville Distribution (WVD)—were applied to convert the signals into 2D images. A pre-trained ViT-Base architecture was fine-tuned on the resulting images for classification tasks. The model was evaluated on two separate scenarios: (i) eight-class rotating component fault classification and (ii) four-class bearing fault classification. Importantly, in each task, the samples were collected under varying conditions of the other component (i.e., different rotating conditions in bearing classification and vice versa). This design allowed for an independent assessment of the model’s ability to generalize across fault domains. The experimental results demonstrate that the ViT-based approach achieves high classification performance across various time–frequency representations, highlighting its potential for mechanical fault diagnosis in rotating machinery. Notably, the model achieved higher accuracy in bearing fault classification compared to rotating component faults, suggesting a higher sensitivity to bearing-related anomalies.
This study proposes a hybrid deep learning framework that integrates supervised classification and unsupervised profiling for electricity consumption analysis. In the supervised phase, a one-dimensional Convolutional Neural Network combined with Long Short-Term Memory (1D CNN–LSTM) architecture is developed to classify daily load patterns. The performance of the proposed model is compared with traditional machine learning and deep learning approaches, including Support Vector Machine (SVM), k-Nearest Neighbors (KNN), a standalone Long Short-Term Memory (LSTM) model, a Transformer-based model, and a standalone 1D CNN model. Experimental results on the Precon house dataset and the CU-BEMS dataset demonstrate that the proposed hybrid architecture outperforms the benchmark models, achieving classification accuracies of 87.59% and 86.40%, respectively. In the unsupervised phase, the trained CNN–LSTM encoder is utilized as a deep feature extractor. The resulting 32-dimensional latent embeddings are clustered using K-Means, Gaussian Mixture Model (GMM), Agglomerative, Spectral, and Ensemble methods. Clustering robustness is evaluated through bootstrap-based stability analysis using the Adjusted Rand Index (ARI) and the Normalized Mutual Information (NMI). The results demonstrate stable and interpretable electricity consumption profiles, particularly in the residential dataset, where near-perfect clustering stability is observed for K-Means. The proposed framework provides both improved classification performance and robust consumption profiling based on deep embedding, offering a practical tool for energy management.